The role of voice input for human-machine communication.

Optimism is growing that the near future will witness rapid growth in human-computer interaction using voice. System prototypes have recently been built that demonstrate speaker-independent real-time speech recognition, and understanding of naturally spoken utterances with vocabularies of 1000 to 2000 words, and larger. Already, computer manufacturers are building speech recognition subsystems into their new product lines. However, before this technology can be broadly useful, a substantial knowledge base is needed about human spoken language and performance during computer-based spoken interaction. This paper reviews application areas in which spoken interaction can play a significant role, assesses potential benefits of spoken interaction with machines, and compares voice with other modalities of human-computer interaction. It also discusses information that will be needed to build a firm empirical foundation for the design of future spoken and multimodal interfaces. Finally, it argues for a more systematic and scientific approach to investigating spoken input and performance with future language technology.

Direct Visualization of the Human Estrogen Receptor α Reveals a Role for Ligand in the Nuclear Distribution of the Receptor

The human estrogen receptor α (ER α) has been tagged at its amino terminus with the S65T variant of the green fluorescent protein (GFP), allowing subcellular trafficking and localization to be observed in living cells by fluorescence microscopy. The tagged receptor, GFP-ER, is functional as a ligand-dependent transcription factor, responds to both agonist and antagonist ligands, and can associate with the nuclear matrix. Its cellular localization was analyzed in four human breast cancer epithelial cell lines, two ER+ (MCF7 and T47D) and two ER− (MDA-MB-231 and MDA-MB-435A), under a variety of ligand conditions. In all cell lines, GFP-ER is observed only in the nucleus in the absence of ligand. Upon the addition of agonist or antagonist ligand, a dramatic redistribution of GFP-ER from a reticular to punctate pattern occurs within the nucleus. In addition, the full antagonist ICI 182780 alters the nucleocytoplasmic compartmentalization of the receptor and causes partial accumulation in the cytoplasm in a process requiring continued protein synthesis. GFP-ER localization varies between cells, despite being cultured and treated in a similar manner. Analysis of the nuclear fluorescence intensity for variation in its frequency distribution helped establish localization patterns characteristic of cell line and ligand. During the course of this study, localization of GFP-ER to the nucleolar region is observed for ER− but not ER+ human breast cancer epithelial cell lines. Finally, our work provides a visual description of the “unoccupied” and ligand-bound receptor and is discussed in the context of the role of ligand in modulating receptor activity.

The design, computer modeling, solution structure, and biological evaluation of synthetic analogs of bryostatin 1

The bryostatins are a unique family of emerging cancer chemotherapeutic candidates isolated from marine bryozoa. Although the biochemical basis for their therapeutic activity is not known, these macrolactones exhibit high affinities for protein kinase C (PKC) isozymes, compete for the phorbol ester binding site on PKC, and stimulate kinase activity in vitro and in vivo. Unlike the phorbol esters, they are not first-stage tumor promoters. The design, computer modeling, NMR solution structure, PKC binding, and functional assays of a unique class of synthetic bryostatin analogs are described. These analogs (7b, 7c, and 8) retain the putative recognition domain of the bryostatins but are simplified through deletions and modifications in the C4-C14 spacer domain. Computer modeling of an analog prototype (7a) indicates that it exists preferentially in two distinct conformational classes, one in close agreement with the crystal structure of bryostatin 1. The solution structure of synthetic analog 7c was determined by NMR spectroscopy and found to be very similar to the previously reported structures of bryostatins 1 and 10. Analogs 7b, 7c, and 8 bound strongly to PKC isozymes with Ki = 297, 3.4, and 8.3 nM, respectively. Control 7d, like the corresponding bryostatin derivative, exhibited weak PKC affinity, as did the derivative, 9, lacking the spacer domain. Like bryostatin, acetal 7c exhibited significant levels of in vitro growth inhibitory activity (1.8–170 ng/ml) against several human cancer cell lines, providing an important step toward the development of simplified, synthetically accessible analogs of the bryostatins.

Analysis of human cytochrome P450 3A4 cooperativity: Construction and characterization of a site-directed mutant that displays hyperbolic steroid hydroxylation kinetics

Cytochrome P450 3A4 is generally considered to be the most important human drug-metabolizing enzyme and is known to catalyze the oxidation of a number of substrates in a cooperative manner. An allosteric mechanism is usually invoked to explain the cooperativity. Based on a structure–activity study from another laboratory using various effector–substrate combinations and on our own studies using site-directed mutagenesis and computer modeling of P450 3A4, the most likely location of effector binding is in the active site along with the substrate. Our study was designed to test this hypothesis by replacing residues Leu-211 and Asp-214 with the larger Phe and Glu, respectively. These residues were predicted to constitute a portion of the effector binding site, and the substitutions were designed to mimic the action of the effector by reducing the size of the active site. The L211F/D214E double mutant displayed an increased rate of testosterone and progesterone 6β-hydroxylation at low substrate concentrations and a decreased level of heterotropic stimulation elicited by α-naphthoflavone. Kinetic analyses of the double mutant revealed the absence of homotropic cooperativity with either steroid substrate. At low substrate concentrations the steroid 6β-hydroxylase activity of the wild-type enzyme was stimulated by a second steroid, whereas L211F/D214E displayed simple substrate inhibition. To analyze L211F/D214E at a more mechanistic level, spectral binding studies were carried out. Testosterone binding by the wild-type enzyme displayed homotropic cooperativity, whereas substrate binding by L211F/D214E displayed hyperbolic behavior.

Direct visualization of antigen-specific T cells: HTLV-1 Tax11–19- specific CD8+ T cells are activated in peripheral blood and accumulate in cerebrospinal fluid from HAM/TSP patients

Human T lymphotropic virus type 1 (HTLV-1) -associated myelopathy/tropic spastic paraparesis is a demyelinating inflammatory neurologic disease associated with HTLV-1 infection. HTLV-1 Tax11–19-specific cytotoxic T cells have been isolated from HLA-A2-positive patients. We have used a peptide-loaded soluble HLA-A2–Ig complex to directly visualize HTLV-1 Tax11–19-specific T cells from peripheral blood and cerebrospinal fluid without in vitro stimulation. Five of six HTLV-1-associated myelopathy/tropic spastic paraparesis patients carried a significant number (up to 13.87%) of CD8+ lymphocytes specific for the HTLV-1 Tax11–19 peptide in their peripheral blood, which were not found in healthy controls. Simultaneous comparison of peripheral blood and cerebrospinal fluid from one patient revealed 2.5-fold more Tax11–19-specific T cells in the cerebrospinal fluid (23.7% vs. 9.4% in peripheral blood lymphocyte). Tax11–19-specific T cells were seen consistently over a 9-yr time course in one patient as far as 19 yrs after the onset of clinical symptoms. Further analysis of HTLV-1 Tax11–19-specific CD8+ T lymphocytes in HAM/TSP patients showed different expression patterns of activation markers, intracellular TNF-α and γ-interferon depending on the severity of the disease. Thus, visualization of antigen-specific T cells demonstrates that HTLV-1 Tax11–19-specific CD8+ T cells are activated, persist during the chronic phase of the disease, and accumulate in cerebrospinal fluid, showing their pivotal role in the pathogenesis of this neurologic disease.

Peptide design by artificial neural networks and computer-based evolutionary search

A technique for systematic peptide variation by a combination of rational and evolutionary approaches is presented. The design scheme consists of five consecutive steps: (i) identification of a “seed peptide” with a desired activity, (ii) generation of variants selected from a physicochemical space around the seed peptide, (iii) synthesis and testing of this biased library, (iv) modeling of a quantitative sequence-activity relationship by an artificial neural network, and (v) de novo design by a computer-based evolutionary search in sequence space using the trained neural network as the fitness function. This strategy was successfully applied to the identification of novel peptides that fully prevent the positive chronotropic effect of anti-β1-adrenoreceptor autoantibodies from the serum of patients with dilated cardiomyopathy. The seed peptide, comprising 10 residues, was derived by epitope mapping from an extracellular loop of human β1-adrenoreceptor. A set of 90 peptides was synthesized and tested to provide training data for neural network development. De novo design revealed peptides with desired activities that do not match the seed peptide sequence. These results demonstrate that computer-based evolutionary searches can generate novel peptides with substantial biological activity.

Natural genetic exchange between Haemophilus and Neisseria: Intergeneric transfer of chromosomal genes between major human pathogens

Members of the bacterial families Haemophilus and Neisseria, important human pathogens that commonly colonize the nasopharynx, are naturally competent for DNA uptake from their environment. In each genus this process is discriminant in favor of its own and against foreign DNA through sequence specificity of DNA receptors. The Haemophilus DNA uptake apparatus binds a 29-bp oligonucleotide domain containing a highly conserved 9-bp core sequence, whereas the neisserial apparatus binds a 10-bp motif. Each motif (“uptake sequence”, US) is highly over-represented in the chromosome of the corresponding genus, particularly concentrated with core sequences in inverted pairs forming gene terminators. Two Haemophilus core USs were unexpectedly found forming the terminator of sodC in Neisseria meningitidis (meningococcus), and sequence analysis strongly suggests that this virulence gene, located next to IS1106, arose through horizontal transfer from Haemophilus. By using USs as search strings in a computer-based analysis of genome sequence, it was established that while USs of the “wrong” genus do not occur commonly in Neisseria or Haemophilus, where they do they are highly likely to flag domains of chromosomal DNA that have been transferred from Haemophilus. Three independent domains of Haemophilus-like DNA were found in the meningococcal chromosome, associated respectively with the virulence gene sodC, the bio gene cluster, and an unidentified orf. This report identifies intergenerically transferred DNA and its source in bacteria, and further identifies transformation with heterologous chromosomal DNA as a way of establishing potentially important chromosomal mosaicism in these pathogenic bacteria.

Working memory constrains human cooperation in the Prisoner’s Dilemma

Many problems in human society reflect the inability of selfish parties to cooperate. The “Iterated Prisoner’s Dilemma” has been used widely as a model for the evolution of cooperation in societies. Axelrod’s computer tournaments and the extensive simulations of evolution by Nowak and Sigmund and others have shown that natural selection can favor cooperative strategies in the Prisoner’s Dilemma. Rigorous empirical tests, however, lag behind the progress made by theorists. Clear predictions differ depending on the players’ capacity to remember previous rounds of the game. To test whether humans use the kind of cooperative strategies predicted, we asked students to play the iterated Prisoner’s Dilemma game either continuously or interrupted after each round by a secondary memory task (i.e., playing the game “Memory”) that constrained the students’ working-memory capacity. When playing without interruption, most students used “Pavlovian” strategies, as predicted, for greater memory capacity, and the rest used “generous tit-for-tat” strategies. The proportion of generous tit-for-tat strategies increased when games of Memory interfered with the subjects’ working memory, as predicted. Students who continued to use complex Pavlovian strategies were less successful in the Memory game, but more successful in the Prisoner’s Dilemma, which indicates a trade-off in memory capacity for the two tasks. Our results suggest that the set of strategies predicted by game theorists approximates human reality.

Functional and structural mapping of human cerebral cortex: Solutions are in the surfaces

The human cerebral cortex is notorious for the depth and irregularity of its convolutions and for its variability from one individual to the next. These complexities of cortical geography have been a chronic impediment to studies of functional specialization in the cortex. In this report, we discuss ways to compensate for the convolutions by using a combination of strategies whose common denominator involves explicit reconstructions of the cortical surface. Surface-based visualization involves reconstructing cortical surfaces and displaying them, along with associated experimental data, in various complementary formats (including three-dimensional native configurations, two-dimensional slices, extensively smoothed surfaces, ellipsoidal representations, and cortical flat maps). Generating these representations for the cortex of the Visible Man leads to a surface-based atlas that has important advantages over conventional stereotaxic atlases as a substrate for displaying and analyzing large amounts of experimental data. We illustrate this by showing the relationship between functionally specialized regions and topographically organized areas in human visual cortex. Surface-based warping allows data to be mapped from individual hemispheres to a surface-based atlas while respecting surface topology, improving registration of identifiable landmarks, and minimizing unwanted distortions. Surface-based warping also can aid in comparisons between species, which we illustrate by warping a macaque flat map to match the shape of a human flat map. Collectively, these approaches will allow more refined analyses of commonalities as well as individual differences in the functional organization of primate cerebral cortex.

Human cooperation in the simultaneous and the alternating Prisoner's Dilemma: Pavlov versus Generous Tit-for-Tat.

The iterated Prisoner's Dilemma has become the paradigm for the evolution of cooperation among egoists. Since Axelrod's classic computer tournaments and Nowak and Sigmund's extensive simulations of evolution, we know that natural selection can favor cooperative strategies in the Prisoner's Dilemma. According to recent developments of theory the last champion strategy of "win--stay, lose--shift" ("Pavlov") is the winner only if the players act simultaneously. In the more natural situation of players alternating the roles of donor and recipient a strategy of "Generous Tit-for-Tat" wins computer simulations of short-term memory strategies. We show here by experiments with humans that cooperation dominated in both the simultaneous and the alternating Prisoner's Dilemma. Subjects were consistent in their strategies: 30% adopted a Generous Tit-for-Tat-like strategy, whereas 70% used a Pavlovian strategy in both the alternating and the simultaneous game. As predicted for unconditional strategies, Pavlovian players appeared to be more successful in the simultaneous game whereas Generous Tit-for-Tat-like players achieved higher payoffs in the alternating game. However, the Pavlovian players were smarter than predicted: they suffered less from defectors and exploited cooperators more readily. Humans appear to cooperate either with a Generous Tit-for-Tat-like strategy or with a strategy that appreciates Pavlov's advantages but minimizes its handicaps.

A high-resolution annotated physical map of the human chromosome 13q12-13 region containing the breast cancer susceptibility locus BRCA2.

Various types of physical mapping data were assembled by developing a set of computer programs (Integrated Mapping Package) to derive a detailed, annotated map of a 4-Mb region of human chromosome 13 that includes the BRCA2 locus. The final assembly consists of a yeast artificial chromosome (YAC) contig with 42 members spanning the 13q12-13 region and aligned contigs of 399 cosmids established by cross-hybridization between the cosmids, which were selected from a chromosome 13-specific cosmid library using inter-Alu PCR probes from the YACs. The end sequences of 60 cosmids spaced nearly evenly across the map were used to generate sequence-tagged sites (STSs), which were mapped to the YACs by PCR. A contig framework was generated by STS content mapping, and the map was assembled on this scaffold. Additional annotation was provided by 72 expressed sequences and 10 genetic markers that were positioned on the map by hybridization to cosmids.

Scientific bases of human-machine communication by voice.

The scientific bases for human-machine communication by voice are in the fields of psychology, linguistics, acoustics, signal processing, computer science, and integrated circuit technology. The purpose of this paper is to highlight the basic scientific and technological issues in human-machine communication by voice and to point out areas of future research opportunity. The discussion is organized around the following major issues in implementing human-machine voice communication systems: (i) hardware/software implementation of the system, (ii) speech synthesis for voice output, (iii) speech recognition and understanding for voice input, and (iv) usability factors related to how humans interact with machines.

Military and government applications of human-machine communication by voice.

This paper describes a range of opportunities for military and government applications of human-machine communication by voice, based on visits and contacts with numerous user organizations in the United States. The applications include some that appear to be feasible by careful integration of current state-of-the-art technology and others that will require a varying mix of advances in speech technology and in integration of the technology into applications environments. Applications that are described include (1) speech recognition and synthesis for mobile command and control; (2) speech processing for a portable multifunction soldier's computer; (3) speech- and language-based technology for naval combat team tactical training; (4) speech technology for command and control on a carrier flight deck; (5) control of auxiliary systems, and alert and warning generation, in fighter aircraft and helicopters; and (6) voice check-in, report entry, and communication for law enforcement agents or special forces. A phased approach for transfer of the technology into applications is advocated, where integration of applications systems is pursued in parallel with advanced research to meet future needs.