The role of voice input for human-machine communication.

Optimism is growing that the near future will witness rapid growth in human-computer interaction using voice. System prototypes have recently been built that demonstrate speaker-independent real-time speech recognition, and understanding of naturally spoken utterances with vocabularies of 1000 to 2000 words, and larger. Already, computer manufacturers are building speech recognition subsystems into their new product lines. However, before this technology can be broadly useful, a substantial knowledge base is needed about human spoken language and performance during computer-based spoken interaction. This paper reviews application areas in which spoken interaction can play a significant role, assesses potential benefits of spoken interaction with machines, and compares voice with other modalities of human-computer interaction. It also discusses information that will be needed to build a firm empirical foundation for the design of future spoken and multimodal interfaces. Finally, it argues for a more systematic and scientific approach to investigating spoken input and performance with future language technology.

Speech recognition technology: a critique.

This paper introduces the session on advanced speech recognition technology. The two papers comprising this session argue that current technology yields a performance that is only an order of magnitude in error rate away from human performance and that incremental improvements will bring us to that desired level. I argue that, to the contrary, present performance is far removed from human performance and a revolution in our thinking is required to achieve the goal. It is further asserted that to bring about the revolution more effort should be expended on basic research and less on trying to prematurely commercialize a deficient technology.

Military and government applications of human-machine communication by voice.

This paper describes a range of opportunities for military and government applications of human-machine communication by voice, based on visits and contacts with numerous user organizations in the United States. The applications include some that appear to be feasible by careful integration of current state-of-the-art technology and others that will require a varying mix of advances in speech technology and in integration of the technology into applications environments. Applications that are described include (1) speech recognition and synthesis for mobile command and control; (2) speech processing for a portable multifunction soldier's computer; (3) speech- and language-based technology for naval combat team tactical training; (4) speech technology for command and control on a carrier flight deck; (5) control of auxiliary systems, and alert and warning generation, in fighter aircraft and helicopters; and (6) voice check-in, report entry, and communication for law enforcement agents or special forces. A phased approach for transfer of the technology into applications is advocated, where integration of applications systems is pursued in parallel with advanced research to meet future needs.

Deployment of human-machine dialogue systems.

The deployment of systems for human-to-machine communication by voice requires overcoming a variety of obstacles that affect the speech-processing technologies. Problems encountered in the field might include variation in speaking style, acoustic noise, ambiguity of language, or confusion on the part of the speaker. The diversity of these practical problems encountered in the "real world" leads to the perceived gap between laboratory and "real-world" performance. To answer the question "What applications can speech technology support today?" the concept of the "degree of difficulty" of an application is introduced. The degree of difficulty depends not only on the demands placed on the speech recognition and speech synthesis technologies but also on the expectations of the user of the system. Experience has shown that deployment of effective speech communication systems requires an iterative process. This paper discusses general deployment principles, which are illustrated by several examples of human-machine communication systems.

Toward the ultimate synthesis/recognition system.

This paper predicts speech synthesis, speech recognition, and speaker recognition technology for the year 2001, and it describes the most important research problems to be solved in order to arrive at these ultimate synthesis and recognition systems. The problems for speech synthesis include natural and intelligible voice production, prosody control based on meaning, capability of controlling synthesized voice quality and choosing individual speaking style, multilingual and multidialectal synthesis, choice of application-oriented speaking styles, capability of adding emotion, and synthesis from concepts. The problems for speech recognition include robust recognition against speech variations, adaptation/normalization to variations due to environmental conditions and speakers, automatic knowledge acquisition for acoustic and linguistic modeling, spontaneous speech recognition, naturalness and ease of human-machine interaction, and recognition of emotion. The problems for speaker recognition are similar to those for speech recognition. The research topics related to all these techniques include the use of articulatory and perceptual constraints and evaluation methods for measuring the quality of technology and systems.

Cyclic polyamides for recognition in the minor groove of DNA.

Small molecules that specifically bind with high affinity to any designated DNA sequence in the human genome would be useful tools in molecular biology and potentially in human medicine. Simple rules have been developed to rationally alter the sequence specificity of minor groove-binding polyamides containing N-methylimidazole and N-methylpyrrole amino acids. Crescent-shaped polyamides bind as antiparallel dimers with each polyamide making specific contacts with each strand on the floor of the minor groove. Cyclic polyamides have now been synthesized that bind designated DNA sequences at subnanomolar concentrations.

The 94- to 97-kDa mouse macrophage membrane protein that recognizes oxidized low density lipoprotein and phosphatidylserine-rich liposomes is identical to macrosialin, the mouse homologue of human CD68.

We have previously reported the partial purification of a 94- to 97-kDa plasma membrane protein from mouse peritoneal macrophages that binds oxidatively modified low density lipoprotein (OxLDL) and phosphatidylserine-rich liposomes. We have now identified that protein as macrosialin, a previously cloned macrophage-restricted membrane protein in the lysosomal-associated membrane protein family (mouse homologue of human CD68). Early in the course of purification of the 94- to 97-kDa protein, a new OxLDL-binding band at 190-200 kDa appeared and copurified with the 94- to 97-kDa protein. The HPLC pattern of tryptic peptides from this higher molecular mass ligand-binding band closely matched that derived from the 94- to 97-kDa band. Specifically, the same three macrosialin-derived tryptic peptides (9, 9, and 15 residues) were present in the purified 94- to 97-kDa band and in the 190- to 200-kDa band and antisera raised against peptide sequences in macrosialin recognized both bands. An antiserum against macrosialin precipitated most of the 94- to 97-kDa OxLDL-binding material. We conclude that the binding of OxLDL to mouse macrophage membranes is in part attributable to macrosialin. Our previous studies show that OxLDL competes with oxidized red blood cells and with apoptotic thymocytes for binding to mouse peritoneal macrophages. Whether macrosialin plays a role in recognition of OxLDL and oxidatively damaged cells by intact macrophages remains uncertain.

CD14 enhances cellular responses to endotoxin without imparting ligand-specific recognition.

Binding of the lipid A portion of bacterial lipopolysaccharide (LPS) to leukocyte CD14 activates phagocytes and initiates the septic shock syndrome. Two lipid A analogs, lipid IVA and Rhodobacter sphaeroides lipid A (RSLA), have been described as LPS-receptor antagonists when tested with human phagocytes. In contrast, lipid IVA activated murine phagocytes, whereas RSLA was an LPS antagonist. Thus, these compounds displayed a species-specific pharmacology. To determine whether the species specificity of these LPS antagonists occurred as a result of interactions with CD14, the effects of lipid IVA and RSLA were examined by using human, mouse, and hamster cell lines transfected with murine or human CD14 cDNA expression vectors. These transfectants displayed sensitivities to lipid IVA and RSLA that reflected the sensitivities of macrophages of similar genotype (species) and were independent of the source of CD14 cDNA. For example, hamster macrophages and hamster fibroblasts transfected with either mouse or human-derived CD14 cDNA responded to lipid IVA and RSLA as LPS mimetics. Similarly, lipid IVA and RSLA acted as LPS antagonists in human phagocytes and human fibrosarcoma cells transfected with either mouse or human-derived CD14 cDNA. Therefore, the target of these LPS antagonists, which is encoded in the genomes of these cells, is distinct from CD14. Although the expression of CD14 is required for macrophage-like sensitivity to LPS, CD14 cannot discriminate between the lipid A moieties of these agents. We hypothesize that the target of the LPS antagonists is a lipid A recognition protein which functions as a signaling receptor that is triggered after interaction with CD14-bound LPS.

Structure of human T-cell receptors specific for an immunodominant myelin basic protein peptide: positioning of T-cell receptors on HLA-DR2/peptide complexes.

T-cell receptors (TCRs) recognize peptide bound within the relatively conserved structural framework of major histocompatibility complex (MHC) class I or class II molecules but can discriminate between closely related MHC molecules. The structural basis for the specificity of ternary complex formation by the TCR and MHC/peptide complexes was examined for myelin basic protein (MBP)-specific T-cell clones restricted by different DR2 subtypes. Conserved features of this system allowed a model for positioning of the TCR on DR2/peptide complexes to be developed: (i) The DR2 subtypes that presented the immunodominant MBP peptide differed only at a few polymorphic positions of the DR beta chain. (ii) TCR recognition of a polymorphic residue on the helical portion of the DR beta chain (position DR beta 67) was important in determining the MHC restriction. (iii) The TCR variable region (V) alpha 3.1 gene segment was used by all of the T-cell clones. TCR V beta usage was more diverse but correlated with the MHC restriction--i.e., with the polymorphic DR beta chains. (iv) Two clones with conserved TCR alpha chains but different TCR beta chains had a different MHC restriction but a similar peptide specificity. The difference in MHC restriction between these T-cell clones appeared due to recognition of a cluster of polymorphic DR beta-chain residues (DR beta 67-71). MBP-(85-99)-specific TCRs therefore appeared to be positioned on the DR2/peptide complex such that the TCR beta chain contacted the polymorphic DR beta-chain helix while the conserved TCR alpha chain contacted the nonpolymorphic DR alpha chain.

Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex.

The stages of integration leading from local feature analysis to object recognition were explored in human visual cortex by using the technique of functional magnetic resonance imaging. Here we report evidence for object-related activation. Such activation was located at the lateral-posterior aspect of the occipital lobe, just abutting the posterior aspect of the motion-sensitive area MT/V5, in a region termed the lateral occipital complex (LO). LO showed preferential activation to images of objects, compared to a wide range of texture patterns. This activation was not caused by a global difference in the Fourier spatial frequency content of objects versus texture images, since object images produced enhanced LO activation compared to textures matched in power spectra but randomized in phase. The preferential activation to objects also could not be explained by different patterns of eye movements: similar levels of activation were observed when subjects fixated on the objects and when they scanned the objects with their eyes. Additional manipulations such as spatial frequency filtering and a 4-fold change in visual size did not affect LO activation. These results suggest that the enhanced responses to objects were not a manifestation of low-level visual processing. A striking demonstration that activity in LO is uniquely correlated to object detectability was produced by the "Lincoln" illusion, in which blurring of objects digitized into large blocks paradoxically increases their recognizability. Such blurring led to significant enhancement of LO activation. Despite the preferential activation to objects, LO did not seem to be involved in the final, "semantic," stages of the recognition process. Thus, objects varying widely in their recognizability (e.g., famous faces, common objects, and unfamiliar three-dimensional abstract sculptures) activated it to a similar degree. These results are thus evidence for an intermediate link in the chain of processing stages leading to object recognition in human visual cortex.

Amino-terminal alteration of the HLA-A*0201-restricted human immunodeficiency virus pol peptide increases complex stability and in vitro immunogenicity.

Initial studies suggested that major histocompatibility complex class I-restricted viral epitopes could be predicted by the presence of particular residues termed anchors. However, recent studies showed that nonanchor positions of the epitopes are also significant for class I binding and recognition by cytotoxic T lymphocytes (CTLs). We investigated if changing nonanchor amino acids could increase class I affinity, complex stability, and T-cell recognition of a natural viral epitope. This concept was tested by using the HLA-A 0201-restricted human immunodeficiency virus type 1 epitope from reverse transcriptase (pol). Position 1 (P1) amino acid substitutions were emphasized because P1 alterations may not alter the T-cell receptor interaction. The peptide with the P1 substitution of tyrosine for isoleucine (I1Y) showed a binding affinity for HLA-A 0201 similar to that of the wild-type pol peptide in a cell lysate assembly assay. Surprisingly, I1Y significantly increased the HLA-A 0201-peptide complex stability at the cell surface. I1Y sensitized HLA-A 0201-expressing target cells for wild-type pol-specific CTL lysis as well as wild-type pol. Peripheral blood lymphocytes from three HLA-A2 HIV-seropositive individuals were stimulated in vitro with I1Y and wild-type pol. I1Y stimulated a higher wild-type pol-specific CTL response than wild-type pol in all three donors. Thus, I1Y may be an "improved" epitope for use as a CTL-based human immunodeficiency virus vaccine component. The design of improved epitopes has important ramifications for prophylaxis and therapeutic vaccine development.

A mutated intron sequence codes for an antigenic peptide recognized by cytolytic T lymphocytes on a human melanoma.

We have identified an antigen recognized on a human melanoma by autologous cytolytic T lymphocytes. It is encoded by a gene that is expressed in many normal tissues. Remarkably, the sequence coding for the antigenic peptide is located across an exon-intron junction. A point mutation is present in the intron that generates an amino acid change that is essential for the recognition of the peptide by the anti-tumor cytotoxic T lymphocytes. This observation suggests that the T-cell-mediated surveillance of the integrity of the genome may extend to some intronic regions.

Construction, purification, and functional incorporation on tumor cells of glycolipid-anchored human B7-1 (CD80).

To generate a potent cell-mediated immune response, at least two signals are required by T cells. One is engagement of the T-cell receptor with peptide-bearing major histocompatibility complex molecules. The other signal can be delivered by various molecules on the antigen-presenting cell, such as B7-1 (CD80). Many tumor cells escape immune recognition by failing to express these costimulatory molecules. Transfection of the B7 gene into some murine tumor cells allows for immune recognition and subsequent rejection of the parental tumor. We have studied an alternative approach for the introduction of B7-1 onto the surface of tumor cells. This method involves purified glycosyl-phosphatidylinositol (GPI)-anchored proteins which can spontaneously incorporate their lipid tail into cell membranes. We have created and purified a GPI-anchored B7-1 molecule (called GPI-B7) which is able to bind its cognate ligand, CD28, and incorporate itself into tumor cell membranes after a short incubation. Tumor cells that have been reconstituted with GPI-B7 can provide the costimulatory signal needed to stimulate T cells. These findings suggest an approach for the introduction of new proteins onto cell membranes to create an effective tumor vaccine for potential use in human immunotherapy.

Structure of the gene for porcine peptide antibiotic PR-39, a cathelin gene family member: comparative mapping of the locus for the human peptide antibiotic FALL-39.

PR-39 is a porcine 39-aa peptide antibiotic composed of 49% proline and 24% arginine, with an activity against Gram-negative bacteria comparable to that of tetracycline. In Escherichia coli, it inhibits DNA and protein synthesis. PR-39 was originally isolated from pig small intestine, but subsequent cDNA cloning showed that the gene is expressed in the bone marrow. The open reading frame of the clone showed that PR-39 is made as 173-aa precursor whose proregion belongs to the cathelin family. The PR39 gene, which is rather compact and spans only 1784 bp has now been sequenced. The coding information is split into four exons. The first exon contains the signal sequence of 29 residues and the first 37 residues of the cathelin propart. Exons 2 and 3 contain only cathelin information, while exon 4 codes for the four C-terminal cathelin residues and the mature PR-39 peptide extended by three residues. The sequenced upstream region (1183 bp) contains four potential recognition sites for NF-IL6 and three for APRF, transcription factors known to regulate genes for both cytokines and acute phase response factors. Genomic hybridizations revealed a fairly high level of restriction fragment length polymorphism and indicated that there are at least two copies of the PR39 gene in the pig genome. PR39 was mapped to pig chromosome 13 by linkage and in situ hybridization mapping. The gene for the human peptide antibiotic FALL-39 (also a member of the cathelin family) was mapped to human chromosome 3, which is homologous to pig chromosome 13.

Recognition by viral and cellular DNA polymerases of nucleosides bearing bases with nonstandard hydrogen bonding patterns.

The ability of DNA polymerases (pols) to catalyze the template-directed synthesis of duplex oligonucleotides containing a nonstandard Watson-Crick base pair between a nucleotide bearing a 5-(2,4-diaminopyrimidine) heterocycle (d kappa) and a nucleotide bearing either deoxyxanthosine (dX) or N1-methyloxoformycin B (pi) has been investigated. The kappa-X and kappa-pi base pairs are jointed by a hydrogen bonding pattern different from and exclusive of those joining the AT and GC base pairs. Reverse transcriptase from human immunodeficiency virus type 1 (HIV-1) incorporates dXTP into an oligonucleotide opposite d kappa in a template with good fidelity. With lower efficiency and fidelity, HIV-1 reverse transcriptase also incorporates d kappa TP opposite dX in the template. With d pi in the template, no incorporation of d kappa TP was observed with HIV reverse transcriptase. The Klenow fragment of DNA pol I from Escherichia coli does not incorporate d kappa TP opposite dX in a template but does incorporate dXTP opposite d kappa. Bovine DNA pols alpha, beta, and epsilon accept neither dXTP opposite d kappa nor d kappa TP opposite d pi. DNA pols alpha and epsilon (but not beta) incorporate d kappa TP opposite dX in a template but discontinue elongation after incorporating a single additional base. These results are discussed in light of the crystal structure for pol beta and general considerations of how polymerases must interact with an incoming base pair to faithfully copy genetic information.