Research in speech communication.

Advances in digital speech processing are now supporting application and deployment of a variety of speech technologies for human/machine communication. In fact, new businesses are rapidly forming about these technologies. But these capabilities are of little use unless society can afford them. Happily, explosive advances in microelectronics over the past two decades have assured affordable access to this sophistication as well as to the underlying computing technology. The research challenges in speech processing remain in the traditionally identified areas of recognition, synthesis, and coding. These three areas have typically been addressed individually, often with significant isolation among the efforts. But they are all facets of the same fundamental issue--how to represent and quantify the information in the speech signal. This implies deeper understanding of the physics of speech production, the constraints that the conventions of language impose, and the mechanism for information processing in the auditory system. In ongoing research, therefore, we seek more accurate models of speech generation, better computational formulations of language, and realistic perceptual guides for speech processing--along with ways to coalesce the fundamental issues of recognition, synthesis, and coding. Successful solution will yield the long-sought dictation machine, high-quality synthesis from text, and the ultimate in low bit-rate transmission of speech. It will also open the door to language-translating telephony, where the synthetic foreign translation can be in the voice of the originating talker.

Chemical communication in scarab beetles: reciprocal behavioral agonist-antagonist activities of chiral pheromones.

A novel mechanism of reciprocal behavioral agonist-antagonist activities of enantiomeric pheromones plays a pivotal role in overcoming the signal-to-noise problem derived from the use of a single-constituent pheromone system in scarab beetles. Female Anomala osakana produce (S, Z)-5-(+)-(1-decenyl)oxacyclopentan-2-one, which is highly attractive to males; the response is completely inhibited even by 5% of its antipode. These two enantiomers have reverse roles in the Popillia japonica sex pheromone system. Chiral GC-electroantennographic detector experiments suggest that A. osakana and P. japonica have both R and S receptors that are responsible for behavioral agonist and antagonist responses.

Introduction of asymmetry in the naturally symmetric restriction endonuclease EcoRV to investigate intersubunit communication in the homodimeric protein.

Type II restriction endonucleases are dimers of two identical subunits that together form one binding site for the double-stranded DNA substrate. Cleavage within the palindromic recognition site occurs in the two strands of the duplex in a concerted manner, due to the action of two catalytic centers, one per subunit. To investigate how the two identical subunits of the restriction endonuclease EcoRV cooperate in binding and cleaving their substrate, heterodimeric versions of EcoRV with different amino acid substitutions in the two subunits were constructed. For this purpose, the ecorV gene was fused to the coding region for the glutathione-binding domain of the glutathione S-transferase and a His6-tag, respectively. Upon cotransformation of Escherichia coli cells with both gene fusions stable homo- and heterodimers of the EcoRV variants are produced, which can be separated and purified to homogeneity by affinity chromatography over Ni-nitrilotriacetic acid and glutathione columns. A steady-state kinetic analysis shows that the activity of a heterodimeric variant with one inactive catalytic center is decreased by 2-fold, demonstrating that the two catalytic centers operate independently from each other. In contrast, heterodimeric variants with a defect in one DNA-binding site have a 30- to 50-fold lower activity, indicating that the two subunits of EcoRV cooperate in the recognition of the palindromic DNA sequence. By combining a subunit with an inactive catalytic center with a subunit with a defect in the DNA-binding site, EcoRV heterodimers were produced that only nick DNA specifically within the EcoRV recognition sequence.

Cell-cell communication regulates the effects of protein aspartate phosphatases on the phosphorelay controlling development in Bacillus subtilis.

Rap phosphatases are a recently discovered family of protein aspartate phosphatases that dephosphorylate the Spo0F--P intermediate of the phosphorelay, thus preventing sporulation of Bacillus subtilis. They are regulators induced by physiological processes that are antithetical to sporulation. The RapA phosphatase is induced by the ComP-ComA two-component signal transduction system responsible for initiating competence. RapA phosphatase activity was found to be controlled by a small protein, PhrA, encoded on the same transcript as RapA. PhrA resembles secreted proteins and the evidence suggests that it is cleaved by signal peptidase I and a 19-residue C-terminal domain is secreted from the cell. The sporulation deficiency caused by the uncontrolled RapA activity of a phrA mutant can be complemented by synthetic peptides comprising the last six or more of the C-terminal residues of PhrA. Whether the peptide controls RapA activity directly or by regulating its synthesis remains to be determined. Complementation of the phrA mutant can also be obtained in mixed cultures with a wild-type strain, suggesting the peptide may serve as a means of communication between cells. Importation of the secreted peptide required the oligopeptide transport system. The sporulation deficiency of oligopeptide transport mutants can be suppressed by mutating the rapA and rapB genes or by introduction of a spo0F mutation Y13S that renders the protein insensitive to Rap phosphatases. The data indicate that the sporulation deficiency of oligopeptide transport mutants is due to their inability to import the peptides controlling Rap phosphatases.

The extent of heterocellular communication mediated by gap junctions is predictive of bystander tumor cytotoxicity in vitro.

Herpes simplex virus thymidine kinase (HSV-tk)/ganciclovir (GCV) viral-directed enzyme prodrug gene therapy causes potent, tumor-selective cytotoxicity in animal models in which HSV-tk gene transduction is limited to a minority of tumor cells. The passage of toxic molecules from HSV-tk+ cells to neighboring HSV-tk- cells during GCV therapy is one mechanism that may account for this "bystander" cytotoxicity. To investigate whether gap junction-mediated intercellular coupling could mediate this bystander effect, we used a flow cytometry assay to quantitate the extent of heterocellular coupling between HSV-tk+ murine fibroblasts and both rodent and human tumor cell lines. Bystander tumor cytotoxicity during GCV treatment in a coculture assay was highly correlated (P < 0.001) with the extent of gap junction-mediated coupling. These findings show that gap junction-mediated intercellular coupling contributes to the in vitro bystander effect during HSV-tk/GCV therapy and that retroviral transduction of tumor cells is not required for bystander cytotoxicity.

Scientific bases of human-machine communication by voice.

The scientific bases for human-machine communication by voice are in the fields of psychology, linguistics, acoustics, signal processing, computer science, and integrated circuit technology. The purpose of this paper is to highlight the basic scientific and technological issues in human-machine communication by voice and to point out areas of future research opportunity. The discussion is organized around the following major issues in implementing human-machine voice communication systems: (i) hardware/software implementation of the system, (ii) speech synthesis for voice output, (iii) speech recognition and understanding for voice input, and (iv) usability factors related to how humans interact with machines.

The role of voice input for human-machine communication.

Optimism is growing that the near future will witness rapid growth in human-computer interaction using voice. System prototypes have recently been built that demonstrate speaker-independent real-time speech recognition, and understanding of naturally spoken utterances with vocabularies of 1000 to 2000 words, and larger. Already, computer manufacturers are building speech recognition subsystems into their new product lines. However, before this technology can be broadly useful, a substantial knowledge base is needed about human spoken language and performance during computer-based spoken interaction. This paper reviews application areas in which spoken interaction can play a significant role, assesses potential benefits of spoken interaction with machines, and compares voice with other modalities of human-computer interaction. It also discusses information that will be needed to build a firm empirical foundation for the design of future spoken and multimodal interfaces. Finally, it argues for a more systematic and scientific approach to investigating spoken input and performance with future language technology.

Military and government applications of human-machine communication by voice.

This paper describes a range of opportunities for military and government applications of human-machine communication by voice, based on visits and contacts with numerous user organizations in the United States. The applications include some that appear to be feasible by careful integration of current state-of-the-art technology and others that will require a varying mix of advances in speech technology and in integration of the technology into applications environments. Applications that are described include (1) speech recognition and synthesis for mobile command and control; (2) speech processing for a portable multifunction soldier's computer; (3) speech- and language-based technology for naval combat team tactical training; (4) speech technology for command and control on a carrier flight deck; (5) control of auxiliary systems, and alert and warning generation, in fighter aircraft and helicopters; and (6) voice check-in, report entry, and communication for law enforcement agents or special forces. A phased approach for transfer of the technology into applications is advocated, where integration of applications systems is pursued in parallel with advanced research to meet future needs.

Speech technology in 2001: new research directions.

Research in speech recognition and synthesis over the past several decades has brought speech technology to a point where it is being used in "real-world" applications. However, despite the progress, the perception remains that the current technology is not flexible enough to allow easy voice communication with machines. The focus of speech research is now on producing systems that are accurate and robust but that do not impose unnecessary constraints on the user. This chapter takes a critical look at the shortcomings of the current speech recognition and synthesis algorithms, discusses the technical challenges facing research, and examines the new directions that research in speech recognition and synthesis must take in order to form the basis of new solutions suitable for supporting a wide range of applications.