The role of voice input for human-machine communication.

Optimism is growing that the near future will witness rapid growth in human-computer interaction using voice. System prototypes have recently been built that demonstrate speaker-independent real-time speech recognition, and understanding of naturally spoken utterances with vocabularies of 1000 to 2000 words, and larger. Already, computer manufacturers are building speech recognition subsystems into their new product lines. However, before this technology can be broadly useful, a substantial knowledge base is needed about human spoken language and performance during computer-based spoken interaction. This paper reviews application areas in which spoken interaction can play a significant role, assesses potential benefits of spoken interaction with machines, and compares voice with other modalities of human-computer interaction. It also discusses information that will be needed to build a firm empirical foundation for the design of future spoken and multimodal interfaces. Finally, it argues for a more systematic and scientific approach to investigating spoken input and performance with future language technology.

Scientific bases of human-machine communication by voice.

The scientific bases for human-machine communication by voice are in the fields of psychology, linguistics, acoustics, signal processing, computer science, and integrated circuit technology. The purpose of this paper is to highlight the basic scientific and technological issues in human-machine communication by voice and to point out areas of future research opportunity. The discussion is organized around the following major issues in implementing human-machine voice communication systems: (i) hardware/software implementation of the system, (ii) speech synthesis for voice output, (iii) speech recognition and understanding for voice input, and (iv) usability factors related to how humans interact with machines.

Military and government applications of human-machine communication by voice.

This paper describes a range of opportunities for military and government applications of human-machine communication by voice, based on visits and contacts with numerous user organizations in the United States. The applications include some that appear to be feasible by careful integration of current state-of-the-art technology and others that will require a varying mix of advances in speech technology and in integration of the technology into applications environments. Applications that are described include (1) speech recognition and synthesis for mobile command and control; (2) speech processing for a portable multifunction soldier's computer; (3) speech- and language-based technology for naval combat team tactical training; (4) speech technology for command and control on a carrier flight deck; (5) control of auxiliary systems, and alert and warning generation, in fighter aircraft and helicopters; and (6) voice check-in, report entry, and communication for law enforcement agents or special forces. A phased approach for transfer of the technology into applications is advocated, where integration of applications systems is pursued in parallel with advanced research to meet future needs.

Deployment of human-machine dialogue systems.

The deployment of systems for human-to-machine communication by voice requires overcoming a variety of obstacles that affect the speech-processing technologies. Problems encountered in the field might include variation in speaking style, acoustic noise, ambiguity of language, or confusion on the part of the speaker. The diversity of these practical problems encountered in the "real world" leads to the perceived gap between laboratory and "real-world" performance. To answer the question "What applications can speech technology support today?" the concept of the "degree of difficulty" of an application is introduced. The degree of difficulty depends not only on the demands placed on the speech recognition and speech synthesis technologies but also on the expectations of the user of the system. Experience has shown that deployment of effective speech communication systems requires an iterative process. This paper discusses general deployment principles, which are illustrated by several examples of human-machine communication systems.

Toward the ultimate synthesis/recognition system.

This paper predicts speech synthesis, speech recognition, and speaker recognition technology for the year 2001, and it describes the most important research problems to be solved in order to arrive at these ultimate synthesis and recognition systems. The problems for speech synthesis include natural and intelligible voice production, prosody control based on meaning, capability of controlling synthesized voice quality and choosing individual speaking style, multilingual and multidialectal synthesis, choice of application-oriented speaking styles, capability of adding emotion, and synthesis from concepts. The problems for speech recognition include robust recognition against speech variations, adaptation/normalization to variations due to environmental conditions and speakers, automatic knowledge acquisition for acoustic and linguistic modeling, spontaneous speech recognition, naturalness and ease of human-machine interaction, and recognition of emotion. The problems for speaker recognition are similar to those for speech recognition. The research topics related to all these techniques include the use of articulatory and perceptual constraints and evaluation methods for measuring the quality of technology and systems.

Research in speech communication.

Advances in digital speech processing are now supporting application and deployment of a variety of speech technologies for human/machine communication. In fact, new businesses are rapidly forming about these technologies. But these capabilities are of little use unless society can afford them. Happily, explosive advances in microelectronics over the past two decades have assured affordable access to this sophistication as well as to the underlying computing technology. The research challenges in speech processing remain in the traditionally identified areas of recognition, synthesis, and coding. These three areas have typically been addressed individually, often with significant isolation among the efforts. But they are all facets of the same fundamental issue--how to represent and quantify the information in the speech signal. This implies deeper understanding of the physics of speech production, the constraints that the conventions of language impose, and the mechanism for information processing in the auditory system. In ongoing research, therefore, we seek more accurate models of speech generation, better computational formulations of language, and realistic perceptual guides for speech processing--along with ways to coalesce the fundamental issues of recognition, synthesis, and coding. Successful solution will yield the long-sought dictation machine, high-quality synthesis from text, and the ultimate in low bit-rate transmission of speech. It will also open the door to language-translating telephony, where the synthetic foreign translation can be in the voice of the originating talker.

A perspective on early commercial applications of voice-processing technology for telecommunications and aids for the handicapped.

The Colloquium on Human-Machine Communication by Voice highlighted the global technical community's focus on the problems and promise of voice-processing technology, particularly, speech recognition and speech synthesis. Clearly, there are many areas in both the research and development of these technologies that can be advanced significantly. However, it is also true that there are many applications of these technologies that are capable of commercialization now. Early successful commercialization of new technology is vital to ensure continuing interest in its development. This paper addresses efforts to commercialize speech technologies in two markets: telecommunications and aids for the handicapped.

Speech technology in the year 2001.

This paper introduces the session "Technology in the Year 2001" and is the first of four papers dealing with the future of human-machine communication by voice. In looking to the future it is important to recognize both the difficulties of technological forecasting and the frailties of the technology as it exists today--frailties that are manifestations of our limited scientific understanding of human cognition. The technology to realize truly advanced applications does not yet exist and cannot be supported by our presently incomplete science of speech. To achieve this long-term goal, the authors advocate a fundamental research program using a cybernetic approach substantially different from more conventional synthetic approaches. In a cybernetic approach, feedback control systems will allow a machine to adapt to a linguistically rich environment using reinforcement learning.

The future of voice-processing technology in the world of computers and communications.

This talk, which was the keynote address of the NAS Colloquium on Human-Machine Communication by Voice, discusses the past, present, and future of human-machine communications, especially speech recognition and speech synthesis. Progress in these technologies is reviewed in the context of the general progress in computer and communications technologies.

Interaction of the human androgen receptor transactivation function with the general transcription factor TFIIF

The human androgen receptor (AR) is a ligand-activated transcription factor that regulates genes important for male sexual differentiation and development. To better understand the role of the receptor as a transcription factor we have studied the mechanism of action of the N-terminal transactivation function. In a protein–protein interaction assay the AR N terminus (amino acids 142–485) selectively bound to the basal transcription factors TFIIF and the TATA-box-binding protein (TBP). Reconstitution of the transactivation activity in vitro revealed that AR142–485 fused to the LexA protein DNA-binding domain was competent to activate a reporter gene in the presence of a competing DNA template lacking LexA binding sites. Furthermore, consistent with direct interaction with basal transcription factors, addition of recombinant TFIIF relieved squelching of basal transcription by AR142–485. Taken together these results suggest that one mechanism of transcriptional activation by the AR involves binding to TFIIF and recruitment of the transcriptional machinery.

Evidence for two nonidentical drug-interaction sites in the human P-glycoprotein

Human P-glycoprotein (Pgp) confers multidrug resistance to cancer cells by ATP-dependent extrusion of a great many structurally dissimilar hydrophobic compounds. The manner in which Pgp recognizes these different substrates is unknown. The protein shows internal homology between its N- and C-terminal halves, each comprised of six putative transmembrane helices and a consensus ATP binding/utilization site. Photoactive derivatives of certain Pgp substrates specifically label two regions, one on each half of the protein. In this study, using [125I]iodoarylazidoprazosin ([125I]IAAP), a photoactive analog of prazosin, we have demonstrated the presence of two nonidentical drug-interaction sites within Pgp. Taking advantage of a highly susceptible trypsin cleavage site in the linker region of Pgp, we characterized the [125I]IAAP binding to the N- and C-terminal halves. cis(Z)-Flupentixol, a modulator of Pgp function, preferentially increased the affinity of [125I]IAAP for the C-terminal half of the protein (C-site) by reducing the Kd from 20 to 6 nM without changing the labeling or affinity (Kd = 42–46 nM) of the N-terminal half (N-site). Also, the concentration of vinblastine (Pgp substrate) and cyclosporin A (Pgp modulator) required for 50% inhibition of [125I]IAAP binding to the C-site was increased 5- to 6-fold by cis(Z)-flupentixol without any effect on the N-site. In addition, [125I]IAAP binding to the N-site was less susceptible than to C-site to inhibition by vanadate which blocks ATP hydrolysis and drug transport. These data demonstrate the presence of at least two nonidentical substrate interaction sites in Pgp.

Interaction of human apurinic endonuclease and DNA polymerase β in the base excision repair pathway

Mutagenic abasic (AP) sites are generated directly by DNA-damaging agents or by DNA glycosylases acting in base excision repair. AP sites are corrected via incision by AP endonucleases, removal of deoxyribose 5-phosphate, repair synthesis, and ligation. Mammalian DNA polymerase β (Polβ) carries out most base excision repair synthesis and also can excise deoxyribose 5-phosphate after AP endonuclease incision. Yeast two-hybrid analysis now indicates protein–protein contact between Polβ and human AP endonuclease (Ape protein). In vitro, binding of Ape protein to uncleaved AP sites loads Polβ into a ternary complex with Ape and the AP-DNA. After incision by Ape, only Polβ exhibits stable DNA binding. Kinetic experiments indicated that Ape accelerates the excision of 5′-terminal deoxyribose 5-phosphate by Polβ. Thus, the two central players of the base excision repair pathway are coordinated in sequential reactions.

Interaction of Class I Human Leukocyte Antigen (HLA-I) Molecules with Insulin Receptors and Its Effect on the Insulin-Signaling Cascade

Insulin receptor (IR) and class I major histocompatibility complex molecules associate with one another in cell membranes, but the functional consequences of this association are not defined. We found that IR and human class I molecules (HLA-I) associate in liposome membranes and that the affinity of IR for insulin and its tyrosine kinase activity increase as the HLA:IR ratio increases over the range 1:1 to 20:1. The same relationship between HLA:IR and IR function was found in a series of B-LCL cell lines. The association of HLA-I and IR depends upon the presence of free HLA heavy chains. All of the effects noted were reduced or abrogated if liposomes or cells were incubated with excess HLA-I light chain, β2-microglobulin. Increasing HLA:IR also enhanced phosphorylation of insulin receptor substrate-1 and the activation of phosphoinositide 3-kinase. HLA-I molecules themselves were phosphorylated on tyrosine and associated with phosphoinositide 3-kinase when B-LCL were stimulated with insulin.

Functional interaction between c-Jun and promoter factor Sp1 in epidermal growth factor-induced gene expression of human 12(S)-lipoxygenase

The functional role of the interaction between c-Jun and simian virus 40 promoter factor 1 (Sp1) in epidermal growth factor (EGF)-induced expression of 12(S)-lipoxygenase gene in human epidermoid carcinoma A431 cells was studied. Coimmunoprecipitation experiments indicated that EGF stimulated interaction between c-Jun and Sp1 in a time-dependent manner. Overexpression of Ha-ras and c-Jun also enhanced the amount of c-Jun binding to Sp1. In addition, the c-Jun dominant negative mutant TAM-67 not only inhibited the coimmunoprecipitated c-Jun binding to Sp1 in a dose-dependent manner in cells overexpressing c-Jun but also reduced promoter activity of the 12(S)-lipoxygenase gene induced by c-Jun overexpression. Treatment of cells with EGF increased the interaction between the Sp1 oligonucleotide and nuclear c-Jun/Sp1 in a time-dependent manner. Furthermore, EGF activated the chimeric promoter consisting of 10 tandem GAL4-binding sites, which replaced the three Sp1-binding sites in the 12(S)lipoxygenase promoter only when coexpressed with GAL4-c-Jun () fusion proteins. These results indicate that the direct interaction between c-Jun and Sp1 induced by EGF cooperatively activated expression of the 12(S)-lipoxygenase gene, and that Sp1 may serve at least in part as a carrier bringing c-Jun to the promoter, thus transactivating the transcriptional activity of 12(S)-lipoxygenase gene.

ETO, fusion partner in t(8;21) acute myeloid leukemia, represses transcription by interaction with the human N-CoR/mSin3/HDAC1 complex

The t(8;21) translocation between two genes known as AML1 and ETO is seen in approximately 12–15% of all acute myeloid leukemia (AML) and is the second-most-frequently observed nonrandom genetic alteration associated with AML. AML1 up-regulates a number of target genes critical to normal hematopoiesis, whereas the AML1/ETO fusion interferes with this trans-activation. We discovered that the fusion partner ETO binds to the human homolog of the murine nuclear receptor corepressor (N-CoR). The interaction is mediated by two unusual zinc finger motifs present at the carboxyl terminus of ETO. Human N-CoR (HuN-CoR), which we cloned and sequenced in its entirety, encodes a 2,440-amino acid polypeptide and has a central domain that binds ETO. N-CoR, mammalian Sin3 (mSin3A and B), and histone deacetylase 1 (HDAC1) form a complex that alters chromatin structure and mediates transcriptional repression by nuclear receptors and by a number of oncoregulatory proteins. We found that ETO, through its interaction with the N-CoR/mSin3/HDAC1 complex, is also a potent repressor of transcription. This observation provides a mechanism for how the AML1/ETO fusion may inhibit expression of AML1-responsive target genes and disturb normal hematopoiesis.