Processing of speech signals for physical and sensory disabilities.

Assistive technology involving voice communication is used primarily by people who are deaf, hard of hearing, or who have speech and/or language disabilities. It is also used to a lesser extent by people with visual or motor disabilities. A very wide range of devices has been developed for people with hearing loss. These devices can be categorized not only by the modality of stimulation [i.e., auditory, visual, tactile, or direct electrical stimulation of the auditory nerve (auditory-neural)] but also in terms of the degree of speech processing that is used. At least four such categories can be distinguished: assistive devices (a) that are not designed specifically for speech, (b) that take the average characteristics of speech into account, (c) that process articulatory or phonetic characteristics of speech, and (d) that embody some degree of automatic speech recognition. Assistive devices for people with speech and/or language disabilities typically involve some form of speech synthesis or symbol generation for severe forms of language disability. Speech synthesis is also used in text-to-speech systems for sightless persons. Other applications of assistive technology involving voice communication include voice control of wheelchairs and other devices for people with mobility disabilities.

Pattern of neuronal activity associated with conscious and unconscious processing of visual signals

Following striate cortex damage in monkeys and humans there can be residual function mediated by parallel visual pathways. In humans this can sometimes be associated with a “feeling” that something has happened, especially with rapid movement or abrupt onset. For less transient events, discriminative performance may still be well above chance even when the subject reports no conscious awareness of the stimulus. In a previous study we examined parameters that yield good residual visual performance in the “blind” hemifield of a subject with unilateral damage to the primary visual cortex. With appropriate parameters we demonstrated good discriminative performance, both with and without conscious awareness of a visual event. These observations raise the possibility of imaging the brain activity generated in the “aware” and the “unaware” modes, with matched levels of discrimination performance, and hence of revealing patterns of brain activation associated with visual awareness. The intact hemifield also allows a comparison with normal vision. Here we report the results of a functional magnetic resonance imaging study on the same subject carried out under aware and unaware stimulus conditions. The results point to a shift in the pattern of activity from neocortex in the aware mode, to subcortical structures in the unaware mode. In the aware mode prestriate and dorsolateral prefrontal cortices (area 46) are active. In the unaware mode the superior colliculus is active, together with medial and orbital prefrontal cortical sites.

In silico detection of control signals: mRNA 3′-end-processing sequences in diverse species

We have investigated mRNA 3′-end-processing signals in each of six eukaryotic species (yeast, rice, arabidopsis, fruitfly, mouse, and human) through the analysis of more than 20,000 3′-expressed sequence tags. The use and conservation of the canonical AAUAAA element vary widely among the six species and are especially weak in plants and yeast. Even in the animal species, the AAUAAA signal does not appear to be as universal as indicated by previous studies. The abundance of single-base variants of AAUAAA correlates with their measured processing efficiencies. As found previously, the plant polyadenylation signals are more similar to those of yeast than to those of animals, with both common content and arrangement of the signal elements. In all species examined, the complete polyadenylation signal appears to consist of an aggregate of multiple elements. In light of these and previous results, we present a broadened concept of 3′-end-processing signals in which no single exact sequence element is universally required for processing. Rather, the total efficiency is a function of all elements and, importantly, an inefficient word in one element can be compensated for by strong words in other elements. These complex patterns indicate that effective tools to identify 3′-end-processing signals will require more than consensus sequence identification.

Elemental propagation of calcium signals in response-specific patterns determined by environmental stimulus strength

Plant cells can respond qualitatively and quantitatively to a wide range of environmental signals. Ca2+ is used as an intracellular signal for volume regulation in response to external osmotic changes. We show here that the spatiotemporal patterns of hypo-osmotically induced Ca2+ signals vary dramatically with stimulus strength in embryonic cells of the marine alga Fucus. Biphasic or multiphasic Ca2+ signals reflect Ca2+ elevations in distinct cellular domains. These propagate via elemental Ca2+ release in nuclear or peripheral regions that are rich in endoplasmic reticulum. Cell volume regulation specifically requires Ca2+ elevation in apical peripheral regions, whereas an altered cell division rate occurs only in response to stimuli that cause Ca2+ elevation in nuclear regions.

Maternal effects and the evolution of aposematic signals

Aposematic signals that warn predators of the noxious qualities of prey gain their greatest selective advantage when predators have already experienced similar signals. Existing theory explains how such signals can spread through selective advantage after they are present at some critical frequency, but is unclear about how warning signals can be selectively advantageous when the trait is initially rare (i.e., when it first arises through mutation) and predators are naive. When aposematism is controlled by a maternal effect gene, the difficulty of initial rarity may be overcome. Unlike a zygotically expressed gene, a maternally expressed aposematism gene will be hidden from selection because it is not phenotypically expressed in the first individual with the mutation. Furthermore, the first individual carrying the new mutation will produce an entire family of aposematic offspring, thereby providing an immediate fitness advantage to this gene.

Periodicity of strong nucleosome positioning sites around the chicken adult beta-globin gene may encode regularly spaced chromatin.

Positioned nucleosomes contribute to both the structure and the function of the chromatin fiber and can play a decisive role in controlling gene expression. We have mapped, at high resolution, the translational positions adopted by limiting amounts of core histone octamers reconstituted onto 4.4 kb of DNA comprising the entire chicken adult beta-globin gene, its enhancer, and flanking sequences. The octamer displays extensive variation in its affinity for different positioning sites, the range exhibited being about 2 orders of magnitude greater than that of the initial binding of the octamer. Strong positioning sites are located 5' and 3' of the globin gene and in the second intron but are absent from the coding regions. These sites exhibit a periodicity (approximately 200 bp) similar to the average spacing of nucleosomes on the inactive beta-globin gene in vivo, which could indicate their involvement in packaging the gene into higher-order chromatin structure. Overlapping, alternative octamer positioning sites commonly exhibit spacings of 20 and 40 bp, but not of 10 bp. These short-range periodicities could reflect features of the core particle structure contributing to the pronounced sequence-dependent manner in which the core histone octamer interacts with DNA.

The role of voice input for human-machine communication.

Optimism is growing that the near future will witness rapid growth in human-computer interaction using voice. System prototypes have recently been built that demonstrate speaker-independent real-time speech recognition, and understanding of naturally spoken utterances with vocabularies of 1000 to 2000 words, and larger. Already, computer manufacturers are building speech recognition subsystems into their new product lines. However, before this technology can be broadly useful, a substantial knowledge base is needed about human spoken language and performance during computer-based spoken interaction. This paper reviews application areas in which spoken interaction can play a significant role, assesses potential benefits of spoken interaction with machines, and compares voice with other modalities of human-computer interaction. It also discusses information that will be needed to build a firm empirical foundation for the design of future spoken and multimodal interfaces. Finally, it argues for a more systematic and scientific approach to investigating spoken input and performance with future language technology.

A perspective on early commercial applications of voice-processing technology for telecommunications and aids for the handicapped.

The Colloquium on Human-Machine Communication by Voice highlighted the global technical community's focus on the problems and promise of voice-processing technology, particularly, speech recognition and speech synthesis. Clearly, there are many areas in both the research and development of these technologies that can be advanced significantly. However, it is also true that there are many applications of these technologies that are capable of commercialization now. Early successful commercialization of new technology is vital to ensure continuing interest in its development. This paper addresses efforts to commercialize speech technologies in two markets: telecommunications and aids for the handicapped.

The future of voice-processing technology in the world of computers and communications.

This talk, which was the keynote address of the NAS Colloquium on Human-Machine Communication by Voice, discusses the past, present, and future of human-machine communications, especially speech recognition and speech synthesis. Progress in these technologies is reviewed in the context of the general progress in computer and communications technologies.

Periodicity of polar and nonpolar amino acids is the major determinant of secondary structure in self-assembling oligomeric peptides.

The tendency of a polypeptide chain to form alpha-helical or beta-strand secondary structure depends upon local and nonlocal effects. Local effects reflect the intrinsic propensities of the amino acid residues for particular secondary structures, while nonlocal effects reflect the positioning of the individual residues in the context of the entire amino acid sequence. In particular, the periodicity of polar and nonpolar residues specifies whether a given sequence is consistent with amphiphilic alpha-helices or beta-strands. The importance of intrinsic propensities was compared to that of polar/nonpolar periodicity by a direct competition. Synthetic peptides were designed using residues with intrinsic propensities that favored one or the other type of secondary structure. The polar/nonpolar periodicities of the peptides were designed either to be consistent with the secondary structure favored by the intrinsic propensities of the component residues or in other cases to oppose these intrinsic propensities. Characterization of the synthetic peptides demonstrated that in all cases the observed secondary structure correlates with the periodicity of the peptide sequence--even when this secondary structure differs from that predicted from the intrinsic propensities of the component amino acids. The observed secondary structures are concentration dependent, indicating that oligomerization of the amphiphilic peptides is responsible for the observed secondary structures. Thus, for self-assembling oligomeric peptides, the polar/nonpolar periodicity can overwhelm the intrinsic propensities of the amino acid residues and serves as the major determinant of peptide secondary structure.

Transduction of Basolateral-to-Apical Signals across Epithelial Cells: Ligand-stimulated Transcytosis of the Polymeric Immunoglobulin Receptor Requires Two Signals

Transcytosis of the polymeric immunoglobulin receptor (pIgR) is stimulated by binding of its ligand, dimeric IgA (dIgA). During this process, dIgA binding at the basolateral surface of the epithelial cell transmits a signal to the apical region of the cell, which in turn stimulates the transport of dIgA–pIgR complex from a postmicrotubule compartment to the apical surface. We have previously reported that the signal of stimulation was controlled by a protein-tyrosine kinase (PTK) activated upon dIgA binding. We now show that this signal of stimulation moves across the cell independently of pIgR movement or microtubules and acts through the tyrosine kinase activity by releasing Ca++ from inositol trisphosphate–sensitive intracellular stores. Surprisingly we have found that a second independent signal is required to achieve dIgA-stimulated transcytosis of pIgR. This second signal depends on dIgA binding to the pIgR solely at the basolateral surface and the ability of pIgR to dimerize. This enables pIgR molecules that have bound dIgA at the basolateral surface to respond to the signal of stimulation once they reach the postmicrotubule compartment. We propose that the use of two signals may be a general mechanism by which signaling receptors maintain specificity along their signaling and trafficking pathways.

Di-Leucine Signals Mediate Targeting of Tyrosinase and Synaptotagmin to Synaptic-like Microvesicles within PC12 Cells

One pathway in forming synaptic-like microvesicles (SLMV) involves direct budding from the plasma membrane, requires adaptor protein 2 (AP2) and is brefeldin A (BFA) resistant. A second route leads from the plasma membrane to an endosomal intermediate from which SLMV bud in a BFA-sensitive, AP3-dependent manner. Because AP3 has been shown to bind to a di-leucine targeting signal in vitro, we have investigated whether this major class of targeting signals is capable of directing protein traffic to SLMV in vivo. We have found that a di-leucine signal within the cytoplasmic tail of human tyrosinase is responsible for the majority of the targeting of HRP-tyrosinase chimeras to SLMV in PC12 cells. Furthermore, we have discovered that a Met-Leu di-hydrophobic motif within the extreme C terminus of synaptotagmin I supports 20% of the SLMV targeting of a CD4-synaptotagmin chimera. All of the traffic to the SLMV mediated by either di-Leu or Met-Leu is BFA sensitive, strongly suggesting a role for AP3 and possibly for an endosomal intermediate in this process. The differential reduction in SLMV targeting for HRP-tyrosinase and CD4-synaptotagmin chimeras by di-alanine substitutions or BFA treatment implies that different proteins use the two routes to the SLMV to differing extents.

Analysis of endoplasmic reticulum trafficking signals by combinatorial screening in mammalian cells

To improve the accuracy of predicting membrane protein sorting signals, we developed a general methodology for defining trafficking signal consensus sequences in the environment of the living cell. Our approach uses retroviral gene transfer to create combinatorial expression libraries of trafficking signal variants in mammalian cells, flow cytometry to sort cells based on trafficking phenotype, and quantitative trafficking assays to measure the efficacy of individual signals. Using this strategy to analyze arginine- and lysine-based endoplasmic reticulum localization signals, we demonstrate that small changes in the local sequence context dramatically alter signal strength, generating a broad spectrum of trafficking phenotypes. Finally, using sequences from our screen, we found that the potency of di-lysine, but not di-arginine, mediated endoplasmic reticulum localization was correlated with the strength of interaction with α-COP.

Release of Flavonoids by the Soybean Cultivars McCall and Peking and Their Perception as Signals by the Nitrogen-Fixing Symbiont Sinorhizobium fredii1

Sinorhizobium fredii strain USDA191 forms N-fixing nodules on the soybean (Glycine max L. Merr.) cultivars (cvs) McCall and Peking, but S. fredii strain USDA257 nodulates only cv Peking. We wondered whether specificity in this system is conditioned by the release of unique flavonoid signals from one of the cultivars or by differential perception of signals by the strains. We isolated flavonoids and used nodC and nolX, which are nod-box-dependent and -independent nod genes, respectively, to determine how signals activate genes in the microsymbionts. Seeds of cv McCall and cv Peking contain the isoflavones daidzein, genistein, and glycitein, as well as their glucosyl and malonylglucosyl glycosides. Roots exude picomolar concentrations of daidzein, genistein, glycitein, and coumestrol. Amounts are generally higher in cv Peking than in cv McCall, and the presence of rhizobia markedly influences the level of specific signals. Nanomolar concentrations of daidzein, genistein, and coumestrol induce expression of nodC and nolX in strain USDA257, but the relative nolX-inducing activities of these signals differ in strain USDA191. Glycitein and the conjugates are inactive. Strain USDA257 deglycosylates daidzin and genistin into daidzein and genistein, respectively, thereby converting inactive precursors into active inducers. Although neither soybean cultivar contains unique nod-gene-inducing flavonoids, strain- and cultivar-specific interactions are characterized by distinct patterns of signal release and response.

Generation of cell-to-cell signals in quorum sensing: acyl homoserine lactone synthase activity of a purified Vibrio fischeri LuxI protein.

Many bacteria use acyl homoserine lactone signals to monitor cell density in a type of gene regulation termed quorum sensing and response. Synthesis of these signals is directed by homologs of the luxi gene of Vibrio fischeri. This communication resolves two critical issues concerning the synthesis of the V. fischeri signal. (i) The luxI product is directly involved in signal synthesis-the protein is an acyl homoserine lactone synthase; and (ii) the substrates for acyl homoserine lactone synthesis are not amino acids from biosynthetic pathways or fatty acid degradation products, but rather they are S-adenosylmethionine (SAM) and an acylated acyl carrier protein (ACP) from the fatty acid biosynthesis pathway. We purified a maltose binding protein-LuxI fusion polypeptide and showed that, when provided with the appropriate substrates, it catalyzes the synthesis of an acyl homoserine lactone. In V. fischeri, luxi directs the synthesis of N-(3-oxohexanoyl) homoserine lactone and hexanoyl homoserine lactone. The purified maltose binding protein-LuxI fusion protein catalyzes the synthesis of hexanoyl homoserine lactone from hexanoyl-ACP and SAM. There is a high level of specificity for hexanoyl-ACP over ACPs with differing acyl group lengths, and hexanoyl homoserine lactone was not synthesized when SAM was replaced with other amino acids, such as methionine, S-adenosylhomocysteine, homoserine, or homoserine lactone, or when hexanoyl-SAM was provided as the substrate. This provides direct evidence that the LuxI protein is an auto-inducer synthase that catalyzes the formation of an amide bond between SAM and a fatty acyl-ACP and then catalyzes the formation of the acyl homoserine lactone from the acyl-SAM intermediate.