Visual Speech Segmentation: Using Facial Cues to Locate Word Boundaries in Continuous Speech

Speech is typically a multimodal phenomenon, yet few studies have focused on the exclusive contributions of visual cues to language acquisition. To address this gap, we investigated whether visual prosodic information can facilitate speech segmentation. Previous research has demonstrated that language learners can use lexical stress and pitch cues to segment speech and that learners can extract this information from talking faces. Thus, we created an artificial speech stream that contained minimal segmentation cues and paired it with two synchronous facial displays in which visual prosody was either informative or uninformative for identifying word boundaries. Across three familiarisation conditions (audio stream alone, facial streams alone, and paired audiovisual), learning occurred only when the facial displays were informative to word boundaries, suggesting that facial cues can help learners solve the early challenges of language acquisition.

The effects of dexmedetomidine/remifentanil and midazolam/remifentanil on auditory-evoked potentials and electroencephalogram at light-to-moderate sedation levels in healthy subjects

Avoidance of excessively deep sedation levels is problematic in intensive care patients. Electrophysiologic monitoring may offer an approach to solving this problem. Since electroencephalogram (EEG) responses to different sedation regimens vary, we assessed electrophysiologic responses to two sedative drug regimens in 10 healthy volunteers. Dexmedetomidine/remifentanil (dex/remi group) and midazolam/remifentanil (mida/remi group) were infused 7 days apart. Each combination of medications was given at stepwise intervals to reach Ramsay scores (RS) 2, 3, and 4. Resting EEG, bispectral index (BIS), and the N100 amplitudes of long-latency auditory-evoked potentials (ERP) were recorded at each level of sedation. During dex/remi, resting EEG was characterized by a recurrent high-power low-frequency pattern which became more pronounced at deeper levels of sedation. BIS Index decreased uniformly in only the dex/remi group (from 94 +/- 3 at baseline to 58 +/- 14 at RS 4) compared to the mida/remi group (from 94 +/- 2 to 76 +/- 10; P = 0.029 between groups). The ERP amplitudes decreased from 5.3 +/- 1.3 at baseline to 0.4 +/- 1.1 at RS 4 (P = 0.003) in only the mida/remi group. We conclude that ERPs in volunteers sedated with dex/remi, in contrast to mida/remi, indicate a cortical response to acoustic stimuli, even when sedation reaches deeper levels. Consequently, ERP can monitor sedation with midazolam but not with dexmedetomidine. The reverse is true for BIS.

Dissociated lateralization of transient and sustained blood oxygen level-dependent signal components in human primary auditory cortex

Among other auditory operations, the analysis of different sound levels received at both ears is fundamental for the localization of a sound source. These so-called interaural level differences, in animals, are coded by excitatory-inhibitory neurons yielding asymmetric hemispheric activity patterns with acoustic stimuli having maximal interaural level differences. In human auditory cortex, the temporal blood oxygen level-dependent (BOLD) response to auditory inputs, as measured by functional magnetic resonance imaging (fMRI), consists of at least two independent components: an initial transient and a subsequent sustained signal, which, on a different time scale, are consistent with electrophysiological human and animal response patterns. However, their specific functional role remains unclear. Animal studies suggest these temporal components being based on different neural networks and having specific roles in representing the external acoustic environment. Here we hypothesized that the transient and sustained response constituents are differentially involved in coding interaural level differences and therefore play different roles in spatial information processing. Healthy subjects underwent monaural and binaural acoustic stimulation and BOLD responses were measured using high signal-to-noise-ratio fMRI. In the anatomically segmented Heschl's gyrus the transient response was bilaterally balanced, independent of the side of stimulation, while in opposite the sustained response was contralateralized. This dissociation suggests a differential role at these two independent temporal response components, with an initial bilateral transient signal subserving rapid sound detection and a subsequent lateralized sustained signal subserving detailed sound characterization.

Differential patterns of multisensory interactions in core and belt areas of human auditory cortex

The auditory cortex is anatomically segregated into a central core and a peripheral belt region, which exhibit differences in preference to bandpassed noise and in temporal patterns of response to acoustic stimuli. While it has been shown that visual stimuli can modify response magnitude in auditory cortex, little is known about differential patterns of multisensory interactions in core and belt. Here, we used functional magnetic resonance imaging and examined the influence of a short visual stimulus presented prior to acoustic stimulation on the spatial pattern of blood oxygen level-dependent signal response in auditory cortex. Consistent with crossmodal inhibition, the light produced a suppression of signal response in a cortical region corresponding to the core. In the surrounding areas corresponding to the belt regions, however, we found an inverse modulation with an increasing signal in centrifugal direction. Our data suggest that crossmodal effects are differentially modulated according to the hierarchical core-belt organization of auditory cortex.

Enhancing BOLD response in the auditory system by neurophysiologically tuned fMRI sequence

Auditory neuroscience has not tapped fMRI's full potential because of acoustic scanner noise emitted by the gradient switches of conventional echoplanar fMRI sequences. The scanner noise is pulsed, and auditory cortex is particularly sensitive to pulsed sounds. Current fMRI approaches to avoid stimulus-noise interactions are temporally inefficient. Since the sustained BOLD response to pulsed sounds decreases with repetition rate and becomes minimal with unpulsed sounds, we developed an fMRI sequence emitting continuous rather than pulsed gradient sound by implementing a novel quasi-continuous gradient switch pattern. Compared to conventional fMRI, continuous-sound fMRI reduced auditory cortex BOLD baseline and increased BOLD amplitude with graded sound stimuli, short sound events, and sounds as complex as orchestra music with preserved temporal resolution. Response in subcortical auditory nuclei was enhanced, but not the response to light in visual cortex. Finally, tonotopic mapping using continuous-sound fMRI demonstrates that enhanced functional signal-to-noise in BOLD response translates into improved spatial separability of specific sound representations.

Anxiety trait modulates psychophysiological reactions, but not habituation processes related to affective auditory stimuli

BACKGROUND: It is well known that there are specific peripheral activation patterns associated with the emotional valence of sounds. However, it is unclear how these effects adapt over time. The personality traits influencing these processes are also not clear. Anxiety disorders influence the autonomic activation related to emotional processing. However, personality anxiety traits have never been studied in the context of affective auditory stimuli. METHODS: Heart rate, skin conductance, zygomatic muscle activity and subjective rating of emotional valence and arousal were recorded in healthy subjects during the presentation of pleasant, unpleasant, and neutral sounds. Recordings were repeated 1 week later to examine possible time-dependent changes related to habituation and sensitization processes. RESULTS AND CONCLUSION: There was not a generalized habituation or sensitization process related to the repeated presentation of affective sounds, but rather, specific adaptation processes for each physiological measure. These observations are consistent with previous studies performed with affective pictures and simple tones. Thus, the measures of skin conductance activity showed the strongest changes over time, including habituation during the first presentation session and sensitization at the end of the second presentation session, whereas the facial electromyographic activity habituated only for the neutral stimuli and the heart rate did not habituate at all. Finally, we showed that the measure of personality trait anxiety influenced the orienting reaction to affective sounds, but not the adaptation processes related to the repeated presentation of these sounds.

Brain responses to auditory and visual stimulus offset: Shared representations of temporal edges

Edges are crucial for the formation of coherent objects from sequential sensory inputs within a single modality. Moreover, temporally coincident boundaries of perceptual objects across different sensory modalities facilitate crossmodal integration. Here, we used functional magnetic resonance imaging in order to examine the neural basis of temporal edge detection across modalities. Onsets of sensory inputs are not only related to the detection of an edge but also to the processing of novel sensory inputs. Thus, we used transitions from input to rest (offsets) as convenient stimuli for studying the neural underpinnings of visual and acoustic edge detection per se. We found, besides modality-specific patterns, shared visual and auditory offset-related activity in the superior temporal sulcus and insula of the right hemisphere. Our data suggest that right hemispheric regions known to be involved in multisensory processing are crucial for detection of edges in the temporal domain across both visual and auditory modalities. This operation is likely to facilitate cross-modal object feature binding based on temporal coincidence. Hum Brain Mapp, 2008. (c) 2008 Wiley-Liss, Inc.

The spatiotemporal pattern of auditory cortical responses during verbal hallucinations

Functional magnetic resonance imaging (fMRI) studies can provide insight into the neural correlates of hallucinations. Commonly, such studies require self-reports about the timing of the hallucination events. While many studies have found activity in higher-order sensory cortical areas, only a few have demonstrated activity of the primary auditory cortex during auditory verbal hallucinations. In this case, using self-reports as a model of brain activity may not be sensitive enough to capture all neurophysiological signals related to hallucinations. We used spatial independent component analysis (sICA) to extract the activity patterns associated with auditory verbal hallucinations in six schizophrenia patients. SICA decomposes the functional data set into a set of spatial maps without the use of any input function. The resulting activity patterns from auditory and sensorimotor components were further analyzed in a single-subject fashion using a visualization tool that allows for easy inspection of the variability of regional brain responses. We found bilateral auditory cortex activity, including Heschl's gyrus, during hallucinations of one patient, and unilateral auditory cortex activity in two more patients. The associated time courses showed a large variability in the shape, amplitude, and time of onset relative to the self-reports. However, the average of the time courses during hallucinations showed a clear association with this clinical phenomenon. We suggest that detection of this activity may be facilitated by examining hallucination epochs of sufficient length, in combination with a data-driven approach.

[The model project "newborn auditory screening" in the Upper Palatinate: high process and result quality of an interdisciplinary concept]

BACKGROUND: In May 2003, a newborn auditory screening program was initiated in the Upper Palatinate. METHODS: Sequential OAE- and BERA-screening was conducted in all hospitals with obstetric facilities. The Screening Center at the Public Health Authority was responsible for the coordination of the screening process, completeness of participation, the follow-up of all subjects with a positive screening test and the quality of instrumental screening. RESULTS: A total of 96% of 17,469 newborns were screened. The referral rate at discharge was 1.6% (0.4% for bilateral positive findings). For 97% of the positive screening results, a definite diagnosis to confirm or exclude hearing loss was achieved; for 43% only after intervention by the Screening Center. Fifteen children with profound bilateral hearing impairment were identified of whom eight were only detected by the intervention of the Screening Center. CONCLUSION: The effective structures established in the Upper Palatinate provide a standard for the quality of neonatal auditory screening achievable in Germany.

Psychobiological responses to drug cues before and after methadone intake in heroin-dependent patients: A pilot study

Craving and stress frequently drive compulsive heroin use. Although methadone attenuates craving, drug-conditioned stimuli can trigger craving and possibly stress arousal in heroin-dependent patients receiving methadone maintenance. This study investigated drug cue-related craving, affectivity, and cortisol reactivity in 16 methadone-maintained patients before and after daily methadone. Unexpectedly, drug cues significantly increased craving after (t[15]=-4.27, p=0.001), but not before methadone intake. Patients displayed blunted cortisol response after post-methadone drug cues (t[15]=3.05, p=0.008) suggesting dissociated craving and cortisol reactivity after methadone intake of possible clinical relevance.

Differential distribution of stem cells in the auditory and vestibular organs of the inner ear

The adult mammalian cochlea lacks regenerative capacity, which is the main reason for the permanence of hearing loss. Vestibular organs, in contrast, replace a small number of lost hair cells. The reason for this difference is unknown. In this work we show isolation of sphere-forming stem cells from the early postnatal organ of Corti, vestibular sensory epithelia, the spiral ganglion, and the stria vascularis. Organ of Corti and vestibular sensory epithelial stem cells give rise to cells that express multiple hair cell markers and express functional ion channels reminiscent of nascent hair cells. Spiral ganglion stem cells display features of neural stem cells and can give rise to neurons and glial cell types. We found that the ability for sphere formation in the mouse cochlea decreases about 100-fold during the second and third postnatal weeks; this decrease is substantially faster than the reduction of stem cells in vestibular organs, which maintain their stem cell population also at older ages. Coincidentally, the relative expression of developmental and progenitor cell markers in the cochlea decreases during the first 3 postnatal weeks, which is in sharp contrast to the vestibular system, where expression of progenitor cell markers remains constant or even increases during this period. Our findings indicate that the lack of regenerative capacity in the adult mammalian cochlea is either a result of an early postnatal loss of stem cells or diminishment of stem cell features of maturing cochlear cells.

External auditory canal cholesteatoma: reassessment of and amendments to its categorization, pathogenesis, and treatment in 34 patients

OBJECTIVE: External auditory canal cholesteatoma (EACC) is a rarity. Although there have been numerous case reports, there are only few systematic analyses of case series, and the pathogenesis of idiopathic EACC remains enigmatic. STUDY DESIGN: In a tertiary referral center for a population of 1.5 million inhabitants, 34 patients with 35 EACC (13 idiopathic [1 bilateral] and 22 secondary) who were treated between 1994 and 2006 were included in the study. RESULTS: EACC cardinal symptoms were longstanding otorrhea (65%) and dull otalgia (12%). Focal bone destruction in the external auditory canal with retained squamous debris and an intact tympanic membrane were characteristic. Only 27% of the patients showed conductive hearing loss exceeding 20 dB. Patients with idiopathic EACC had lesions typically located on the floor of the external auditory canal and were older, and the mean smoking intensity was also greater (p < 0.05) compared with patients with secondary EACC. The secondary lesions were assigned to categories (poststenotic [n = 6], postoperative [n = 6], and posttraumatic EACC [n = 4]) and rare categories (radiogenic [n = 2], postinflammatory [n = 1], and postobstructive EACC [n = 1]). In addition, we describe 2 patients with EACC secondary to the complete remission of a Langerhans cell histiocytosis of the external auditory canal. Thirty of 34 patients were treated surgically and became all free of recurrence, even after extensive disease. DISCUSSION: For the development of idiopathic EACC, repeated microtrauma (e.g., microtrauma resulting from cotton-tipped applicator abuse or from hearing aids) and diminished microcirculation (e.g., from smoking) might be risk factors. A location other than in the inferior portion of the external auditory canal indicates a secondary form of the disease, as in the case of 2 patients with atypically located EACC after years of complete remission of Langerhans cell histiocytosis, which we consider as a new posttumorous category and specific late complication of this rare disease.

Incidence of auditory ossicle luxation and petrous bone fractures detected in post-mortem multislice computed tomography (MSCT)

As the auditory ossicles are difficult to display without harming them in conventional autopsies, lesions of these minute bones and the ossicular chain are regularly missed. In this study, the method of choice in clinical medicine for the examination of such lesions, namely multislice computed tomography, was applied to 100 corpses. The hereby obtained results regarding ossicle luxation and petrous bone fracture indicated that the lesions were not dependant on the amount, but rather on the type of energy inflicted to the head.