Affective and linguistic processing of speech prosody: DC potential studies

Speech melody or prosody subserves linguistic, emotional, and pragmatic functions in speech communication. Prosodic perception is based on the decoding of acoustic cues with a predominant function of frequency-related information perceived as speaker's pitch. Evaluation of prosodic meaning is a cognitive function implemented in cortical and subcortical networks that generate continuously updated affective or linguistic speaker impressions. Various brain-imaging methods allow delineation of neural structures involved in prosody processing. In contrast to functional magnetic resonance imaging techniques, DC (direct current, slow) components of the EEG directly measure cortical activation without temporal delay. Activation patterns obtained with this method are highly task specific and intraindividually reproducible. Studies presented here investigated the topography of prosodic stimulus processing in dependence on acoustic stimulus structure and linguistic or affective task demands, respectively. Data obtained from measuring DC potentials demonstrated that the right hemisphere has a predominant role in processing emotions from the tone of voice, irrespective of emotional valence. However, right hemisphere involvement is modulated by diverse speech and language-related conditions that are associated with a left hemisphere participation in prosody processing. The degree of left hemisphere involvement depends on several factors such as (i) articulatory demands on the perceiver of prosody (possibly, also the poser), (ii) a relative left hemisphere specialization in processing temporal cues mediating prosodic meaning, and (iii) the propensity of prosody to act on the segment level in order to modulate word or sentence meaning. The specific role of top-down effects in terms of either linguistically or affectively oriented attention on lateralization of stimulus processing is not clear and requires further investigations.

Internet video telephony allows speech reading by deaf individuals and improves speech perception by cochlear implant users

OBJECTIVE To analyze speech reading through Internet video calls by profoundly hearing-impaired individuals and cochlear implant (CI) users. METHODS Speech reading skills of 14 deaf adults and 21 CI users were assessed using the Hochmair Schulz Moser (HSM) sentence test. We presented video simulations using different video resolutions (1280 × 720, 640 × 480, 320 × 240, 160 × 120 px), frame rates (30, 20, 10, 7, 5 frames per second (fps)), speech velocities (three different speakers), webcameras (Logitech Pro9000, C600 and C500) and image/sound delays (0-500 ms). All video simulations were presented with and without sound and in two screen sizes. Additionally, scores for live Skype™ video connection and live face-to-face communication were assessed. RESULTS Higher frame rate (>7 fps), higher camera resolution (>640 × 480 px) and shorter picture/sound delay (<100 ms) were associated with increased speech perception scores. Scores were strongly dependent on the speaker but were not influenced by physical properties of the camera optics or the full screen mode. There is a significant median gain of +8.5%pts (p = 0.009) in speech perception for all 21 CI-users if visual cues are additionally shown. CI users with poor open set speech perception scores (n = 11) showed the greatest benefit under combined audio-visual presentation (median speech perception +11.8%pts, p = 0.032). CONCLUSION Webcameras have the potential to improve telecommunication of hearing-impaired individuals.

Statistical Learning, Syllable Processing, and Speech Production in Healthy Hearing and Hearing-Impaired Preschool Children: A Mismatch Negativity Study

OBJECTIVES The objectives of the present study were to investigate temporal/spectral sound-feature processing in preschool children (4 to 7 years old) with peripheral hearing loss compared with age-matched controls. The results verified the presence of statistical learning, which was diminished in children with hearing impairments (HIs), and elucidated possible perceptual mediators of speech production. DESIGN Perception and production of the syllables /ba/, /da/, /ta/, and /na/ were recorded in 13 children with normal hearing and 13 children with HI. Perception was assessed physiologically through event-related potentials (ERPs) recorded by EEG in a multifeature mismatch negativity paradigm and behaviorally through a discrimination task. Temporal and spectral features of the ERPs during speech perception were analyzed, and speech production was quantitatively evaluated using speech motor maximum performance tasks. RESULTS Proximal to stimulus onset, children with HI displayed a difference in map topography, indicating diminished statistical learning. In later ERP components, children with HI exhibited reduced amplitudes in the N2 and early parts of the late disciminative negativity components specifically, which are associated with temporal and spectral control mechanisms. Abnormalities of speech perception were only subtly reflected in speech production, as the lone difference found in speech production studies was a mild delay in regulating speech intensity. CONCLUSIONS In addition to previously reported deficits of sound-feature discriminations, the present study results reflect diminished statistical learning in children with HI, which plays an early and important, but so far neglected, role in phonological processing. Furthermore, the lack of corresponding behavioral abnormalities in speech production implies that impaired perceptual capacities do not necessarily translate into productive deficits.

The effect of arts speech therapy on cerebral oxygenation and low frequency hemodynamic oscillations measured using functional near-infrared spectroscopy

Introduction: As a previous study revealed, arts speech therapy (AST) affects cardiorespiratory interaction [1]. The aim of the present study was to investigate whether AST also has effects on brain oxygenation and hemodynamics measured non-invasively using near-infrared spectroscopy (NIRS). Material and methods: NIRS measurements were performed on 17 subjects (8 men and 9 women, mean age: 35.6 ± 12.7 y) during AST. Each measurement lasted 35 min, comprising 8 min pre-baseline, 10 min recitation and 20 min post-baseline. For each subject, measurements were performed for three different AST recitation tasks (recitation of alliterative, hexameter and prose verse). Relative concentration changes of oxyhemoglobin (Δ[O2Hb]) and deoxyhemoglobin (Δ[HHb]) as well as the tissue oxygenation index (TOI) were measured using a Hamamatsu NIRO300 NIRS device and a sensor placed on the subjects forehead. Movement artifacts were removed using a novel method [2]. Statistical analysis (Wilcoxon test) was applied to the data to investigate (i) if the recitation causes changes in the median values and/or in the Mayer wave power spectral density (MW-PSD, range: 0.07–0.13 Hz) of Δ[O2Hb], Δ[HHb] or TOI, and (ii) if these changes vary between the 3 recitation forms. Results: For all three recitation styles a significant (p < 0.05) decrease in Δ[O2Hb] and TOI was found, indicating a decrease in blood flow. These decreases did not vary significantly between the three styles. MW-PSD increased significantly for Δ[O2Hb] when reciting the hexameter and prose verse, and for Δ[HHb] and TOI when reciting alliterations and hexameter, representing an increase in Mayer waves. The MW-PSD increase for Δ[O2Hb] was significantly larger for the hexameter verse compared to alliterative and prose verse Conclusion: The study showed that AST affects brain hemodynamics (oxygenation, blood flow and Mayer waves). Recitation caused a significant decrease in cerebral blood flow for all recitation styles as well as an increase in Mayer waves, particularly for the hexameter, which may indicate a sympathetic activation. References 1. D. Cysarz, D. von Bonin, H. Lackner, P. Heusser, M. Moser, H. Bettermann. Am J Physiol Heart Circ Physiol, 287 (2) (2004), pp. H579–H587 2. F. Scholkmann, S. Spichtig, T. Muehlemann, M. Wolf. Physiol Meas, 31 (5) (2010), pp. 649–662

The near babylonian speech confusion in early detection of psychosis

It is barely 15 years since, in 1996, the issue theme of Schizophrenia Bulletin (Vol 22, 2) “Early Detection, and Intervention in Schizophrenia” signified the commencement of this field of research. Since that time the field of early detection research has developed rapidly and it may be translated into clinical practice by the introduction of an Attenuated Psychosis Syndrome in Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, (DSM-5) (www.dsm5.org/ProposedRevisions/Pages/proposedrevision.aspx?rid=412#). Attenuated psychotic symptoms (APS) had first been suggested as a clinical predictor of first-episode psychosis by the Personal Assessment and Crisis Evaluation (PACE) Clinic group as part of the ultrahigh risk (UHR) criteria.1 The term ultrahigh risk became broadly accepted for this set of criteria for imminent risk of developing psychosis in the late 1990s. The use of the term “prodrome” for a state characterized by at-risk (AR) criteria was criticized as a retrospective concept inevitably followed by the full-blown disorder.1 Although alternative terms have been suggested, prodrome is still used in prospective studies (eg, prodromally symptomatic, potentially or putatively prodromal, prodrome-like state/symptoms). Some alternative suggestions such as prepsychotic state/symptoms, subthreshold psychotic symptoms, early psychosis, subsyndromal psychosis, hypopsychosis, or subpsychosis were short-lived. Other terms still in use include UHR, at-risk mental state (ARMS), AR, high risk, clinical high risk (CHR), or early and late AR state. Further, the term psychotic-like experiences (PLEs) has recently (re-)entered early detection research. …

Assessment of speech perception and communication skills in adolescents with cochlear implants for pre- and peri-lingual deafness

This study aimed to assess speech perception and communication skills in adolescents between ages 8 and 18 that received cochlear implants for pre- and peri-lingual deafness.

Changes in hemodynamics and tissue oxygenation saturation in the brain and skeletal muscle induced by speech therapy - a near-infrared spectroscopy study

Arts speech therapy (AST) is a therapeutic method within complementary medicine and has been practiced for decades for various medical conditions. It comprises listening and the recitation of different forms of speech exercises under the guidance of a licensed speech therapist. The aim of our study was to noninvasively investigate whether different types of recitation influence hemodynamics and oxygenation in the brain and skeletal leg muscle using near-infrared spectroscopy (NIRS). Seventeen healthy volunteers (eight men and nine women, mean age ± standard deviation 35.6 ± 12.7 years) were enrolled in the study. Each subject was measured three times on different days with the different types of recitation: hexameter, alliteration, and prose verse. Before, during, and after recitation, relative concentration changes of oxyhemoglobin (Δ[O2Hb]), deoxyhemoglobin (Δ[HHb]), total hemoglobin (Δ[tHb]), and tissue oxygenation saturation (StO2) were measured in the brain and skeletal leg muscle using a NIRS device. The study was performed with a randomized crossover design. Significant concentration changes were found during recitation of all verses, with mainly a decrease in Δ[O2Hb] and ΔStO2 in the brain, and an increase in Δ[O2Hb] and Δ[tHb] in the leg muscle during recitation. After the recitations, significant changes were mainly increases of Δ[HHb] and Δ[tHb] in the calf muscle. The Mayer wave spectral power (MWP) was also significantly affected, i.e., mainly the MWP of the Δ[O2Hb] and Δ[tHb] increased in the brain during recitation of hexameter and prose verse. The changes in MWP were also significantly different between hexameter and alliteration, and hexameter and prose. Possible physiological explanations for these changes are discussed. A probable reason is a different effect of recitations on the sympathetic nervous system. In conclusion, these changes show that AST has relevant effects on the hemodynamics and oxygenation of the brain and muscle.