Processing of English words with fine acoustic contrasts and simple tones: A mismatch negativity study

The purpose of this study was to compare the robustness of the event-related potential (ERP) response, called the mismatch negativity (MMN), when elicited by simple tone stimuli (differing in frequency, duration, or intensity) and speech stimuli (CV nonword contrast /de:/ vs. /ge:/ and CV word contrast /deI/ vs. /geI/). The study was conducted using 30 young adult subjects (Groups A and B; n = 15 each). The speech stimuli were presented to Group A at a stimulus onset asynchrony (SOA) of 610 msec and to Group B at an SOA of 900 msec. The tone stimuli were presented to both groups at an SOA of 610 msec. MMN responses were elicited by the simple tone stimuli (66.7%-96.7% of subjects with MMN "present," or significantly different from zero, p < 0.05) but not the speech stimuli (10% subjects with MMN present for nonwords, 10% for words). The length of the SOA (610 msec or 900 msec) had no effect on the ability to obtain consistent MMN responses to the speech stimuli. The results indicated a lack of robust MMN elicited by speech stimuli with fine acoustic contrasts under carefully controlled methodological conditions. The implications of these results are discussed in relation to conflicting reports in the literature of speech-elicited MMNs, and the importance of appropriate methodological design in MMN studies investigating speech processing in normal and pathological populations.

The mismatch negativity (MMN) response to complex tones and spoken words in individuals with aphasia

Background: The mismatch negativity (MMN) is a fronto-centrally distributed event-related potential (ERP) that is elicited by any discriminable auditory change. It is an ideal neurophysiological tool for measuring the auditory processing skills of individuals with aphasia because it can be elicited even in the absence of attention. Previous MMN studies have shown that acoustic processing of tone or pitch deviance is relatively preserved in aphasia, whereas the basic acoustic processing of speech stimuli can be impaired (e.g., auditory discrimination). However, no MMN study has yet investigated the higher levels of auditory processing, such as language-specific phonological and/or lexical processing, in individuals with aphasia. Aims: The aim of the current study was to investigate the MMN response of normal and language-disordered subjects to tone stimuli and speech stimuli that incorporate the basic auditory processing (acoustic, acoustic-phonetic) levels of non-speech and speech sound processing, and also the language-specific phonological and lexical levels of spoken word processing. Furthermore, this study aimed to correlate the aphasic MMN data with language performance on a variety of tasks specifically targeted at the different levels of spoken word processing. Methods M Procedures: Six adults with aphasia (71.7 years +/- 3.0) and six healthy age-, gender-, and education-matched controls (72.2 years +/- 5.4) participated in the study. All subjects were right-handed and native speakers of English. Each subject was presented with complex harmonic tone stimuli, differing in pitch or duration, and consonant-vowel (CV) speech stimuli (non-word /de:/versus real world/deI/). The probability of the deviant for each tone or speech contrast was 10%. The subjects were also presented with the same stimuli in behavioural discrimination tasks, and were administered a language assessment battery to measure their auditory comprehension skills. Outcomes O Results: The aphasic subjects demonstrated attenuated MMN responses to complex tone duration deviance and to speech stimuli (words and non-words), and their responses to the frequency, duration, and real word deviant stimuli were found to strongly correlate with performance on the auditory comprehension section of the Western Aphasia Battery (WAB). Furthermore, deficits in attentional lexical decision skills demonstrated by the aphasic subjects correlated with a word-related enhancement demonstrated during the automatic MMN paradigm, providing evidence to support the word advantage effect, thought to reflect the activation of language-specific memory traces in the brain for words. Conclusions: These results indicate that the MMN may be used as a technique for investigating general and more specific auditory comprehension skills of individuals with aphasia, using speech and/or non-speech stimuli, independent of the individual's attention. The combined use of the objective MMN technique and current clinical language assessments may result in improved rehabilitative management of aphasic individuals.

Abnormality of mismatch negativity in response to tone omission in dyslexic adults

Evidence of abnormalities in the perception of rapidly presented sounds in dyslexia has been interpreted as evidence of a prolonged time window within which sounds can influence the perception of temporally surrounding sounds. We recorded the magnetic mismatch negativity (MMNm) to infrequent tone omissions in a group of six dyslexic adults and six IQ and age-matched controls. An MMNm is only elicited in response to a complete stimulus omission when successive inputs fall within the temporal window of integration (stimulus onset asynchrony (SOA) ∼160 ms). No MMNm responses were recorded in either experimental group when stimuli were presented at SOAs falling just outside the temporal window of integration (SOA = 175 ms). However, while presentation rates of 100 ms resulted in MMNm responses for all control participants, the same stimulus omissions elicited an MMNm response in only one of the six dyslexic participants. These results cannot support the hypothesis of a prolonged time window of integration, but rather indicate auditory grouping deficits in the dyslexic population. © 2006 Elsevier B.V. All rights reserved.

Functional neuroanatomy of auditory mismatch processing : an event-related fMRI study of duration-deviant oddballs

This study was designed to identify the neural networks underlying automatic auditory deviance detection in 10 healthy subjects using functional magnetic resonance imaging. We measured blood oxygenation level-dependent contrasts derived from the comparison of blocks of stimuli presented as a series of standard tones (50 ms duration) alone versus blocks that contained rare duration-deviant tones (100 ms) that were interspersed among a series of frequent standard tones while subjects were watching a silent movie. Possible effects of scanner noise were assessed by a “no tone” condition. In line with previous positron emission tomography and EEG source modeling studies, we found temporal lobe and prefrontal cortical activation that was associated with auditory duration mismatch processing. Data were also analyzed employing an event-related hemodynamic response model, which confirmed activation in response to duration-deviant tones bilaterally in the superior temporal gyrus and prefrontally in the right inferior and middle frontal gyri. In line with previous electrophysiological reports, mismatch activation of these brain regions was significantly correlated with age. These findings suggest a close relationship of the event-related hemodynamic response pattern with the corresponding electrophysiological activity underlying the event-related “mismatch negativity” potential, a putative measure of auditory sensory memory.

The potential for new understandings of normal and abnormal cognition by integration of neuroimaging and behavioral data : Not an exercise in carrying coals to Newcastle

Discovering the means to prevent and cure schizophrenia is a vision that motivates many scientists. But in order to achieve this goal, we need to understand its neurobiological basis. The emergent metadiscipline of cognitive neuroscience fields an impressive array of tools that can be marshaled towards achieving this goal, including powerful new methods of imaging the brain (both structural and functional) as well as assessments of perceptual and cognitive capacities based on psychophysical procedures, experimental tasks and models developed by cognitive science. We believe that the integration of data from this array of tools offers the greatest possibilities and potential for advancing understanding of the neural basis of not only normal cognition but also the cognitive impairments that are fundamental to schizophrenia. Since sufficient expertise in the application of these tools and methods rarely reside in a single individual, or even a single laboratory, collaboration is a key element in this endeavor. Here, we review some of the products of our integrative efforts in collaboration with our colleagues on the East Coast of Australia and Pacific Rim. This research focuses on the neural basis of executive function deficits and impairments in early auditory processing in patients using various combinations of performance indices (from perceptual and cognitive paradigms), ERPs, fMRI and sMRI. In each case, integration of two or more sources of information provides more information than any one source alone by revealing new insights into structure-function relationships. Furthermore, the addition of other imaging methodologies (such as DTI) and approaches (such as computational models of cognition) offers new horizons in human brain imaging research and in understanding human behavior.

Cortical processing of speech and non-speech sounds in adults and newborns

Comprehension of a complex acoustic signal - speech - is vital for human communication, with numerous brain processes required to convert the acoustics into an intelligible message. In four studies in the present thesis, cortical correlates for different stages of speech processing in a mature linguistic system of adults were investigated. In two further studies, developmental aspects of cortical specialisation and its plasticity in adults were examined. In the present studies, electroencephalographic (EEG) and magnetoencephalographic (MEG) recordings of the mismatch negativity (MMN) response elicited by changes in repetitive unattended auditory events and the phonological mismatch negativity (PMN) response elicited by unexpected speech sounds in attended speech inputs served as the main indicators of cortical processes. Changes in speech sounds elicited the MMNm, the magnetic equivalent of the electric MMN, that differed in generator loci and strength from those elicited by comparable changes in non-speech sounds, suggesting intra- and interhemispheric specialisation in the processing of speech and non-speech sounds at an early automatic processing level. This neuronal specialisation for the mother tongue was also reflected in the more efficient formation of stimulus representations in auditory sensory memory for typical native-language speech sounds compared with those formed for unfamiliar, non-prototype speech sounds and simple tones. Further, adding a speech or non-speech sound context to syllable changes was found to modulate the MMNm strength differently in the left and right hemispheres. Following the acoustic-phonetic processing of speech input, phonological effort related to the selection of possible lexical (word) candidates was linked with distinct left-hemisphere neuronal populations. In summary, the results suggest functional specialisation in the neuronal substrates underlying different levels of speech processing. Subsequently, plasticity of the brain's mature linguistic system was investigated in adults, in whom representations for an aurally-mediated communication system, Morse code, were found to develop within the same hemisphere where representations for the native-language speech sounds were already located. Finally, recording and localization of the MMNm response to changes in speech sounds was successfully accomplished in newborn infants, encouraging future MEG investigations on, for example, the state of neuronal specialisation at birth.

Sensory auditory processing and intuitive sound detection : an investigation of musical experts and nonexperts

The auditory system can detect occasional changes (deviants) in acoustic regularities without the need for subjects to focus their attention on the sound material. Deviant detection is reflected in the elicitation of the mismatch negativity component (MMN) of the event-related potentials. In the studies presented in this thesis, the MMN is used to investigate the auditory abilities for detecting similarities and regularities in sound streams. To investigate the limits of these processes, professional musicians have been tested in some of the studies. The results show that auditory grouping is already more advanced in musicians than in nonmusicians and that the auditory system of musicians can, unlike that of nonmusicians, detect a numerical regularity of always four tones in a series. These results suggest that sensory auditory processing in musicians is not only a fine tuning of universal abilities, but is also qualitatively more advanced than in nonmusicians. In addition, the relationship between the auditory change-detection function and perception is examined. It is shown that, contrary to the generally accepted view, MMN elicitation does not necessarily correlate with perception. The outcome of the auditory change-detection function can be implicit and the implicit knowledge of the sound structure can, after training, be utilized for behaviorally correct intuitive sound detection. These results illustrate the automatic character of the sensory change detection function.

Cortical representations for phonological quantity

Different languages use temporal speech cues in different linguistic functions. In Finnish, speech-sound duration is used as the primary cue for the phonological quantity distinction ― i.e., a distinction between short and long phonemes. For the second-language (L2) learners of Finnish, quantity is often difficult to master if speech-sound duration plays a less important role in the phonology of their native language (L1). The present studies aimed to investigate the cortical representations for phonological quantity in native speakers and L2 users of Finnish by using behavioral and electrophysiological methods. Since long-term memory representations for different speech units have been previously shown to participate in the elicitation of the mismatch negativity (MMN) brain response, MMN was used to compare the neural representation for quantity between native speakers and L2 users of Finnish. The results of the studies suggested that native Finnish speakers' MMN response to quantity was determined by the activation of native-language phonetic prototypes rather than by phoneme boundaries. In addition, native speakers seemed to process phoneme quantity and quality independently from each other by separate brain representations. The cross-linguistic MMN studies revealed that, in native speakers of Finnish, the MMN response to duration or quantity-degree changes was enhanced in amplitude selectively in speech sounds, whereas this pattern was not observed in L2 users. Native speakers' MMN enhancement is suggested to be due to the pre-attentive activation of L1 prototypes for quantity. In L2 users, the activation of L2 prototypes or other L2 learning effects were not reflected in the MMN, with one exception. Even though L2 users failed to show native-like brain responses to duration changes in a vowel that was similar in L1 and L2, their duration MMN response was native-like for an L2 vowel with no counterpart in L1. Thus, the pre-attentive activation of L2 users' representations was determined by the degree of similarity of L2 sounds to L1 sounds. In addition, behavioral experiments suggested that the establishment of representations for L2 quantity may require several years of language exposure.

Processing of Stimulus Repetition and Change in the Somatosensory System: Recordings of Electrical and Magnetic Brain Responses

In the present work, effects of stimulus repetition and change in a continuous stimulus stream on the processing of somatosensory information in the human brain were studied. Human scalp-recorded somatosensory event-related potentials (ERPs) and magnetoencephalographic (MEG) responses rapidly diminished with stimulus repetition when mechanical or electric stimuli were applied to fingers. On the contrary, when the ERPs and multi-unit a ctivity (MUA) were directly recorded from the primary (SI) and secondary (SII) somatosensory cortices in a monkey, there was no marked decrement in the somatosensory responses as a function of stimulus repetition. These results suggest that this rate effect is not due to the response diminution in the SI and SII cortices. Obviously the responses to the first stimulus after a long "silent" period are nhanced due to unspecific initial orientation, originating in more broadly distributed and/or deeper neural structures, perhaps in the prefrontal cortices. With fast repetition rates not only the late unspecific but also some early specific somatosensory ERPs were diminished in amplitude. The fast decrease of the ERPs as a function of stimulus repetition is mainly due to the disappearance of the orientation effect and with faster repetition rates additively due to stimulus specific refractoriness. A sudden infrequent change in the continuous stimulus stream also enhanced somatosensory MEG responses to electric stimuli applied to different fingers. These responses were quite similar to those elicited by the deviant stimuli alone when the frequent standard stimuli were omitted. This enhancement was obviously due to the release from refractoriness because the neural structures generating the responses to the infrequent deviants had more time to recover from the refractoriness than the respective structures for the standards. Infrequent deviant mechanical stimuli among frequent standard stimuli also enhanced somatosensory ERPs and, in addition, they elicited a new negative wave which did not occur in the deviants-alone condition. This extra negativity could be recorded to deviations in the stimulation site and in the frequency of the vibratory stimuli. This response is probably a somatosensory analogue of the auditory mismatch negativity (MMN) which has been suggested to reflect a neural mismatch process between the sensory input and the sensory memory trace.

Neurochemical regulation of auditory information processing studied with EEG/MEG: application to schizophrenia

Cognitive impairments of attention, memory and executive functions are a fundamental feature of the pathophysiology of schizophrenia. The neurophysiological and neurochemical changes in the auditory cortex are shown to underlie cognitive impairmentsin schizophrenia patients. Functional state of the neural substrate of auditory information processing could be objectively and non-invasively probed with auditory event-related potentials (ERPs) and event- related fields (ERFs). In the current work, we explored the neurochemical effect on the neural origins of auditory information processing in relation to schizophrenia. By means of ERPs/ERFs we aimed to determine how neural substrates of auditory information processing are modulated by antipsychotic medication in schizophrenia spectrum patients (Studies I, II) and by neuropharmacological challenges in healthy human subjects (Studies III, IV). First, with auditory ERPs we investigated the effects of olanzapine (Study I) and risperidone (Study II) in a group of patients with schizophrenia spectrum disorders. After 2 and 4 weeks of treatment, olanzapine has no significant effects on mismatch negativity(MMN) and P300, which, as it has been suggested, respectively reflect preattentive and attention-dependent information processing. After 2 weeks of treatment, risperidone has no significant effect on P300, however risperidone reduces P200 amplitude. This latter effect of risperidone on neural resources responsible for P200 generation could be partly explained through the action of dopamine. Subsequently, we used simultaneous EEG/MEG to investigate the effects of memantine (Study III) and methylphenidate (Study IV) in healthy subjects. We found that memantine modulates MMN response without changing other ERP components. This could be interpreted as being due to the possible influence of memantine through the NMDA receptors on auditory change- detection mechanism, with processing of auditory stimuli remaining otherwise unchanged. Further, we found that methylphenidate does not modulate the MMN response. This finding could indicate no association between catecholaminergic activities and electrophysiological measures of preattentive auditory discrimination processes reflected in the MMN. However, methylphenidate decreases the P200 amplitudes. This could be interpreted as a modulation of auditory information processing reflected in P200 by dopaminergic and noradrenergic systems. Taken together, our set of studies indicates a complex pattern of neurochemical influences produced by the antipsychotic drugs in the neural substrate of auditory information processing in patients with schizophrenia spectrum disorders and by the pharmacological challenges in healthy subjects studied with ERPs and ERFs.

Aivojen jännitevasteiden rekisteröinti useaan äänen piirteeseen yhdellä mittauskerralla terveillä musiikkileikkikoulua käyvillä kaksivuotiailla

The early detection of hearing deficits is important to a child's development. However, examining small children with behavioural methods is often difficult. Research with ERPs (event-related potentials), recorded with EEG (electroencephalography), does not require attention or action from the child. Especially in children's ERP research, it is essential that the duration of a recording session is not too long. A new, faster optimum paradigm has been developed to record MMN (mismatch negativity), where ERPs to several sound features can be recorded in one recording session. This substantially shortens the time required for the experiment. So far, the new paradigm has been used in adult and school-aged children research. This study examines if MMN, LDN (late discriminative negativity) and P3a components can be recorded in two-year-olds with the new paradigm. The standard stimulus (p=0.50) was an 80 dB harmonic tone consisting of three harmonic frequencies (500 Hz, 1000 Hz and 1500 Hz) with a duration of 200 ms. The loudness deviants (p=0.067) were at a level of +6 dB or -6 dB compared to the standards. The frequency deviants (p=0.112) had a fundamental frequency of 550 or 454.4 Hz (small deviation), 625 or 400 Hz (medium deviation) or 750 or 333.3 Hz (large deviation). The duration deviants (p=0.112) had a duration of 175 ms (small deviation), 150 ms (medium deviation) or 100 ms (large deviation). The direction deviants (p=0.067) were presented from the left or right loudspeaker only. The gap deviant (p=0.067) included a 5-ms silent gap in the middle of the sound. Altogether 17 children participated in the experiment, of whom the data of 12 children was used in the analysis. ERP components were observed for all deviant types. The MMN was significant for duration and gap deviants. The LDN was significant for the large duration deviant and all other deviant types. No significant P3a was observed. These results indicate that the optimum paradigm can be used with two-year-olds. With this paradigm, data on several sound features can be recorded in a shorter time than with the previous paradigms used in ERP research.

Opioid dependence: Brain structure and function : a magnetic resonance imaging, neuropsychological, and electromagnetic study

Background: Opiod dependence is a chronic severe brain disorder associated with enormous health and social problems. The relapse back to opioid abuse is very high especially in early abstinence, but neuropsychological and neurophysiological deficits during opioid abuse or soon after cessation of opioids are scarcely investigated. Also the structural brain changes and their correlations with the length of opioid abuse or abuse onset age are not known. In this study the cognitive functions, neural basis of cognitive dysfunction, and brain structural changes was studied in opioid-dependent patients and in age and sex matched healthy controls. Materials and methods: All subjects participating in the study, 23 opioid dependents of whom, 15 were also benzodiazepine and five cannabis co-dependent and 18 healthy age and sex matched controls went through Structured Clinical Interviews (SCID) to obtain DSM-IV axis I and II diagnosis and to exclude psychiatric illness not related to opioid dependence or personality disorders. Simultaneous magnetoencephalography (MEG) and electroencephalography (EEG) measurements were done on 21 opioid-dependent individuals on the day of hospitalization for withdrawal therapy. The neural basis of auditory processing was studied and pre-attentive attention and sensory memory were investigated. During the withdrawal 15 opioid-dependent patients participated in neuropsychological tests, measuring fluid intelligence, attention and working memory, verbal and visual memory, and executive functions. Fifteen healthy subjects served as controls for the MEG-EEG measurements and neuropsychological assessment. The brain magnetic resonance imaging (MRI) was obtained from 17 patients after approximately two weeks abstinence, and from 17 controls. The areas of different brain structures and the absolute and relative volumes of cerebrum, cerebral white and gray matter, and cerebrospinal fluid (CSF) spaces were measured and the Sylvian fissure ratio (SFR) and bifrontal ratio were calculated. Also correlation between the cerebral measures and neuropsychological performance was done. Results: MEG-EEG measurements showed that compared to controls the opioid-dependent patients had delayed mismatch negativity (MMN) response to novel sounds in the EEG and P3am on the contralateral hemisphere to the stimulated ear in MEG. The equivalent current dipole (ECD) of N1m response was stronger in patients with benzodiazepine co-dependence than those without benzodiazepine co-dependence or controls. In early abstinence the opioid dependents performed poorer than the controls in tests measuring attention and working memory, executive function and fluid intelligence. Test results of the Culture Fair Intelligence Test (CFIT), testing fluid intelligence, and Paced Auditory Serial Addition Test (PASAT), measuring attention and working memory correlated positively with the days of abstinence. MRI measurements showed that the relative volume of CSF was significantly larger in opioid dependents, which could also be seen in visual analysis. Also Sylvian fissures, expressed by SFR were wider in patients, which correlated negatively with the age of opioid abuse onset. In controls the relative gray matter volume had a positive correlation with composite cognitive performance, but this correlation was not found in opioid dependents in early abstinence. Conclusions: Opioid dependents had wide Sylvian fissures and CSF spaces indicating frontotemporal atrophy. Dilatation of Sylvian fissures correlated with the abuse onset age. During early withdrawal cognitive performance of opioid dependents was impaired. While intoxicated the pre-attentive attention to novel stimulus was delayed and benzodiazepine co-dependence impaired sound detection. All these changes point to disturbances on frontotemporal areas.