Statistical Learning, Syllable Processing, and Speech Production in Healthy Hearing and Hearing-Impaired Preschool Children: A Mismatch Negativity Study

OBJECTIVES The objectives of the present study were to investigate temporal/spectral sound-feature processing in preschool children (4 to 7 years old) with peripheral hearing loss compared with age-matched controls. The results verified the presence of statistical learning, which was diminished in children with hearing impairments (HIs), and elucidated possible perceptual mediators of speech production. DESIGN Perception and production of the syllables /ba/, /da/, /ta/, and /na/ were recorded in 13 children with normal hearing and 13 children with HI. Perception was assessed physiologically through event-related potentials (ERPs) recorded by EEG in a multifeature mismatch negativity paradigm and behaviorally through a discrimination task. Temporal and spectral features of the ERPs during speech perception were analyzed, and speech production was quantitatively evaluated using speech motor maximum performance tasks. RESULTS Proximal to stimulus onset, children with HI displayed a difference in map topography, indicating diminished statistical learning. In later ERP components, children with HI exhibited reduced amplitudes in the N2 and early parts of the late disciminative negativity components specifically, which are associated with temporal and spectral control mechanisms. Abnormalities of speech perception were only subtly reflected in speech production, as the lone difference found in speech production studies was a mild delay in regulating speech intensity. CONCLUSIONS In addition to previously reported deficits of sound-feature discriminations, the present study results reflect diminished statistical learning in children with HI, which plays an early and important, but so far neglected, role in phonological processing. Furthermore, the lack of corresponding behavioral abnormalities in speech production implies that impaired perceptual capacities do not necessarily translate into productive deficits.

Abnormality of mismatch negativity in response to tone omission in dyslexic adults

Evidence of abnormalities in the perception of rapidly presented sounds in dyslexia has been interpreted as evidence of a prolonged time window within which sounds can influence the perception of temporally surrounding sounds. We recorded the magnetic mismatch negativity (MMNm) to infrequent tone omissions in a group of six dyslexic adults and six IQ and age-matched controls. An MMNm is only elicited in response to a complete stimulus omission when successive inputs fall within the temporal window of integration (stimulus onset asynchrony (SOA) ∼160 ms). No MMNm responses were recorded in either experimental group when stimuli were presented at SOAs falling just outside the temporal window of integration (SOA = 175 ms). However, while presentation rates of 100 ms resulted in MMNm responses for all control participants, the same stimulus omissions elicited an MMNm response in only one of the six dyslexic participants. These results cannot support the hypothesis of a prolonged time window of integration, but rather indicate auditory grouping deficits in the dyslexic population. © 2006 Elsevier B.V. All rights reserved.

The potential for new understandings of normal and abnormal cognition by integration of neuroimaging and behavioral data : Not an exercise in carrying coals to Newcastle

Discovering the means to prevent and cure schizophrenia is a vision that motivates many scientists. But in order to achieve this goal, we need to understand its neurobiological basis. The emergent metadiscipline of cognitive neuroscience fields an impressive array of tools that can be marshaled towards achieving this goal, including powerful new methods of imaging the brain (both structural and functional) as well as assessments of perceptual and cognitive capacities based on psychophysical procedures, experimental tasks and models developed by cognitive science. We believe that the integration of data from this array of tools offers the greatest possibilities and potential for advancing understanding of the neural basis of not only normal cognition but also the cognitive impairments that are fundamental to schizophrenia. Since sufficient expertise in the application of these tools and methods rarely reside in a single individual, or even a single laboratory, collaboration is a key element in this endeavor. Here, we review some of the products of our integrative efforts in collaboration with our colleagues on the East Coast of Australia and Pacific Rim. This research focuses on the neural basis of executive function deficits and impairments in early auditory processing in patients using various combinations of performance indices (from perceptual and cognitive paradigms), ERPs, fMRI and sMRI. In each case, integration of two or more sources of information provides more information than any one source alone by revealing new insights into structure-function relationships. Furthermore, the addition of other imaging methodologies (such as DTI) and approaches (such as computational models of cognition) offers new horizons in human brain imaging research and in understanding human behavior.

Cortical processing of speech and non-speech sounds in adults and newborns

Comprehension of a complex acoustic signal - speech - is vital for human communication, with numerous brain processes required to convert the acoustics into an intelligible message. In four studies in the present thesis, cortical correlates for different stages of speech processing in a mature linguistic system of adults were investigated. In two further studies, developmental aspects of cortical specialisation and its plasticity in adults were examined. In the present studies, electroencephalographic (EEG) and magnetoencephalographic (MEG) recordings of the mismatch negativity (MMN) response elicited by changes in repetitive unattended auditory events and the phonological mismatch negativity (PMN) response elicited by unexpected speech sounds in attended speech inputs served as the main indicators of cortical processes. Changes in speech sounds elicited the MMNm, the magnetic equivalent of the electric MMN, that differed in generator loci and strength from those elicited by comparable changes in non-speech sounds, suggesting intra- and interhemispheric specialisation in the processing of speech and non-speech sounds at an early automatic processing level. This neuronal specialisation for the mother tongue was also reflected in the more efficient formation of stimulus representations in auditory sensory memory for typical native-language speech sounds compared with those formed for unfamiliar, non-prototype speech sounds and simple tones. Further, adding a speech or non-speech sound context to syllable changes was found to modulate the MMNm strength differently in the left and right hemispheres. Following the acoustic-phonetic processing of speech input, phonological effort related to the selection of possible lexical (word) candidates was linked with distinct left-hemisphere neuronal populations. In summary, the results suggest functional specialisation in the neuronal substrates underlying different levels of speech processing. Subsequently, plasticity of the brain's mature linguistic system was investigated in adults, in whom representations for an aurally-mediated communication system, Morse code, were found to develop within the same hemisphere where representations for the native-language speech sounds were already located. Finally, recording and localization of the MMNm response to changes in speech sounds was successfully accomplished in newborn infants, encouraging future MEG investigations on, for example, the state of neuronal specialisation at birth.

Sensory auditory processing and intuitive sound detection : an investigation of musical experts and nonexperts

The auditory system can detect occasional changes (deviants) in acoustic regularities without the need for subjects to focus their attention on the sound material. Deviant detection is reflected in the elicitation of the mismatch negativity component (MMN) of the event-related potentials. In the studies presented in this thesis, the MMN is used to investigate the auditory abilities for detecting similarities and regularities in sound streams. To investigate the limits of these processes, professional musicians have been tested in some of the studies. The results show that auditory grouping is already more advanced in musicians than in nonmusicians and that the auditory system of musicians can, unlike that of nonmusicians, detect a numerical regularity of always four tones in a series. These results suggest that sensory auditory processing in musicians is not only a fine tuning of universal abilities, but is also qualitatively more advanced than in nonmusicians. In addition, the relationship between the auditory change-detection function and perception is examined. It is shown that, contrary to the generally accepted view, MMN elicitation does not necessarily correlate with perception. The outcome of the auditory change-detection function can be implicit and the implicit knowledge of the sound structure can, after training, be utilized for behaviorally correct intuitive sound detection. These results illustrate the automatic character of the sensory change detection function.

Cortical representations for phonological quantity

Different languages use temporal speech cues in different linguistic functions. In Finnish, speech-sound duration is used as the primary cue for the phonological quantity distinction ― i.e., a distinction between short and long phonemes. For the second-language (L2) learners of Finnish, quantity is often difficult to master if speech-sound duration plays a less important role in the phonology of their native language (L1). The present studies aimed to investigate the cortical representations for phonological quantity in native speakers and L2 users of Finnish by using behavioral and electrophysiological methods. Since long-term memory representations for different speech units have been previously shown to participate in the elicitation of the mismatch negativity (MMN) brain response, MMN was used to compare the neural representation for quantity between native speakers and L2 users of Finnish. The results of the studies suggested that native Finnish speakers' MMN response to quantity was determined by the activation of native-language phonetic prototypes rather than by phoneme boundaries. In addition, native speakers seemed to process phoneme quantity and quality independently from each other by separate brain representations. The cross-linguistic MMN studies revealed that, in native speakers of Finnish, the MMN response to duration or quantity-degree changes was enhanced in amplitude selectively in speech sounds, whereas this pattern was not observed in L2 users. Native speakers' MMN enhancement is suggested to be due to the pre-attentive activation of L1 prototypes for quantity. In L2 users, the activation of L2 prototypes or other L2 learning effects were not reflected in the MMN, with one exception. Even though L2 users failed to show native-like brain responses to duration changes in a vowel that was similar in L1 and L2, their duration MMN response was native-like for an L2 vowel with no counterpart in L1. Thus, the pre-attentive activation of L2 users' representations was determined by the degree of similarity of L2 sounds to L1 sounds. In addition, behavioral experiments suggested that the establishment of representations for L2 quantity may require several years of language exposure.

Processing of Stimulus Repetition and Change in the Somatosensory System: Recordings of Electrical and Magnetic Brain Responses

In the present work, effects of stimulus repetition and change in a continuous stimulus stream on the processing of somatosensory information in the human brain were studied. Human scalp-recorded somatosensory event-related potentials (ERPs) and magnetoencephalographic (MEG) responses rapidly diminished with stimulus repetition when mechanical or electric stimuli were applied to fingers. On the contrary, when the ERPs and multi-unit a ctivity (MUA) were directly recorded from the primary (SI) and secondary (SII) somatosensory cortices in a monkey, there was no marked decrement in the somatosensory responses as a function of stimulus repetition. These results suggest that this rate effect is not due to the response diminution in the SI and SII cortices. Obviously the responses to the first stimulus after a long "silent" period are nhanced due to unspecific initial orientation, originating in more broadly distributed and/or deeper neural structures, perhaps in the prefrontal cortices. With fast repetition rates not only the late unspecific but also some early specific somatosensory ERPs were diminished in amplitude. The fast decrease of the ERPs as a function of stimulus repetition is mainly due to the disappearance of the orientation effect and with faster repetition rates additively due to stimulus specific refractoriness. A sudden infrequent change in the continuous stimulus stream also enhanced somatosensory MEG responses to electric stimuli applied to different fingers. These responses were quite similar to those elicited by the deviant stimuli alone when the frequent standard stimuli were omitted. This enhancement was obviously due to the release from refractoriness because the neural structures generating the responses to the infrequent deviants had more time to recover from the refractoriness than the respective structures for the standards. Infrequent deviant mechanical stimuli among frequent standard stimuli also enhanced somatosensory ERPs and, in addition, they elicited a new negative wave which did not occur in the deviants-alone condition. This extra negativity could be recorded to deviations in the stimulation site and in the frequency of the vibratory stimuli. This response is probably a somatosensory analogue of the auditory mismatch negativity (MMN) which has been suggested to reflect a neural mismatch process between the sensory input and the sensory memory trace.

Neurochemical regulation of auditory information processing studied with EEG/MEG: application to schizophrenia

Cognitive impairments of attention, memory and executive functions are a fundamental feature of the pathophysiology of schizophrenia. The neurophysiological and neurochemical changes in the auditory cortex are shown to underlie cognitive impairmentsin schizophrenia patients. Functional state of the neural substrate of auditory information processing could be objectively and non-invasively probed with auditory event-related potentials (ERPs) and event- related fields (ERFs). In the current work, we explored the neurochemical effect on the neural origins of auditory information processing in relation to schizophrenia. By means of ERPs/ERFs we aimed to determine how neural substrates of auditory information processing are modulated by antipsychotic medication in schizophrenia spectrum patients (Studies I, II) and by neuropharmacological challenges in healthy human subjects (Studies III, IV). First, with auditory ERPs we investigated the effects of olanzapine (Study I) and risperidone (Study II) in a group of patients with schizophrenia spectrum disorders. After 2 and 4 weeks of treatment, olanzapine has no significant effects on mismatch negativity(MMN) and P300, which, as it has been suggested, respectively reflect preattentive and attention-dependent information processing. After 2 weeks of treatment, risperidone has no significant effect on P300, however risperidone reduces P200 amplitude. This latter effect of risperidone on neural resources responsible for P200 generation could be partly explained through the action of dopamine. Subsequently, we used simultaneous EEG/MEG to investigate the effects of memantine (Study III) and methylphenidate (Study IV) in healthy subjects. We found that memantine modulates MMN response without changing other ERP components. This could be interpreted as being due to the possible influence of memantine through the NMDA receptors on auditory change- detection mechanism, with processing of auditory stimuli remaining otherwise unchanged. Further, we found that methylphenidate does not modulate the MMN response. This finding could indicate no association between catecholaminergic activities and electrophysiological measures of preattentive auditory discrimination processes reflected in the MMN. However, methylphenidate decreases the P200 amplitudes. This could be interpreted as a modulation of auditory information processing reflected in P200 by dopaminergic and noradrenergic systems. Taken together, our set of studies indicates a complex pattern of neurochemical influences produced by the antipsychotic drugs in the neural substrate of auditory information processing in patients with schizophrenia spectrum disorders and by the pharmacological challenges in healthy subjects studied with ERPs and ERFs.

Opioid dependence: Brain structure and function : a magnetic resonance imaging, neuropsychological, and electromagnetic study

Background: Opiod dependence is a chronic severe brain disorder associated with enormous health and social problems. The relapse back to opioid abuse is very high especially in early abstinence, but neuropsychological and neurophysiological deficits during opioid abuse or soon after cessation of opioids are scarcely investigated. Also the structural brain changes and their correlations with the length of opioid abuse or abuse onset age are not known. In this study the cognitive functions, neural basis of cognitive dysfunction, and brain structural changes was studied in opioid-dependent patients and in age and sex matched healthy controls. Materials and methods: All subjects participating in the study, 23 opioid dependents of whom, 15 were also benzodiazepine and five cannabis co-dependent and 18 healthy age and sex matched controls went through Structured Clinical Interviews (SCID) to obtain DSM-IV axis I and II diagnosis and to exclude psychiatric illness not related to opioid dependence or personality disorders. Simultaneous magnetoencephalography (MEG) and electroencephalography (EEG) measurements were done on 21 opioid-dependent individuals on the day of hospitalization for withdrawal therapy. The neural basis of auditory processing was studied and pre-attentive attention and sensory memory were investigated. During the withdrawal 15 opioid-dependent patients participated in neuropsychological tests, measuring fluid intelligence, attention and working memory, verbal and visual memory, and executive functions. Fifteen healthy subjects served as controls for the MEG-EEG measurements and neuropsychological assessment. The brain magnetic resonance imaging (MRI) was obtained from 17 patients after approximately two weeks abstinence, and from 17 controls. The areas of different brain structures and the absolute and relative volumes of cerebrum, cerebral white and gray matter, and cerebrospinal fluid (CSF) spaces were measured and the Sylvian fissure ratio (SFR) and bifrontal ratio were calculated. Also correlation between the cerebral measures and neuropsychological performance was done. Results: MEG-EEG measurements showed that compared to controls the opioid-dependent patients had delayed mismatch negativity (MMN) response to novel sounds in the EEG and P3am on the contralateral hemisphere to the stimulated ear in MEG. The equivalent current dipole (ECD) of N1m response was stronger in patients with benzodiazepine co-dependence than those without benzodiazepine co-dependence or controls. In early abstinence the opioid dependents performed poorer than the controls in tests measuring attention and working memory, executive function and fluid intelligence. Test results of the Culture Fair Intelligence Test (CFIT), testing fluid intelligence, and Paced Auditory Serial Addition Test (PASAT), measuring attention and working memory correlated positively with the days of abstinence. MRI measurements showed that the relative volume of CSF was significantly larger in opioid dependents, which could also be seen in visual analysis. Also Sylvian fissures, expressed by SFR were wider in patients, which correlated negatively with the age of opioid abuse onset. In controls the relative gray matter volume had a positive correlation with composite cognitive performance, but this correlation was not found in opioid dependents in early abstinence. Conclusions: Opioid dependents had wide Sylvian fissures and CSF spaces indicating frontotemporal atrophy. Dilatation of Sylvian fissures correlated with the abuse onset age. During early withdrawal cognitive performance of opioid dependents was impaired. While intoxicated the pre-attentive attention to novel stimulus was delayed and benzodiazepine co-dependence impaired sound detection. All these changes point to disturbances on frontotemporal areas.

The Effect of Intrauterine Growth Restriction on Long-Term Outcome in Very or Extremely Low Birth Weight Infants

The project consisted of two long-term follow-up studies of preterm children addressing the question whether intrauterine growth restriction affects the outcome. Assessment at 5 years of age of 203 children with a birth weight less than 1000 g born in Finland in 1996-1997 showed that 9% of the children had cognitive impairment, 14% cerebral palsy, and 4% needed a hearing aid. The intelligence quotient was lower (p<0.05) than the reference value. Thus, 20% exhibited major, 19% minor disabilities, and 61% had no functional abnormalities. Being small for gestational age (SGA) was associated with sub-optimal growth later. In children born before 27 gestational weeks, the SGA had more neuropsychological disabilities than those appropriate for gestational age (AGA). In another cohort with birth weight less than 1500 g assessed at 5 years of age, echocardiography showed a thickened interventricular septum and a decreased left ventricular end-diastolic diameter in both SGA and AGA born children. They also had a higher systolic blood pressure than the reference. Laser-Doppler flowmetry showed different endothelium-dependent and -independent vasodilation responses in the AGA children compared to those of the controls. SGA was not associated with cardio-vascular abnormalities. Auditory event-related potentials (AERPs) were recorded using an oddball paradigm with frequency deviants (standard tone 500 Hz and deviant 750-Hz with 10% probability). At term, the P350 was smaller in SGA and AGA infants than in controls. At 12 months, the automatic change detection peak (mismatch negativity, MMN) was observed in the controls. However, the pre-term infants had a difference positivity that correlated with their neurodevelopment scores. At 5 years of age, the P1-deflection, which reflects primary auditory processing, was smaller, and the MMN larger in the preterm than in the control children. Even with a challenging paradigm or a distraction paradigm, P1 was smaller in the preterm than in the control children. The SGA and AGA children showed similar AERP responses. Prematurity is a major risk factor for abnormal brain development. Preterm children showed signs of cardiovascular abnormality suggesting that prematurity per se may carry a risk for later morbidity. The small positive amplitudes in AERPs suggest persisting altered auditory processing in the preterm in-fants.

An exploration of pre-attentive visual discrimination using event-related potentials

The Mismatch Negativity (MMN) has been characterised as a ‘pre-attentive’ component of an Event-Related Potential (ERP) that is related to discriminatory processes. Although well established in the auditory domain, characteristics of the MMN are less well characterised in the visual domain. The five main studies presented in this thesis examine visual cortical processing using event-related potentials. Novel methodologies have been used to elicit visual detection and discrimination components in the absence of a behavioural task. Developing paradigms in which a behavioural task is not required may have important clinical applications for populations, such as young children, who cannot comply with the demands of an active task. The ‘pre-attentive’ nature of visual MMN has been investigated by modulating attention. Generators and hemispheric lateralisation of visual MMN have been investigated by using pertinent clinical groups. A three stimulus visual oddball paradigm was used to explore the elicitation of visual discrimination components to a change in the orientation of stimuli in the absence of a behavioural task. Monochrome stimuli based on pacman figures were employed that differed from each other only in terms of the orientation of their elements. One such stimulus formed an illusory figure in order to capture the participant’s attention, either in place of, or alongside, a behavioural task. The elicitation of a P3a to the illusory figure but not to the standard or deviant stimuli provided evidence that the illusory figure captured attention. A visual MMN response was recorded in a paradigm with no task demands. When a behavioural task was incorporated into the paradigm, a P3b component was elicited consistent with the allocation of attentional resources to the task. However, visual discrimination components were attenuated revealing that the illusory figure was unable to command all attentional resources from the standard deviant transition. The results are the first to suggest that the visual MMN is modulated by attention. Using the same three stimulus oddball paradigm, generators of visual MMN were investigated by recording potentials directly from the cortex of an adolescent undergoing pre-surgical evaluation for resection of a right anterior parietal lesion. To date no other study has explicitly recorded activity related to the visual MMN intracranially using an oddball paradigm in the absence of a behavioural task. Results indicated that visual N1 and visual MMN could be temporally and spatially separated, with visual MMN being recorded more anteriorly than N1. The characteristic abnormality in retinal projections in albinism afforded the opportunity to investigate each hemisphere in relative isolation and was used, for the first time, as a model to investigate lateralisation of visual MMN and illusory contour processing. Using the three stimulus oddball paradigm, no visual MMN was elicited in this group, and so no conclusions regarding the lateralisation of visual MMN could be made. Results suggested that both hemispheres were equally capable of processing an illusory figure. As a method of presenting visual test stimuli without conscious perception, a continuous visual stream paradigm was developed that used a briefly presented checkerboard stimulus combined with masking for exploring stimulus detection below and above subjective levels of perception. A correlate of very early cortical processing at a latency of 60-80 ms (CI) was elicited whether stimuli were reported as seen or unseen. Differences in visual processing were only evident at a latency of 90 ms (CII) implying that this component may represent a correlate of visual consciousness/awareness. Finally, an oddball sequence was introduced into the visual stream masking paradigm to investigate whether visual MMN responses could be recorded without conscious perception. The stimuli comprised of black and white checkerboard elements differing only in terms of their orientation to form an x or a +. Visual MMN was not recorded when participants were unable to report seeing the stimulus. Results therefore suggest that behavioural identification of the stimuli was required for the elicitation of visual MMN and that visual MMN may require some attentional resources. On the basis of these studies it is concluded that visual MMN is not entirely independent of attention. Further, the combination of clinical and non-clinical investigations provides a unique opportunity to study the characterisation and localisation of putative mechanisms related to conscious and non-conscious visual processing.