Pitch discrimination in optimal and suboptimal acoustic environments: electroencephalographic, magnetoencephalographic, and behavioral evidence

Pitch discrimination is a fundamental property of the human auditory system. Our understanding of pitch-discrimination mechanisms is important from both theoretical and clinical perspectives. The discrimination of spectrally complex sounds is crucial in the processing of music and speech. Current methods of cognitive neuroscience can track the brain processes underlying sound processing either with precise temporal (EEG and MEG) or spatial resolution (PET and fMRI). A combination of different techniques is therefore required in contemporary auditory research. One of the problems in comparing the EEG/MEG and fMRI methods, however, is the fMRI acoustic noise. In the present thesis, EEG and MEG in combination with behavioral techniques were used, first, to define the ERP correlates of automatic pitch discrimination across a wide frequency range in adults and neonates and, second, they were used to determine the effect of recorded acoustic fMRI noise on those adult ERP and ERF correlates during passive and active pitch discrimination. Pure tones and complex 3-harmonic sounds served as stimuli in the oddball and matching-to-sample paradigms. The results suggest that pitch discrimination in adults, as reflected by MMN latency, is most accurate in the 1000-2000 Hz frequency range, and that pitch discrimination is facilitated further by adding harmonics to the fundamental frequency. Newborn infants are able to discriminate a 20% frequency change in the 250-4000 Hz frequency range, whereas the discrimination of a 5% frequency change was unconfirmed. Furthermore, the effect of the fMRI gradient noise on the automatic processing of pitch change was more prominent for tones with frequencies exceeding 500 Hz, overlapping with the spectral maximum of the noise. When the fundamental frequency of the tones was lower than the spectral maximum of the noise, fMRI noise had no effect on MMN and P3a, whereas the noise delayed and suppressed N1 and exogenous N2. Noise also suppressed the N1 amplitude in a matching-to-sample working memory task. However, the task-related difference observed in the N1 component, suggesting a functional dissociation between the processing of spatial and non-spatial auditory information, was partially preserved in the noise condition. Noise hampered feature coding mechanisms more than it hampered the mechanisms of change detection, involuntary attention, and the segregation of the spatial and non-spatial domains of working-memory. The data presented in the thesis can be used to develop clinical ERP-based frequency-discrimination protocols and combined EEG and fMRI experimental paradigms.

情绪干扰下焦虑水平对执行抑制的影响机制——事件相关电位研究

Behavioral inhibition model suggests the generation of anxiety is related with over-inhibition. For knowing about anxiety better, we used event-related potential (ERP) technique to explore the underlying mechanism of executive inhibition under the emotional distracter in high and low trait-anxious groups. Firstly, we set up the Chinese affective picture system (CAPS) as the stimuli of subsequent experiments. Secondly, we screened the high and low trait-anxious participants using the State-Trait Anxiety Inventory. In the first ERP study, a modified oddball paradigm was used with the positive, neutral and negative pictures as novel stimuli and the potentials evoked by three types pictures were analyzed. In the second ERP study, the same paradigm with higher task load was employed to examine the interaction of anxious level and emotion. Main results as follows: 1. CAPS consisted of 852 pictures was assessed via three dimensionalities, valence, arousal and dominance. The standard deviation of scores on valence and dominance was more than the standard deviation of scores on dimension of arousal. Scatter plot showed that the score distributing on the dimension of valence and arousal was wide in CAPS. 2. In both high and low trait-anxiety groups, the amplitudes of N2 and P3 of negative pictures were greater and smaller respectively as compared with neutral and positive pictures, which suggested all participants no matter what anxious level required more inhibition processing to negative information than others. 3. With increasing of task load, the P3 amplitudes of negative pictures in high anxious group were reduced relative to neutral pictures. In addition, in high anxious group, the P3 amplitudes of positive pictures had the same changes as those of negative ones. Whereas, the reduced P3 of positive pictures were not observed in low anxious group. The results showed the high anxious participants employed the same inhibitory strategy to the positive distracter as the negative distracter, which possibly the over-inhibition processing was involved in this group. 4. Dipole source analysis found cingulate may be involved in executive inhibition processing. In sum, as for the inhibition, high and low anxious group both is sensitive to negative information. However, in the high load situation, due to the shortness of cognitive resources, the high anxious individual represents the general sensitivity to all emotional information. These results gave the electrophysiological evidence for over-inhibition in high trait-anxiety group.

Attentional Biases in Value-Based Decision-Making

Humans make decisions in highly complex physical, economic and social environments. In order to adaptively choose, the human brain has to learn about- and attend to- sensory cues that provide information about the potential outcome of different courses of action. Here I present three event-related potential (ERP) studies, in which I evaluated the role of the interactions between attention and reward learning in economic decision-making. I focused my analyses on three ERP components (Chap. 1): (1) the N2pc, an early lateralized ERP response reflecting the lateralized focus of visual; (2) the feedback-related negativity (FRN), which reflects the process by which the brain extracts utility from feedback; and (3) the P300 (P3), which reflects the amount of attention devoted to feedback-processing. I found that learned stimulus-reward associations can influence the rapid allocation of attention (N2pc) towards outcome-predicting cues, and that differences in this attention allocation process are associated with individual differences in economic decision performance (Chap. 2). Such individual differences were also linked to differences in neural responses reflecting the amount of attention devoted to processing monetary outcomes (P3) (Chap. 3). Finally, the relative amount of attention devoted to processing rewards for oneself versus others (as reflected by the P3) predicted both charitable giving and self-reported engagement in real-life altruistic behaviors across individuals (Chap. 4). Overall, these findings indicate that attention and reward processing interact and can influence each other in the brain. Moreover, they indicate that individual differences in economic choice behavior are associated both with biases in the manner in which attention is drawn towards sensory cues that inform subsequent choices, and with biases in the way that attention is allocated to learn from the outcomes of recent choices.

The presence of a culturally similar or dissimilar social partner affects neural responses to emotional stimuli

Background: Emotional responding is sensitive to social context; however, little emphasis has been placed on the mechanisms by which social context effects changes in emotional responding.

Objective: We aimed to investigate the effects of social context on neural responses to emotional stimuli to inform on the mechanisms underpinning context-linked changes in emotional responding.

Design: We measured event-related potential (ERP) components known to index specific emotion processes and self-reports of explicit emotion regulation strategies and emotional arousal. Female Chinese university students observed positive, negative, and neutral photographs, whilst alone or accompanied by a culturally similar (Chinese) or dissimilar researcher (British).

Results: There was a reduction in the positive versus neutral differential N1 amplitude (indexing attentional capture by positive stimuli) in the dissimilar relative to alone context. In this context, there was also a corresponding increase in amplitude of a frontal late positive potential (LPP) component (indexing engagement of cognitive control resources). In the similar relative to alone context, these effects on differential N1 and frontal LPP amplitudes were less pronounced, but there was an additional decrease in the amplitude of a parietal LPP component (indexing motivational relevance) in response to positive stimuli. In response to negative stimuli, the differential N1 component was increased in the similar relative to dissimilar and alone (trend) context.

Conclusion: These data suggest that neural processes engaged in response to emotional stimuli are modulated by social context. Possible mechanisms for the social-context-linked changes in attentional capture by emotional stimuli include a context-directed modulation of the focus of attention, or an altered interpretation of the emotional stimuli based on additional information proportioned by the context.

Brain responses and looking behavior during audiovisual speech integration in infants predict auditory speech comprehension in the second year of life

The use of visual cues during the processing of audiovisual (AV) speech is known to be less efficient in children and adults with language difficulties and difficulties are known to be more prevalent in children from low-income populations. In the present study, we followed an economically diverse group of thirty-seven infants longitudinally from 6–9 months to 14–16 months of age. We used eye-tracking to examine whether individual differences in visual attention during AV processing of speech in 6–9 month old infants, particularly when processing congruent and incongruent auditory and visual speech cues, might be indicative of their later language development. Twenty-two of these 6–9 month old infants also participated in an event-related potential (ERP) AV task within the same experimental session. Language development was then followed-up at the age of 14–16 months, using two measures of language development, the Preschool Language Scale and the Oxford Communicative Development Inventory. The results show that those infants who were less efficient in auditory speech processing at the age of 6–9 months had lower receptive language scores at 14–16 months. A correlational analysis revealed that the pattern of face scanning and ERP responses to audiovisually incongruent stimuli at 6–9 months were both significantly associated with language development at 14–16 months. These findings add to the understanding of individual differences in neural signatures of AV processing and associated looking behavior in infants.

Can illusory deviant stimuli be used as attentional distractors to record vMMN in a passive three stimulus oddball paradigm?

A passive three stimulus oddball paradigm was used to investigate Visual Mismatch Negativity (vMMN) a component of the Event Related Potential (ERP) believed to represent a central pre-attentive change mechanism. Responses to a change in orientation were recorded to monochrome stimuli presented to subjects on a computer screen. One of the infrequent stimuli formed an illusory figure (Kanizsa Square) aimed to capture spatial attention in the absence of an active task. Nineteen electrodes (10-20 system) were used to record the electroencephalogram in fourteen subjects (ten females) mean age 34.5 years. ERPs to all stimuli consisted of a positive negative positive complex recorded maximally over lateral occipital areas. The negative component was greater for deviant and illusory deviant compared to standard stimuli in a time window of 170-190 ms. A P3a component over frontal/central electrodes to the illusory deviant but not to the deviant stimulus suggests the illusory figure was able to capture attention and orientate subjects to the recording. Subtraction waveforms revealed visual discrimination responses at occipital electrodes, which may represent vMMN. In a control study with 13 subjects (11 females; mean age 29.23 years), using an embedded active attention task, we confirmed the existence of an earlier (150-170 ms) and attenuated vMMN. Recordings from an intracranial case study confirmed separation of N1 and discrimination components to posterior and anterior occipital areas, respectively. We conclude that although the illusory figure captured spatial attention in its own right it did not draw sufficient attentional resources from the standard-deviant comparison as revealed when using a concurrent active task.

Electrophysiological correlates of performance monitoring in middle and late adolescence

The ability to monitor and evaluate the consequences of ongoing behaviors and coordinate behavioral adjustments seems to rely on networks including the anterior cingulate cortex (ACC) and phasic changes in dopamine activity. Activity (and presumably functional maturation) of the ACC may be indirectly measured using the error-related negativity (ERN), an event-related potential (ERP) component that is hypothesized to reflect activity of the automatic response monitoring system. To date, no studies have examined the measurement reliability of the ERN as a trait-like measure of response monitoring, its development in mid- and late- adolescence as well as its relation to risk-taking and empathic ability, two traits linked to dopaminergic and ACC activity. Utilizing a large sample of 15- and 18-year-old males, the present study examined the test-retest reliability of the ERN, age-related changes in the ERN and other components of the ERP associated with error monitoring (the Pe and CRN), and the relations of the error-related ERP components to personality traits of risk propensity and empathy. Results indicated good test-retest reliability of the ERN providing important validation of the ERN as a stable and possibly trait-like electrophysiological correlate of performance monitoring. Ofthe three components, only the ERN was of greater amplitude for the older adolescents suggesting that its ACC network is functionally late to mature, due to either structural or neurochemical changes with age. Finally, the ERN was smaller for those with high risk propensity and low empathy, while other components associated with error monitoring were not, which suggests that poor ACe function may be associated with the desire to engage in risky behaviors and the ERN may be influenced by the extent of individuals' concern with the outcome of events.

Hot cognition and activation of the medial prefrontal cortex: Self-regulating in contexts involving motivational pressures

The medial prefrontal cortex (mPFC) is involved in performance-monitoring and has been implicated in the generation of several electrocortical responses associated with self-regulation. The error-related negativity (ERN), the inhibitory Nogo N2 (N2), and the feedback-related negativity (FRN) are event-related potential (ERP) components which reflect mPFC activity associated with feedback to behavioural (ERN, N2) and environmental (FRN) consequences. Our main goal was to determine whether or not rnPFC activation varies as a function of motivational context (e.g., those involving performance-related incentives) or the use of internally versus externally generated feedback signals (i.e., errors). Additionally, we assessed medial prefrontal activity in relation to individual differences in personality and temperament. Participants completed a combination of tasks in which performance-related incentives were associated with task performance and feedback generated from internal versus external responses. MPFC activity was indexed using both ERP scalp voltage peaks and intracerebral current source density (CSD) of dorsal and ventral regions. Additionally, participants completed several questionnaires assessing personality and temperament styles. Given previous studies have shown that enhanced mPFC activity to loss (or negative) feedback, we expected that activity in the mPFC would generally be greater during the Loss condition relative to the Win condition for both the ERN and N2. Also, due to the evidence that the (vmPFC) is engaged in arousing contexts, we hypothesized that activity in the ventromedial prefrontal cortex (vmPFC) would be greater than activity in the dorsomedial prefrontal cortex (dmPFC), especially in the Loss condition of the GoNogo task (ERN). Similarly, loss feedback in the BART (FRN) was expected to engage the vmPFC more than the dmPFC. Finally, we predicted that persons rating themselves as more willing to engage in approach-related behaviours or to exhibit rigid cognitive styles would show reduced activity of the mPFC. Overall, our results emphasize the role of affective evaluations of behavioural and environmental consequences when self-regulating. Although there were no effects of context on brain activity, our data indicate that, during the time of the ERN and N2 on the MW Go-Nogo task and the FRN on the BART, the vrnPFC was more active compared to the dmPFC. Moreover, regional recruitment in the mPFC was similar across internally (ERN) and externally (FRN) generated errors signals associated with loss feedback, as reflected by relatively greater activity in the vmPFC than the dmPFC. Our data also suggest that greater activity in the mPFC is associated with better inhibitory control, as reflected by both scalp and CSD measures. Additionally, deactivation of the subgenual anterior cingulate cortex (sgACC) and lower levels of self-reported positive affect were both related to increased voluntary risk-taking on the BART. Finally, persons reporting higher levels of approach-related behaviour or cognitive rigidity showed reduced activity of the mPFC. These results are in line with previous research emphasizing that affect/motivation is central to the processes reflected by mediofrontal negativities (MFNs), that the vmPFC is involved in regulating demands on motivational/affective systems, and that the underlying mechanisms driving these functions vary across both individuals and contexts.

Modulation de l'apprentissage visuel par stimulation électrique transcrânienne à courant direct du cortex préfrontal

Le traitement visuel répété d’un visage inconnu entraîne une suppression de l’activité neuronale dans les régions préférentielles aux visages du cortex occipito-temporal. Cette «suppression neuronale» (SN) est un mécanisme primitif hautement impliqué dans l’apprentissage de visages, pouvant être détecté par une réduction de l’amplitude de la composante N170, un potentiel relié à l’événement (PRE), au-dessus du cortex occipito-temporal. Le cortex préfrontal dorsolatéral (CPDL) influence le traitement et l’encodage visuel, mais sa contribution à la SN de la N170 demeure inconnue. Nous avons utilisé la stimulation électrique transcrânienne à courant direct (SETCD) pour moduler l’excitabilité corticale du CPDL de 14 adultes sains lors de l’apprentissage de visages inconnus. Trois conditions de stimulation étaient utilisées: inhibition à droite, excitation à droite et placebo. Pendant l’apprentissage, l’EEG était enregistré afin d’évaluer la SN de la P100, la N170 et la P300. Trois jours suivant l’apprentissage, une tâche de reconnaissance était administrée où les performances en pourcentage de bonnes réponses et temps de réaction (TR) étaient enregistrées. Les résultats indiquent que la condition d’excitation à droite a facilité la SN de la N170 et a augmentée l’amplitude de la P300, entraînant une reconnaissance des visages plus rapide à long-terme. À l’inverse, la condition d’inhibition à droite a causé une augmentation de l’amplitude de la N170 et des TR plus lents, sans affecter la P300. Ces résultats sont les premiers à démontrer que la modulation d’excitabilité du CPDL puisse influencer l’encodage visuel de visages inconnus, soulignant l’importance du CPDL dans les mécanismes d’apprentissage de base.

L’influence de la distance spatiale et la similarité physique entre une cible et un distracteur saillant sur la composante N2pc.

Une composante PRE (potentiel relié aux événements) nommée la N2pc est associée au déploiement de l’attention visuo-spatiale. Nous avons examiné la modulation de la N2pc en fonction de la présence ou l’absence d’une cible, la séparation physique de deux items saillants ainsi que leur similarité. Les stimuli présentés étaient des lignes variant selon leur orientation et leur couleur, les items saillants étant bleus et les items non saillants, gris. Les résultats démontrent une augmentation de l’amplitude de la N2pc en lien avec la distance séparant deux items saillants ainsi qu’une augmentation de l’amplitude de la N2pc lorsque les items saillants avaient des orientations plus similaires. Aucune interaction entre ces deux facteurs n’a été observée. Une interaction significative a par contre été observée entre la présence/absence d’une cible et la similarité du distracteur avec la cible recherchée. Ces résultats montrent une dissociation entre l’activité reliée à la distance entre les items saillants et celle qui est reliée à la similarité distracteur-cible, car ils ne peuvent pas être expliqués par un seul mécanisme. Donc, les résultats suggèrent qu’une combinaison de traitement ascendant et de traitement descendant module la composante N2pc.

A new paradigm for BCI research

A new control paradigm for Brain Computer Interfaces (BCIs) is proposed. BCIs provide a means of communication direct from the brain to a computer that allows individuals with motor disabilities an additional channel of communication and control of their external environment. Traditional BCI control paradigms use motor imagery, frequency rhythm modification or the Event Related Potential (ERP) as a means of extracting a control signal. A new control paradigm for BCIs based on speech imagery is initially proposed. Further to this a unique system for identifying correlations between components of the EEG and target events is proposed and introduced.

Scalp field maps and their characterization

The present chapter gives a comprehensive introduction into the display and quantitative characterization of scalp field data. After introducing the construction of scalp field maps, different interpolation methods, the effect of the recording reference and the computation of spatial derivatives are discussed. The arguments raised in this first part have important implications for resolving a potential ambiguity in the interpretation of differences of scalp field data. In the second part of the chapter different approaches for comparing scalp field data are described. All of these comparisons can be interpreted in terms of differences of intracerebral sources either in strength, or in location and orientation in a nonambiguous way. In the present chapter we only refer to scalp field potentials, but mapping also can be used to display other features, such as power or statistical values. However, the rules for comparing and interpreting scalp field potentials might not apply to such data. Generic form of scalp field data Electroencephalogram (EEG) and event-related potential (ERP) recordings consist of one value for each sample in time and for each electrode. The recorded EEG and ERP data thus represent a two-dimensional array, with one dimension corresponding to the variable “time” and the other dimension corresponding to the variable “space” or electrode. Table 2.1 shows ERP measurements over a brief time period. The ERP data (averaged over a group of healthy subjects) were recorded with 19 electrodes during a visual paradigm. The parietal midline Pz electrode has been used as the reference electrode.

Brain electrical microstates in subjects with panic disorder

Brain electrical microstates represent spatial configurations of scalp recorded brain electrical activity and are considered to be the basic elements of stepwise processing of information in the brain. In the present study, the hypothesis of a temporo-limbic dysfunction in panic disorder (PD) was tested by investigating the topographic descriptors of brain microstates, in particular the one corresponding to the Late Positive Complex (LPC), an event-related potential (ERP) component with generators in these regions. ERPs were recorded in PD patients and matched healthy subjects during a target detection task, in a central (CC) and a lateral condition (LC). In the CC, a leftward shift of the LPC microstate positive centroid was observed in the patients with PD versus the healthy control subjects. In the LC, the topographic descriptor of the first microstate showed a rightward shift, while those of both the second and the fourth microstate, corresponding to the LPC, revealed a leftward shift in the PD patients versus the healthy control subjects. These findings indicate an overactivation of the right hemisphere networks involved in early visual processing and a hypoactivation of the right hemisphere circuits involved in LPC generators in PD. In line with this interpretation, the abnormal topography of the LPC microstate, observed in the CC, was associated with a worse performance on a test exploring right temporo-hippocampal functioning. Topographical abnormalities found for the LPC microstate in the LC were associated with a higher number of panic attacks, suggesting a pathogenetic role of the right temporo-hippocampal dysfunction in PD.

Faces and emotions: brain electric field sources during covert emotional processing

Covert brain activity related to task-free, spontaneous (i.e. unrequested), emotional evaluation of human face images was analysed in 27-channel averaged event-related potential (ERP) map series recorded from 18 healthy subjects while observing random sequences of face images without further instructions. After recording, subjects self-rated each face image on a scale from “liked” to “disliked”. These ratings were used to dichotomize the face images into the affective evaluation categories of “liked” and “disliked” for each subject and the subjects into the affective attitudes of “philanthropists” and “misanthropists” (depending on their mean rating across images). Event-related map series were averaged for “liked” and “disliked” face images and for “philanthropists” and “misanthropists”. The spatial configuration (landscape) of the electric field maps was assessed numerically by the electric gravity center, a conservative estimate of the mean location of all intracerebral, active, electric sources. Differences in electric gravity center location indicate activity of different neuronal populations. The electric gravity center locations of all event-related maps were averaged over the entire stimulus-on time (450 ms). The mean electric gravity center for disliked faces was located (significant across subjects) more to the right and somewhat more posterior than for liked faces. Similar differences were found between the mean electric gravity centers of misanthropists (more right and posterior) and philanthropists. Our neurophysiological findings are in line with neuropsychological findings, revealing visual emotional processing to depend on affective evaluation category and affective attitude, and extending the conclusions to a paradigm without directed task.

Face-elicited ERPs and affective attitude: brain electric microstate and tomography analyses

Objectives: Although behavioral studies have demonstrated that normative affective traits modulate the processing of facial and emotionally charged stimuli, direct electrophysiological evidence for this modulation is still lacking. Methods: Event-related potential (ERP) data associated with personal, traitlike approach- or withdrawal-related attitude (assessed post-recording and 14 months later) were investigated in 18 subjects during task-free (i.e. unrequested, spontaneous) emotional evaluation of faces. Temporal and spatial aspects of 27 channel ERP were analyzed with microstate analysis and low resolution electromagnetic tomography (LORETA), a new method to compute 3 dimensional cortical current density implemented in the Talairach brain atlas. Results: Microstate analysis showed group differences 132-196 and 196-272 ms poststimulus, with right-shifted electric gravity centers for subjects with negative affective attitude. During these (over subjects reliably identifiable) personality-modulated, face-elicited microstates, LORETA revealed activation of bilateral occipito-temporal regions, reportedly associated with facial configuration extraction processes. Negative compared to positive affective attitude showed higher activity right temporal; positive compared to negative attitude showed higher activity left temporo-parieto-occipital. Conclusions: These temporal and spatial aspects suggest that the subject groups differed in brain activity at early, automatic, stimulus-related face processing steps when structural face encoding (configuration extraction) occurs. In sum, the brain functional microstates associated with affect-related personality features modulate brain mechanisms during face processing already at early information processing stages.