The N170 observed ‘in the wild’: robust event-related potentials to faces in cluttered dynamic visual scenes

As a social species in a constantly changing environment, humans rely heavily on the informational richness and communicative capacity of the face. Thus, understanding how the brain processes information about faces in real-time is of paramount importance. The N170 is a high temporal resolution electrophysiological index of the brain's early response to visual stimuli that is reliably elicited in carefully controlled laboratory-based studies. Although the N170 has often been reported to be of greatest amplitude to faces, there has been debate regarding whether this effect might be an artifact of certain aspects of the controlled experimental stimulation schedules and materials. To investigate whether the N170 can be identified in more realistic conditions with highly variable and cluttered visual images and accompanying auditory stimuli we recorded EEG 'in the wild', while participants watched pop videos. Scene-cuts to faces generated a clear N170 response, and this was larger than the N170 to transitions where the videos cut to non-face stimuli. Within participants, wild-type face N170 amplitudes were moderately correlated to those observed in a typical laboratory experiment. Thus, we demonstrate that the face N170 is a robust and ecologically valid phenomenon and not an artifact arising as an unintended consequence of some property of the more typical laboratory paradigm.

Integrated semantic processing of complex pictures and spoken sentences - Evidence from event-related potentials

It has been suggested that semantic information processing is modularized according to the input form (e.g., visual, verbal, non-verbal sound). A great deal of research has concentrated on detecting a separate verbal module. Also, it has traditionally been assumed in linguistics that the meaning of a single clause is computed before integration to a wider context. Recent research has called these views into question. The present study explored whether it is reasonable to assume separate verbal and nonverbal semantic systems in the light of the evidence from event-related potentials (ERPs). The study also provided information on whether the context influences processing of a single clause before the local meaning is computed. The focus was on an ERP called N400. Its amplitude is assumed to reflect the effort required to integrate an item to the preceding context. For instance, if a word is anomalous in its context, it will elicit a larger N400. N400 has been observed in experiments using both verbal and nonverbal stimuli. Contents of a single sentence were not hypothesized to influence the N400 amplitude. Only the combined contents of the sentence and the picture were hypothesized to influence the N400. The subjects (n = 17) viewed pictures on a computer screen while hearing sentences through headphones. Their task was to judge the congruency of the picture and the sentence. There were four conditions: 1) the picture and the sentence were congruent and sensible, 2) the sentence and the picture were congruent, but the sentence ended anomalously, 3) the picture and the sentence were incongruent but sensible, 4) the picture and the sentence were incongruent and anomalous. Stimuli from the four conditions were presented in a semi-randomized sequence. Their electroencephalography was simultaneously recorded. ERPs were computed for the four conditions. The amplitude of the N400 effect was largest in the incongruent sentence-picture -pairs. The anomalously ending sentences did not elicit a larger N400 than the sensible sentences. The results suggest that there is no separate verbal semantic system, and that the meaning of a single clause is not processed independent of the context.

Language distance and non-native syntactic processing: Evidence from event-related potentials

[EN] In this study, we explore native and non-native syntactic processing, paying special attention to the language distance factor. To this end, we compared how native speakers of Basque and highly proficient non-native speakers of Basque who are native speakers of Spanish process certain core aspects of Basque syntax. Our results suggest that differences in native versus non-native language processing strongly correlate with language distance: native/non-native processing differences obtain if a syntactic parameter of the non-native grammar diverges from the native grammar. Otherwise, non-native processing will approximate native processing as levels of proficiency increase. We focus on three syntactic parameters: (i) the head parameter, (ii) argument alignment (ergative/accusative), and (iii) verb agreement. The first two diverge in Basque and Spanish, but the third is the same in both languages. Our results reveal that native and non-native processing differs for the diverging syntactic parameters, but not for the convergent one. These findings indicate that language distance has a significant impact in non-native language processing.

An Integrated Neural Network-Event-Related Potentials Model of Temporal and Probability Context Effects on Event Categorization

We present a neural network that adapts and integrates several preexisting or new modules to categorize events in short term memory (STM), encode temporal order in working memory, evaluate timing and probability context in medium and long term memory. The model shows how processed contextual information modulates event recognition and categorization, focal attention and incentive motivation. The model is based on a compendium of Event Related Potentials (ERPs) and behavioral results either collected by the authors or compiled from the classical ERP literature. Its hallmark is, at the functional level, the interplay of memory registers endowed with widely different dynamical ranges, and at the structural level, the attempt to relate the different modules to known anatomical structures.

N1, P2 and T-complex of the auditory brain event-related potentials to tones with varying rise times in adults with and without dyslexia

Dyslexia is a learning difficulty affecting the acquisition of fluent reading and spelling skills due to poor phonological processing. Underlying deficits in processing sound rise time have also been found in children and adults with dyslexia. However, the neural basis for these deficits is unknown. In the present study event-related potentials were used to index neural processing and examine the effect of rise time manipulation on the obligatory N1. T-complex and P2 responses in English speaking adults with and without dyslexia. The Tb wave of the T-complex showed differences between groups, with the amplitudes for Tb becoming less negative with increased rise time for the participants with dyslexia only. Frontocentral N1 and P2 did not show group effects. Enhanced Tb amplitude that is modulated by rise time could indicate altered neural networks at the lateral surface of the superior temporal gyrus in adults with dyslexia. (C) 2011 Elsevier B.V. All rights reserved.

An exploration of pre-attentive visual discrimination using event-related potentials

The Mismatch Negativity (MMN) has been characterised as a ‘pre-attentive’ component of an Event-Related Potential (ERP) that is related to discriminatory processes. Although well established in the auditory domain, characteristics of the MMN are less well characterised in the visual domain. The five main studies presented in this thesis examine visual cortical processing using event-related potentials. Novel methodologies have been used to elicit visual detection and discrimination components in the absence of a behavioural task. Developing paradigms in which a behavioural task is not required may have important clinical applications for populations, such as young children, who cannot comply with the demands of an active task. The ‘pre-attentive’ nature of visual MMN has been investigated by modulating attention. Generators and hemispheric lateralisation of visual MMN have been investigated by using pertinent clinical groups. A three stimulus visual oddball paradigm was used to explore the elicitation of visual discrimination components to a change in the orientation of stimuli in the absence of a behavioural task. Monochrome stimuli based on pacman figures were employed that differed from each other only in terms of the orientation of their elements. One such stimulus formed an illusory figure in order to capture the participant’s attention, either in place of, or alongside, a behavioural task. The elicitation of a P3a to the illusory figure but not to the standard or deviant stimuli provided evidence that the illusory figure captured attention. A visual MMN response was recorded in a paradigm with no task demands. When a behavioural task was incorporated into the paradigm, a P3b component was elicited consistent with the allocation of attentional resources to the task. However, visual discrimination components were attenuated revealing that the illusory figure was unable to command all attentional resources from the standard deviant transition. The results are the first to suggest that the visual MMN is modulated by attention. Using the same three stimulus oddball paradigm, generators of visual MMN were investigated by recording potentials directly from the cortex of an adolescent undergoing pre-surgical evaluation for resection of a right anterior parietal lesion. To date no other study has explicitly recorded activity related to the visual MMN intracranially using an oddball paradigm in the absence of a behavioural task. Results indicated that visual N1 and visual MMN could be temporally and spatially separated, with visual MMN being recorded more anteriorly than N1. The characteristic abnormality in retinal projections in albinism afforded the opportunity to investigate each hemisphere in relative isolation and was used, for the first time, as a model to investigate lateralisation of visual MMN and illusory contour processing. Using the three stimulus oddball paradigm, no visual MMN was elicited in this group, and so no conclusions regarding the lateralisation of visual MMN could be made. Results suggested that both hemispheres were equally capable of processing an illusory figure. As a method of presenting visual test stimuli without conscious perception, a continuous visual stream paradigm was developed that used a briefly presented checkerboard stimulus combined with masking for exploring stimulus detection below and above subjective levels of perception. A correlate of very early cortical processing at a latency of 60-80 ms (CI) was elicited whether stimuli were reported as seen or unseen. Differences in visual processing were only evident at a latency of 90 ms (CII) implying that this component may represent a correlate of visual consciousness/awareness. Finally, an oddball sequence was introduced into the visual stream masking paradigm to investigate whether visual MMN responses could be recorded without conscious perception. The stimuli comprised of black and white checkerboard elements differing only in terms of their orientation to form an x or a +. Visual MMN was not recorded when participants were unable to report seeing the stimulus. Results therefore suggest that behavioural identification of the stimuli was required for the elicitation of visual MMN and that visual MMN may require some attentional resources. On the basis of these studies it is concluded that visual MMN is not entirely independent of attention. Further, the combination of clinical and non-clinical investigations provides a unique opportunity to study the characterisation and localisation of putative mechanisms related to conscious and non-conscious visual processing.

Quantifying consistency of Event Related Potentials across subjects based on single-trial topographic analysis

Introduction: Non-invasive brain imaging techniques often contrast experimental conditions across a cohort of participants, obfuscating distinctions in individual performance and brain mechanisms that are better characterised by the inter-trial variability. To overcome such limitations, we developed topographic analysis methods for single-trial EEG data [1]. So far this was typically based on time-frequency analysis of single-electrode data or single independent components. The method's efficacy is demonstrated for event-related responses to environmental sounds, hitherto studied at an average event-related potential (ERP) level. Methods: Nine healthy subjects participated to the experiment. Auditory meaningful sounds of common objects were used for a target detection task [2]. On each block, subjects were asked to discriminate target sounds, which were living or man-made auditory objects. Continuous 64-channel EEG was acquired during the task. Two datasets were considered for each subject including single-trial of the two conditions, living and man-made. The analysis comprised two steps. In the first part, a mixture of Gaussians analysis [3] provided representative topographies for each subject. In the second step, conditional probabilities for each Gaussian provided statistical inference on the structure of these topographies across trials, time, and experimental conditions. Similar analysis was conducted at group-level. Results: Results show that the occurrence of each map is structured in time and consistent across trials both at the single-subject and at group level. Conducting separate analyses of ERPs at single-subject and group levels, we could quantify the consistency of identified topographies and their time course of activation within and across participants as well as experimental conditions. A general agreement was found with previous analysis at average ERP level. Conclusions: This novel approach to single-trial analysis promises to have impact on several domains. In clinical research, it gives the possibility to statistically evaluate single-subject data, an essential tool for analysing patients with specific deficits and impairments and their deviation from normative standards. In cognitive neuroscience, it provides a novel tool for understanding behaviour and brain activity interdependencies at both single-subject and at group levels. In basic neurophysiology, it provides a new representation of ERPs and promises to cast light on the mechanisms of its generation and inter-individual variability.

Children born preterm have high risk for central auditory processing deficits, as indexed by the auditory brain event-related potentials (ERPs). 'Los niños prematuros tienen un alto riesgo de dificultades en el procesamiento auditivo central, evidenciadas mediante los potenciales evocados auditivos'.

Resumen basado en el de la publicación. Resumen en español

Adaptive control of event integration: evidence from event-related potentials

We investigated whether it is possible to control the temporal window of attention used to rapidly integrate visual information. To study the underlying neural mechanisms, we recorded ERPs in an attentional blink task, known to elicit Lag-1 sparing. Lag-1 sparing fosters joint integration of the two targets, evidenced by increased order errors. Short versus long integration windows were induced by showing participants mostly fast or slow stimuli. Participants expecting slow speed used a longer integration window, increasing joint integration. Difference waves showed an early (200 ms post-T2) negative and a late positive modulation (390 ms) in the fast group, but not in the slow group. The modulations suggest the creation of a separate event for T2, which is not needed in the slow group, where targets were often jointly integrated. This suggests that attention can be guided by global expectations of presentation speed within tens of milliseconds.

Automatic artefact removal from event-related potentials via clustering

This paper outlines a method for automatic artefact removal from multichannel recordings of event-related potentials (ERPs). The proposed method is based on, firstly, separation of the ERP recordings into independent components using the method of temporal decorrelation source separation (TDSEP). Secondly, the novel lagged auto-mutual information clustering (LAMIC) algorithm is used to cluster the estimated components, together with ocular reference signals, into clusters corresponding to cerebral and non-cerebral activity. Thirdly, the components in the cluster which contains the ocular reference signals are discarded. The remaining components are then recombined to reconstruct the clean ERPs.

Examining second language development using event-related potentials: a cross-sectional study on the processing of gender and number agreement

This cross-sectional study examines the role of L1-L2 differences and structural distance in the processing of gender and number agreement by English-speaking learners of Spanish at three different levels of proficiency. Preliminary results show that differences between the L1 and L2 impact L2 development, as sensitivity to gender agreement violations, as opposed to number agreement violations, emerges only in learners at advanced levels of proficiency. Results also show that the establishment of agreement dependencies is impacted by the structural distance between the agreeing elements for native speakers and for learners at intermediate and advanced levels of proficiency but not for low proficiency. The overall pattern of results suggests that the linguistic factors examined here impact development but do not constrain ultimate attainment; for advanced learners, results suggest that second language processing is qualitatively similar to native processing.

Simulating event related potentials in tasks involving conflict resolution: a neural network

In this thesis, the main Executive Control theories are exposed. Methods typical of Cognitive and Computational Neuroscience are introduced and the role of behavioural tasks involving conflict resolution in the response elaboration, after the presentation of a stimulus to the subject, are highlighted. In particular, the Eriksen Flanker Task and its variants are discussed. Behavioural data, from scientific literature, are illustrated in terms of response times and error rates. During experimental behavioural tasks, EEG is registered simultaneously. Thanks to this, event related potential, related with the current task, can be studied. Different theories regarding relevant event related potential in this field - such as N2, fERN (feedback Error Related Negativity) and ERN (Error Related Negativity) – are introduced. The aim of this thesis is to understand and simulate processes regarding Executive Control, including performance improvement, error detection mechanisms, post error adjustments and the role of selective attention, with the help of an original neural network model. The network described here has been built with the purpose to simulate behavioural results of a four choice Eriksen Flanker Task. Model results show that the neural network can simulate response times, error rates and event related potentials quite well. Finally, results are compared with behavioural data and discussed in light of the mentioned Executive Control theories. Future perspective for this new model are outlined.

Tracking the implicit self using event-related potentials

Negative biases in implicit self-evaluation are thought to be detrimental to subjective well-being and have been linked to various psychological disorders, including depression. An understanding of the neural processes underlying implicit self-evaluation in healthy subjects could provide a basis for the investigation of negative biases in depressed patients, the development of differential psychotherapeutic interventions, and the estimation of relapse risk in remitted patients. We thus studied the brain processes linked to implicit self-evaluation in 25 healthy subjects using event-related potential (ERP) recording during a self-relevant Implicit Association Test (sIAT). Consistent with a positive implicit self-evaluation in healthy subjects, they responded significantly faster to the congruent (self-positive mapping) than to the incongruent sIAT condition (self-negative mapping). Our main finding was a topographical ERP difference in a time window between 600 and 700 ms, whereas no significant differences between congruent and incongruent conditions were observed in earlier time windows. This suggests that biases in implicit self-evaluation are reflected only indirectly, in the additional recruitment of control processes needed to override the positive implicit self-evaluation of healthy subjects in the incongruent sIAT condition. Brain activations linked to these control processes can thus serve as an indirect measure for estimating biases in implicit self-evaluation. The sIAT paradigm, combined with ERP, could therefore permit the tracking of the neural processes underlying implicit self-evaluation in depressed patients during psychotherapy.