Comparing neural correlates of configural processing in faces and objects:An ERP study of the thatcher illusion

In the Thatcher illusion, a face with inverted eyes and mouth looks abnormal when upright but not when inverted. Behavioral studies have shown that thatcherization of an upright face disrupts perceptual processing of the local configuration. We recorded high-density EEG from normal observers to study ERP correlates of the illusion during the perception of faces and nonface objects, to determine whether inversion and thatcherization affect similar neural mechanisms. Observers viewed faces and houses in four conditions (upright vs. inverted, and normal vs. thatcherized) while detecting an oddball category (chairs). Thatcherization delayed the N170 component over occipito-temporal cortex to faces, but not to houses. This modulation matched the illusion as it was larger for upright than inverted faces. The P1 over medial occipital regions was delayed by face inversion but unaffected by thatcherization. Finally, face thatcherization delayed P2 over occipito-temporal but not over parietal regions, while inversion affected P2 across categories. All effects involving thatcherization were face-specific. These results indicate that effects of face inversion and feature inversion (in thatcherized faces) can be distinguished on a functional as well as neural level, and that they affect configural processing of faces in different time windows. © 2006 Elsevier Inc.

Investigation of neural correlates of faces and emotional expressions using magnetoencephalography

The recognition of faces and of facial expressions in an important evolutionary skill, and an integral part of social communication. It has been argued that the processing of faces is distinct from the processing of non-face stimuli and functional neuroimaging investigations have even found evidence of a distinction between the perception of faces and of emotional expressions. Structural and temporal correlates of face perception and facial affect have only been separately identified. Investigation neural dynamics of face perception per se as well as facial affect would allow the mapping of these in space, time and frequency specific domains. Participants were asked to perform face categorisation and emotional discrimination tasks and Magnetoencephalography (MEG) was used to measure the neurophysiology of face and facial emotion processing. SAM analysis techniques enable the investigation of spectral changes within specific time-windows and frequency bands, thus allowing the identification of stimulus specific regions of cortical power changes. Furthermore, MEG’s excellent temporal resolution allows for the detection of subtle changes associated with the processing of face and non-face stimuli and different emotional expressions. The data presented reveal that face perception is associated with spectral power changes within a distributed cortical network comprising occipito-temporal as well as parietal and frontal areas. For the perception of facial affect, spectral power changes were also observed within frontal and limbic areas including the parahippocampal gyrus and the amygdala. Analyses of temporal correlates also reveal a distinction between the processing of faces and facial affect. Face perception per se occurred at earlier latencies whereas the discrimination of facial expression occurred within a longer time-window. In addition, the processing of faces and facial affect was differentially associated with changes in cortical oscillatory power for alpha, beta and gamma frequencies. The perception of faces and facial affect is associated with distinct changes in cortical oscillatory activity that can be mapped to specific neural structures, specific time-windows and latencies as well as specific frequency bands. Therefore, the work presented in this thesis provides further insight into the sequential processing of faces and facial affect.

Investigation of the neural correlates of recognition memory using magnetoencephalography

Neuroimaging literature has identified several regions involved in encoding and recognition processes. A review of the literature illustrated considerable variations in the precise location and mechanisms of these processes, and it was these variations that were investigated in the studies in this thesis. Magnetoencephalography (MEG) was used as the neuroimaging tool and a preliminary study identified Synthetic Aperture Magnetometry (SAM) and not a traditional dipole fitting technique, as an appropriate tool for identifying the multiple cortical regions involved in recognition memory. It has been suggested that there is hemispheric asymmetry in encoding and recognition processes. There are two main hypotheses: the first suggesting that there is task-specificity, the second that this specificity is determined by stimulus modality. A series of experiments was completed with two main aims: first to produce consistent and complementary recognition memory data with MEG, and second to determine whether there exists any hemispheric asymmetry in recognition memory. The results obtained from five experiments demonstrated activation of prefrontal and middle temporal structures, which were consistent with those reported in previous neuroimaging studies. It was suggested that this diverse activation may be explained by the involvement of a semantic network during recognition memory processes. In support of this, a subsequent study involving a semantic encoding task demonstrated that category-specific differences in cortical activation also existed in the recognition memory phase. Controlling for the involvement of such semantic processes produced predominantly bilateral activation. It was suggested that the apparent hemispheric asymmetry findings reported in the literature may be due to the 'coarse' temporal analysis available with earlier imaging techniques, which over-simplified the networks reported by being unable to recognise the early complex processes associated with semantic processing which these MEG studies were able to identify. The importance of frequency-specific activations, specifically theta synchronisation and alpha desynchronisation, in memory processes was also investigated.

Having a word with yourself:neural correlates of self-criticism and self-reassurance

Self-criticism is strongly correlated with a range of psychopathologies, such as depression, eating disorders and anxiety. In contrast, self-reassurance is inversely associated with such psychopathologies. Despite the importance of self-judgements and evaluations, little is known about the neurophysiology of these internal processes. The current study therefore used a novel fMRI task to investigate the neuronal correlates of self-criticism and self-reassurance. Participants were presented statements describing two types of scenario, with the instruction to either imagine being self-critical or self-reassuring in that situation. One scenario type focused on a personal setback, mistake or failure, which would elicit negative emotions, whilst the second was of a matched neutral event. Self-criticism was associated with activity in lateral prefrontal cortex (PFC) regions and dorsal anterior cingulate (dAC), therefore linking self-critical thinking to error processing and resolution, and also behavioural inhibition. Self-reassurance was associated with left temporal pole and insula activation, suggesting that efforts to be self-reassuring engage similar regions to expressing compassion and empathy towards others. Additionally, we found a dorsal/ventral PFC divide between an individual's tendency to be self-critical or self-reassuring. Using multiple regression analyses, dorsolateral PFC activity was positively correlated with high levels of self-criticism (assessed via self-report measure), suggesting greater error processing and behavioural inhibition in such individuals. Ventrolateral PFC activity was positively correlated with high self-reassurance. Our findings may have implications for the neural basis of a range of mood disorders that are characterised by a preoccupation with personal mistakes and failures, and a self-critical response to such events.

Familial and disease specific abnormalities in the neural correlates of the Stroop Task in Bipolar Disorder

Patients with Bipolar Disorder (BD) perform poorly on tasks of selective attention and inhibitory control. Although similar behavioural deficits have been noted in their relatives, it is yet unclear whether they reflect dysfunction in the same neural circuits. We used functional magnetic resonance imaging and the Stroop Colour Word Task to compare task related neural activity between 39 euthymic BD patients, 39 of their first-degree relatives (25 with no Axis I disorders and 14 with Major Depressive Disorder) and 48 healthy controls. Compared to controls, all individuals with familial predisposition to BD, irrespective of diagnosis, showed similar reductions in neural responsiveness in regions involved in selective attention within the posterior and inferior parietal lobules. In contrast, hypoactivation within fronto-striatal regions, implicated in inhibitory control, was observed only in BD patients and MDD relatives. Although striatal deficits were comparable between BD patients and their MDD relatives, right ventrolateral prefrontal dysfunction was uniquely associated with BD. Our findings suggest that while reduced parietal engagement relates to genetic risk, fronto-striatal dysfunction reflects processes underpinning disease expression for mood disorders. © 2011 Elsevier Inc.

The impact of the Val158Met catechol-O-methyltransferase genotype on neural correlates of sad facial affect processing in patients with bipolar disorder and their relatives

Background - The Met allele of the catechol-O-methyltransferase (COMT) valine-to-methionine (Val158Met) polymorphism is known to affect dopamine-dependent affective regulation within amygdala-prefrontal cortical (PFC) networks. It is also thought to increase the risk of a number of disorders characterized by affective morbidity including bipolar disorder (BD), major depressive disorder (MDD) and anxiety disorders. The disease risk conferred is small, suggesting that this polymorphism represents a modifier locus. Therefore our aim was to investigate how the COMT Val158Met may contribute to phenotypic variation in clinical diagnosis using sad facial affect processing as a probe for its neural action. Method - We employed functional magnetic resonance imaging to measure activation in the amygdala, ventromedial PFC (vmPFC) and ventrolateral PFC (vlPFC) during sad facial affect processing in family members with BD (n=40), MDD and anxiety disorders (n=22) or no psychiatric diagnosis (n=25) and 50 healthy controls. Results - Irrespective of clinical phenotype, the Val158 allele was associated with greater amygdala activation and the Met allele with greater signal change in the vmPFC and vlPFC. Signal changes in the amygdala and vmPFC were not associated with disease expression. However, in the right vlPFC the Met158 allele was associated with greater activation in all family members with affective morbidity compared with relatives without a psychiatric diagnosis and healthy controls. Conclusions - Our results suggest that the COMT Val158Met polymorphism has a pleiotropic effect within the neural networks subserving emotional processing. Furthermore the Met158 allele further reduces cortical efficiency in the vlPFC in individuals with affective morbidity. © 2010 Cambridge University Press.

The neural correlates of reading impairment in adults with developmental dyslexia:evidence from fMRI between group analyses and an fMRI multiple-case study

The goal of this project was to investigate the neural correlates of reading impairment in dyslexia as hypothesised by the main theories – the phonological deficit, visual magnocellular deficit and cerebellar deficit theories, with emphasis on individual differences. This research took a novel approach by: 1) contrasting the predictions in one sample of participants with dyslexia (DPs); 2) using a multiple-case study (and between-group comparisons) to investigate differences in BOLD between each DP and the controls (CPs); 3) demonstrating a possible relationship between reading impairment and its hypothesised neural correlates by using fMRI and a reading task. The multiple-case study revealed that the neural correlates of reading in dyslexia in all cases are not in agreement with the predictions of a single theory. The results show striking individual differences - even, where the neural correlates of reading in two DPs are consistent with the same theory, the areas can differ. A DP can exhibit under-engagement in an area in word, but not in pseudoword reading and vice versa, demonstrating that underactivation in that area cannot be interpreted as a ‘developmental lesion’. Additional analyses revealed complex results. Within-group analyses between behavioural measures and BOLD showed correlations in the predicted regions, areas outside ROI, and lack of correlations in some predicted areas. Comparisons of subgroups which differed on Orthography Composite supported the MDT, but only for Words. The results suggest that phonological scores are not a sufficient predictor of the under-engagement of phonological areas during reading. DPs and CPs exhibited correlations between Purdue Pegboard Composite and BOLD in cerebellar areas only for Pseudowords. Future research into reading in dyslexia should use a more holistic approach, involving genetic and environmental factors, gene by environment interaction, and comorbidity with other disorders. It is argued that multidisciplinary research, within the multiple-deficit model holds significant promise here.

Cortical mechanisms of attention in time:neural correlates of the Lag-1-sparing phenomenon

If humans monitor streams of rapidly presented (approximately 100-ms intervals) visual stimuli, which are typically specific single letters of the alphabet, for two targets (T1 and T2), they often miss T2 if it follows T1 within an interval of 200-500 ms. If T2 follows T1 directly (within 100 ms; described as occurring at 'Lag 1'), however, performance is often excellent: the so-called 'Lag-1 sparing' phenomenon. Lag-1 sparing might result from the integration of the two targets into the same 'event representation', which fits with the observation that sparing is often accompanied by a loss of T1-T2 order information. Alternatively, this might point to competition between the two targets (implying a trade-off between performance on T1 and T2) and Lag-1 sparing might solely emerge from conditional data analysis (i.e. T2 performance given T1 correct). We investigated the neural correlates of Lag-1 sparing by carrying out magnetoencephalography (MEG) recordings during an attentional blink (AB) task, by presenting two targets with a temporal lag of either 1 or 2 and, in the case of Lag 2, with a nontarget or a blank intervening between T1 and T2. In contrast to Lag 2, where two distinct neural responses were observed, at Lag 1 the two targets produced one common neural response in the left temporo-parieto-frontal (TPF) area but not in the right TPF or prefrontal areas. We discuss the implications of this result with respect to competition and integration hypotheses, and with respect to the different functional roles of the cortical areas considered. We suggest that more than one target can be identified in parallel in left TPF, at least in the absence of intervening nontarget information (i.e. masks), yet identified targets are processed and consolidated as two separate events by other cortical areas (right TPF and PFC, respectively).

Developmental Neural Correlates of Social Interaction

Children develop in a sea of reciprocal social interaction, but their brain development is predominately studied in non-interactive contexts (e.g., viewing photographs of faces). This dissertation investigated how the developing brain supports social interaction. Specifically, novel paradigms were used to target two facets of social experience—social communication and social motivation—across three studies in children and adults. In Study 1, adults listened to short vignettes—which contained no social information—that they believed to be either prerecorded or presented over an audio-feed by a live social partner. Simply believing that speech was from a live social partner increased activation in the brain’s mentalizing network—a network involved in thinking about others’ thoughts. Study 2 extended this paradigm to middle childhood, a time of increasing social competence and social network complexity, as well as structural and functional social brain development. Results showed that, as in adults, regions of the mentalizing network were engaged by live speech. Taken together, these findings indicate that the mentalizing network may support the processing of interactive communicative cues across development. Given this established importance of social-interactive context, Study 3 examined children’s social motivation when they believed they were engaged in a computer-based chat with a peer. Children initiated interaction via sharing information about their likes and hobbies and received responses from the peer. Compared to a non-social control, in which children chatted with a computer, peer interaction increased activation in mentalizing regions and reward circuitry. Further, within mentalizing regions, responsivity to the peer increased with age. Thus, across all three studies, social cognitive regions associated with mentalizing supported real-time social interaction. In contrast, the specific social context appeared to influence both reward circuitry involvement and age-related changes in neural activity. Future studies should continue to examine how the brain supports interaction across varied real-world social contexts. In addition to illuminating typical development, understanding the neural bases of interaction will offer insight into social disabilities such as autism, where social difficulties are often most acute in interactive situations. Ultimately, to best capture human experience, social neuroscience ought to be embedded in the social world.

Steady state visually evoked potential correlates of static and dynamic emotional face processing

While the neural regions associated with facial identity recognition are considered to be well defined, the neural correlates of non-moving and moving images of facial emotion processing are less clear. This study examined the brain electrical activity changes in 26 participants (14 males M = 21.64, SD = 3.99; 12 females M = 24.42, SD = 4.36), during a passive face viewing task, a scrambled face task and separate emotion and gender face discrimination tasks. The steady state visual evoked potential (SSVEP) was recorded from 64-electrode sites. Consistent with previous research, face related activity was evidenced at scalp regions over the parieto-temporal region approximately 170 ms after stimulus presentation. Results also identified different SSVEP spatio-temporal changes associated with the processing of static and dynamic facial emotions with respect to gender, with static stimuli predominately associated with an increase in inhibitory processing within the frontal region. Dynamic facial emotions were associated with changes in SSVEP response within the temporal region, which are proposed to index inhibitory processing. It is suggested that static images represent non-canonical stimuli which are processed via different mechanisms to their more ecologically valid dynamic counterparts.

Characterization of the neural mechanisms supporting the implementation of cognitive control in human decision making

Humans are particularly adept at modifying their behavior in accordance with changing environmental demands. Through various mechanisms of cognitive control, individuals are able to tailor actions to fit complex short- and long-term goals. The research described in this thesis uses functional magnetic resonance imaging to characterize the neural correlates of cognitive control at two levels of complexity: response inhibition and self-control in intertemporal choice. First, we examined changes in neural response associated with increased experience and skill in response inhibition; successful response inhibition was associated with decreased neural response over time in the right ventrolateral prefrontal cortex, a region widely implicated in cognitive control, providing evidence for increased neural efficiency with learned automaticity. We also examined a more abstract form of cognitive control using intertemporal choice. In two experiments, we identified putative neural substrates for individual differences in temporal discounting, or the tendency to prefer immediate to delayed rewards. Using dynamic causal models, we characterized the neural circuit between ventromedial prefrontal cortex, an area involved in valuation, and dorsolateral prefrontal cortex, a region implicated in self-control in intertemporal and dietary choice, and found that connectivity from dorsolateral prefrontal cortex to ventromedial prefrontal cortex increases at the time of choice, particularly when delayed rewards are chosen. Moreover, estimates of the strength of connectivity predicted out-of-sample individual rates of temporal discounting, suggesting a neurocomputational mechanism for variation in the ability to delay gratification. Next, we interrogated the hypothesis that individual differences in temporal discounting are in part explained by the ability to imagine future reward outcomes. Using a novel paradigm, we imaged neural response during the imagining of primary rewards, and identified negative correlations between activity in regions associated the processing of both real and imagined rewards (lateral orbitofrontal cortex and ventromedial prefrontal cortex, respectively) and the individual temporal discounting parameters estimated in the previous experiment. These data suggest that individuals who are better able to represent reward outcomes neurally are less susceptible to temporal discounting. Together, these findings provide further insight into role of the prefrontal cortex in implementing cognitive control, and propose neurobiological substrates for individual variation.

The Impact of Prenatal Nicotine Exposure on Impulsivity and Neural Firing in the Medial Prefrontal Cortex

Prenatal nicotine exposure (PNE) is linked to a large number of psychiatric disorders, including attention deficit hyperactivity disorder (ADHD). Current literature suggests that core deficits observed in ADHD reflect abnormal inhibitory control governed by the prefrontal cortex (PFC) of the brain. The PFC is structurally altered by PNE, but it is still unclear how neural firing is affected during tasks that test behavioral inhibition, such as the stop-signal task, or if neural correlates related to inhibitory control are affected after PNE in awake behaving animals. To address these questions, we recorded from single medial PFC (mPFC) neurons in control rats and PNE rats as they performed our stopsignal task. We found that PNE rats were faster for all trial types and were less likely to inhibit the behavioral response on STOP trials. Neurons in mPFC fired more strongly on STOP trials and were correlated with accuracy and reaction time. Although the number of neurons exhibiting significant modulation during task performance did not differ between groups, overall activity in PNE was reduced. We conclude that PNE makes rats impulsive and reduces firing in mPFC neurons that carry signals related to response inhibition.

The neural basis of maternal responsiveness to infants: an fMRI study

Using fMRI, we examined the neural correlates of maternal responsiveness. Ten healthy mothers viewed alternating blocks of video: (i) 40 s of their own infant; (ii) 20 s of a neutral video; (iii) 40 s of an unknown infant and (iv) 20 s of neutral video, repeated 4 times. Predominant BOLD signal change to the contrast of infants minus neutral stimulus occurred in bilateral visual processing regions BA minus neutral stimulus occurred in bilateral visual processing regions (BA 38), left amygdala and visual cortex (BA 19), and to the unknown infant minus own infant contrast in bilateral orbitofrontal cortex (BA 10,47) and medial prefrontal cortex (BA 8). These findings suggest that amygdala and temporal pole may be key sites in mediating a mother's response to her infant and reaffirms their importance in face emotion processing and social behaviour.

Neural basis of the undermining effect of monetary reward on intrinsic motivation

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.