A multimodal investigation of dynamic face perception using functional magnetic resonance imaging and magnetoencephalography

Motion is an important aspect of face perception that has been largely neglected to date. Many of the established findings are based on studies that use static facial images, which do not reflect the unique temporal dynamics available from seeing a moving face. In the present thesis a set of naturalistic dynamic facial emotional expressions was purposely created and used to investigate the neural structures involved in the perception of dynamic facial expressions of emotion, with both functional Magnetic Resonance Imaging (fMRI) and Magnetoencephalography (MEG). Through fMRI and connectivity analysis, a dynamic face perception network was identified, which is demonstrated to extend the distributed neural system for face perception (Haxby et al.,2000). Measures of effective connectivity between these regions revealed that dynamic facial stimuli were associated with specific increases in connectivity between early visual regions, such as inferior occipital gyri and superior temporal sulci, along with coupling between superior temporal sulci and amygdalae, as well as with inferior frontal gyri. MEG and Synthetic Aperture Magnetometry (SAM) were used to examine the spatiotemporal profile of neurophysiological activity within this dynamic face perception network. SAM analysis revealed a number of regions showing differential activation to dynamic versus static faces in the distributed face network, characterised by decreases in cortical oscillatory power in the beta band, which were spatially coincident with those regions that were previously identified with fMRI. These findings support the presence of a distributed network of cortical regions that mediate the perception of dynamic facial expressions, with the fMRI data providing information on the spatial co-ordinates paralleled by the MEG data, which indicate the temporal dynamics within this network. This integrated multimodal approach offers both excellent spatial and temporal resolution, thereby providing an opportunity to explore dynamic brain activity and connectivity during face processing.

Stochasticity, periodicity and localized light structures in partially mode-locked fibre lasers

Physical systems with co-existence and interplay of processes featuring distinct spatio-temporal scales are found in various research areas ranging from studies of brain activity to astrophysics. The complexity of such systems makes their theoretical and experimental analysis technically and conceptually challenging. Here, we discovered that while radiation of partially mode-locked fibre lasers is stochastic and intermittent on a short time scale, it exhibits non-trivial periodicity and long-scale correlations over slow evolution from one round-trip to another. A new technique for evolution mapping of intensity autocorrelation function has enabled us to reveal a variety of localized spatio-temporal structures and to experimentally study their symbiotic co-existence with stochastic radiation. Real-time characterization of dynamical spatio-temporal regimes of laser operation is set to bring new insights into rich underlying nonlinear physics of practical active- and passive-cavity photonic systems.

Multiple roles for executive control in belief-desire reasoning:distinct neural networks are recruited for self perspective inhibition and complexity of reasoning

Belief-desire reasoning is a core component of 'Theory of Mind' (ToM), which can be used to explain and predict the behaviour of agents. Neuroimaging studies reliably identify a network of brain regions comprising a 'standard' network for ToM, including temporoparietal junction and medial prefrontal cortex. Whilst considerable experimental evidence suggests that executive control (EC) may support a functioning ToM, co-ordination of neural systems for ToM and EC is poorly understood. We report here use of a novel task in which psychologically relevant ToM parameters (true versus false belief; approach versus avoidance desire) were manipulated orthogonally. The valence of these parameters not only modulated brain activity in the 'standard' ToM network but also in EC regions. Varying the valence of both beliefs and desires recruits anterior cingulate cortex, suggesting a shared inhibitory component associated with negatively valenced mental state concepts. Varying the valence of beliefs additionally draws on ventrolateral prefrontal cortex, reflecting the need to inhibit self perspective. These data provide the first evidence that separate functional and neural systems for EC may be recruited in the service of different aspects of ToM.

Dissociating the spatio-temporal characteristics of cortical neuronal activity associated with human volitional swallowing in the healthy adult brain

Human swallowing represents a complex highly coordinated sensorimotor function whose functional neuroanatomy remains incompletely understood. Specifically, previous studies have failed to delineate the temporo-spatial sequence of those cerebral loci active during the differing phases of swallowing. We therefore sought to define the temporal characteristics of cortical activity associated with human swallowing behaviour using a novel application of magnetoencephalography (MEG). In healthy volunteers (n = 8, aged 28-45), 151-channel whole cortex MEG was recorded during the conditions of oral water infusion, volitional wet swallowing (5 ml bolus), tongue thrust or rest. Each condition lasted for 5 s and was repeated 20 times. Synthetic aperture magnetometry (SAM) analysis was performed on each active epoch and compared to rest. Temporal sequencing of brain activations utilised time-frequency wavelet plots of regions selected using virtual electrodes. Following SAM analysis, water infusion preferentially activated the caudolateral sensorimotor cortex, whereas during volitional swallowing and tongue movement, the superior sensorimotor cortex was more strongly active. Time-frequency wavelet analysis indicated that sensory input from the tongue simultaneously activated caudolateral sensorimotor and primary gustatory cortex, which appeared to prime the superior sensory and motor cortical areas, involved in the volitional phase of swallowing. Our data support the existence of a temporal synchrony across the whole cortical swallowing network, with sensory input from the tongue being critical. Thus, the ability to non-invasively image this network, with intra-individual and high temporal resolution, provides new insights into the brain processing of human swallowing. © 2004 Elsevier Inc. All rights reserved.

Modulation of neuronal network activity in the primary motor cortex

In the present study I investigated the mechanisms of modulation of neuronal network activity in rat primary motor cortex using pharmacological manipulations employing the in vitro brain slice technique. Preparation of the brain slice in sucrose-based aCSF produced slices with low viability. Introducing the neuroprotectants N-acetyl-cysteine, taurine and aminoguanidine to the preparatory method saw viability of slices increase significantly. Co-application of low dose kainic acid and carbachol consistently generated beta oscillatory activity in M1. Analyses indicated that network activity in M1 relied on the involvement of GABAA receptors. Dose-response experiments performed in M1 showed that beta activity can be modulated by benzodiazepine site ligands. Low doses of positive allosteric modulators consistently desynchronised beta oscillatory activity, a mechanism that may be driven by a1-subunit containing GABAA receptors. Higher doses increased the power of beta oscillatory activity. Whole-cell recordings in M1 uncovered three interneuronal subtypes regularly encountered in M1; Fast-spiking, regular-spiking non-Pyramidal and low threshold spiking. With the paradoxical effects of positive allosteric modulators in mind, subsequent voltage-clamp recordings in FS cells revealed a constitutively active tonic inhibitory current that could be modulated by zolpidem in two different ways. Low dose zolpidem increased the tonic inhibitory current in FS cells, consistent with the desynchronisation of network oscillatory activity seen at this concentration. High dose zolpidem decreased the inhibitory tonic current seen in FS cells, coinciding with an increase in oscillatory power. These studies indicate a fundamental role for a tonic inhibitory current in the modulation of network activity. Furthermore, desynchronisation of beta activity in M1 decreased as viability of the in vitro brain slice increased, suggesting that the extent of desynchronisation is dependent upon the pathophysiological state of the network. This indicates that low dose zolpidem could be used as a therapeutic agent specifically for the desynchronisation of pathological oscillations in oscillopathies such as Parkinson’s disease.

The relationship between self-awareness of attentional status, behavioral performance and oscillatory brain rhythms

High-level cognitive factors, including self-awareness, are believed to play an important role in human visual perception. The principal aim of this study was to determine whether oscillatory brain rhythms play a role in the neural processes involved in self-monitoring attentional status. To do so we measured cortical activity using magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) while participants were asked to self-monitor their internal status, only initiating the presentation of a stimulus when they perceived their attentional focus to be maximal. We employed a hierarchical Bayesian method that uses fMRI results as soft-constrained spatial information to solve the MEG inverse problem, allowing us to estimate cortical currents in the order of millimeters and milliseconds. Our results show that, during self-monitoring of internal status, there was a sustained decrease in power within the 7-13 Hz (alpha) range in the rostral cingulate motor area (rCMA) on the human medial wall, beginning approximately 430 msec after the trial start (p < 0.05, FDR corrected). We also show that gamma-band power (41-47 Hz) within this area was positively correlated with task performance from 40-640 msec after the trial start (r = 0.71, p < 0.05). We conclude: (1) the rCMA is involved in processes governing self-monitoring of internal status; and (2) the qualitative differences between alpha and gamma activity are reflective of their different roles in self-monitoring internal states. We suggest that alpha suppression may reflect a strengthening of top-down interareal connections, while a positive correlation between gamma activity and task performance indicates that gamma may play an important role in guiding visuomotor behavior. © 2013 Yamagishi et al.

Attentional changes in pre-stimulus oscillatory activity within early visual cortex are predictive of human visual performance

Physiological and neuroimaging studies provide evidence to suggest that attentional mechanisms operating within the fronto-parietal network may exert top–down control on early visual areas, priming them for forthcoming sensory events. The believed consequence of such priming is enhanced task performance. Using the technique of magnetoencephalography (MEG), we investigated this possibility by examining whether attention-driven changes in cortical activity are correlated with performance on a line-orientation judgment task. We observed that, approximately 200 ms after a covert attentional shift towards the impending visual stimulus, the level of phase-resetting (transient neural coherence) within the calcarine significantly increased for 2–10 Hz activity. This was followed by a suppression of alpha activity (near 10 Hz) which persisted until the onset of the stimulus. The levels of phase-resetting, alpha suppression and subsequent behavioral performance varied between subjects in a systematic fashion. The magnitudes of phase-resetting and alpha-band power were negatively correlated, with high levels of coherence associated with high levels of performance. We propose that top–down attentional control mechanisms exert their initial effects within the calcarine through a phase-resetting within the 2–10 Hz band, which in turn triggers a suppression of alpha activity, priming early visual areas for incoming information and enhancing behavioral performance.

Cortical oscillatory activity associated with the perception of illusory and real visual contours

We used magnetoencephalography (MEG) to examine the nature of oscillatory brain rhythms when passively viewing both illusory and real visual contours. Three stimuli were employed: a Kanizsa triangle; a Kanizsa triangle with a real triangular contour superimposed; and a control figure in which the corner elements used to form the Kanizsa triangle were rotated to negate the formation of illusory contours. The MEG data were analysed using synthetic aperture magnetometry (SAM) to enable the spatial localisation of task-related oscillatory power changes within specific frequency bands, and the time-course of activity within given locations-of-interest was determined by calculating time-frequency plots using a Morlet wavelet transform. In contrast to earlier studies, we did not find increases in gamma activity (> 30 Hz) to illusory shapes, but instead a decrease in 10–30 Hz activity approximately 200 ms after stimulus presentation. The reduction in oscillatory activity was primarily evident within extrastriate areas, including the lateral occipital complex (LOC). Importantly, this same pattern of results was evident for each stimulus type. Our results further highlight the importance of the LOC and a network of posterior brain regions in processing visual contours, be they illusory or real in nature. The similarity of the results for both real and illusory contours, however, leads us to conclude that the broadband (< 30 Hz) decrease in power we observed is more likely to reflect general changes in visual attention than neural computations specific to processing visual contours.

Attentional shifts towards an expected visual target alter the level of alpha-band oscillatory activity in the human calcarine cortex

Neuronal operations associated with the top-down control process of shifting attention from one locus to another involve a network of cortical regions, and their influence is deemed fundamental to visual perception. However, the extent and nature of these operations within primary visual areas are unknown. In this paper, we used magnetoencephalography (MEG) in combination with magnetic resonance imaging (MRI) to determine whether, prior to the onset of a visual stimulus, neuronal activity within early visual cortex is affected by covert attentional shifts. Time/frequency analyses were used to identify the nature of this activity. Our results show that shifting attention towards an expected visual target results in a late-onset (600 ms postcue onset) depression of alpha activity which persists until the appearance of the target. Independent component analysis (ICA) and dipolar source modeling confirmed that the neuronal changes we observed originated from within the calcarine cortex. Our results further show that the amplitude changes in alpha activity were induced not evoked (i.e., not phase-locked to the cued attentional task). We argue that the decrease in alpha prior to the onset of the target may serve to prime the early visual cortex for incoming sensory information. We conclude that attentional shifts affect activity within the human calcarine cortex by altering the amplitude of spontaneous alpha rhythms and that subsequent modulation of visual input with attentional engagement follows as a consequence of these localized changes in oscillatory activity. © 2005 Elsevier B.V. All rights reserved.

Attentional modulation of oscillatory activity in human visual cortex

The effects of attentional modulation on activity within the human visual cortex were investigated using magnetoencephalography. Chromatic sinusoidal stimuli were used to evoke activity from the occipital cortex, with attention directed either toward or away from the stimulus using a bar-orientation judgment task. For five observers, global magnetic field power was plotted as a function of time from stimulus onset. The major peak of each function occurred at about 120 ms latency and was well modeled by a current dipole near the calcarine sulcus. Independent component analysis (ICA) on the non-averaged data for each observer also revealed one component of calcarine origin, the location of which matched that of the dipolar source determined from the averaged data. For two observers, ICA revealed a second component near the parieto-occipital sulcus. Although no effects of attention were evident using standard averaging procedures, time-varying spectral analyses of single trials revealed that the main effect of attention was to alter the level of oscillatory activity. Most notably, a sustained increase in alpha-band (7-12 Hz) activity of both calcarine and parieto-occipital origin was evident. In addition, calcarine activity in the range of 13-21 Hz was enhanced, while calcarine activity in the range of 5-6 Hz was reduced. Our results are consistent with the hypothesis that attentional modulation affects neural processing within the calcarine and parieto-occipital cortex by altering the amplitude of alpha-band activity and other natural brain rhythms. © 2003 Elsevier Inc. All rights reserved.

Real-time imaging of human cortical activity evoked by painful esophageal stimulation

Background & Aims: Current models of visceral pain processing derived from metabolic brain imaging techniques fail to differentiate between exogenous (stimulus-dependent) and endogenous (non-stimulus-specific) neural activity. The aim of this study was to determine the spatiotemporal correlates of exogenous neural activity evoked by painful esophageal stimulation. Methods: In 16 healthy subjects (8 men; mean age, 30.2 ± 2.2 years), we recorded magnetoencephalographic responses to 2 runs of 50 painful esophageal electrical stimuli originating from 8 brain subregions. Subsequently, 11 subjects (6 men; mean age, 31.2 ± 1.8 years) had esophageal cortical evoked potentials recorded on a separate occasion by using similar experimental parameters. Results: Earliest cortical activity (P1) was recorded in parallel in the primary/secondary somatosensory cortex and posterior insula (∼85 ms). Significantly later activity was seen in the anterior insula (∼103 ms) and cingulate cortex (∼106 ms; P = .0001). There was no difference between the P1 latency for magnetoencephalography and cortical evoked potential (P = .16); however, neural activity recorded with cortical evoked potential was longer than with magnetoencephalography (P = .001). No sex differences were seen for psychophysical or neurophysiological measures. Conclusions: This study shows that exogenous cortical neural activity evoked by experimental esophageal pain is processed simultaneously in somatosensory and posterior insula regions. Activity in the anterior insula and cingulate - brain regions that process the affective aspects of esophageal pain - occurs significantly later than in the somatosensory regions, and no sex differences were observed with this experimental paradigm. Cortical evoked potential reflects the summation of cortical activity from these brain regions and has sufficient temporal resolution to separate exogenous and endogenous neural activity. © 2005 by the American Gastroenterological Association.

Disordered connectivity in the autistic brain:challenges for the 'new psychophysiology'

In 2002, we published a paper [Brock, J., Brown, C., Boucher, J., Rippon, G., 2002. The temporal binding deficit hypothesis of autism. Development and Psychopathology 142, 209-224] highlighting the parallels between the psychological model of 'central coherence' in information processing [Frith, U., 1989. Autism: Explaining the Enigma. Blackwell, Oxford] and the neuroscience model of neural integration or 'temporal binding'. We proposed that autism is associated with abnormalities of information integration that is caused by a reduction in the connectivity between specialised local neural networks in the brain and possible overconnectivity within the isolated individual neural assemblies. The current paper updates this model, providing a summary of theoretical and empirical advances in research implicating disordered connectivity in autism. This is in the context of changes in the approach to the core psychological deficits in autism, of greater emphasis on 'interactive specialisation' and the resultant stress on early and/or low-level deficits and their cascading effects on the developing brain [Johnson, M.H., Halit, H., Grice, S.J., Karmiloff-Smith, A., 2002. Neuroimaging of typical and atypical development: a perspective from multiple levels of analysis. Development and Psychopathology 14, 521-536].We also highlight recent developments in the measurement and modelling of connectivity, particularly in the emerging ability to track the temporal dynamics of the brain using electroencephalography (EEG) and magnetoencephalography (MEG) and to investigate the signal characteristics of this activity. This advance could be particularly pertinent in testing an emerging model of effective connectivity based on the balance between excitatory and inhibitory cortical activity [Rubenstein, J.L., Merzenich M.M., 2003. Model of autism: increased ratio of excitation/inhibition in key neural systems. Genes, Brain and Behavior 2, 255-267; Brown, C., Gruber, T., Rippon, G., Brock, J., Boucher, J., 2005. Gamma abnormalities during perception of illusory figures in autism. Cortex 41, 364-376]. Finally, we note that the consequence of this convergence of research developments not only enables a greater understanding of autism but also has implications for prevention and remediation. © 2006.

Pharmacologically induced and stimulus evoked rhythmic neuronal oscillatory activity in the primary motor cortex in vitro

Parkinson's disease (PD) is associated with enhanced synchronization of neuronal network activity in the beta (15-30 Hz) frequency band across several nuclei of the basal ganglia (BG). Deep brain stimulation of the subthalamic nucleus (STN) appears to reduce this pathological oscillation, thereby alleviating PD symptoms. However, direct stimulation of primary motor cortex (M1) has recently been shown to be effective in reducing symptoms in PD, suggesting a role for cortex in patterning pathological rhythms. Here, we examine the properties of M1 network oscillations in coronal slices taken from rat brain. Oscillations in the high beta frequency range (layer 5, 27.8 +/- 1.1 Hz, n=6) were elicited by co-application of the glutamate receptor agonist kainic acid (400 nM) and muscarinic receptor agonist carbachol (50 mu M). Dual extracellular recordings, local application of tetrodotoxin and recordings in M1 micro-sections indicate that the activity originates within deep layers V/VI. Beta oscillations were unaffected by specific AMPA receptor blockade, abolished by the GABA type A receptor (GABAAR) antagonist picrotoxin and the gap-junction blocker carbenoxolone, and modulated by pentobarbital and zolpidem indicating dependence on networks of GABAergic interneurons and electrical coupling. High frequency stimulation (HFS) at 125 Hz in superficial layers, designed to mimic transdural/transcranial stimulation, generated gamma oscillations in layers 11 and V (incidence 95%, 69.2 +/- 7.3 Hz, n=17) with very fast oscillatory components (VFO; 100-250 Hz). Stimulation at 4 Hz, however, preferentially promoted theta activity (incidence 62.5%, 5.1 +/- 0.6 Hz, n=15) that effected strong amplitude modulation of ongoing beta activity. Stimulation at 20 Hz evoked mixed theta and gamma responses. These data suggest that within M1, evoked theta, gamma and fast oscillations may coexist with and in some cases modulate pharmacologically induced beta oscillations.

Functional interconnectivity between the globus pallidus and the subthalamic nucleus in the mouse brain slice

In accordance with its central role in basal ganglia circuitry, changes in the rate of action potential firing and pattern of activity in the globus pallidus (GP)-subthalamic nucleus (STN) network are apparent in movement disorders. In this study we have developed a mouse brain slice preparation that maintains the functional connectivity between the GP and STN in order to assess its role in shaping and modulating bursting activity promoted by pharmacological manipulations. Fibre-tract tracing studies indicated that a parasagittal slice cut 20 deg to the midline best preserved connectivity between the GP and the STN. IPSCs and EPSCs elicited by electrical stimulation confirmed connectivity from GP to STN in 44/59 slices and from STN to GP in 22/33 slices, respectively. In control slices, 74/76 (97%) of STN cells fired tonically at a rate of 10.3 ± 1.3 Hz. This rate and pattern of single spiking activity was unaffected by bath application of the GABAA antagonist picrotoxin (50 μM, n = 9) or the glutamate receptor antagonist (6-cyano-7-nitroquinoxaline-2, 3-dione (CNQX) 10 μM, n = 8). Bursting activity in STN neurones could be induced pharmacologically by application of NMDA alone (20 μM, 3/18 cells, 17%) but was more robust if NMDA was applied in conjunction with apamin (20-100 nM, 34/77 cells, 44%). Once again, neither picrotoxin (50 μM, n = 5) nor CNQX (10 μM, n = 5) had any effect on the frequency or pattern of the STN neurone activity while paired STN and GP recordings of tonic and bursting activity show no evidence of coherent activity. Thus, in a mouse brain slice preparation where functional GP-STN connectivity is preserved, no regenerative synaptically mediated activity indicative of a dynamic network is evident, either in the resting state or when neuronal bursting in both the GP and STN is generated by application of NMDA/apamin. This difference from the brain in Parkinson's disease may be attributed either to insufficient preservation of cortico-striato-pallidal or cortico-subthalamic circuitry, and/or an essential requirement for adaptive changes resulting from dopamine depletion for the expression of network activity within this tissue complex. © The Physiological Society 2005.

Functional source separation applied to induced visual gamma activity

Objective of this work was to explore the performance of a recently introduced source extraction method, FSS (Functional Source Separation), in recovering induced oscillatory change responses from extra-cephalic magnetoencephalographic (MEG) signals. Unlike algorithms used to solve the inverse problem, FSS does not make any assumption about the underlying biophysical source model; instead, it makes use of task-related features (functional constraints) to estimate source/s of interest. FSS was compared with blind source separation (BSS) approaches such as Principal and Independent Component Analysis, PCA and ICA, which are not subject to any explicit forward solution or functional constraint, but require source uncorrelatedness (PCA), or independence (ICA). A visual MEG experiment with signals recorded from six subjects viewing a set of static horizontal black/white square-wave grating patterns at different spatial frequencies was analyzed. The beamforming technique Synthetic Aperture Magnetometry (SAM) was applied to localize task-related sources; obtained spatial filters were used to automatically select BSS and FSS components in the spatial area of interest. Source spectral properties were investigated by using Morlet-wavelet time-frequency representations and significant task-induced changes were evaluated by means of a resampling technique; the resulting spectral behaviours in the gamma frequency band of interest (20-70 Hz), as well as the spatial frequency-dependent gamma reactivity, were quantified and compared among methods. Among the tested approaches, only FSS was able to estimate the expected sustained gamma activity enhancement in primary visual cortex, throughout the whole duration of the stimulus presentation for all subjects, and to obtain sources comparable to invasively recorded data.