Learning based automatic face annotation for arbitrary poses and expressions from frontal images only

Statistical approaches for building non-rigid deformable models, such as the Active Appearance Model (AAM), have enjoyed great popularity in recent years, but typically require tedious manual annotation of training images. In this paper, a learning based approach for the automatic annotation of visually deformable objects from a single annotated frontal image is presented and demonstrated on the example of automatically annotating face images that can be used for building AAMs for fitting and tracking. This approach employs the idea of initially learning the correspondences between landmarks in a frontal image and a set of training images with a face in arbitrary poses. Using this learner, virtual images of unseen faces at any arbitrary pose for which the learner was trained can be reconstructed by predicting the new landmark locations and warping the texture from the frontal image. View-based AAMs are then built from the virtual images and used for automatically annotating unseen images, including images of different facial expressions, at any random pose within the maximum range spanned by the virtually reconstructed images. The approach is experimentally validated by automatically annotating face images from three different databases. © 2009 IEEE.

Contingency awareness in human aversive conditioning involves the middle frontal gyrus.

In contrast to the wealth of data describing the neural mechanisms underlying classical conditioning, we know remarkably little about the mechanisms involved in acquisition of explicit contingency awareness. Subjects variably acquire contingency awareness in classical conditioning paradigms, in which they are able to describe the temporal relationship between a conditioned cue and its outcome. Previous studies have implicated the hippocampus and prefrontal cortex in the acquisition of explicit knowledge, although their specific roles remain unclear. We used functional magnetic resonance imaging to track the trial-by-trial acquisition of explicit knowledge in a concurrent trace and delay conditioning paradigm. We show that activity in bilateral middle frontal gyrus and parahippocampal gyrus correlates with the accuracy of explicit contingency awareness on each trial. In contrast, amygdala activation correlates with conditioned responses indexed by skin conductance responses (SCRs). These results demonstrate that brain regions known to be involved in other aspects of learning and memory also play a specific role, reflecting on each trial the acquisition and representation of contingency awareness.

Design of surface emitting distributed feedback quantum cascade laser with single-lobe far-field pattern and high outcoupling efficiency

A 7.8-mu m surface emitting second-order distributed feedback quantum cascade laser (DFB QCL) structure with metallized surface grating is studied. The modal property of this structure is described by utilizing coupled-mode theory where the coupling coefficients are derived from exact Floquet-Bloch solutions of infinite periodic structure. Based on this theory, the influence of waveguide structure and grating topography as well as device length on the laser performance is numerically investigated. The optimized surface emitting second-order DFB QCL structure design exhibits a high surface outcoupling efficiency of 22% and a low threshold gain of 10 cm(-1). Using a pi phase-shift in the centre of the grating, a high-quality single-lobe far-field radiation pattern is obtained.

Study on the interaction between strychnine and bovine serum albumin by capillary electrophoretic frontal analysis

The protein binding constant, binding sites of the Strychnos alkaloid-strychnine and bovine serum albumin (BSA) was determined by capillary electrophoretic frontal analysis (CE-FA) for the first time. The experiment was carried out in a polyacrylamide-coated fused silica capillary (48.4 cmx50 mu m i.d., 38.1 cm effective length) with 20 mmol/L citrate/MES buffer (pH 6.0, ionic strength 0.17). The applied voltage was 12 kV and detection wavelength was set at 257 nm. The plateau height of the peak was employed to determine the unbound concentration of drug in BSA equilibrated sample solution based on the external drug standard in the absence of protein. The present method provides a convenient, accurate technique for the early stage of drug screening.

Evaluation of nonlinear chromatographic performance by frontal analysis using a simple multi-plate mathematical model

A multi-plate (NIP) mathematical model was proposed by frontal analysis to evaluate nonlinear chromatographic performance. One of its advantages is that the parameters may be easily calculated from experimental data. Moreover, there is a good correlation between it and the equilibrium-dispersive (E-D) or Thomas models. This shows that it can well accommodate both types of band broadening that is comprised of either diffusion-dominated processes or kinetic sorption processes. The MP model can well describe experimental breakthrough curves that were obtained from membrane affinity chromatography and column reversed-phase liquid chromatography. Furthermore, the coefficients of mass transfer may be calculated according to the relationship between the MP model and the E-D or Thomas models. (C) 2004 Elsevier B.V. All rights reserved.

Target Selection by Frontal Cortex During Coordinated Saccadic and Smooth Pursuit Eye Movement

Oculomotor tracking of moving objects is an important component of visually based cognition and planning. Such tracking is achieved by a combination of saccades and smooth pursuit eye movements. In particular, the saccadic and smooth pursuit systems interact to often choose the same target, and to maximize its visibility through time. How do multiple brain regions interact, including frontal cortical areas, to decide the choice of a target among several competing moving stimuli? How is target selection information that is created by a bias (e.g., electrical stimulation) transferred from one movement system to another? These saccade-pursuit interactions are clarified by a new computational neural model, which describes interactions among motion processing areas MT, MST, FPA, DLPN; saccade specification, selection, and planning areas LIP, FEF, SNr, SC; the saccadic generator in the brain stem; and the cerebellum. Model simulations explain a broad range of neuroanatomical and neurophysiological data. These results are in contrast with the simplest parallel model with no interactions between saccades and pursuit than common-target selection and recruitment of shared motoneurons. Actual tracking episodes in primates reveal multiple systematic deviations from predictions of the simplest parallel model, which are explained by the current model.

Investigations into the cellular and molecular changes in the amygdala in models of temporal lobe epilepsy and maternal immune activation

The amygdala is a limbic structure that is involved in many of our emotions and processing of these emotions such as fear, anger and pleasure. Conditions such as anxiety, autism, and also epilepsy, have been linked to abnormal functioning of the amygdala, owing to improper neurodevelopment or damage. This thesis investigated the cellular and molecular changes in the amygdala in models of temporal lobe epilepsy (TLE) and maternal immune activation (MIA). The kainic acid (KA) model of temporal lobe epilepsy (TLE) was used to induce Ammon’s-horn sclerosis (AHS) and to investigate behavioural and cytoarchitectural changes that occur in the amygdala related to Neuropeptide Y1 receptor expression. Results showed that KA-injected animals showed increased anxiety-like behaviours and displayed histopathological hallmarks of AHS including CA1 ablation, granule cell dispersion, volume reduction and astrogliosis. Amygdalar volume and neuronal loss was observed in the ipsilateral nuclei which was accompanied by astrogliosis. In addition, a decrease in Y1 receptor expressing cells in the ipsilateral CA1 and CA3 sectors of the hippocampus, ipsi- and contralateral granule cell layer of the dentate gyrus and ipsilateral central nucleus of the amygdala was found, consistent with a reduction in Y1 receptor protein levels. The results suggest that plastic changes in hippocampal and/or amygdalar Y1 receptor expression may negatively impact anxiety levels. Gamma-aminobutyric acid (GABA) is the main inhibitory neurotransmitter in the brain and tight regulation and appropriate control of GABA is vital for neurochemical homeostasis. GABA transporter-1 (GAT-1) is abundantly expressed by neurones and astrocytes and plays a key role in GABA reuptake and regulation. Imbalance in GABA homeostasis has been implicated in epilepsy with GAT-1 being an attractive pharmacological target. Electron microscopy was used to examine the distribution, expression and morphology of GAT-1 expressing structures in the amygdala of the TLE model. Results suggest that GAT-1 was preferentially expressed on putative axon terminals over astrocytic processes in this TLE model. Myelin integrity was examined and results suggested that in the TLE model myelinated fibres were damaged in comparison to controls. Synaptic morphology was studied and results suggested that asymmetric (excitatory) synapses occurred more frequently than symmetric (inhibitory) synapses in the TLE model in comparison to controls. This study illustrated that the amygdala undergoes ultrastructural alterations in this TLE model. Maternal immune activation (MIA) is a risk factor for neurodevelopmental disorders such as autism, schizophrenia and also epilepsy. MIA was induced at a critical window of amygdalar development at E12 using bacterial mimetic lipopolysaccharide (LPS). Results showed that MIA activates cytokine, toll-like receptor and chemokine expression in the fetal brain that is prolonged in the postnatal amygdala. Inflammation elicited by MIA may prime the fetal brain for alterations seen in the glial environment and this in turn have deleterious effects on neuronal populations as seen in the amygdala at P14. These findings may suggest that MIA induced during amygdalar development may predispose offspring to amygdalar related disorders such as heightened anxiety, fear impairment and also neurodevelopmental disorders.

Less wiring, more firing: low-performing older adults compensate for impaired white matter with greater neural activity.

The reliable neuroimaging finding that older adults often show greater activity (over-recruitment) than younger adults is typically attributed to compensation. Yet, the neural mechanisms of over-recruitment in older adults (OAs) are largely unknown. Rodent electrophysiology studies have shown that as number of afferent fibers within a circuit decreases with age, the fibers that remain show higher synaptic field potentials (less wiring, more firing). Extrapolating to system-level measures in humans, we proposed and tested the hypothesis that greater activity in OAs compensates for impaired white-matter connectivity. Using a neuropsychological test battery, we measured individual differences in executive functions associated with the prefrontal cortex (PFC) and memory functions associated with the medial temporal lobes (MTLs). Using event-related functional magnetic resonance imaging, we compared activity for successful versus unsuccessful trials during a source memory task. Finally, we measured white-matter integrity using diffusion tensor imaging. The study yielded 3 main findings. First, low-executive OAs showed greater success-related activity in the PFC, whereas low-memory OAs showed greater success-related activity in the MTLs. Second, low-executive OAs displayed white-matter deficits in the PFC, whereas low-memory OAs displayed white-matter deficits in the MTLs. Finally, in both prefrontal and MTL regions, white-matter decline and success-related activations occurred in close proximity and were negatively correlated. This finding supports the less-wiring-more-firing hypothesis, which provides a testable account of compensatory over-recruitment in OAs.

Division of labor in frontal eye field neurons during presaccadic remapping of visual receptive fields.

Our percept of visual stability across saccadic eye movements may be mediated by presaccadic remapping. Just before a saccade, neurons that remap become visually responsive at a future field (FF), which anticipates the saccade vector. Hence, the neurons use corollary discharge of saccades. Many of the neurons also decrease their response at the receptive field (RF). Presaccadic remapping occurs in several brain areas including the frontal eye field (FEF), which receives corollary discharge of saccades in its layer IV from a collicular-thalamic pathway. We studied, at two levels, the microcircuitry of remapping in the FEF. At the laminar level, we compared remapping between layers IV and V. At the cellular level, we compared remapping between different neuron types of layer IV. In the FEF in four monkeys (Macaca mulatta), we identified 27 layer IV neurons with orthodromic stimulation and 57 layer V neurons with antidromic stimulation from the superior colliculus. With the use of established criteria, we classified the layer IV neurons as putative excitatory (n = 11), putative inhibitory (n = 12), or ambiguous (n = 4). We found that just before a saccade, putative excitatory neurons increased their visual response at the RF, putative inhibitory neurons showed no change, and ambiguous neurons increased their visual response at the FF. None of the neurons showed presaccadic visual changes at both RF and FF. In contrast, neurons in layer V showed full remapping (at both the RF and FF). Our data suggest that elemental signals for remapping are distributed across neuron types in early cortical processing and combined in later stages of cortical microcircuitry.

Dynamics of visual receptive fields in the macaque frontal eye field.

Neuronal receptive fields (RFs) provide the foundation for understanding systems-level sensory processing. In early visual areas, investigators have mapped RFs in detail using stochastic stimuli and sophisticated analytical approaches. Much less is known about RFs in prefrontal cortex. Visual stimuli used for mapping RFs in prefrontal cortex tend to cover a small range of spatial and temporal parameters, making it difficult to understand their role in visual processing. To address these shortcomings, we implemented a generalized linear model to measure the RFs of neurons in the macaque frontal eye field (FEF) in response to sparse, full-field stimuli. Our high-resolution, probabilistic approach tracked the evolution of RFs during passive fixation, and we validated our results against conventional measures. We found that FEF neurons exhibited a surprising level of sensitivity to stimuli presented as briefly as 10 ms or to multiple dots presented simultaneously, suggesting that FEF visual responses are more precise than previously appreciated. FEF RF spatial structures were largely maintained over time and between stimulus conditions. Our results demonstrate that the application of probabilistic RF mapping to FEF and similar association areas is an important tool for clarifying the neuronal mechanisms of cognition.

Similar prevalence and magnitude of auditory-evoked and visually evoked activity in the frontal eye fields: implications for multisensory motor control.

Saccadic eye movements can be elicited by more than one type of sensory stimulus. This implies substantial transformations of signals originating in different sense organs as they reach a common motor output pathway. In this study, we compared the prevalence and magnitude of auditory- and visually evoked activity in a structure implicated in oculomotor processing, the primate frontal eye fields (FEF). We recorded from 324 single neurons while 2 monkeys performed delayed saccades to visual or auditory targets. We found that 64% of FEF neurons were active on presentation of auditory targets and 87% were active during auditory-guided saccades, compared with 75 and 84% for visual targets and saccades. As saccade onset approached, the average level of population activity in the FEF became indistinguishable on visual and auditory trials. FEF activity was better correlated with the movement vector than with the target location for both modalities. In summary, the large proportion of auditory-responsive neurons in the FEF, the similarity between visual and auditory activity levels at the time of the saccade, and the strong correlation between the activity and the saccade vector suggest that auditory signals undergo tailoring to match roughly the strength of visual signals present in the FEF, facilitating accessing of a common motor output pathway.

A subcortical source of visual input to the frontal eye field

Many neurons in the frontal eye field (FEF) exhibit visual responses and are thought to play important roles in visuosaccadic behavior. The FEF, however, is far removed from striate cortex. Where do the FEF's visual signals come from? Usually they are reasonably assumed to enter the FEF through afferents from extrastriate cortex. Here we show that, surprisingly, visual signals also enter the FEF through a subcortical route: a disynaptic, ascending pathway originating in the intermediate layers of the superior colliculus (SC). We recorded from identified neurons at all three stages of this pathway (n=30-40 in each sample): FEF recipient neurons, orthodromically activated from the SC; mediodorsal thalamus (MD) relay neurons, antidromically activated from FEF and orthodromically activated from SC; and SC source neurons, antidromically activated from MD. We studied the neurons while monkeys performed delayed saccade tasks designed to temporally resolve visual responses from presaccadic discharges. We found, first, that most neurons at every stage in the pathway had visual responses, presaccadic bursts, or both. Second, we found marked similarities between the SC source neurons and MD relay neurons: in both samples, about 15% of the neurons had only a visual response, 10% had only a presaccadic burst, and 75% had both. In contrast, FEF recipient neurons tended to be more visual in nature: 50% had only a visual response, none had only a presaccadic burst, and 50% had both a visual response and a presaccadic burst. This suggests that in addition to their subcortical inputs, these FEF neurons also receive other visual inputs, e.g. from extrastriate cortex. We conclude that visual activity in the FEF results not only from cortical afferents but also from subcortical inputs. Intriguingly, this implies that some of the visual signals in FEF are pre-processed by the SC.

The frontal eye field sends predictively remapped visual signals to the superior colliculus

We perceive a stable visual world even though saccades often move our retinas. One way the brain may achieve a stable visual percept is through predictive remapping of visual receptive fields: just before a saccade, the receptive field of many neurons moves from its current location ("current receptive field") to the location it is expected to occupy after the saccade ("future receptive field"). Goldberg and colleagues found such remapping in cortical areas, e.g. in the frontal eye field (FEF), as well as in the intermediate layers of the superior colliculus (SC). In the present study we investigated the source of the SC's remapped visual signals. Do some of them come from the FEF? We identified FEF neurons that project to the SC using antidromic stimulation. For neurons with a visual response, we tested whether the receptive field shifted just prior to making a saccade. Saccadic amplitudes were chosen to be as small as possible while clearly separating the current and future receptive fields; they ranged from 5-30 deg. in amplitude and were directed contraversively. The saccadic target was a small red spot. We probed visual responsiveness at the current and future receptive field locations using a white spot flashed at various times before or after the saccade. Predictive remapping was indicated by a visual response to a probe flashed in the future receptive field just before the saccade began. We found that many FEF neurons projecting to the SC exhibited predictive remapping. Moreover, the remapping was as fast and strong as any previously reported for FEF or SC. It is clear, therefore, that remapped visual signals are sent from FEF to SC, providing direct evidence that the FEF is one source of the SC's remapped visual signals. Because remapping requires information about an imminent saccade, we hypothesize that remapping in FEF depends on corollary discharge signals such as those ascending from the SC through MD thalamus (Sommer and Wurtz 2002).