Validation and verification of embedded neural systems

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

Validation and verification of embedded neural systems

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

The role of stochasticity in an information-optimal neural population code

In this paper we consider the optimisation of Shannon mutual information (MI) in the context of two model neural systems The first is a stochastic pooling network (population) of McCulloch-Pitts (MP) type neurons (logical threshold units) subject to stochastic forcing; the second is (in a rate coding paradigm) a population of neurons that each displays Poisson statistics (the so called 'Poisson neuron'). The mutual information is optimised as a function of a parameter that characterises the 'noise level'-in the MP array this parameter is the standard deviation of the noise, in the population of Poisson neurons it is the window length used to determine the spike count. In both systems we find that the emergent neural architecture and; hence, code that maximises the MI is strongly influenced by the noise level. Low noise levels leads to a heterogeneous distribution of neural parameters (diversity), whereas, medium to high noise levels result in the clustering of neural parameters into distinct groups that can be interpreted as subpopulations In both cases the number of subpopulations increases with a decrease in noise level. Our results suggest that subpopulations are a generic feature of an information optimal neural population.

Multiple roles for executive control in belief-desire reasoning:distinct neural networks are recruited for self perspective inhibition and complexity of reasoning

Belief-desire reasoning is a core component of 'Theory of Mind' (ToM), which can be used to explain and predict the behaviour of agents. Neuroimaging studies reliably identify a network of brain regions comprising a 'standard' network for ToM, including temporoparietal junction and medial prefrontal cortex. Whilst considerable experimental evidence suggests that executive control (EC) may support a functioning ToM, co-ordination of neural systems for ToM and EC is poorly understood. We report here use of a novel task in which psychologically relevant ToM parameters (true versus false belief; approach versus avoidance desire) were manipulated orthogonally. The valence of these parameters not only modulated brain activity in the 'standard' ToM network but also in EC regions. Varying the valence of both beliefs and desires recruits anterior cingulate cortex, suggesting a shared inhibitory component associated with negatively valenced mental state concepts. Varying the valence of beliefs additionally draws on ventrolateral prefrontal cortex, reflecting the need to inhibit self perspective. These data provide the first evidence that separate functional and neural systems for EC may be recruited in the service of different aspects of ToM.

Efficient training of RBF networks for classification.

Radial Basis Function networks with linear outputs are often used in regression problems because they can be substantially faster to train than Multi-layer Perceptrons. For classification problems, the use of linear outputs is less appropriate as the outputs are not guaranteed to represent probabilities. We show how RBFs with logistic and softmax outputs can be trained efficiently using the Fisher scoring algorithm. This approach can be used with any model which consists of a generalised linear output function applied to a model which is linear in its parameters. We compare this approach with standard non-linear optimisation algorithms on a number of datasets.

Disordered connectivity in the autistic brain:challenges for the 'new psychophysiology'

In 2002, we published a paper [Brock, J., Brown, C., Boucher, J., Rippon, G., 2002. The temporal binding deficit hypothesis of autism. Development and Psychopathology 142, 209-224] highlighting the parallels between the psychological model of 'central coherence' in information processing [Frith, U., 1989. Autism: Explaining the Enigma. Blackwell, Oxford] and the neuroscience model of neural integration or 'temporal binding'. We proposed that autism is associated with abnormalities of information integration that is caused by a reduction in the connectivity between specialised local neural networks in the brain and possible overconnectivity within the isolated individual neural assemblies. The current paper updates this model, providing a summary of theoretical and empirical advances in research implicating disordered connectivity in autism. This is in the context of changes in the approach to the core psychological deficits in autism, of greater emphasis on 'interactive specialisation' and the resultant stress on early and/or low-level deficits and their cascading effects on the developing brain [Johnson, M.H., Halit, H., Grice, S.J., Karmiloff-Smith, A., 2002. Neuroimaging of typical and atypical development: a perspective from multiple levels of analysis. Development and Psychopathology 14, 521-536].We also highlight recent developments in the measurement and modelling of connectivity, particularly in the emerging ability to track the temporal dynamics of the brain using electroencephalography (EEG) and magnetoencephalography (MEG) and to investigate the signal characteristics of this activity. This advance could be particularly pertinent in testing an emerging model of effective connectivity based on the balance between excitatory and inhibitory cortical activity [Rubenstein, J.L., Merzenich M.M., 2003. Model of autism: increased ratio of excitation/inhibition in key neural systems. Genes, Brain and Behavior 2, 255-267; Brown, C., Gruber, T., Rippon, G., Brock, J., Boucher, J., 2005. Gamma abnormalities during perception of illusory figures in autism. Cortex 41, 364-376]. Finally, we note that the consequence of this convergence of research developments not only enables a greater understanding of autism but also has implications for prevention and remediation. © 2006.

Can we observe collective neuronal activity from macroscopic aggregate signals?

The fundamental problem faced by noninvasive neuroimaging techniques such as EEG/MEG1 is to elucidate functionally important aspects of the microscopic neuronal network dynamics from macroscopic aggregate measurements. Due to the mixing of the activities of large neuronal populations in the observed macroscopic aggregate, recovering the underlying network that generates the signal in the absence of any additional information represents a considerable challenge. Recent MEG studies have shown that macroscopic measurements contain sufficient information to allow the differentiation between patterns of activity, which are likely to represent different stimulus-specific collective modes in the underlying network (Hadjipapas, A., Adjamian, P., Swettenham, J.B., Holliday, I.E., Barnes, G.R., 2007. Stimuli of varying spatial scale induce gamma activity with distinct temporal characteristics in human visual cortex. NeuroImage 35, 518–530). The next question arising in this context is whether aspects of collective network activity can be recovered from a macroscopic aggregate signal. We propose that this issue is most appropriately addressed if MEG/EEG signals are to be viewed as macroscopic aggregates arising from networks of coupled systems as opposed to aggregates across a mass of largely independent neural systems. We show that collective modes arising in a network of simulated coupled systems can be indeed recovered from the macroscopic aggregate. Moreover, we show that nonlinear state space methods yield a good approximation of the number of effective degrees of freedom in the network. Importantly, information about hidden variables, which do not directly contribute to the aggregate signal, can also be recovered. Finally, this theoretical framework can be applied to experimental MEG/EEG data in the future, enabling the inference of state dependent changes in the degree of local synchrony in the underlying network.

Abnormal amygdala-prefrontal effective connectivity to happy faces differentiates bipolar from major depression

Background - Bipolar disorder is frequently misdiagnosed as major depressive disorder, delaying appropriate treatment and worsening outcome for many bipolar individuals. Emotion dysregulation is a core feature of bipolar disorder. Measures of dysfunction in neural systems supporting emotion regulation might therefore help discriminate bipolar from major depressive disorder. Methods - Thirty-one depressed individuals—15 bipolar depressed (BD) and 16 major depressed (MDD), DSM-IV diagnostic criteria, ages 18–55 years, matched for age, age of illness onset, illness duration, and depression severity—and 16 age- and gender-matched healthy control subjects performed two event-related paradigms: labeling the emotional intensity of happy and sad faces, respectively. We employed dynamic causal modeling to examine significant among-group alterations in effective connectivity (EC) between right- and left-sided neural regions supporting emotion regulation: amygdala and orbitomedial prefrontal cortex (OMPFC). Results - During classification of happy faces, we found profound and asymmetrical differences in EC between the OMPFC and amygdala. Left-sided differences involved top-down connections and discriminated between depressed and control subjects. Furthermore, greater medication load was associated with an amelioration of this abnormal top-down EC. Conversely, on the right side the abnormality was in bottom-up EC that was specific to bipolar disorder. These effects replicated when we considered only female subjects. Conclusions - Abnormal, left-sided, top-down OMPFC–amygdala and right-sided, bottom-up, amygdala–OMPFC EC during happy labeling distinguish BD and MDD, suggesting different pathophysiological mechanisms associated with the two types of depression.

Disconnected brains:what is the role of fMRI in connectivity research?

In this paper we consider how functional Magnetic Resonance Imaging (fMRI) has been used to study cortical connectivity in autism and autistic spectrum disorders (ASD). We discuss those studies that have contributed to the evidence supporting a model of disordered cortical connectivity in autism and (ASD), with a focusing emphasis on the application to research into the underconnectivity model. We note that the analytical techniques employed are limited and do not allow interpretation in terms of effective, or directional connectivity, nor do they provide information about the temporal or spectral characteristics of the functional networks being studied. We highlight how currently the features of neural generators that are being assessed by functional connectivity in fMRI are unclear. In addition, we note the importance in clinical studies of considering the consequences of task choice for the nature of the imaging data that can be collected and also of individual differences in participant state and trait characteristics for the accurate interpretation of imaging data. We discuss how alternative techniques such as EEG/MEG may address the limitations of fMRI in assessing brain connectivity, and additionally consider the potential of multimodal approaches. We conclude that fMRI has made significant contributions towards our understanding of the brain in terms of neural systems but that the conclusions drawn from its application in the sphere of autism research need to be approached with caution. It is important in research of this kind that we are aware of the need to examine the methodological and analytical techniques closely when applying findings in clinical populations, not only when they are used to support the development of theoretical models but also to inform diagnostic or treatment decisions.

Abnormally increased effective connectivity between parahippocampal gyrus and ventromedial prefrontal regions during emotion labeling in bipolar disorder

Emotional liability and mood dysregulation characterize bipolar disorder (BD), yet no study has examined effective connectivity between parahippocampal gyrus and prefrontal cortical regions in ventromedial and dorsal/lateral neural systems subserving mood regulation in BD. Participants comprised 46 individuals (age range: 18-56 years): 21 with a DSM-IV diagnosis of BD, type I currently remitted; and 25 age- and gender-matched healthy controls (HC). Participants performed an event-related functional magnetic resonance imaging paradigm, viewing mild and intense happy and neutral faces. We employed dynamic causal modeling (DCM) to identify significant alterations in effective connectivity between BD and HC. Bayes model selection was used to determine the best model. The right parahippocampal gyrus (PHG) and right subgenual cingulate gyrus (sgCG) were included as representative regions of the ventromedial neural system. The right dorsolateral prefrontal cortex (DLPFC) region was included as representative of the dorsal/lateral neural system. Right PHG-sgCG effective connectivity was significantly greater in BD than HC, reflecting more rapid, forward PHG-sgCG signaling in BD than HC. There was no between-group difference in sgCG-DLPFC effective connectivity. In BD, abnormally increased right PHG-sgCG effective connectivity and reduced right PHG activity to emotional stimuli suggest a dysfunctional ventromedial neural system implicated in early stimulus appraisal, encoding and automatic regulation of emotion that may represent a pathophysiological functional neural mechanism for mood dysregulation in BD.

Functional neuroimaging studies of bipolar disorder:examining the wide clinical spectrum in the search for disease endophenotypes

Bipolar disorder (BP) is among the top ten most disabling illnesses worldwide. This review includes findings from recent studies employing functional neuroimaging to examine functional abnormalities in neural systems underlying core domains of the psychopathology in BP: emotion processing, emotion regulation and executive control, and common comorbid features of BP, that are relevant to the wide spectrum of BP rather than focused on the more traditional BPI subtype, and that may facilitate future identification of diagnostically-relevant biomarkers of the disorder. In addition, an emerging number of studies are reviewed that demonstrate the use of neuroimaging to elucidate biomarkers whose identification may help to (1) identify at-risk individuals who will subsequently develop the illness to facilitate early intervention, (2) identify targets for treatment and markers of treatment response. The use of newer neuroimaging techniques and potential confounds of psychotropic medication upon neuroimaging findings in BP are also examined. These approaches will help to improve diagnosis and the mental well-being of all individuals with BP.

Prefrontal cortical and striatal activity to happy and fear faces in bipolar disorder is associated with comorbid substance abuse and eating disorder

Background: The spectrum approach was used to examine contributions of comorbid symptom dimensions of substance abuse and eating disorder to abnormal prefrontal-cortical and subcortical-striatal activity to happy and fear faces previously demonstrated in bipolar disorder (BD). Method: Fourteen remitted BD-type I and sixteen healthy individuals viewed neutral, mild and intense happy and fear faces in two event-related fMRI experiments. All individuals completed Substance-Use and Eating-Disorder Spectrum measures. Region-of-Interest analyses for bilateral prefrontal and subcortical-striatal regions were performed. Results: BD individuals scored significantly higher on these spectrum measures than healthy individuals (p < 0.05), and were distinguished by activity in prefrontal and subcortical-striatal regions. BD relative to healthy individuals showed reduced dorsal prefrontal-cortical activity to all faces. Only BD individuals showed greater subcortical-striatal activity to happy and neutral faces. In BD individuals, negative correlations were shown between substance use severity and right PFC activity to intense happy faces (p < 0.04), and between substance use severity and right caudate nucleus activity to neutral faces (p < 0.03). Positive correlations were shown between eating disorder and right ventral putamen activity to intense happy (p < 0.02) and neutral faces (p < 0.03). Exploratory analyses revealed few significant relationships between illness variables and medication upon neural activity in BD individuals. Limitations: Small sample size of predominantly medicated BD individuals. Conclusion: This study is the first to report relationships between comorbid symptom dimensions of substance abuse and eating disorder and prefrontal-cortical and subcortical-striatal activity to facial expressions in BD. Our findings suggest that these comorbid features may contribute to observed patterns of functional abnormalities in neural systems underlying mood regulation in BD.

A hierarchy of phase transitions in optimal neuronal coding:from binary to M-ary discrete optimal codes

We have investigated how optimal coding for neural systems changes with the time available for decoding. Optimization was in terms of maximizing information transmission. We have estimated the parameters for Poisson neurons that optimize Shannon transinformation with the assumption of rate coding. We observed a hierarchy of phase transitions from binary coding, for small decoding times, toward discrete (M-ary) coding with two, three and more quantization levels for larger decoding times. We postulate that the presence of subpopulations with specific neural characteristics could be a signiture of an optimal population coding scheme and we use the mammalian auditory system as an example.

Neural network enhanced self tuning adaptive control application for non-linear control of dynamic systems

The main theme of research of this project concerns the study of neutral networks to control uncertain and non-linear control systems. This involves the control of continuous time, discrete time, hybrid and stochastic systems with input, state or output constraints by ensuring good performances. A great part of this project is devoted to the opening of frontiers between several mathematical and engineering approaches in order to tackle complex but very common non-linear control problems. The objectives are: 1. Design and develop procedures for neutral network enhanced self-tuning adaptive non-linear control systems; 2. To design, as a general procedure, neural network generalised minimum variance self-tuning controller for non-linear dynamic plants (Integration of neural network mapping with generalised minimum variance self-tuning controller strategies); 3. To develop a software package to evaluate control system performances using Matlab, Simulink and Neural Network toolbox. An adaptive control algorithm utilising a recurrent network as a model of a partial unknown non-linear plant with unmeasurable state is proposed. Appropriately, it appears that structured recurrent neural networks can provide conveniently parameterised dynamic models for many non-linear systems for use in adaptive control. Properties of static neural networks, which enabled successful design of stable adaptive control in the state feedback case, are also identified. A survey of the existing results is presented which puts them in a systematic framework showing their relation to classical self-tuning adaptive control application of neural control to a SISO/MIMO control. Simulation results demonstrate that the self-tuning design methods may be practically applicable to a reasonably large class of unknown linear and non-linear dynamic control systems.

Drying processess in the United Kingdom:assessment of industrial energy utilisation and efficiency of drying systems and the modelling of drying characters using neural networks (BL)

Drying is an important unit operation in process industry. Results have suggested that the energy used for drying has increased from 12% in 1978 to 18% of the total energy used in 1990. A literature survey of previous studies regarding overall drying energy consumption has demonstrated that there is little continuity of methods and energy trends could not be established. In the ceramics, timber and paper industrial sectors specific energy consumption and energy trends have been investigated by auditing drying equipment. Ceramic products examined have included tableware, tiles, sanitaryware, electrical ceramics, plasterboard, refractories, bricks and abrasives. Data from industry has shown that drying energy has not varied significantly in the ceramics sector over the last decade, representing about 31% of the total energy consumed. Information from the timber industry has established that radical changes have occurred over the last 20 years, both in terms of equipment and energy utilisation. The energy efficiency of hardwood drying has improved by 15% since the 1970s, although no significant savings have been realised for softwood. A survey estimating the energy efficiency and operating characteristics of 192 paper dryer sections has been conducted. Drying energy was found to increase to nearly 60% of the total energy used in the early 1980s, but has fallen over the last decade, representing 23% of the total in 1993. These results have demonstrated that effective energy saving measures, such as improved pressing and heat recovery, have been successfully implemented since the 1970s. Artificial neural networks have successfully been applied to model process characteristics of microwave and convective drying of paper coated gypsum cove. Parameters modelled have included product moisture loss, core gypsum temperature and quality factors relating to paper burning and bubbling defects. Evaluation of thermal and dielectric properties have highlighted gypsum's heat sensitive characteristics in convective and electromagnetic regimes. Modelling experimental data has shown that the networks were capable of simulating drying process characteristics to a high degree of accuracy. Product weight and temperature were predicted to within 0.5% and 5C of the target data respectively. Furthermore, it was demonstrated that the underlying properties of the data could be predicted through a high level of input noise.