Spiking Neural Network Connectivity and its Potential for Temporal Sensory Processing and Variable Binding

The most biologically-inspired artificial neurons are those of the third generation, and are termed spiking neurons, as individual pulses or spikes are the means by which stimuli are communicated. In essence, a spike is a short-term change in electrical potential and is the basis of communication between biological neurons. Unlike previous generations of artificial neurons, spiking neurons operate in the temporal domain, and exploit time as a resource in their computation. In 1952, Alan Lloyd Hodgkin and Andrew Huxley produced the first model of a spiking neuron; their model describes the complex electro-chemical process that enables spikes to propagate through, and hence be communicated by, spiking neurons. Since this time, improvements in experimental procedures in neurobiology, particularly with in vivo experiments, have provided an increasingly more complex understanding of biological neurons. For example, it is now well understood that the propagation of spikes between neurons requires neurotransmitter, which is typically of limited supply. When the supply is exhausted neurons become unresponsive. The morphology of neurons, number of receptor sites, amongst many other factors, means that neurons consume the supply of neurotransmitter at different rates. This in turn produces variations over time in the responsiveness of neurons, yielding various computational capabilities. Such improvements in the understanding of the biological neuron have culminated in a wide range of different neuron models, ranging from the computationally efficient to the biologically realistic. These models enable the modelling of neural circuits found in the brain. In recent years, much of the focus in neuron modelling has moved to the study of the connectivity of spiking neural networks. Spiking neural networks provide a vehicle to understand from a computational perspective, aspects of the brain’s neural circuitry. This understanding can then be used to tackle some of the historically intractable issues with artificial neurons, such as scalability and lack of variable binding. Current knowledge of feed-forward, lateral, and recurrent connectivity of spiking neurons, and the interplay between excitatory and inhibitory neurons is beginning to shed light on these issues, by improved understanding of the temporal processing capabilities and synchronous behaviour of biological neurons. This research topic aims to amalgamate current research aimed at tackling these phenomena.

Dynamic Network Mechanisms of Relational Integration

A prominent hypothesis states that specialized neural modules within the human lateral frontopolar cortices (LFPCs) support “relational integration” (RI), the solving of complex problems using inter-related rules. However, it has been proposed that LFPC activity during RI could reflect the recruitment of additional “domain-general” resources when processing more difficult problems in general as opposed to RI specifi- cally. Moreover, theoretical research with computational models has demonstrated that RI may be supported by dynamic processes that occur throughout distributed networks of brain regions as opposed to within a discrete computational module. Here, we present fMRI findings from a novel deductive reasoning paradigm that controls for general difficulty while manipulating RI demands. In accordance with the domain- general perspective, we observe an increase in frontoparietal activation during challenging problems in general as opposed to RI specifically. Nonetheless, when examining frontoparietal activity using analyses of phase synchrony and psychophysiological interactions, we observe increased network connectivity during RI alone. Moreover, dynamic causal modeling with Bayesian model selection identifies the LFPC as the effective connectivity source. Based on these results, we propose that during RI an increase in network connectivity and a decrease in network metastability allows rules that are coded throughout working memory systems to be dynamically bound. This change in connectivity state is top-down propagated via a hierarchical system of domain-general networks with the LFPC at the apex. In this manner, the functional network perspective reconciles key propositions of the globalist, modular, and computational accounts of RI within a single unified framework.

Brain Glutamate Dehydrogenase Changes In Streptozotocin Diabetic Rats As A Function Of Age

Kinetic parameters of brain glutamate dehydrogenase (GDH) were compared in the brain stem, cerebellum and cerebral cortex of three weeks and one year old streptozotocin (STZ) induced four day diabetic rats with respective controls. A single intrafemoral dose of STZ (60mg/Kg body weight) was administered to induce diabetes in both age groups. After four days the blood glucose levels showed a significant increase in the diabetic animals of both age groups compared with the respective controls. The increase in blood glucose was significant in one year old compared to the three weeks old diabetic rats. The Vmm of the enzyme was decreased in all the brain regions studied, of the three weeks old diabetic rats without any significant change in the Km. In the adult the Vmax of GDH was increased in cerebellum and brain stem but was unchanged in the cerebral cortex. The K. was unchanged in cerebellum and cerebral cortex but was increased in the brain stem. These results suggest there may be an important regulatory role of the glutamate pathway in brain neural network disturbances and neuronal degeneration in diabetes as a function of age.

Photoperiod-dependent plasticity of circadian pacemaker center in the brain of the Madeira cockroach Rhyparobia maderae

To various degrees, insects in nature adapt to and live with two fundamental environmental rhythms around them: (1) the daily rhythm of light and dark, and (2) the yearly seasonal rhythm of the changing photoperiod (length of light per day). It is hypothesized that two biological clocks evolved in organisms on earth which allow them to harmonize successfully with the two environmental rhythms: (1) the circadian clock, which orchestrates circadian rhythms in physiology and behavior, and (2) the photoperiodic clock, which allows for physiological adaptations to changes in photoperiod during the course of the year (insect photoperiodism). The circadian rhythm is endogenous and continues in constant conditions, while photoperiodism requires specific light inputs of a minimal duration. Output pathways from both clocks control neurosecretory cells which regulate growth and reproduction. This dissertation focuses on the question whether different photoperiods change the network and physiology of the circadian clock of an originally equatorial cockroach species. It is assumed that photoperiod-dependent plasticity of the cockroach circadian clock allows for adaptations in physiology and behavior without the need for a separate photoperiodic clock circuit. The Madeira cockroach Rhyparobia maderae is a well established circadian clock model system. Lesion and transplantation studies identified the accessory medulla (aMe), a small neuropil with about 250 neurons, as the cockroach circadian pacemaker. Among them, the pigment-dispersing factor immunoreactive (PDF-ir) neurons anterior to the aMe (aPDFMes) play a key role as inputs to and outputs of the circadian clock system. The aim of my doctoral thesis was to examine whether and how different photoperiods modify the circadian clock system. With immunocytochemical studies, three-dimensional (3D) reconstruction, standardization and Ca2+-imaging technique, my studies revealed that raising cockroaches in different photoperiods changed the neuronal network of the circadian clock (Wei and Stengl, 2011). In addition, different photoperiods affected the physiology of single, isolated circadian pacemaker neurons. This thesis provides new evidence for the involvement of the circadian clock in insect photoperiodism. The data suggest that the circadian pacemaker system of the Madeira cockroach has the plasticity and potential to allow for physiological adaptations to different photoperiods. Therefore, it may express also properties of a photoperiodic clock.

Detection of Parkinson’s disease tremor-onset with a frequency analysing artificial neural network

Deep Brain Stimulator devices are becoming widely used for therapeutic benefits in movement disorders such as Parkinson's disease. Prolonging the battery life span of such devices could dramatically reduce the risks and accumulative costs associated with surgical replacement. This paper demonstrates how an artificial neural network can be trained using pre-processing frequency analysis of deep brain electrode recordings to detect the onset of tremor in Parkinsonian patients. Implementing this solution into an 'intelligent' neurostimulator device will remove the need for continuous stimulation currently used, and open up the possibility of demand-driven stimulation. Such a methodology could potentially decrease the power consumption of a deep brain pulse generator.

Architecture for Living Neuronal Network Control of a mobile robot

The intelligent controlling mechanism of a typical mobile robot is usually a computer system. Research is however now ongoing in which biological neural networks are being cultured and trained to act as the brain of an interactive real world robot – thereby either completely replacing or operating in a cooperative fashion with a computer system. Studying such neural systems can give a distinct insight into biological neural structures and therefore such research has immediate medical implications. The principal aims of the present research are to assess the computational and learning capacity of dissociated cultured neuronal networks with a view to advancing network level processing of artificial neural networks. This will be approached by the creation of an artificial hybrid system (animat) involving closed loop control of a mobile robot by a dissociated culture of rat neurons. This paper details the components of the overall animat closed loop system architecture and reports on the evaluation of the results from preliminary real-life and simulated robot experiments.

Gaze fixations predict brain activation during the voluntary regulation of picture-induced negative affect

Recent studies have identified a distributed network of brain regions thought to support cognitive reappraisal processes underlying emotion regulation in response to affective images, including parieto-temporal regions and lateral/medial regions of prefrontal cortex (PFC). A number of these commonly activated regions are also known to underlie visuospatial attention and oculomotor control, which raises the possibility that people use attentional redeployment rather than, or in addition to, reappraisal as a strategy to regulate emotion. We predicted that a significant portion of the observed variance in brain activation during emotion regulation tasks would be associated with differences in how participants visually scan the images while regulating their emotions. We recorded brain activation using fMRI and quantified patterns of gaze fixation while participants increased or decreased their affective response to a set of affective images. fMRI results replicated previous findings on emotion regulation with regulation differences reflected in regions of PFC and the amygdala. In addition, our gaze fixation data revealed that when regulating, individuals changed their gaze patterns relative to a control condition. Furthermore, this variation in gaze fixation accounted for substantial amounts of variance in brain activation. These data point to the importance of controlling for gaze fixation in studies of emotion regulation that use visual stimuli.

Reduced capacity to sustain positive emotion in major depression reflects diminished maintenance of fronto-striatal brain activation

Anhedonia, the loss of pleasure or interest in previously rewarding stimuli, is a core feature of major depression. While theorists have argued that anhedonia reflects a reduced capacity to experience pleasure, evidence is mixed as to whether anhedonia is caused by a reduction in hedonic capacity. An alternative explanation is that anhedonia is due to the inability to sustain positive affect across time. Using positive images, we used an emotion regulation task to test whether individuals with depression are unable to sustain activation in neural circuits underlying positive affect and reward. While up-regulating positive affect, depressed individuals failed to sustain nucleus accumbens activity over time compared with controls. This decreased capacity was related to individual differences in self-reported positive affect. Connectivity analyses further implicated the fronto-striatal network in anhedonia. These findings support the hypothesis that anhedonia in depressed patients reflects the inability to sustain engagement of structures involved in positive affect and reward.

How the brain blinks: towards a neurocognitive model of the attentional blink

When people monitor a visual stream of rapidly presented stimuli for two targets (T1 and T2), they often miss T2 if it falls into a time window of about half a second after T1 onset-the attentional blink (AB). We provide an overview of recent neuroscientific studies devoted to analyze the neural processes underlying the AB and their temporal dynamics. The available evidence points to an attentional network involving temporal, right-parietal and frontal cortex, and suggests that the components of this neural network interact by means of synchronization and stimulus-induced desynchronization in the beta frequency range. We set up a neurocognitive scenario describing how the AB might emerge and why it depends on the presence of masks and the other event(s) the targets are embedded in. The scenario supports the idea that the AB arises from "biased competition", with the top-down bias being generated by parietal-frontal interactions and the competition taking place between stimulus codes in temporal cortex.

Prefrontal social cognition network dysfunction underlying face encoding and social anxiety in fragile X syndrome

Individuals with fragile X syndrome (FXS) commonly display characteristics of social anxiety, including gaze aversion, increased time to initiate social interaction, and difficulty forming meaningful peer relationships. While neural correlates of face processing, an important component of social interaction, are altered in FXS, studies have not examined whether social anxiety in this population is related to higher cognitive processes, such as memory. This study aimed to determine whether the neural circuitry involved in face encoding was disrupted in individuals with FXS, and whether brain activity during face encoding was related to levels of social anxiety. A group of 11 individuals with FXS (5 M) and 11 age-and gender-matched control participants underwent fMRI scanning while performing a face encoding task with onlineeye-tracking. Results indicate that compared to the control group, individuals with FXS exhibited decreased activation of prefrontal regions associated with complex social cognition, including the medial and superior frontal cortex, during successful face encoding. Further, the FXS and control groups showed significantly different relationships between measures of social anxiety (including gaze-fixation) and brain activity during face encoding. These data indicate that social anxiety in FXS may be related to the inability to successfully recruit higher level social cognition regions during the initial phases of memory formation. (C) 2008 Elsevier Inc. All rights reserved.

Neural and wavelet network models for financial distress classification

This work analyzes the use of linear discriminant models, multi-layer perceptron neural networks and wavelet networks for corporate financial distress prediction. Although simple and easy to interpret, linear models require statistical assumptions that may be unrealistic. Neural networks are able to discriminate patterns that are not linearly separable, but the large number of parameters involved in a neural model often causes generalization problems. Wavelet networks are classification models that implement nonlinear discriminant surfaces as the superposition of dilated and translated versions of a single "mother wavelet" function. In this paper, an algorithm is proposed to select dilation and translation parameters that yield a wavelet network classifier with good parsimony characteristics. The models are compared in a case study involving failed and continuing British firms in the period 1997-2000. Problems associated with over-parameterized neural networks are illustrated and the Optimal Brain Damage pruning technique is employed to obtain a parsimonious neural model. The results, supported by a re-sampling study, show that both neural and wavelet networks may be a valid alternative to classical linear discriminant models.

Prediction of Parkinson’s Disease tremor onset using a radial basis function neural network based on particle swarm optimization

Deep Brain Stimulation (DBS) has been successfully used throughout the world for the treatment of Parkinson's disease symptoms. To control abnormal spontaneous electrical activity in target brain areas DBS utilizes a continuous stimulation signal. This continuous power draw means that its implanted battery power source needs to be replaced every 18–24 months. To prolong the life span of the battery, a technique to accurately recognize and predict the onset of the Parkinson's disease tremors in human subjects and thus implement an on-demand stimulator is discussed here. The approach is to use a radial basis function neural network (RBFNN) based on particle swarm optimization (PSO) and principal component analysis (PCA) with Local Field Potential (LFP) data recorded via the stimulation electrodes to predict activity related to tremor onset. To test this approach, LFPs from the subthalamic nucleus (STN) obtained through deep brain electrodes implanted in a Parkinson patient are used to train the network. To validate the network's performance, electromyographic (EMG) signals from the patient's forearm are recorded in parallel with the LFPs to accurately determine occurrences of tremor, and these are compared to the performance of the network. It has been found that detection accuracies of up to 89% are possible. Performance comparisons have also been made between a conventional RBFNN and an RBFNN based on PSO which show a marginal decrease in performance but with notable reduction in computational overhead.

Endogenous cholinergic tone modulates spontaneous network level neuronal activity in primary cortical cultures grown on multi-electrode arrays

Background Cortical cultures grown long-term on multi-electrode arrays (MEAs) are frequently and extensively used as models of cortical networks in studies of neuronal firing activity, neuropharmacology, toxicology and mechanisms underlying synaptic plasticity. However, in contrast to the predominantly asynchronous neuronal firing activity exhibited by intact cortex, electrophysiological activity of mature cortical cultures is dominated by spontaneous epileptiform-like global burst events which hinders their effective use in network-level studies, particularly for neurally-controlled animat (‘artificial animal’) applications. Thus, the identification of culture features that can be exploited to produce neuronal activity more representative of that seen in vivo could increase the utility and relevance of studies that employ these preparations. Acetylcholine has a recognised neuromodulatory role affecting excitability, rhythmicity, plasticity and information flow in vivo although its endogenous production by cortical cultures and subsequent functional influence upon neuronal excitability remains unknown. Results Consequently, using MEA electrophysiological recording supported by immunohistochemical and RT-qPCR methods, we demonstrate for the first time, the presence of intrinsic cholinergic neurons and significant, endogenous cholinergic tone in cortical cultures with a characterisation of the muscarinic and nicotinic components that underlie modulation of spontaneous neuronal activity. We found that tonic muscarinic ACh receptor (mAChR) activation affects global excitability and burst event regularity in a culture age-dependent manner whilst, in contrast, tonic nicotinic ACh receptor (nAChR) activation can modulate burst duration and the proportion of spikes occurring within bursts in a spatio-temporal fashion. Conclusions We suggest that the presence of significant endogenous cholinergic tone in cortical cultures and the comparability of its modulatory effects to those seen in intact brain tissues support emerging, exploitable commonalities between in vivo and in vitro preparations. We conclude that experimental manipulation of endogenous cholinergic tone could offer a novel opportunity to improve the use of cortical cultures for studies of network-level mechanisms in a manner that remains largely consistent with its functional role.

A mesoscopic modelling approach to anaesthetic action on brain electrical activity

Relating the measurable, large scale, effects of anaesthetic agents to their molecular and cellular targets of action is necessary to better understand the principles by which they affect behavior, as well as enabling the design and evaluation of more effective agents and the better clinical monitoring of existing and future drugs. Volatile and intravenous general anaesthetic agents (GAs) are now known to exert their effects on a variety of protein targets, the most important of which seem to be the neuronal ion channels. It is hence unlikely that anaesthetic effect is the result of a unitary mechanism at the single cell level. However, by altering the behavior of ion channels GAs are believed to change the overall dynamics of distributed networks of neurons. This disruption of regular network activity can be hypothesized to cause the hypnotic and analgesic effects of GAs and may well present more stereotypical characteristics than its underlying microscopic causes. Nevertheless, there have been surprisingly few theories that have attempted to integrate, in a quantitative manner, the empirically well documented alterations in neuronal ion channel behavior with the corresponding macroscopic effects. Here we outline one such approach, and show that a range of well documented effects of anaesthetics on the electroencephalogram (EEG) may be putatively accounted for. In particular we parameterize, on the basis of detailed empirical data, the effects of halogenated volatile ethers (a clinically widely used class of general anaesthetic agent). The resulting model is able to provisionally account for a range of anaesthetically induced EEG phenomena that include EEG slowing, biphasic changes in EEG power, and the dose dependent appearance of anomalous ictal activity, as well as providing a basis for novel approaches to monitoring brain function in both health and disease.

Whole-brain functional connectivity during emotional word classification in medication-free Major Depressive Disorder: abnormal salience circuitry and relations to positive emotionality

Major Depressive Disorder (MDD) has been associated with biased processing and abnormal regulation of negative and positive information, which may result from compromised coordinated activity of prefrontal and subcortical brain regions involved in evaluating emotional information. We tested whether patients with MDD show distributed changes in functional connectivity with a set of independently derived brain networks that have shown high correspondence with different task demands, including stimulus salience and emotional processing. We further explored if connectivity during emotional word processing related to the tendency to engage in positive or negative emotional states. In this study, 25 medication-free MDD patients without current or past comorbidity and matched controls (n=25) performed an emotional word-evaluation task during functional MRI. Using a dual regression approach, individual spatial connectivity maps representing each subject’s connectivity with each standard network were used to evaluate between-group differences and effects of positive and negative emotionality (extraversion and neuroticism, respectively, as measured with the NEO-FFI). Results showed decreased functional connectivity of the medial prefrontal cortex, ventrolateral prefrontal cortex, and ventral striatum with the fronto-opercular salience network in MDD patients compared to controls. In patients, abnormal connectivity was related to extraversion, but not neuroticism. These results confirm the hypothesis of a relative (para)limbic-cortical decoupling that may explain dysregulated affect in MDD. As connectivity of these regions with the salience network was related to extraversion, but not to general depression severity or negative emotionality, dysfunction of this network may be responsible for the failure to sustain engagement in rewarding behavior.