Matching Recall and Storage in Sequence Learning with Spiking Neural Networks

Storing and recalling spiking sequences is a general problem the brain needs to solve. It is, however, unclear what type of biologically plausible learning rule is suited to learn a wide class of spatiotemporal activity patterns in a robust way. Here we consider a recurrent network of stochastic spiking neurons composed of both visible and hidden neurons. We derive a generic learning rule that is matched to the neural dynamics by minimizing an upper bound on the Kullback–Leibler divergence from the target distribution to the model distribution. The derived learning rule is consistent with spike-timing dependent plasticity in that a presynaptic spike preceding a postsynaptic spike elicits potentiation while otherwise depression emerges. Furthermore, the learning rule for synapses that target visible neurons can be matched to the recently proposed voltage-triplet rule. The learning rule for synapses that target hidden neurons is modulated by a global factor, which shares properties with astrocytes and gives rise to testable predictions.

Intermittent spike-wave dynamics in a heterogeneous, spatially extended neural mass model

Generalised epileptic seizures are frequently accompanied by sudden, reversible transitions from low amplitude, irregular background activity to high amplitude, regular spike-wave discharges (SWD) in the EEG. The underlying mechanisms responsible for SWD generation and for the apparently spontaneous transitions to SWD and back again are still not fully understood. Specifically, the role of spatial cortico-cortical interactions in ictogenesis is not well studied. We present a macroscopic, neural mass model of a cortical column which includes two distinct time scales of inhibition. This model can produce both an oscillatory background and a pathological SWD rhythm. We demonstrate that coupling two of these cortical columns can lead to a bistability between out-of-phase, low amplitude background dynamics and in-phase, high amplitude SWD activity. Stimuli can cause state-dependent transitions from background into SWD. In an extended local area of cortex, spatial heterogeneities in a model parameter can lead to spontaneous reversible transitions from a desynchronised background to synchronous SWD due to intermittency. The deterministic model is therefore capable of producing absence seizure-like events without any time dependent adjustment of model parameters. The emergence of such mechanisms due to spatial coupling demonstrates the importance of spatial interactions in modelling ictal dynamics, and in the study of ictogenesis.

Self-organised transients in a neural mass model of epileptogenic tissue dynamics

Stimulation of human epileptic tissue can induce rhythmic, self-terminating responses on the EEG or ECoG. These responses play a potentially important role in localising tissue involved in the generation of seizure activity, yet the underlying mechanisms are unknown. However, in vitro evidence suggests that self-terminating oscillations in nervous tissue are underpinned by non-trivial spatio-temporal dynamics in an excitable medium. In this study, we investigate this hypothesis in spatial extensions to a neural mass model for epileptiform dynamics. We demonstrate that spatial extensions to this model in one and two dimensions display propagating travelling waves but also more complex transient dynamics in response to local perturbations. The neural mass formulation with local excitatory and inhibitory circuits, allows the direct incorporation of spatially distributed, functional heterogeneities into the model. We show that such heterogeneities can lead to prolonged reverberating responses to a single pulse perturbation, depending upon the location at which the stimulus is delivered. This leads to the hypothesis that prolonged rhythmic responses to local stimulation in epileptogenic tissue result from repeated self-excitation of regions of tissue with diminished inhibitory capabilities. Combined with previous models of the dynamics of focal seizures this macroscopic framework is a first step towards an explicit spatial formulation of the concept of the epileptogenic zone. Ultimately, an improved understanding of the pathophysiologic mechanisms of the epileptogenic zone will help to improve diagnostic and therapeutic measures for treating epilepsy.

Learning real-world stimuli in a neural network with spike-driven synaptic dynamics

We present a model of spike-driven synaptic plasticity inspired by experimental observations and motivated by the desire to build an electronic hardware device that can learn to classify complex stimuli in a semisupervised fashion. During training, patterns of activity are sequentially imposed on the input neurons, and an additional instructor signal drives the output neurons toward the desired activity. The network is made of integrate-and-fire neurons with constant leak and a floor. The synapses are bistable, and they are modified by the arrival of presynaptic spikes. The sign of the change is determined by both the depolarization and the state of a variable that integrates the postsynaptic action potentials. Following the training phase, the instructor signal is removed, and the output neurons are driven purely by the activity of the input neurons weighted by the plastic synapses. In the absence of stimulation, the synapses preserve their internal state indefinitely. Memories are also very robust to the disruptive action of spontaneous activity. A network of 2000 input neurons is shown to be able to classify correctly a large number (thousands) of highly overlapping patterns (300 classes of preprocessed Latex characters, 30 patterns per class, and a subset of the NIST characters data set) and to generalize with performances that are better than or comparable to those of artificial neural networks. Finally we show that the synaptic dynamics is compatible with many of the experimental observations on the induction of long-term modifications (spike-timing-dependent plasticity and its dependence on both the postsynaptic depolarization and the frequency of pre- and postsynaptic neurons).

Influence of inspired oxygen on glucose-lactate dynamics after subdural hematoma in the rat

The mechanisms causing brain damage after acute subdural hematoma (SDH) are poorly understood. A decrease in cerebral blood flow develops immediately after the hematoma forms, thus reducing cerebral oxygenation. This in turn may activate mitochondrial failure and tissue damage leading to ionic imbalance and possibly to cellular breakdown. The purpose of this study was to test whether a simple therapeutic measure, namely increased fraction of inspired oxygen (FiO2 100), and hence increased arterial and brain tissue oxygen tension, can influence brain glucose and lactate dynamics acutely after subdural hematoma in the rat. Twenty-five male Sprague-Dawley anesthetized rats were studied before, during and after induction of the SDH in two separate groups. The Oxygen group (n = 10) was ventilated with 100% oxygen immediately after induction of the SDH. The Air group (n = 10) was ventilated during the entire study with 21% oxygen. Brain microdialysate samples were analyzed for glucose and lactate. All rats were monitored with femoral arterial blood pressure catheters, arterial blood gas analysis, arterial glucose, lactate and end tidal CO2 (EtCO2). Five male Sprague-Dawley rats were sham operated to measure the effect of oxygen challenge on glucose-lactate dynamics without injury. Arterial oxygen tension in the Oxygen group was 371 +/- 30 mmHg and was associated with significantly greater increase in dialysate lactate in the first 30 min after induction of SDH. Dialysate glucose initially dropped in both groups, after SDH, but then reverted significantly faster to values above baseline in the Oxygen group. Changes in ventilatory parameters had no significant effect on dialysate glucose and lactate parameters in the sham group. Extracellular dialysate lactate and glucose are influenced by administration of 100% O2 after SDH. Dialysate glucose normalizes significantly quicker upon 100% oxygen ventilation. We hypothesize that increased neural tissue oxygen tension, in presence of reduced regional CBF, and possibly compromised mitochondrial function, after acute SDH results in upregulation of rate-limiting enzyme systems responsible for both glycolytic and aerobic metabolism. Similar changes have been seen in severe human head injury, and suggest that a simple therapeutic measure, such as early ventilation with 100% O2, may improve cerebral energy metabolism, early after SDH. Further studies to measure the generation of adenosine triphosphate (ATP) are needed to validate the hypothesis.

First valence, then arousal: the temporal dynamics of brain electric activity evoked by emotional stimuli

The temporal dynamics of the neural activity that implements the dimensions valence and arousal during processing of emotional stimuli were studied in two multi-channel ERP experiments that used visually presented emotional words (experiment 1) and emotional pictures (experiment 2) as stimulus material. Thirty-two healthy subjects participated (mean age 26.8 +/- 6.4 years, 24 women). The stimuli in both experiments were selected on the basis of verbal reports in such a way that we were able to map the temporal dynamics of one dimension while controlling for the other one. Words (pictures) were centrally presented for 450 (600) ms with interstimulus intervals of 1,550 (1,400) ms. ERP microstate analysis of the entire epochs of stimulus presentations parsed the data into sequential steps of information processing. The results revealed that in several microstates of both experiments, processing of pleasant and unpleasant valence (experiment 1, microstate #3: 118-162 ms, #6: 218-238 ms, #7: 238-266 ms, #8: 266-294 ms; experiment 2, microstate #5: 142-178 ms, #6: 178-226 ms, #7: 226-246 ms, #9: 262-302 ms, #10: 302-330 ms) as well as of low and high arousal (experiment 1, microstate #8: 266-294 ms, #9: 294-346 ms; experiment 2, microstate #10: 302-330 ms, #15: 562-600 ms) involved different neural assemblies. The results revealed also that in both experiments, information about valence was extracted before information about arousal. The last microstate of valence extraction was identical with the first microstate of arousal extraction.

Local changes in neocortical circuit dynamics coincide with the spread of seizures to thalamus in a model of epilepsy

During the generalization of epileptic seizures, pathological activity in one brain area recruits distant brain structures into joint synchronous discharges. However, it remains unknown whether specific changes in local circuit activity are related to the aberrant recruitment of anatomically distant structures into epileptiform discharges. Further, it is not known whether aberrant areas recruit or entrain healthy ones into pathological activity. Here we study the dynamics of local circuit activity during the spread of epileptiform discharges in the zero-magnesium in vitro model of epilepsy. We employ high-speed multi-photon imaging in combination with dual whole-cell recordings in acute thalamocortical (TC) slices of the juvenile mouse to characterize the generalization of epileptic activity between neocortex and thalamus. We find that, although both structures are exposed to zero-magnesium, the initial onset of focal epileptiform discharge occurs in cortex. This suggests that local recurrent connectivity that is particularly prevalent in cortex is important for the initiation of seizure activity. Subsequent recruitment of thalamus into joint, generalized discharges is coincident with an increase in the coherence of local cortical circuit activity that itself does not depend on thalamus. Finally, the intensity of population discharges is positively correlated between both brain areas. This suggests that during and after seizure generalization not only the timing but also the amplitude of epileptiform discharges in thalamus is entrained by cortex. Together these results suggest a central role of neocortical activity for the onset and the structure of pathological recruitment of thalamus into joint synchronous epileptiform discharges.