Modeling habits as self-sustaining patterns of sensorimotor behavior

In the recent history of psychology and cognitive neuroscience, the notion of habit has been reduced to a stimulus-triggered response probability correlation. In this paper we use a computational model to present an alternative theoretical view (with some philosophical implications), where habits are seen as self-maintaining patterns of behavior that share properties in common with self-maintaining biological processes, and that inhabit a complex ecological context, including the presence and influence of other habits. Far from mechanical automatisms, this organismic and self-organizing concept of habit can overcome the dominating atomistic and statistical conceptions, and the high temporal resolution effects of situatedness, embodiment and sensorimotor loops emerge as playing a more central, subtle and complex role in the organization of behavior. The model is based on a novel "iterant deformable sensorimotor medium (IDSM)," designed such that trajectories taken through sensorimotor-space increase the likelihood that in the future, similar trajectories will be taken. We couple the IDSM to sensors and motors of a simulated robot, and show that under certain conditions, the IDSM conditions, the IDSM forms self-maintaining patterns of activity that operate across the IDSM, the robot's body, and the environment. We present various environments and the resulting habits that form in them. The model acts as an abstraction of habits at a much needed sensorimotor "meso-scale" between microscopic neuron-based models and macroscopic descriptions of behavior. Finally, we discuss how this model and extensions of it can help us understand aspects of behavioral self-organization, historicity and autonomy that remain out of the scope of contemporary representationalist frameworks.

Energy demands of diverse spiking cells from the neocortex, hippocampus, and thalamus

It has long been known that neurons in the brain are not physiologically homogeneous. In response to current stimulus, they can fire several distinct patterns of action potentials that are associated with different physiological classes ranging from regular-spiking cells, fast-spiking cells, intrinsically bursting cells, and low-threshold cells. In this work we show that the high degree of variability in firing characteristics of action potentials among these cells is accompanied with a significant variability in the energy demands required to restore the concentration gradients after an action potential. The values of the metabolic energy were calculated for a wide range of cell temperatures and stimulus intensities following two different approaches. The first one is based on the amount of Na+ load crossing the membrane during a single action potential, while the second one focuses on the electrochemical energy functions deduced from the dynamics of the computational neuron models. The results show that the thalamocortical relay neuron is the most energy-efficient cell consuming between 7 and 18 nJ/cm(2) for each spike generated, while both the regular and fast spiking cells from somatosensory cortex and the intrinsically-bursting cell from a cat visual cortex are the least energy-efficient, and can consume up to 100 nJ/cm(2) per spike. The lowest values of these energy demands were achieved at higher temperatures and high external stimuli.

Alcohol-Related Brain Damage in Humans

Chronic excessive alcohol intoxications evoke cumulative damage to tissues and organs. We examined prefrontal cortex (Brodmann's area (BA) 9) from 20 human alcoholics and 20 age, gender, and postmortem delay matched control subjects. H & E staining and light microscopy of prefrontal cortex tissue revealed a reduction in the levels of cytoskeleton surrounding the nuclei of cortical and subcortical neurons, and a disruption of subcortical neuron patterning in alcoholic subjects. BA 9 tissue homogenisation and one dimensional polyacrylamide gel electrophoresis (PAGE) proteomics of cytosolic proteins identified dramatic reductions in the protein levels of spectrin beta II, and alpha- and beta-tubulins in alcoholics, and these were validated and quantitated by Western blotting. We detected a significant increase in a-tubulin acetylation in alcoholics, a non-significant increase in isoaspartate protein damage, but a significant increase in protein isoaspartyl methyltransferase protein levels, the enzyme that triggers isoaspartate damage repair in vivo. There was also a significant reduction in proteasome activity in alcoholics. One dimensional PAGE of membrane-enriched fractions detected a reduction in beta-spectrin protein levels, and a significant increase in transmembranous alpha 3 (catalytic) subunit of the Na+, K+-ATPase in alcoholic subjects. However, control subjects retained stable oligomeric forms of a-subunit that were diminished in alcoholics. In alcoholics, significant loss of cytosolic alpha-and beta-tubulins were also seen in caudate nucleus, hippocampus and cerebellum, but to different levels, indicative of brain regional susceptibility to alcohol-related damage. Collectively, these protein changes provide a molecular basis for some of the neuronal and behavioural abnormalities attributed to alcoholics

Differential Neuroprotective Effects of 5 '-Deoxy-5 '-Methylthioadenosine

Background: 5'-deoxy-5'-methylthioadenosine (MTA) is an endogenous compound produced through the metabolism of polyamines. The therapeutic potential of MTA has been assayed mainly in liver diseases and, more recently, in animal models of multiple sclerosis. The aim of this study was to determine the neuroprotective effect of this molecule in vitro and to assess whether MTA can cross the blood brain barrier (BBB) in order to also analyze its potential neuroprotective efficacy in vivo. Methods: Neuroprotection was assessed in vitro using models of excitotoxicity in primary neurons, mixed astrocyte-neuron and primary oligodendrocyte cultures. The capacity of MTA to cross the BBB was measured in an artificial membrane assay and using an in vitro cell model. Finally, in vivo tests were performed in models of hypoxic brain damage, Parkinson's disease and epilepsy. Results: MTA displays a wide array of neuroprotective activities against different insults in vitro. While the data from the two complementary approaches adopted indicate that MTA is likely to cross the BBB, the in vivo data showed that MTA may provide therapeutic benefits in specific circumstances. Whereas MTA reduced the neuronal cell death in pilocarpine-induced status epilepticus and the size of the lesion in global but not focal ischemic brain damage, it was ineffective in preserving dopaminergic neurons of the substantia nigra in the 1-methyl-4-phenyl-1,2,3,6-tetrahydro-pyridine (MPTP)-mice model. However, in this model of Parkinson's disease the combined administration of MTA and an A(2A) adenosine receptor antagonist did produce significant neuroprotection in this brain region. Conclusion: MTA may potentially offer therapeutic neuroprotection.

Brca1 is expressed in human microglia and is dysregulated in human and animal model of ALS

Background: There is growing evidence that microglia are key players in the pathological process of amyotrophic lateral sclerosis (ALS). It is suggested that microglia have a dual role in motoneurone degeneration through the release of both neuroprotective and neurotoxic factors. Results: To identify candidate genes that may be involved in ALS pathology we have analysed at early symptomatic age (P90), the molecular signature of microglia from the lumbar region of the spinal cord of hSOD1(G93A) mice, the most widely used animal model of ALS. We first identified unique hSOD1(G93A) microglia transcriptomic profile that, in addition to more classical processes such as chemotaxis and immune response, pointed toward the potential involvement of the tumour suppressor gene breast cancer susceptibility gene 1 (Brca1). Secondly, comparison with our previous data on hSOD1(G93A) motoneurone gene profile substantiated the putative contribution of Brca1 in ALS. Finally, we established that Brca1 protein is specifically expressed in human spinal microglia and is up-regulated in ALS patients. Conclusions: Overall, our data provide new insights into the pathogenic concept of a non-cell-autonomous disease and the involvement of microglia in ALS. Importantly, the identification of Brca1 as a novel microglial marker and as possible contributor in both human and animal model of ALS may represent a valid therapeutic target. Moreover, our data points toward novel research strategies such as investigating the role of oncogenic proteins in neurodegenerative diseases.

Avaliação morfofuncional do complexo hipocampal em ratos submetidos a um modelo de hipóxia-isquemia pré-natal

A diminuição do aporte de oxigênio e nutrientes na vida perinatal resulta em danos, como astrogliose, morte de neurônios e de células proliferativas. Déficits cognitivos podem estar relacionados a danos no hipocampo. Neste trabalho avaliamos a citoarquitetura do giro dentado (DG) durante o desenvolvimento e a memória de ratos submetidos à HI. Para tal, utilizamos a técnica de imunohistoquímica para marcador de proliferação celular (KI67), neurônio jovem (DCX), de astrócitos (GFAP) e de óxido nítrico sintase neuronal (NOSn). Para avaliar a memória de curta e de longa duração foi utilizado o teste de reconhecimento de objetos (RO). Ratas Wistar grávidas em E18 foram anestesiadas (tribromoetanol) e as quatro artérias uterinas foram ocluídas com grampos de aneurisma (Grupo HI). Após 45 minutos, os grampos foram removidos e foi feita a sutura por planos anatômicos. Os animais do grupo controle (SHAM) sofreram o mesmo procedimento, excetuando a oclusão das artérias. Os animais nasceram a termo. Animais com idades de 7 a 90 dias pós-natal (P7 a P90), foram anestesiados e perfundido-fixados com paraformaldeído a 4%, e os encéfalos submetidos ao processamento histológico. Cortes coronais do hipocampo (20m) foram submetidos à imunohistoquímica para KI67, DCX, GFAP e NOSn. Animais P90 foram submetidos ao RO. Os procedimentos foram aprovados pelo comitê de ética (CEA/019/2010). Observamos menor imunomarcação para KI67 no giro dentado de animais HI em P7. Para a marcação de DCX nesta idade não foi observada diferença entre os grupos. Animais HI em P15, P20 e P45 tiveram menor imunomarcação para DCX e Ki67 na camada granular. Animais P90 de ambos os grupos não apresentaram marcação para KI67 e DCX. Vimos aumento da imunomarcação para GFAP nos animais HI em todas as idades. A imunomarcação para NOSn nos animais HI foi menor em todas as idades. O maior número de células NOSn positivas foi visto em animais P7 em ambos os grupos na camada polimórfica. Em P15, animais HI apresentam células NOSn+ em todo o DG. Em P30 animais HI apresentam células NOSn+ nas camadas polimórfica e sub-granular. Animais adultos (P90) de ambos os grupos apresentam células NOSn positivas apenas nas camadas granular e sub-granular. Embora animais HI P90 não apresentaram déficits de memória, estes apresentaram menor tempo de exploração do objeto. Comportamento correspondente a déficits de atenção em humanos. Nossos resultados sugerem que HI perinatal diminui a população de células proliferativas, de neurônios jovens, de neurônios NOSn+, além de causar astrogliose e possivelmente déficits de atenção. O modelo demonstrou ser útil para a compreensão dos mecanismos celulares das lesões hipóxico-isquêmicas e pode ser usado para testar estratégias terapêuticas.

Synapses with short-term plasticity are optimal estimators of presynaptic membrane potentials.

The trajectory of the somatic membrane potential of a cortical neuron exactly reflects the computations performed on its afferent inputs. However, the spikes of such a neuron are a very low-dimensional and discrete projection of this continually evolving signal. We explored the possibility that the neuron's efferent synapses perform the critical computational step of estimating the membrane potential trajectory from the spikes. We found that short-term changes in synaptic efficacy can be interpreted as implementing an optimal estimator of this trajectory. Short-term depression arose when presynaptic spiking was sufficiently intense as to reduce the uncertainty associated with the estimate; short-term facilitation reflected structural features of the statistics of the presynaptic neuron such as up and down states. Our analysis provides a unifying account of a powerful, but puzzling, form of plasticity.

Properties of the proton-evoked currents and their modulation by Ca2+ and Zn2+ in the acutely dissociated hippocampus CA1 neurons

The characterization of acid-sensing ion channel (ASIC)-like currents has been reported in hippocampal neurons in primary culture. However, it is suggested that the profile of expression of ASICs changes in culture. In this study, we investigated the properties of proton-activated current and its modulation by extracellular Ca2+ and Zn2+ in neurons acutely dissociated from the rat hippocampal CA1 using conventional whole-cell patch-clamp recording. A rapidly decaying inward current and membrane depolarization was induced by exogenous application of acidic solution. The current was sensitive to the extracellular proton with a response threshold of pH 7.0-6.8 and the pH(50) Of 6.1, the reversal potential close to the Na+ equilibrium potential. It had a characteristic of acid-sensing ion channels (ASICs) as demonstrated by its sensitivity to amiloride (IC50 = 19.6 +/- 2.1 muM). Either low [Ca2+](0) or high [Zn2+](0) increased the amplitude of the current. All these characteristics are consistent with a current mediated through a mixture of homomeric ASIC1a and heteromeric ASIC1a + 2a channels and closely replicate many of the characteristics that have been previously reported for hippocampal neurons cultured for a week or more, indicating that culture artifacts do not necessarily flaw the properties of ASICs. Interestingly, we found that high [Zn2+] (>10(-4) M) slowed the decay time constant of the ASIC-like current significantly in both acutely dissociated and cultured hippocampal neurons. In addition, the facilitating effects of low [Ca2+](0) and high [Zn2+](0) on the ASIC-like current were not additive. Since tissue acidosis, extracellular Zn elevation and/or Ca2+ reduction occur concurrently under some physiological and/or pathological conditions, the present observations suggest that hippocampal ASICs may offer a novel pharmacological target for therapeutic invention. (C) 2004 Elsevier B.V. All rights reserved.

Coupling between NMDA receptor and acid-sensing ion channel contributes to ischemic neuronal death

Acid-sensing ion channels (ASICs) composed of ASIC1a subunit exhibit a high Ca2+ permeability and play important roles in synaptic plasticity and acid-induced cell death. Here, we show that ischemia enhances ASIC currents through the phosphorylation at Ser478 and Ser479 of ASIC1a, leading to exacerbated ischemic cell death. The phosphorylation is catalyzed by Ca2+/calmodulin-dependent protein kinase II (CaMKII) activity, as a result of activation of NR2B-containing N-methyl-D-aspartate subtype of glutamate receptors (NMDARs) during ischemia. Furthermore, NR2B-specific antagonist, CaMKII inhibitor, or overexpression of mutated form of ASIC1a with Ser478 or Ser479 replaced by alanine (ASICla-S478A, ASIC1a-S479A) in cultured hippocampal neurons prevented ischemia-induced enhancement of ASIC currents, cytoplasmic Ca2+ elevation, as well as neuronal death. Thus, NMDAR-CaMKII cascade is functionally coupled to ASICs and contributes to acidotoxicity during ischemia. Specific blockade of NMDAR/CaMKII-ASIC coupling may reduce neuronal death after ischemia and other pathological conditions involving excessive glutamate release and acidosis.

Computational mechanisms of sensorimotor control.

In order to generate skilled and efficient actions, the motor system must find solutions to several problems inherent in sensorimotor control, including nonlinearity, nonstationarity, delays, redundancy, uncertainty, and noise. We review these problems and five computational mechanisms that the brain may use to limit their deleterious effects: optimal feedback control, impedance control, predictive control, Bayesian decision theory, and sensorimotor learning. Together, these computational mechanisms allow skilled and fluent sensorimotor behavior.

Know thy neighbour: A normative theory of synaptic depression

Synapses exhibit an extraordinary degree of short-term malleability, with release probabilities and effective synaptic strengths changing markedly over multiple timescales. From the perspective of a fixed computational operation in a network, this seems like a most unacceptable degree of added variability. We suggest an alternative theory according to which short-term synaptic plasticity plays a normatively-justifiable role. This theory starts from the commonplace observation that the spiking of a neuron is an incomplete, digital, report of the analog quantity that contains all the critical information, namely its membrane potential. We suggest that a synapse solves the inverse problem of estimating the pre-synaptic membrane potential from the spikes it receives, acting as a recursive filter. We show that the dynamics of short-term synaptic depression closely resemble those required for optimal filtering, and that they indeed support high quality estimation. Under this account, the local postsynaptic potential and the level of synaptic resources track the (scaled) mean and variance of the estimated presynaptic membrane potential. We make experimentally testable predictions for how the statistics of subthreshold membrane potential fluctuations and the form of spiking non-linearity should be related to the properties of short-term plasticity in any particular cell type.

Neural representations of courtship song in the Drosophila brain.

Acoustic communication in drosophilid flies is based on the production and perception of courtship songs, which facilitate mating. Despite decades of research on courtship songs and behavior in Drosophila, central auditory responses have remained uncharacterized. In this study, we report on intracellular recordings from central neurons that innervate the Drosophila antennal mechanosensory and motor center (AMMC), the first relay for auditory information in the fly brain. These neurons produce graded-potential (nonspiking) responses to sound; we compare recordings from AMMC neurons to extracellular recordings of the receptor neuron population [Johnston's organ neurons (JONs)]. We discover that, while steady-state response profiles for tonal and broadband stimuli are significantly transformed between the JON population in the antenna and AMMC neurons in the brain, transient responses to pulses present in natural stimuli (courtship song) are not. For pulse stimuli in particular, AMMC neurons simply low-pass filter the receptor population response, thus preserving low-frequency temporal features (such as the spacing of song pulses) for analysis by postsynaptic neurons. We also compare responses in two closely related Drosophila species, Drosophila melanogaster and Drosophila simulans, and find that pulse song responses are largely similar, despite differences in the spectral content of their songs. Our recordings inform how downstream circuits may read out behaviorally relevant information from central neurons in the AMMC.