Striatal activity underlies novelty-based choice in humans.

The desire to seek new and unfamiliar experiences is a fundamental behavioral tendency in humans and other species. In economic decision making, novelty seeking is often rational, insofar as uncertain options may prove valuable and advantageous in the long run. Here, we show that, even when the degree of perceptual familiarity of an option is unrelated to choice outcome, novelty nevertheless drives choice behavior. Using functional magnetic resonance imaging (fMRI), we show that this behavior is specifically associated with striatal activity, in a manner consistent with computational accounts of decision making under uncertainty. Furthermore, this activity predicts interindividual differences in susceptibility to novelty. These data indicate that the brain uses perceptual novelty to approximate choice uncertainty in decision making, which in certain contexts gives rise to a newly identified and quantifiable source of human irrationality.

Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum.

Food preferences are acquired through experience and can exert strong influence on choice behavior. In order to choose which food to consume, it is necessary to maintain a predictive representation of the subjective value of the associated food stimulus. Here, we explore the neural mechanisms by which such predictive representations are learned through classical conditioning. Human subjects were scanned using fMRI while learning associations between arbitrary visual stimuli and subsequent delivery of one of five different food flavors. Using a temporal difference algorithm to model learning, we found predictive responses in the ventral midbrain and a part of ventral striatum (ventral putamen) that were related directly to subjects' actual behavioral preferences. These brain structures demonstrated divergent response profiles, with the ventral midbrain showing a linear response profile with preference, and the ventral striatum a bivalent response. These results provide insight into the neural mechanisms underlying human preference behavior.

Changing the responses of cortical neurons from sub- to suprathreshold using single spikes in vivo.

Action Potential (APs) patterns of sensory cortex neurons encode a variety of stimulus features, but how can a neuron change the feature to which it responds? Here, we show that in vivo a spike-timing-dependent plasticity (STDP) protocol-consisting of pairing a postsynaptic AP with visually driven presynaptic inputs-modifies a neurons' AP-response in a bidirectional way that depends on the relative AP-timing during pairing. Whereas postsynaptic APs repeatedly following presynaptic activation can convert subthreshold into suprathreshold responses, APs repeatedly preceding presynaptic activation reduce AP responses to visual stimulation. These changes were paralleled by restructuring of the neurons response to surround stimulus locations and membrane-potential time-course. Computational simulations could reproduce the observed subthreshold voltage changes only when presynaptic temporal jitter was included. Together this shows that STDP rules can modify output patterns of sensory neurons and the timing of single-APs plays a crucial role in sensory coding and plasticity.DOI:http://dx.doi.org/10.7554/eLife.00012.001.

Code-specific policy gradient rules for spiking neurons

Although it is widely believed that reinforcement learning is a suitable tool for describing behavioral learning, the mechanisms by which it can be implemented in networks of spiking neurons are not fully understood. Here, we show that different learning rules emerge from a policy gradient approach depending on which features of the spike trains are assumed to influence the reward signals, i.e., depending on which neural code is in effect. We use the framework of Williams (1992) to derive learning rules for arbitrary neural codes. For illustration, we present policy-gradient rules for three different example codes - a spike count code, a spike timing code and the most general "full spike train" code - and test them on simple model problems. In addition to classical synaptic learning, we derive learning rules for intrinsic parameters that control the excitability of the neuron. The spike count learning rule has structural similarities with established Bienenstock-Cooper-Munro rules. If the distribution of the relevant spike train features belongs to the natural exponential family, the learning rules have a characteristic shape that raises interesting prediction problems.

How modeling can reconcile apparently discrepant experimental results: The case of pacemaking in dopaminergic neurons

Midbrain dopaminergic neurons are endowed with endogenous slow pacemaking properties. In recent years, many different groups have studied the basis for this phenomenon, often with conflicting conclusions. In particular, the role of a slowly-inactivating L-type calcium channel in the depolarizing phase between spikes is controversial, and the analysis of slow oscillatory potential (SOP) recordings during the blockade of sodium channels has led to conflicting conclusions. Based on a minimal model of a dopaminergic neuron, our analysis suggests that the same experimental protocol may lead to drastically different observations in almost identical neurons. For example, complete L-type calcium channel blockade eliminates spontaneous firing or has almost no effect in two neurons differing by less than 1% in their maximal sodium conductance. The same prediction can be reproduced in a state of the art detailed model of a dopaminergic neuron. Some of these predictions are confirmed experimentally using single-cell recordings in brain slices. Our minimal model exhibits SOPs when sodium channels are blocked, these SOPs being uncorrelated with the spiking activity, as has been shown experimentally. We also show that block of a specific conductance (in this case, the SK conductance) can have a different effect on these two oscillatory behaviors (pacemaking and SOPs), despite the fact that they have the same initiating mechanism. These results highlight the fact that computational approaches, besides their well known confirmatory and predictive interests in neurophysiology, may also be useful to resolve apparent discrepancies between experimental results. © 2011 Drion et al.

M-type channels selectively control bursting in rat dopaminergic neurons

Midbrain dopaminergic neurons in the substantia nigra, pars compacta and ventral tegmental area are critically important in many physiological functions. These neurons exhibit firing patterns that include tonic slow pacemaking, irregular firing and bursting, and the amount of dopamine that is present in the synaptic cleft is much increased during bursting. The mechanisms responsible for the switch between these spiking patterns remain unclear. Using both in-vivo recordings combined with microiontophoretic or intraperitoneal drug applications and in-vitro experiments, we have found that M-type channels, which are present in midbrain dopaminergic cells, modulate the firing during bursting without affecting the background low-frequency pacemaker firing. Thus, a selective blocker of these channels, 10,10-bis(4-pyridinylmethyl)-9(10H)- anthracenone dihydrochloride, specifically potentiated burst firing. Computer modeling of the dopamine neuron confirmed the possibility of a differential influence of M-type channels on excitability during various firing patterns. Therefore, these channels may provide a novel target for the treatment of dopamine-related diseases, including Parkinson's disease and drug addiction. Moreover, our results demonstrate that the influence of M-type channels on the excitability of these slow pacemaker neurons is conditional upon their firing pattern. © 2010 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Differentiated adipose-derived stem cells act synergistically with RGD-modified surfaces to improve neurite outgrowth in a co-culture model.

Peripheral nerve damage is a problem encountered after trauma and during surgery and the development of synthetic polymer conduits may offer a promising alternative to autografts. In order to improve the performance of the polymer to be used for nerve conduits, poly-ε-caprolactone (PCL) films were chemically functionalized with RGD moieties, using a chemical reaction previously developed. In vitro cultures of dissociated dorsal root ganglion (DRG) neurons provide a valid model to study different factors affecting axonal growth. In this work, DRG neurons were cultured on RGD-functionalized PCL films. Adult adipose-derived stem cells differentiated to Schwann cells (dASCs) were initially cultured on the functionalized PCL films, resulting in improved attachment and proliferation. dASCs were also co-cultured with DRG neurons on treated and untreated PCL to assess stimulation by dASCs on neurite outgrowth. Neuron response was generally poor on untreated PCL films, but long neurites were observed in the presence of dASCs or RGD moieties. A combination of the two factors enhanced even further neurite outgrowth, acting synergistically. Finally, in order to better understand the extracellular matrix (ECM)-cell interaction, a β1 integrin blocking experiment was carried out. Neurite outgrowth was not affected by the specific antibody blocking, showing that β1 integrin function can be compensated by other molecules present on the cell membrane. Copyright © 2013 John Wiley & Sons, Ltd.

Encoding of mixtures in a simple olfactory system.

Natural odors are usually mixtures; yet, humans and animals can experience them as unitary percepts. Olfaction also enables stimulus categorization and generalization. We studied how these computations are performed with the responses of 168 locust antennal lobe projection neurons (PNs) to varying mixtures of two monomolecular odors, and of 174 PNs and 209 mushroom body Kenyon cells (KCs) to mixtures of up to eight monomolecular odors. Single-PN responses showed strong hypoadditivity and population trajectories clustered by odor concentration and mixture similarity. KC responses were much sparser on average than those of PNs and often signaled the presence of single components in mixtures. Linear classifiers could read out the responses of both populations in single time bins to perform odor identification, categorization, and generalization. Our results suggest that odor representations in the mushroom body may result from competing optimization constraints to facilitate memorization (sparseness) while enabling identification, classification, and generalization.

Encoding of mixtures in a simple olfactory system

Natural odors are usually mixtures; yet, humans and animals can experience them as unitary percepts. Olfaction also enables stimulus categorization and generalization. We studied how these computations are performed with the responses of 168 locust antennal lobe projection neurons (PNs) to varying mixtures of two monomolecular odors, and of 174 PNs and 209 mushroom body Kenyon cells (KCs) to mixtures of up to eight monomolecular odors. Single-PN responses showed strong hypoadditivity and population trajectories clustered by odor concentration and mixture similarity. KC responses were much sparser on average than those of PNs and often signaled the presence of single components in mixtures. Linear classifiers could read out the responses of both populations in single time bins to perform odor identification, categorization, and generalization. Our results suggest that odor representations in the mushroom body may result from competing optimization constraints to facilitate memorization (sparseness) while enabling identification, classification, and generalization

How neurons migrate: a dynamic in-silico model of neuronal migration in the developing cortex.

BACKGROUND: Neuronal migration, the process by which neurons migrate from their place of origin to their final position in the brain, is a central process for normal brain development and function. Advances in experimental techniques have revealed much about many of the molecular components involved in this process. Notwithstanding these advances, how the molecular machinery works together to govern the migration process has yet to be fully understood. Here we present a computational model of neuronal migration, in which four key molecular entities, Lis1, DCX, Reelin and GABA, form a molecular program that mediates the migration process. RESULTS: The model simulated the dynamic migration process, consistent with in-vivo observations of morphological, cellular and population-level phenomena. Specifically, the model reproduced migration phases, cellular dynamics and population distributions that concur with experimental observations in normal neuronal development. We tested the model under reduced activity of Lis1 and DCX and found an aberrant development similar to observations in Lis1 and DCX silencing expression experiments. Analysis of the model gave rise to unforeseen insights that could guide future experimental study. Specifically: (1) the model revealed the possibility that under conditions of Lis1 reduced expression, neurons experience an oscillatory neuron-glial association prior to the multipolar stage; and (2) we hypothesized that observed morphology variations in rats and mice may be explained by a single difference in the way that Lis1 and DCX stimulate bipolar motility. From this we make the following predictions: (1) under reduced Lis1 and enhanced DCX expression, we predict a reduced bipolar migration in rats, and (2) under enhanced DCX expression in mice we predict a normal or a higher bipolar migration. CONCLUSIONS: We present here a system-wide computational model of neuronal migration that integrates theory and data within a precise, testable framework. Our model accounts for a range of observable behaviors and affords a computational framework to study aspects of neuronal migration as a complex process that is driven by a relatively simple molecular program. Analysis of the model generated new hypotheses and yet unobserved phenomena that may guide future experimental studies. This paper thus reports a first step toward a comprehensive in-silico model of neuronal migration.

Decisions about decisions.

A major puzzle of decision making is how the brain decides which decision system to use at any one time. In this issue of Neuron, Lee et al. (2014) provide a theoretical, behavioral, and neurobiological account of a prefrontal reliability-based arbitration system.

Cell types, network homeostasis, and pathological compensation from a biologically plausible ion channel expression model.

How do neurons develop, control, and maintain their electrical signaling properties in spite of ongoing protein turnover and perturbations to activity? From generic assumptions about the molecular biology underlying channel expression, we derive a simple model and show how it encodes an "activity set point" in single neurons. The model generates diverse self-regulating cell types and relates correlations in conductance expression observed in vivo to underlying channel expression rates. Synaptic as well as intrinsic conductances can be regulated to make a self-assembling central pattern generator network; thus, network-level homeostasis can emerge from cell-autonomous regulation rules. Finally, we demonstrate that the outcome of homeostatic regulation depends on the complement of ion channels expressed in cells: in some cases, loss of specific ion channels can be compensated; in others, the homeostatic mechanism itself causes pathological loss of function.