Learning reward timing in cortex through reward dependent expression of synaptic plasticity.

The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions.

Intracranial EEG reveals a time- and frequency-specific role for the right inferior frontal gyrus and primary motor cortex in stopping initiated responses.

Inappropriate response tendencies may be stopped via a specific fronto/basal ganglia/primary motor cortical network. We sought to characterize the functional role of two regions in this putative stopping network, the right inferior frontal gyrus (IFG) and the primary motor cortex (M1), using electocorticography from subdural electrodes in four patients while they performed a stop-signal task. On each trial, a motor response was initiated, and on a minority of trials a stop signal instructed the patient to try to stop the response. For each patient, there was a greater right IFG response in the beta frequency band ( approximately 16 Hz) for successful versus unsuccessful stop trials. This finding adds to evidence for a functional network for stopping because changes in beta frequency activity have also been observed in the basal ganglia in association with behavioral stopping. In addition, the right IFG response occurred 100-250 ms after the stop signal, a time range consistent with a putative inhibitory control process rather than with stop-signal processing or feedback regarding success. A downstream target of inhibitory control is M1. In each patient, there was alpha/beta band desynchronization in M1 for stop trials. However, the degree of desynchronization in M1 was less for successfully than unsuccessfully stopped trials. This reduced desynchronization on successful stop trials could relate to increased GABA inhibition in M1. Together with other findings, the results suggest that behavioral stopping is implemented via synchronized activity in the beta frequency band in a right IFG/basal ganglia network, with downstream effects on M1.

Cerebellar cortex involvement in classical eyelid conditioning

A model for cerebellar involvement in motor learning was tested using classical eyelid conditioning in the rabbit. Briefly, we assume that modifications of the strength of granule cell synapses at Purkinje cells in the cerebellar cortex and mossy fiber (MF) synapses at cerebellar interpositus nuclei are responsible for the acquisition, adaptively-timed expression, and extinction of conditioned eyelid responses (CRs). A corollary of these assumptions is that the cerebellar cortex is necessary for acquisition and extinction. This model also suggests a mechanism whereby the cerebellar cortex can discriminate different times during a conditioned stimulus (CS) and thus mediate the learned timing of CRs. Therefore, experiments were done to determine the role of the cerebellar cortex in the timing, extinction, and acquisition of CRs. Lesions of the cerebellar cortex that included the anterior lobe disrupted the learned timing of CRs such that they occurred at extremely short latencies. Stimulation of MFs in the middle cerebellar peduncle as the CS could support differently timed CRs in the same animal. These data indicate that synaptic plasticity in the cerebellar cortex mediates the learned timing of CRs. These short-latency CRs which resulted from anterior lobe damage did not extinguish, while CRs in animals receiving lesions which did not include the anterior lobe extinguished normally. Preliminary data suggests that lesions of the anterior lobe which produce short-latency responses prevent the acquisition of CRs to a novel CS. These findings indicate that the anterior lobe of cerebellar cortex is necessary for eyelid conditioning. The involvement of the anterior lobe in eyelid conditioning has not been previously reported, however, the anterior lobe has generally been spared in lesion studies examining cerebellar cortex involvement in eyelid conditioning due to its relatively inaccessible location. The observation that the anterior lobe of the cerebellar cortex is not always required for the basic expression of CRs, but is necessary for response timing, extinction, and acquisition, is consistent with the hypothesis that eyelid conditioning can involve plasticity in both the cerebellar cortex and interpositus nucleus and that plasticity in the nucleus is controlled by Purkinje cell activity. ^

β1-Class Integrins Regulate the Development of Laminae and Folia in the Cerebral and Cerebellar Cortex

Mice that lack all beta1-class integrins in neurons and glia die prematurely after birth with severe brain malformations. Cortical hemispheres and cerebellar folia fuse, and cortical laminae are perturbed. These defects result from disorganization of the cortical marginal zone, where beta1-class integrins regulate glial endfeet anchorage, meningeal basement membrane remodeling, and formation of the Cajal-Retzius cell layer. Surprisingly, beta1-class integrins are not essential for neuron-glia interactions and neuronal migration during corticogenesis. The phenotype of the beta1-deficient mice resembles pathological changes observed in human cortical dysplasias, suggesting that defective integrin-mediated signal transduction contributes to the development of some of these diseases.

Nerve Injury-Induced Neuropathic Pain Causes Disinhibition of the Anterior Cingulate Cortex

Neuropathic pain caused by peripheral nerve injury is a debilitating neurological condition of high clinical relevance. On the cellular level, the elevated pain sensitivity is induced by plasticity of neuronal function along the pain pathway. Changes in cortical areas involved in pain processing contribute to the development of neuropathic pain. Yet, it remains elusive which plasticity mechanisms occur in cortical circuits. We investigated the properties of neural networks in the anterior cingulate cortex (ACC), a brain region mediating affective responses to noxious stimuli. We performed multiple whole-cell recordings from neurons in layer 5 (L5) of the ACC of adult mice after chronic constriction injury of the sciatic nerve of the left hindpaw and observed a striking loss of connections between excitatory and inhibitory neurons in both directions. In contrast, no significant changes in synaptic efficacy in the remaining connected pairs were found. These changes were reflected on the network level by a decrease in the mEPSC and mIPSC frequency. Additionally, nerve injury resulted in a potentiation of the intrinsic excitability of pyramidal neurons, whereas the cellular properties of interneurons were unchanged. Our set of experimental parameters allowed constructing a neuronal network model of L5 in the ACC, revealing that the modification of inhibitory connectivity had the most profound effect on increased network activity. Thus, our combined experimental and modeling approach suggests that cortical disinhibition is a fundamental pathological modification associated with peripheral nerve damage. These changes at the cortical network level might therefore contribute to the neuropathic pain condition.

In pneumococcal meningitis a novel water-soluble inhibitor of matrix metalloproteinases and TNF-alpha converting enzyme attenuates seizures and injury of the cerebral cortex

Matrix metalloproteinases (MMPs) and TNF-alpha converting enzyme (TACE) contribute to the pathophysiology of bacterial meningitis. To date, MMP-inhibitors studied in models of meningitis were compromised by their hydrophobic nature. We investigated the pharmacokinetics and the effect of TNF484, a water-soluble hydroxamate-based inhibitor of MMP and TACE, on disease parameters and brain damage in a neonatal rat model of pneumococcal meningitis. At 1 mg/kg q6h TNF484 reduced soluble TNF-alpha and the collagen degradation product hydroxyproline in the cerebrospinal fluid. Clinically, TNF484 attenuated the incidence of seizures and was neuroprotective in the cortex. Water-soluble MMP-inhibitors may hold promise in the therapy of bacterial meningitis.

Norepinephrine drives persistent activity in prefrontal cortex via synergistic α1 and α2 adrenoceptors

Optimal norepinephrine levels in the prefrontal cortex (PFC) increase delay-related firing and enhance working memory, whereas stress-related or pathologically high levels of norepinephrine are believed to inhibit working memory via α1 adrenoceptors. However, it has been shown that activation of Gq-coupled and phospholipase C-linked receptors can induce persistent firing, a cellular correlate of working memory, in cortical pyramidal neurons. Therefore, despite its importance in stress and cognition, the exact role of norepinephrine in modulating PFC activity remains elusive. Using electrophysiology and optogenetics, we report here that norepinephrine induces persistent firing in pyramidal neurons of the PFC independent of recurrent fast synaptic excitation. This persistent excitatory effect involves presynaptic α1 adrenoceptors facilitating glutamate release and subsequent activation of postsynaptic mGluR5 receptors, and is enhanced by postsynaptic α2 adrenoceptors inhibiting HCN channel activity. Activation of α2 adrenoceptors or inhibition of HCN channels also enhances cholinergic persistent responses in pyramidal neurons, providing a mechanism of crosstalk between noradrenergic and cholinergic inputs. The present study describes a novel cellular basis for the noradrenergic control of cortical information processing and supports a synergistic combination of intrinsic and network mechanisms for the expression of mnemonic properties in pyramidal neurons.

Impartiality in humans is predicted by brain structure of dorsomedial prefrontal cortex.

The moral force of impartiality (i.e. the equal treatment of all human beings) is imperative for providing justice and fairness. Yet, in reality many people become partial during intergroup interactions; they demonstrate a preferential treatment of ingroup members and a discriminatory treatment of outgroup members. Some people, however, do not show this intergroup bias. The underlying sources of these inter-individual differences are poorly understood. Here we demonstrate that the larger the gray matter volume and thickness of the dorsomedial prefrontal cortex (DMPFC), the more individuals in the role of an uninvolved third-party impartially punish outgroup and ingroup perpetrators. Moreover, we show evidence for a possible mechanism that explains the impact of DMPFC's gray matter volume on impartiality, namely perspective-taking. Large gray matter volume of DMPFC seems to facilitate equal perspective-taking of all sides, which in turn leads to impartial behavior. This is the first evidence demonstrating that brain structure of the DMPFC constitutes an important source underlying an individual's propensity for impartiality.

Dorsolateral and ventromedial prefrontal cortex orchestrate normative choice.

Humans are noted for their capacity to over-ride self-interest in favor of normatively valued goals. We examined the neural circuitry that is causally involved in normative, fairness-related decisions by generating a temporarily diminished capacity for costly normative behavior, a 'deviant' case, through non-invasive brain stimulation (repetitive transcranial magnetic stimulation) and compared normal subjects' functional magnetic resonance imaging signals with those of the deviant subjects. When fairness and economic self-interest were in conflict, normal subjects (who make costly normative decisions at a much higher frequency) displayed significantly higher activity in, and connectivity between, the right dorsolateral prefrontal cortex (DLPFC) and the posterior ventromedial prefrontal cortex (pVMPFC). In contrast, when there was no conflict between fairness and economic self-interest, both types of subjects displayed identical neural patterns and behaved identically. These findings suggest that a parsimonious prefrontal network, the activation of right DLPFC and pVMPFC, and the connectivity between them, facilitates subjects' willingness to incur the cost of normative decisions.

Virtual reality and the role of the prefrontal cortex in adults and children

In this review, the neural underpinnings of the experience of presence are outlined. Firstly, it is shown that presence is associated with activation of a distributed network, which includes the dorsal and ventral visual stream, the parietal cortex, the premotor cortex, mesial temporal areas, the brainstem and the thalamus. Secondly, the dorsolateral prefrontal cortex (DLPFC) is identified as a key node of the network as it modulates the activity of the network and the associated experience of presence. Thirdly, children lack the strong modulatory influence of the DLPFC on the network due to their unmatured frontal cortex. Fourthly, it is shown that presence-related measures are influenced by manipulating the activation in the DLPFC using transcranial direct current stimulation (tDCS) while participants are exposed to the virtual roller coaster ride. Finally, the findings are discussed in the context of current models explaining the experience of presence, the rubber hand illusion, and out-of-body experiences.

Modulation of anticipatory emotion and perception processing by cognitive control.

Strategies of cognitive control are helpful in reducing anxiety experienced during anticipation of unpleasant or potentially unpleasant events. We investigated the associated cerebral information processing underlying the use of a specific cognitive control strategy during the anticipation of affect-laden events. Using functional magnetic resonance imaging, we examined differential brain activity during anticipation of events of unknown and negative emotional valence in a group of eighteen healthy subjects that used a cognitive control strategy, similar to "reality checking" as used in psychotherapy, compared with a group of sixteen subjects that did not exert cognitive control. While expecting unpleasant stimuli, the "cognitive control" group showed higher activity in left medial and dorsolateral prefrontal cortex areas but reduced activity in the left extended amygdala, pulvinar/lateral geniculate nucleus and fusiform gyrus. Cognitive control during the "unknown" expectation was associated with reduced amygdalar activity as well and further with reduced insular and thalamic activity. The amygdala activations associated with cognitive control correlated negatively with the reappraisal scores of an emotion regulation questionnaire. The results indicate that cognitive control of particularly unpleasant emotions is associated with elevated prefrontal cortex activity that may serve to attenuate emotion processing in for instance amygdala, and, notably, in perception related brain areas.

The Role of the Right Posterior Parietal Cortex in Letter Migration between Words

When briefly presented with pairs of words, skilled readers can sometimes report words with migrated letters (e.g., they report hunt when presented with the words hint and hurt). These letter migration phenomena have been often used to investigate factors that influence reading such as letter position coding. However, the neural basis of letter migration is poorly understood. Previous evidence has implicated the right posterior parietal cortex (PPC) in processing visuospatial attributes and lexical properties during word reading. The aim of this study was to assess this putative role by combining an inhibitory TMS protocol with a letter migration paradigm, which was designed to examine the contributions of visuospatial attributes and lexical factors. Temporary interference with the right PPC led to three specific effects on letter migration. First, the number of letter migrations was significantly increased only in the group with active stimulation (vs. a sham stimulation group or a control group without stimulation), and there was no significant effect on other error types. Second, this effect occurred only when letter migration could result in a meaningful word (migration vs. control context). Third, the effect of active stimulation on the number of letter migrations was lateralized to target words presented on the left. Our study thus demonstrates that the right PPC plays a specific and causal role in the phenomenon of letter migration. The nature of this role cannot be explained solely in terms of visuospatial attention, rather it involves an interplay between visuospatial attentional and word reading-specific factors.

Tonic activity level in the right prefrontal cortex predicts individuals' risk taking

Human risk taking is characterized by a large amount of individual heterogeneity. In this study, we applied resting-state electroencephalography, which captures stable individual differences in neural activity, before subjects performed a risk-taking task. Using a source-localization technique, we found that the baseline cortical activity in the right prefrontal cortex predicts individual risk-taking behavior. Individuals with higher baseline cortical activity in this brain area display more risk aversion than do other individuals. This finding demonstrates that neural characteristics that are stable over time can predict a highly complex behavior such as risk-taking behavior and furthermore suggests that hypoactivity in the right prefrontal cortex might serve as a dispositional indicator of lower regulatory abilities, which is expressed in greater risk-taking behavior.

Disruption of right prefrontal cortex by low-frequency repetitive transcranial magnetic stimulation induces risk-taking behavior

Decisions require careful weighing of the risks and benefits associated with a choice. Some people need to be offered large rewards to balance even minimal risks, whereas others take great risks in the hope for an only minimal benefit. We show here that risk-taking is a modifiable behavior that depends on right hemisphere prefrontal activity. We used low-frequency, repetitive transcranial magnetic stimulation to transiently disrupt left or right dorsolateral prefrontal cortex (DLPFC) function before applying a well known gambling paradigm that provides a measure of decision-making under risk. Individuals displayed significantly riskier decision-making after disruption of the right, but not the left, DLPFC. Our findings suggest that the right DLPFC plays a crucial role in the suppression of superficially seductive options. This confirms the asymmetric role of the prefrontal cortex in decision-making and reveals that this fundamental human capacity can be manipulated in normal subjects through cortical stimulation. The ability to modify risk-taking behavior may be translated into therapeutic interventions for disorders such as drug abuse or pathological gambling.