A Model of Emotion as Patterned Metacontrol

Adaptive systems use feedback as a key strategy to cope with uncertainty and change in their environments. The information fed back from the sensorimotor loop into the control architecture can be used to change different elements of the controller at four different levels: parameters of the control model, the control model itself, the functional organization of the agent and the functional components of the agent. The complexity of such a space of potential configurations is daunting. The only viable alternative for the agent ?in practical, economical, evolutionary terms? is the reduction of the dimensionality of the configuration space. This reduction is achieved both by functionalisation —or, to be more precise, by interface minimization— and by patterning, i.e. the selection among a predefined set of organisational configurations. This last analysis let us state the central problem of how autonomy emerges from the integration of the cognitive, emotional and autonomic systems in strict functional terms: autonomy is achieved by the closure of functional dependency. In this paper we will show a general model of how the emotional biological systems operate following this theoretical analysis and how this model is also of applicability to a wide spectrum of artificial systems.

A Model of Emotion as Patterned Metacontrol

Adaptive agents use feedback as a key strategy to cope with un- certainty and change in their environments. The information fed back from the sensorimotor loop into the control subsystem can be used to change four different elements of the controller: parameters associated to the control model, the control model itself, the functional organization of the agent and the functional realization of the agent. There are many change alternatives and hence the complexity of the agent’s space of potential configurations is daunting. The only viable alternative for space- and time-constrained agents —in practical, economical, evolutionary terms— is to achieve a reduction of the dimensionality of this configuration space. Emotions play a critical role in this reduction. The reduction is achieved by func- tionalization, interface minimization and by patterning, i.e. by selection among a predefined set of organizational configurations. This analysis lets us state how autonomy emerges from the integration of cognitive, emotional and autonomic systems in strict functional terms: autonomy is achieved by the closure of functional dependency. Emotion-based morphofunctional systems are able to exhibit complex adaptation patterns at a reduced cognitive cost. In this article we show a general model of how emotion supports functional adaptation and how the emotional biological systems operate following this theoretical model. We will also show how this model is also of applicability to the construction of a wide spectrum of artificial systems1.

Dopamine receptor 4 promoter polymorphism modulates memory and neuronal responses to salience

Animal models and human functional imaging data implicate the dopamine system in mediating enhanced encoding of novel stimuli into human memory. A separate line of investigation suggests an association between a functional polymorphism in the promoter region for the human dopamine 4 receptor gene (DRD4) and sensitivity to novelty. We demonstrate, in two independent samples, that the -521Cmayor queT DRD4 promoter polymorphism determines the magnitude of human memory enhancement for contextually novel, perceptual oddball stimuli in an allele dose-dependent manner. The genotype-dependent memory enhancement conferred by the C allele is associated with increased neuronal responses during successful encoding of perceptual oddballs in the ventral striatum, an effect which is again allele dose-dependent. Furthermore, with repeated presentations of oddball stimuli, this memory advantage decreases, an effect mirrored by adaptation of activation in the hippocampus and substantia nigra/ventral tegmental area in C carriers only. Thus, a dynamic modulation of human memory enhancement for perceptually salient stimuli is associated with activation of a dopaminergic-hippocampal system, which is critically dependent on a functional polymorphism in the DRD4 promoter region.

Herpes simplex virus vector-mediated expression of Bcl-2 prevents 6-hydroxydopamine-induced degeneration of neurons in the substantia nigra in vivo

6-Hydroxydopamine (6-OHDA) is widely used to selectively lesion dopaminergic neurons of the substantia nigra (SN) in the creation of animal models of Parkinson’s disease. In vitro, the death of PC-12 cells caused by exposure to 6-OHDA occurs with characteristics consistent with an apoptotic mechanism of cell death. To test the hypothesis that apoptotic pathways are involved in the death of dopaminergic neurons of the SN caused by 6-OHDA, we created a replication-defective genomic herpes simplex virus-based vector containing the coding sequence for the antiapoptotic peptide Bcl-2 under the transcriptional control of the simian cytomegalovirus immediate early promoter. Transfection of primary cortical neurons in culture with the Bcl-2-producing vector protected those cells from naturally occurring cell death over 3 weeks. Injection of the Bcl-2-expressing vector into SN of rats 1 week before injection of 6-OHDA into the ipsilateral striatum increased the survival of neurons in the SN, detected either by retrograde labeling of those cells with fluorogold or by tyrosine hydroxylase immunocytochemistry, by 50%. These results, demonstrating that death of nigral neurons induced by 6-OHDA lesioning may be blocked by the expression of Bcl-2, are consistent with the notion that cell death in this model system is at least in part apoptotic in nature and suggest that a Bcl-2-expressing vector may have therapeutic potential in the treatment of Parkinson’s disease.

Region-dependent dynamics of cAMP response element-binding protein phosphorylation in the basal ganglia

The cAMP response element-binding protein (CREB) is an activity-dependent transcription factor that is involved in neural plasticity. The kinetics of CREB phosphorylation have been suggested to be important for gene activation, with sustained phosphorylation being associated with downstream gene expression. If so, the duration of CREB phosphorylation might serve as an indicator for time-sensitive plastic changes in neurons. To screen for regions potentially involved in dopamine-mediated plasticity in the basal ganglia, we used organotypic slice cultures to study the patterns of dopamine- and calcium-mediated CREB phosphorylation in the major subdivisions of the striatum. Different durations of CREB phosphorylation were evoked in the dorsal and ventral striatum by activation of dopamine D1-class receptors. The same D1 stimulus elicited (i) transient phosphorylation (≤15 min) in the matrix of the dorsal striatum; (ii) sustained phosphorylation (≤2 hr) in limbic-related structures including striosomes, the nucleus accumbens, the fundus striati, and the bed nucleus of the stria terminalis; and (iii) prolonged phosphorylation (up to 4 hr or more) in cellular islands in the olfactory tubercle. Elevation of Ca2+ influx by stimulation of L-type Ca2+ channels, NMDA, or KCl induced strong CREB phosphorylation in the dorsal striatum but not in the olfactory tubercle. These findings differentiate the response of CREB to dopamine and calcium signals in different striatal regions and suggest that dopamine-mediated CREB phosphorylation is persistent in limbic-related regions of the neonatal basal ganglia. The downstream effects activated by persistent CREB phosphorylation may include time-sensitive neuroplasticity modulated by dopamine.

Inactivation of tyrosine hydroxylase by nitration following exposure to peroxynitrite and 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP)

The decrement in dopamine levels exceeds the loss of dopaminergic neurons in Parkinson’s disease (PD) patients and experimental models of PD. This discrepancy is poorly understood and may represent an important event in the pathogenesis of PD. Herein, we report that the rate-limiting enzyme in dopamine synthesis, tyrosine hydroxylase (TH), is a selective target for nitration following exposure of PC12 cells to either peroxynitrite or 1-methyl-4-phenylpyridiniun ion (MPP+). Nitration of TH also occurs in mouse striatum after MPTP administration. Nitration of tyrosine residues in TH results in loss of enzymatic activity. In the mouse striatum, tyrosine nitration-mediated loss in TH activity parallels the decline in dopamine levels whereas the levels of TH protein remain unchanged for the first 6 hr post MPTP injection. Striatal TH was not nitrated in mice overexpressing copper/zinc superoxide dismutase after MPTP administration, supporting a critical role for superoxide in TH tyrosine nitration. These results indicate that tyrosine nitration-induced TH inactivation and consequently dopamine synthesis failure, represents an early and thus far unidentified biochemical event in MPTP neurotoxic process. The resemblance of the MPTP model with PD suggests that a similar phenomenon may occur in PD, influencing the severity of parkisonian symptoms.

Prominence of the dopamine D2 short isoform in dopaminergic pathways

As a result of alternative splicing, the D2 gene of the dopamine receptor family exists in two isoforms. The D2 long is characterized by the insertion of 29 amino acids in the third cytoplasmic loop, which is absent in the short isoform. We have produced subtype-specific antibodies against both the D2 short and D2 long isoforms and found a unique compartmentalization between these two isoforms in the primate brain. The D2 short predominates in the cell bodies and projection axons of the dopaminergic cell groups of the mesencephalon and hypothalamus, whereas the D2 long is more strongly expressed by neurons in the striatum and nucleus accumbens, structures targeted by dopaminergic fibers. These results show that the splice variants of the dopamine D2 receptor are differentially distributed and possess distinct functions. The strategic localization of the D2 short isoform in dopaminergic cell bodies and axons strongly suggests that this isoform is the likely dopamine autoreceptor, whereas the D2 long isoform is primarily a postsynaptic receptor.

Selective loss of dopaminergic nigro-striatal neurons in brains of Atm-deficient mice

Ataxia-telangiectasia (AT) is a human disease caused by mutations in the ATM gene. The neural phenotype of AT includes progressive cerebellar neurodegeneration, which results in ataxia and eventual motor dysfunction. Surprisingly, mice in which the Atm gene has been inactivated lack distinct behavioral ataxia or pronounced cerebellar degeneration, the hallmarks of the human disease. To determine whether lack of the Atm protein can nonetheless lead to structural abnormalities in the brain, we compared brains from male Atm-deficient mice with male, age-matched controls. Atm-deficient mice exhibited severe degeneration of tyrosine hydroxylase-positive, dopaminergic nigro-striatal neurons, and their terminals in the striatum. This cell loss was accompanied by a large reduction in immunoreactivity for the dopamine transporter in the striatum. A reduction in dopaminergic neurons also was evident in the ventral tegmental area. This effect was selective in that the noradrenergic nucleus locus coeruleus was normal in these mice. Behaviorally, Atm-deficient mice expressed locomotor abnormalities manifested as stride-length asymmetry, which could be corrected by peripheral application of the dopaminergic precursor l-dopa. In addition, these mice were hypersensitive to the dopamine releasing drug d-amphetamine. These results indicate that ATM deficiency can severely affect dopaminergic neurons in the central nervous system and suggest possible strategies for treating this aspect of the disease.

Intrastriatal injection of an adenoviral vector expressing glial-cell-line-derived neurotrophic factor prevents dopaminergic neuron degeneration and behavioral impairment in a rat model of Parkinson disease

Glial-cell-line-derived neurotrophic factor (GDNF) is a potent neurotrophic factor for adult nigral dopamine neurons in vivo. GDNF has both protective and restorative effects on the nigro-striatal dopaminergic (DA) system in animal models of Parkinson disease. Appropriate administration of this factor is essential for the success of its clinical application. Since it cannot cross the blood–brain barrier, a gene transfer method may be appropriate for delivery of the trophic factor to DA cells. We have constructed a recombinant adenovirus (Ad) encoding GDNF and injected it into rat striatum to make use of its ability to infect neurons and to be retrogradely transported by DA neurons. Ad-GDNF was found to drive production of large amounts of GDNF, as quantified by ELISA. The GDNF produced after gene transfer was biologically active: it increased the survival and differentiation of DA neurons in vitro. To test the efficacy of the Ad-mediated GDNF gene transfer in vivo, we used a progressive lesion model of Parkinson disease. Rats received injections unilaterally into their striatum first of Ad and then 6 days later of 6-hydroxydopamine. We found that mesencephalic nigral dopamine neurons of animals treated with the Ad-GDNF were protected, whereas those of animals treated with the Ad-β-galactosidase were not. This protection was associated with a difference in motor function: amphetamine-induced turning was much lower in animals that received the Ad-GDNF than in the animals that received Ad-β-galactosidase. This finding may have implications for the development of a treatment for Parkinson disease based on the use of neurotrophic factors.

Modulation of cognition-specific cortical activity by gonadal steroids: A positron-emission tomography study in women

There is considerable evidence from animal studies that gonadal steroid hormones modulate neuronal activity and affect behavior. To study this in humans directly, we used H215O positron-emission tomography to measure regional cerebral blood flow (rCBF) in young women during three pharmacologically controlled hormonal conditions spanning 4–5 months: ovarian suppression induced by the gonadotropin-releasing hormone agonist leuprolide acetate (Lupron), Lupron plus estradiol replacement, and Lupron plus progesterone replacement. Estradiol and progesterone were administered in a double-blind cross-over design. On each occasion positron-emission tomography scans were performed during (i) the Wisconsin Card Sorting Test, a neuropsychological test that physiologically activates prefrontal cortex (PFC) and an associated cortical network including inferior parietal lobule and posterior inferolateral temporal gyrus, and (ii) a no-delay matching-to-sample sensorimotor control task. During treatment with Lupron alone (i.e., with virtual absence of gonadal steroid hormones), there was marked attenuation of the typical Wisconsin Card Sorting Test activation pattern even though task performance did not change. Most strikingly, there was no rCBF increase in PFC. When either progesterone or estrogen was added to the Lupron regimen, there was normalization of the rCBF activation pattern with augmentation of the parietal and temporal foci and return of the dorsolateral PFC activation. These data directly demonstrate that the hormonal milieu modulates cognition-related neural activity in humans.

FosB mutant mice: Loss of chronic cocaine induction of Fos-related proteins and heightened sensitivity to cocaine’s psychomotor and rewarding effects

Chronic exposure to cocaine leads to prominent, long-lasting changes in behavior that characterize a state of addiction. The striatum, including the nucleus accumbens and caudoputamen, is an important substrate for these actions. We previously have shown that long-lasting Fos-related proteins of 35–37 kDa are induced in the striatum by chronic cocaine administration. In the present study, the identity and functional role of these Fos-related proteins were examined using fosB mutant mice. The striatum of these mice completely lacked basal levels of the 35- to 37-kDa Fos-related proteins as well as their induction by chronic cocaine administration. This deficiency was associated with enhanced behavioral responses to cocaine: fosB mutant mice showed exaggerated locomotor activation in response to initial cocaine exposures as well as robust conditioned place preference to a lower dose of cocaine, compared with wild-type littermates. These results establish the long-lasting Fos-related proteins as products of the fosB gene (specifically ΔFosB isoforms) and suggest that transcriptional regulation by fosB gene products plays a critical role in cocaine-induced behavioral responses. This finding demonstrates that a Fos family member protein plays a functional role in behavioral responses to drugs of abuse and implicates fosB gene products as important determinants of cocaine abuse.

Loss of haloperidol induced gene expression and catalepsy in protein kinase A-deficient mice

The antipsychotic drug, haloperidol, elicits the expression of neurotensin and c-fos mRNA in the dorsal lateral region of the striatum and produces an acute cataleptic response in rodents that correlates with the motor side effects of haloperidol in humans. Mice harboring a targeted disruption of the RIIβ subunit of protein kinase A have a profound deficit in cAMP-stimulated kinase activity in the striatum. When treated with haloperidol, RIIβ mutant mice fail to induce either c-fos or neurotensin mRNA and the acute cataleptic response is blocked. However, both wild-type and mutant mice become cataleptic when neurotensin peptide is directly injected into the lateral ventricle, demonstrating that the kinase deficiency does not interfere with the action of neurotensin but rather its synthesis and release. These results establish a direct role for protein kinase A as a mediator of haloperidol induced gene induction and cataleptic behavior.

Response-reinforcement learning is dependent on N-methyl-d-aspartate receptor activation in the nucleus accumbens core

The nucleus accumbens, a site within the ventral striatum, is best known for its prominent role in mediating the reinforcing effects of drugs of abuse such as cocaine, alcohol, and nicotine. Indeed, it is generally believed that this structure subserves motivated behaviors, such as feeding, drinking, sexual behavior, and exploratory locomotion, which are elicited by natural rewards or incentive stimuli. A basic rule of positive reinforcement is that motor responses will increase in magnitude and vigor if followed by a rewarding event. It is likely, therefore, that the nucleus accumbens may serve as a substrate for reinforcement learning. However, there is surprisingly little information concerning the neural mechanisms by which appetitive responses are learned. In the present study, we report that treatment of the nucleus accumbens core with the selective competitive N-methyl-d-aspartate (NMDA) antagonist 2-amino-5-phosphonopentanoic acid (AP-5; 5 nmol/0.5 μl bilaterally) impairs response-reinforcement learning in the acquisition of a simple lever-press task to obtain food. Once the rats learned the task, AP-5 had no effect, demonstrating the requirement of NMDA receptor-dependent plasticity in the early stages of learning. Infusion of AP-5 into the accumbens shell produced a much smaller impairment of learning. Additional experiments showed that AP-5 core-treated rats had normal feeding and locomotor responses and were capable of acquiring stimulus-reward associations. We hypothesize that stimulation of NMDA receptors within the accumbens core is a key process through which motor responses become established in response to reinforcing stimuli. Further, this mechanism, may also play a critical role in the motivational and addictive properties of drugs of abuse.

Inosine stimulates extensive axon collateral growth in the rat corticospinal tract after injury

The purine nucleoside inosine has been shown to induce axon outgrowth from primary neurons in culture through a direct intracellular mechanism. For this study, we investigated the effects of inosine in vivo by examining whether it would stimulate axon growth after a unilateral transection of the corticospinal tract. Inosine applied with a minipump to the rat sensorimotor cortex stimulated intact pyramidal cells to undergo extensive sprouting of their axons into the denervated spinal cord white matter and adjacent neuropil. Axon growth was visualized by anterograde tracing with biotinylated dextran amine and by immunohistochemistry with antibodies to GAP-43. Thus, inosine, a naturally occurring metabolite without known side effects, might help to restore essential circuitry after injury to the central nervous system.

Regulation of dopaminergic pathways by retinoids: Activation of the D2 receptor promoter by members of the retinoic acid receptor–retinoid X receptor family

Dopamine is a neuromodulator involved in the control of key physiological functions. Dopamine-dependent signal transduction is activated through the interaction with membrane receptors of the seven-transmembrane domain G protein-coupled family. Among them, dopamine D2 receptor is highly expressed in the striatum and the pituitary gland as well as by mesencephalic dopaminergic neurons. Lack of D2 receptors in mice leads to a locomotor parkinsonian-like phenotype and to pituitary tumors. The D2 receptor promoter has characteristics of a housekeeping gene. However, the restricted expression of this gene to particular neurons and cells points to a strict regulation of its expression by cell-specific transcription factors. We demonstrate here that the D2 receptor promoter contains a functional retinoic acid response element. Furthermore, analysis of retinoic acid receptor-null mice supports our finding and shows that in these animals D2 receptor expression is reduced. This finding assigns to retinoids an important role in the control of gene expression in the central nervous system.