A hierarchical neuronal network for planning behavior

Planning a goal-directed sequence of behavior is a higher function of the human brain that relies on the integrity of prefrontal cortical areas. In the Tower of London test, a puzzle in which beads sliding on pegs must be moved to match a designated goal configuration, patients with lesioned prefrontal cortex show deficits in planning a goal-directed sequence of moves. We propose a neuronal network model of sequence planning that passes this test and, when lesioned, fails in a way that mimics prefrontal patients’ behavior. Our model comprises a descending planning system with hierarchically organized plan, operation, and gesture levels, and an ascending evaluative system that analyzes the problem and computes internal reward signals that index the correct/erroneous status of the plan. Multiple parallel pathways connecting the evaluative and planning systems amend the plan and adapt it to the current problem. The model illustrates how specialized hierarchically organized neuronal assemblies may collectively emulate central executive or supervisory functions of the human brain.

A neuronal model of a global workspace in effortful cognitive tasks

A minimal hypothesis is proposed concerning the brain processes underlying effortful tasks. It distinguishes two main computational spaces: a unique global workspace composed of distributed and heavily interconnected neurons with long-range axons, and a set of specialized and modular perceptual, motor, memory, evaluative, and attentional processors. Workspace neurons are mobilized in effortful tasks for which the specialized processors do not suffice. They selectively mobilize or suppress, through descending connections, the contribution of specific processor neurons. In the course of task performance, workspace neurons become spontaneously coactivated, forming discrete though variable spatio-temporal patterns subject to modulation by vigilance signals and to selection by reward signals. A computer simulation of the Stroop task shows workspace activation to increase during acquisition of a novel task, effortful execution, and after errors. We outline predictions for spatio-temporal activation patterns during brain imaging, particularly about the contribution of dorsolateral prefrontal cortex and anterior cingulate to the workspace.

Abolition of morphine-immunosuppression in mice lacking the μ-opioid receptor gene

Opiates are potent analgesic and addictive compounds. They also act on immune responses, and morphine, the prototypic opiate, has been repeatedly described as an immunosuppressive drug. Pharmacological studies have suggested that the inhibitory action of opiates on immunity is mediated by multiple opioid receptor sites but molecular evidence has remained elusive. Recently, three genes encoding μ- (MOR), δ-, and κ-opioid receptors have been cloned. To investigate whether the μ-opioid receptor is functionally implicated in morphine immunosuppression in vivo, we have examined immune responses of mice with a genetic disruption of the MOR gene. In the absence of drug, there was no difference between wild-type and mutant mice with regard to a large number of immunological endpoints, suggesting that the lack of MOR-encoded protein has little consequence on immune status. Chronic morphine administration induced lymphoid organ atrophy, diminished the ratio of CD4+CD8+ cells in the thymus and strongly reduced natural killer activity in wild-type mice. None of these effects was observed in MOR-deficient mice after morphine treatment. This demonstrates that the MOR gene product represents a major molecular target for morphine action on the immune system. Because our previous studies of MOR-deficient mice have shown that this receptor protein is also responsible for morphine analgesia, reward, and physical dependence, the present results imply that MOR-targeted therapeutic drugs that are developed for the treatment of pain or opiate addiction may concomitantly influence immune responses.

Preferential localization of self-stimulation sites in striosomes/patches in the rat striatum

Histological sections of the mammalian striatum reveal a “matrix” that is histochemically distinguishable from patches, or “striosomes”. The latter are cross sections of a compartment that consists primarily of tube-shaped structures radiating through the matrix. As a test of the hypothesis that the function of the striosome/patch compartment includes the mediation of behaviors related to reward, the present study examined electrical self-stimulation of the caudoputamen in rats with electrodes in either of the two compartments. Rats acquired and maintained bar-pressing responses that were contingent on stimulation through electrodes making contact with striosomes/patches more reliably than animals with electrodes terminating exclusively in the matrix. The results provide in vivo evidence that the striosome/patch compartment is functionally differentiated from the matrix compartment: Stimulation centered in or around the striosome/patch compartment but not in the matrix led to rapid acquisition of a new behavior.

Cocaine-predictive stimulus induces drug-seeking behavior and neural activation in limbic brain regions after multiple months of abstinence: Reversal by D1 antagonists

The conditioning of cocaine's subjective actions with environmental stimuli may be a critical factor in long-lasting relapse risk associated with cocaine addiction. To study the significance of learning factors in persistent addictive behavior as well as the neurobiological basis of this phenomenon, rats were trained to associate discriminative stimuli (SD) with the availability of i.v. cocaine vs. nonrewarding saline solution, and then placed on extinction conditions during which the i.v. solutions and SDs were withheld. The effects of reexposure to the SD on the recovery of responding at the previously cocaine-paired lever and on Fos protein expression then were determined in two groups. One group was tested immediately after extinction, whereas rats in the second group were confined to their home cages for an additional 4 months before testing. In both groups, the cocaine SD, but not the non-reward SD, elicited strong recovery of responding and increased Fos immunoreactivity in the basolateral amygdala and medial prefrontal cortex (areas Cg1/Cg3). The response reinstatement and Fos expression induced by the cocaine SD were both reversed by selective dopamine D1 receptor antagonists. The undiminished efficacy of the cocaine SD to elicit drug-seeking behavior after 4 months of abstinence parallels the long-lasting nature of conditioned cue reactivity and cue-induced cocaine craving in humans, and confirms a significant role of learning factors in the long-lasting addictive potential of cocaine. Moreover, the results implicate D1-dependent neural mechanisms within the medial prefrontal cortex and basolateral amygdala as substrates for cocaine-seeking behavior elicited by cocaine-predictive environmental stimuli.

Negative frequency-dependent selection maintains a dramatic flower color polymorphism in the rewardless orchid Dactylorhiza sambucina (L.) Soò

The orchid Dactylorhiza sambucina shows a stable and dramatic flower-color polymorphism, with both yellow- and purple-flowered individuals present in natural populations throughout the range of the species in Europe. The evolutionary significance of flower-color polymorphisms found in many rewardless orchid species has been discussed at length, but the mechanisms responsible for their maintenance remain unclear. Laboratory experiments have suggested that behavioral responses by pollinators to lack of reward availability might result in a reproductive advantage for rare-color morphs. Consequently, we performed an experiment varying the relative frequency of the two color morphs of D. sambucina to test whether rare morph advantage acted in the natural habitat of the species. We show here clear evidence from this manipulative experiment that rare-color morphs have reproductive advantage through male and female components. This is the first demonstration, to our knowledge, that negative frequency-dependent selection through pollinator preference for rare morphs can cause the maintenance of a flower-color polymorphism.

Operant conditioning of H-reflex changes synaptic terminals on primate motoneurons.

Operant conditioning of the primate triceps surae H-reflex, the electrical analog of the spinal stretch reflex, creates a memory trace that includes changes in the spinal cord. To define the morphological correlates of this plasticity, we analyzed the synaptic terminal coverage of triceps surae motoneurons from animals in which the triceps surae H-reflex in one leg had been increased (HRup mode) or decreased (HRdown mode) by conditioning and compared them to each other and to motoneurons from unconditioned animals. Motoneurons were labeled by intramuscular injection of cholera toxin-horseradish peroxidase. A total of 5055 terminals on the cell bodies and proximal dendrites of 114 motoneurons from 14 animals were studied by electron microscopy. Significant differences were found between HRup and HRdown animals and between HRup and naive (i.e., unconditioned) animals. F terminals (i.e., putative inhibitory terminals) were smaller and their active zone coverage on the cell body was lower on motoneurons from the conditioned side of HRup animals than on motoneurons from the conditioned side of HRdown animals. C terminals (i.e., terminals associated with postsynaptic cisterns and rough endoplasmic reticulum) were smaller and the number of C terminals in each C complex (i.e., a group of contiguous C terminals) was larger on motoneurons from the conditioned side of HRup animals than on motoneurons either from the conditioned side of HRdown animals or from naive animals. Because the treatment of HRup and HRdown animals differed only in the reward contingency, the results imply that the two contingencies had different effects on motoneuron synaptic terminals. In combination with other recent data, they show that H-reflex conditioning produces a complex pattern of spinal cord plasticity that includes changes in motoneuron physiological properties as well as in synaptic terminals. Further delineation of this pattern should reveal the contribution of the structural changes described here to the learned change in behavior.

Desigualdades de género en salud laboral en España

Objetivos: Analizar las desigualdades de género en las condiciones de empleo, trabajo, conciliación de la vida laboral y familiar, y en los problemas de salud relacionados con el trabajo en una muestra de la población ocupada en España en el año 2007 teniendo en cuenta la clase social y el sector de actividad. Métodos: Las desigualdades de género se analizaron mediante 25 indicadores en los 11.054 trabajadores entrevistados en la VI Encuesta Nacional de Condiciones de Trabajo. Se calcularon las odds ratio (OR) y sus intervalos de confianza del 95% (IC95%) mediante modelos de regresión logística multivariados, estratificando por clase social ocupacional y sector de actividad. Resultados: Más mujeres que hombres trabajaban sin contrato (OR = 1,83; IC95%: 1,51-2,21), con alto esfuerzo o baja recompensa (1,14:1,05-1,25) y sufriendo acoso sexual (2,85:1,75-4,62), discriminación (1,60:1,26-2,03) y más dolores osteomusculares (1,38:1,19-1,59). Más hombres que mujeres trabajaban a turnos (0,86:0,79-0,94), con altos niveles de ruido (0,34:0,30-0,40), altas exigencias físicas (0,58:0,54-0,63) y sufriendo más lesiones por accidentes de trabajo (0,67:0,59-0,76). Las trabajadoras no manuales mostraron trabajar con un contrato temporal (1,34:1,09-1,63), expuestas a más riesgos psicosociales y sufriendo mayor discriminación (2,47:1,49-4,09) y enfermedades profesionales (1,91:1,28-2,83). En el sector de la industria las desigualdades de género fueron más marcadas. Conclusiones: En España existen importantes desigualdades de género en las condiciones de empleo, trabajo y en los problemas de salud relacionados con el trabajo, que se ven influenciadas por la clase social y el sector de actividad, y que sería necesario tener en consideración en las políticas públicas de salud laboral.

Gender inequalities in occupational health related to the unequal distribution of working and employment conditions: a systematic review

Introduction: Gender inequalities exist in work life, but little is known about their presence in relation to factors examined in occupation health settings. The aim of this study was to identify and summarize the working and employment conditions described as determinants of gender inequalities in occupational health in studies related to occupational health published between 1999 and 2010. Methods: A systematic literature review was undertaken of studies available in MEDLINE, EMBASE, Sociological Abstracts, LILACS, EconLit and CINAHL between 1999 and 2010. Epidemiologic studies were selected by applying a set of inclusion criteria to the title, abstract, and complete text. The quality of the studies was also assessed. Selected studies were qualitatively analysed, resulting in a compilation of all differences between women and men in the prevalence of exposure to working and employment conditions and work-related health problems as outcomes. Results: Most of the 30 studies included were conducted in Europe (n=19) and had a cross-sectional design (n=24). The most common topic analysed was related to the exposure to work-related psychosocial hazards (n=8). Employed women had more job insecurity, lower control, worse contractual working conditions and poorer self-perceived physical and mental health than men did. Conversely, employed men had a higher degree of physically demanding work, lower support, higher levels of effort-reward imbalance, higher job status, were more exposed to noise and worked longer hours than women did. Conclusions: This systematic review has identified a set of working and employment conditions as determinants of gender inequalities in occupational health from the occupational health literature. These results may be useful to policy makers seeking to reduce gender inequalities in occupational health, and to researchers wishing to analyse these determinants in greater depth.

Welfare state regimes and gender inequalities in the exposure to work-related psychosocial hazards

Background: Gender inequalities in the exposure to work-related psychosocial hazards are well established. However, little is known about how welfare state regimes influence these inequalities. Objectives: To examine the relationship between welfare state regimes and gender inequalities in the exposure to work-related psychosocial hazards in Europe, considering occupational social class. Methods: We used a sample of 27, 465 workers from 28 European countries. Dependent variables were high strain, iso-strain, and effort-reward imbalance, and the independent was gender. We calculated the prevalence and prevalence ratio separately for each welfare state regime and occupational social class, using multivariate logistic regression models. Results: More female than male managers/professionals were exposed to: high strain, iso-strain, and effort–reward imbalance in Scandinavian [adjusted prevalence ratio (aPR) = 2·26; 95% confidence interval (95% CI): 1·87–2·75; 2·12: 1·72–2·61; 1·41: 1·15–1·74; respectively] and Continental regimes (1·43: 1·23–1·54; 1·51: 1·23–1·84; 1·40: 1·17–1·67); and to high strain and iso-strain in Anglo-Saxon (1·92: 1·40–2·63; 1·85: 1·30–2·64; respectively), Southern (1·43: 1·14–1·79; 1·60: 1·18–2·18), and Eastern regimes (1·56: 1·35–1·81; 1·53: 1·28–1·83). Conclusion: Gender inequalities in the exposure to work-related psychosocial hazards were not lower in those welfare state regimes with higher levels of universal social protection policies.

Letter from Judah Monis to the Harvard Corporation, 1735 October 3

Two folio-sized leaves containing an October 3, 1735 letter from Judah Monis to the Harvard Corporation requesting an increased "reward" for the Hebrew Grammar and an increased salary. The document includes a financial outline of a "Scheme for 30 Years."

Countermanding in rats as a practical model for investigation of adaptive control of behaviour, lifespan changes in behavioural control and neurotransmitter function

The countermanding paradigm was designed to investigate the ability to cancel a prepotent response when a stop signal is presented and allows estimation of the stop signal response time (SSRT), an otherwise unobservable behaviour. Humans exhibit adaptive control of behaviour in the countermanding task, proactively lengthening response time (RT) in expectation of stopping and reactively lengthening RT following stop trials or errors. Human performance changes throughout the lifespan, with longer RT, SSRT and greater emphasis on post-error slowing reported for older compared to younger adults. Inhibition in the task has generally been improved by drugs that increase extracellular norepinephrine. The current thesis examined a novel choice response countermanding task in rats to explore whether rodent countermanding performance is a suitable model for the study of adaptive control of behaviour, lifespan changes in behavioural control and the role of neurotransmitters in these behaviours. Rats reactively adjusted RT in the countermanding task, shortening RT after consecutive correct go trials and lengthening RT following non-cancelled, but not cancelled stop trials, in sessions with a 10 s, but not a 1 s post-error timeout interval. Rats proactively lengthened RT in countermanding task sessions compared to go trial-only sessions. Together, these findings suggest that rats strategically lengthened RT in the countermanding task to improve accuracy and avoid longer, unrewarded timeout intervals. Next, rats exhibited longer RT and relatively conserved post-error slowing, but no significant change in SSRT when tested at 12, compared to 7 months of age, suggesting that rats exhibit changes in countermanding task performance with aging similar to those observed in humans. Finally, acute administration of yohimbine (1.25, 2.5 mg/kg) and d-amphetamine (0.25, 0.5 mg/kg), which putatively increase extracellular norepinephrine and dopamine respectively, resulted in RT shortening, baseline-dependent effects on SSRT, and attenuated adaptive RT adjustments in rats in the case of d-amphetamine. These findings suggest that dopamine and norepinephrine encouraged motivated, reward-seeking behaviour and supported inhibitory control in an inverted-U-like fashion. Taken together, these observations validate the rat countermanding task for further study of the neural correlates and neurotransmitters mediating adaptive control of behaviour and lifespan changes in behavioural control.

The Optimality of Decision Making During Motor Learning

In our daily lives, we often must predict how well we are going to perform in the future based on an evaluation of our current performance and an assessment of how much we will improve with practice. Such predictions can be used to decide whether to invest our time and energy in learning and, if we opt to invest, what rewards we may gain. This thesis investigated whether people are capable of tracking their own learning (i.e. current and future motor ability) and exploiting that information to make decisions related to task reward. In experiment one, participants performed a target aiming task under a visuomotor rotation such that they initially missed the target but gradually improved. After briefly practicing the task, they were asked to select rewards for hits and misses applied to subsequent performance in the task, where selecting a higher reward for hits came at a cost of receiving a lower reward for misses. We found that participants made decisions that were in the direction of optimal and therefore demonstrated knowledge of future task performance. In experiment two, participants learned a novel target aiming task in which they were rewarded for target hits. Every five trials, they could choose a target size which varied inversely with reward value. Although participants’ decisions deviated from optimal, a model suggested that they took into account both past performance, and predicted future performance, when making their decisions. Together, these experiments suggest that people are capable of tracking their own learning and using that information to make sensible decisions related to reward maximization.

Role of Dopamine D2 Receptors in the Consolidation of Amphetamine-Cue Memory in Conditioned Activity in Rats

The neurotransmitter dopamine (DA) plays an essential role in reward-related incentive learning, whereby neutral stimuli gain the ability to elicit approach and other responses. In an incentive learning paradigm called conditioned activity, animals receive a stimulant drug in a specific environment over the course of several days. When then placed in that environment drug-free, they generally display a conditioned hyperactive response. Modulating DA transmission at different time points during the paradigm has been shown to disrupt or enhance conditioning effects. For instance, blocking DA D2 receptors before sessions generally impedes the acquisition of conditioned activity. To date, no studies have examined the role of D2 receptors in the consolidation phase of conditioned activity; this phase occurs immediately after acquisition and involves the stabilization of memories for long-term storage. To investigate this possible role, I trained Wistar rats (N = 108) in the conditioned activity paradigm produced by amphetamine (2.0 mg/kg, intraperitoneally) to examine the effects of the D2 antagonist haloperidol (doses 0.10, 0.25, 0.50, 0.75, 1.0, & 2.0 mg/kg, intraperitoneally) administered 5 min after conditioning sessions. Two positive control groups received haloperidol 1 h before conditioning sessions (doses 1.0 mg/kg and 2.0 mg/kg). The results revealed that post-session haloperidol at all doses tested did not disrupt the consolidation of conditioned activity, while pre-session haloperidol at 2.0 mg/kg prevented acquisition, with the 1.0 mg/kg group trending toward a block. Additionally, post-session haloperidol did not diminish activity during conditioning days, unlike pre-session haloperidol. One possible reason for these findings is that the consolidation phase may have begun earlier than when haloperidol was administered, since the conditioned activity paradigm uses longer learning sessions than those generally used in consolidation studies. Future studies may test if conditioned activity can be achieved with shorter sessions; if so, haloperidol would then be re-tested at an earlier time point. D2 receptor second messenger systems may also be investigated in consolidation. Since drug-related incentive stimuli can evoke cravings in those with drug addiction, a better understanding of the mechanisms of incentive learning may lead to the development of solutions for these individuals.

Corrélats neuronaux du circuit des récompenses chez les jeunes à risque parental de troubles de l'humeur

Cette thèse a pour objectif l’investigation du circuit des récompenses, sur les plans comportementaux et neuronaux, chez des adolescents à risque parental élevé de dépression majeure et de trouble bipolaire, en comparaison à des jeunes à risque parental peu élevé. Plus précisément, le but est d’identifier des marqueurs comportementaux et neuronaux du risque de développer une dépression majeure ou un trouble bipolaire, afin d’être en mesure de détecter et de prévenir ces troubles le plus tôt possible pour éviter, ou du moins retarder, leur émergence. Pour ce faire, nous avons réalisé deux études, présentées ici dans deux articles empiriques. Dans le premier article, le fonctionnement comportemental et neuronal du circuit des récompenses a été investigué au moyen d’une tâche d’anticipation et d’obtention de gains et de pertes monétaires, chez des adolescents à risque parental de dépression majeure (i.e., jeunes asymptomatiques dont un des parents souffre de dépression majeure), des adolescents à risque parental de trouble bipolaire (i.e., jeunes asymptomatiques dont un des parents souffre de trouble bipolaire) et des adolescents contrôles (i.e., jeunes asymptomatiques dont les deux parents sont en bonne santé mentale). Au niveau comportemental, les résultats ont révélé une meilleure performance chez les jeunes à risque de dépression majeure lorsqu’ils devaient éviter d’obtenir des pertes monétaires de magnitude variée (0,20$, 1$ ou 5$), ainsi qu’une meilleure performance chez les jeunes à risque de trouble bipolaire sur les essais impliquant d’éviter des pertes monétaires de magnitude nulle (0$). Au niveau neuronal, les jeunes à risque de dépression majeure démontraient une diminution de l’activation du cortex préfrontal dorsolatéral lors de l’anticipation de potentielles pertes monétaires de magnitude variée, tandis que les jeunes à risque de trouble bipolaire démontraient une diminution de l’activation du cortex préfrontal dorsolatéral lors de l’anticipation de potentielles pertes monétaires de magnitude nulle. De plus, les jeunes à risque de dépression majeure tendaient à démontrer une augmentation de l’activité du cortex orbitofrontal durant l’évitement réussi de pertes monétaires, tandis que les jeunes à risque de trouble bipolaire tendaient à démontrer une augmentation de l’activité du cortex orbitofrontal lors de l’obtention de pertes monétaires. Dans le deuxième article, l’intégrité structurelle des régions fronto-limbiques a été investiguée, au moyen de mesures du volume, de l’épaisseur corticale et de la superficie corticale. Les résultats ont mis en évidence, chez les jeunes à risque de trouble bipolaire, un volume plus élevé du cortex préfrontal dorsolatéral, par rapport aux jeunes à risque de dépression majeure et contrôles. De plus, les jeunes à risque de trouble bipolaire présentaient un volume plus élevé du cortex cingulaire postérieur, en comparaison aux jeunes à risque de dépression majeure. Enfin, une diminution de l’épaisseur corticale du cortex orbitofrontal et du gyrus frontal moyen a été observée chez les adolescents à risque de trouble bipolaire, en comparaison au groupe contrôle. L’ensemble de ces résultats démontre ainsi l’existence de particularités comportementales et d’altérations neuronales sur les plans fonctionnel et structurel, chez des jeunes à risque élevé de troubles de l’humeur, et ce, avant même l’émergence des premiers symptômes thymiques. Plus particulièrement, ces caractéristiques pourraient constituer des marqueurs du risque de développer un trouble de l’humeur. Par conséquent, ces marqueurs pourraient aider à mieux identifier les jeunes qui sont le plus à risque de développer un trouble de l’humeur, et ainsi permettre la mise en place précoce de stratégies préventives adaptées, afin d’éviter des trajectoires développementales psychopathologiques.