Cocaine effects on mouse incentive-learning and human addiction are linked to alpha 2 subunit-containing GABA(A) receptors

Because GABA(A) receptors containing alpha 2 subunits are highly represented in areas of the brain, such as nucleus accumbens (NAcc), frontal cortex, and amygdala, regions intimately involved in signaling motivation and reward, we hypothesized that manipulations of this receptor subtype would influence processing of rewards. Voltage-clamp recordings from NAcc medium spiny neurons of mice with alpha 2 gene deletion showed reduced synaptic GABA(A) receptor-mediated responses. Behaviorally, the deletion abolished cocaine`s ability to potentiate behaviors conditioned to rewards (conditioned reinforcement), and to support behavioral sensitization. In mice with a point mutation in the benzodiazepine binding pocket of alpha 2-GABA(A) receptors (alpha 2H101R), GABAergic neurotransmission in medium spiny neurons was identical to that of WT (i.e., the mutation was silent), but importantly, receptor function was now facilitated by the atypical benzodiazepine Ro 15-4513 (ethyl 8-amido-5,6-dihydro-5-methyl-6-oxo-4H-imidazo [1,5-a] [1,4] benzodiazepine-3-carboxylate). In alpha 2H101R, but not WT mice, Ro 15-4513 administered directly into the NAcc-stimulated locomotor activity, and when given systemically and repeatedly, induced behavioral sensitization. These data indicate that activation of alpha 2-GABA(A) receptors (most likely in NAcc) is both necessary and sufficient for behavioral sensitization. Consistent with a role of these receptors in addiction, we found specific markers and haplotypes of the GABRA2 gene to be associated with human cocaine addiction.

Role of Dopamine D2 Receptors in the Consolidation of Amphetamine-Cue Memory in Conditioned Activity in Rats

The neurotransmitter dopamine (DA) plays an essential role in reward-related incentive learning, whereby neutral stimuli gain the ability to elicit approach and other responses. In an incentive learning paradigm called conditioned activity, animals receive a stimulant drug in a specific environment over the course of several days. When then placed in that environment drug-free, they generally display a conditioned hyperactive response. Modulating DA transmission at different time points during the paradigm has been shown to disrupt or enhance conditioning effects. For instance, blocking DA D2 receptors before sessions generally impedes the acquisition of conditioned activity. To date, no studies have examined the role of D2 receptors in the consolidation phase of conditioned activity; this phase occurs immediately after acquisition and involves the stabilization of memories for long-term storage. To investigate this possible role, I trained Wistar rats (N = 108) in the conditioned activity paradigm produced by amphetamine (2.0 mg/kg, intraperitoneally) to examine the effects of the D2 antagonist haloperidol (doses 0.10, 0.25, 0.50, 0.75, 1.0, & 2.0 mg/kg, intraperitoneally) administered 5 min after conditioning sessions. Two positive control groups received haloperidol 1 h before conditioning sessions (doses 1.0 mg/kg and 2.0 mg/kg). The results revealed that post-session haloperidol at all doses tested did not disrupt the consolidation of conditioned activity, while pre-session haloperidol at 2.0 mg/kg prevented acquisition, with the 1.0 mg/kg group trending toward a block. Additionally, post-session haloperidol did not diminish activity during conditioning days, unlike pre-session haloperidol. One possible reason for these findings is that the consolidation phase may have begun earlier than when haloperidol was administered, since the conditioned activity paradigm uses longer learning sessions than those generally used in consolidation studies. Future studies may test if conditioned activity can be achieved with shorter sessions; if so, haloperidol would then be re-tested at an earlier time point. D2 receptor second messenger systems may also be investigated in consolidation. Since drug-related incentive stimuli can evoke cravings in those with drug addiction, a better understanding of the mechanisms of incentive learning may lead to the development of solutions for these individuals.

Role of Dopamine D2 Receptors in the Consolidation of Amphetamine-Cue Memory in Conditioned Activity in Rats

The neurotransmitter dopamine (DA) plays an essential role in reward-related incentive learning, whereby neutral stimuli gain the ability to elicit approach and other responses. In an incentive learning paradigm called conditioned activity, animals receive a stimulant drug in a specific environment over the course of several days. When then placed in that environment drug-free, they generally display a conditioned hyperactive response. Modulating DA transmission at different time points during the paradigm has been shown to disrupt or enhance conditioning effects. For instance, blocking DA D2 receptors before sessions generally impedes the acquisition of conditioned activity. To date, no studies have examined the role of D2 receptors in the consolidation phase of conditioned activity; this phase occurs immediately after acquisition and involves the stabilization of memories for long-term storage. To investigate this possible role, I trained Wistar rats (N = 108) in the conditioned activity paradigm produced by amphetamine (2.0 mg/kg, intraperitoneally) to examine the effects of the D2 antagonist haloperidol (doses 0.10, 0.25, 0.50, 0.75, 1.0, & 2.0 mg/kg, intraperitoneally) administered 5 min after conditioning sessions. Two positive control groups received haloperidol 1 h before conditioning sessions (doses 1.0 mg/kg and 2.0 mg/kg). The results revealed that post-session haloperidol at all doses tested did not disrupt the consolidation of conditioned activity, while pre-session haloperidol at 2.0 mg/kg prevented acquisition, with the 1.0 mg/kg group trending toward a block. Additionally, post-session haloperidol did not diminish activity during conditioning days, unlike pre-session haloperidol. One possible reason for these findings is that the consolidation phase may have begun earlier than when haloperidol was administered, since the conditioned activity paradigm uses longer learning sessions than those generally used in consolidation studies. Future studies may test if conditioned activity can be achieved with shorter sessions; if so, haloperidol would then be re-tested at an earlier time point. D2 receptor second messenger systems may also be investigated in consolidation. Since drug-related incentive stimuli can evoke cravings in those with drug addiction, a better understanding of the mechanisms of incentive learning may lead to the development of solutions for these individuals.

Increased salience of gains versus decreased associative learning differentiate bipolar disorder from schizophrenia during incentive decision making

Background Abnormalities in incentive decision making, typically assessed using the Iowa Gambling Task (IGT), have been reported in both schizophrenia (SZ) and bipolar disorder (BD). We applied the Expectancy-Valence (E-V) model to determine whether motivational, cognitive and response selection component processes of IGT performance are differentially affected in SZ and BD. Method Performance on the IGT was assessed in 280 individuals comprising 70 remitted patients with SZ, 70 remitted patients with BD and 140 age-, sex-and IQ-matched healthy individuals. Based on the E-V model, we extracted three parameters, 'attention to gains or loses', 'expectancy learning' and 'response consistency', that respectively reflect motivational, cognitive and response selection influences on IGT performance. Results Both patient groups underperformed in the IGT compared to healthy individuals. However, the source of these deficits was diagnosis specific. Associative learning underlying the representation of expectancies was disrupted in SZ whereas BD was associated with increased incentive salience of gains. These findings were not attributable to non-specific effects of sex, IQ, psychopathology or medication. Conclusions Our results point to dissociable processes underlying abnormal incentive decision making in BD and SZ that could potentially be mapped to different neural circuits. © 2012 Cambridge University Press.

Automating marine mammal detection in aerial images captured during wildlife surveys: A deep learning approach

Aerial surveys conducted using manned or unmanned aircraft with customized camera payloads can generate a large number of images. Manual review of these images to extract data is prohibitive in terms of time and financial resources, thus providing strong incentive to automate this process using computer vision systems. There are potential applications for these automated systems in areas such as surveillance and monitoring, precision agriculture, law enforcement, asset inspection, and wildlife assessment. In this paper, we present an efficient machine learning system for automating the detection of marine species in aerial imagery. The effectiveness of our approach can be credited to the combination of a well-suited region proposal method and the use of Deep Convolutional Neural Networks (DCNNs). In comparison to previous algorithms designed for the same purpose, we have been able to dramatically improve recall to more than 80% and improve precision to 27% by using DCNNs as the core approach.

Mechanism design for cost optimal PAC learning in the presence of strategic noisy annotators

We consider the problem of Probably Ap-proximate Correct (PAC) learning of a bi-nary classifier from noisy labeled exam-ples acquired from multiple annotators(each characterized by a respective clas-sification noise rate). First, we consider the complete information scenario, where the learner knows the noise rates of all the annotators. For this scenario, we derive sample complexity bound for the Mini-mum Disagreement Algorithm (MDA) on the number of labeled examples to be ob-tained from each annotator. Next, we consider the incomplete information sce-nario, where each annotator is strategic and holds the respective noise rate as a private information. For this scenario, we design a cost optimal procurement auc-tion mechanism along the lines of Myer-son’s optimal auction design framework in a non-trivial manner. This mechanism satisfies incentive compatibility property,thereby facilitating the learner to elicit true noise rates of all the annotators.

Protracted Peace processes: Policy (Un)learning and the Cyprus Debacle

The article examines why a comprehensive settlement to resolve the Cyprus problem has yet to be reached despite the existence of a positive incentive structure and the proactive involvement of regional and international organizations, including the European Union and the United Nations. To address this question, evidence from critical turning points in foreign policy decision-making in Turkey, Greece and the two communities in Cyprus is drawn on. The role of hegemonic political discourses is emphasized, and it is argued that the latter have prevented an accurate evaluation of incentives that could have set the stage for a constructive settlement. However, despite the political debacle in the Cypriot negotiations, success stories have emerged, such as the reactivation of the Committee for Missing Persons (CMP), a defunct body for almost 25 years, to become the most successful bi-communal project following Cyprus’s EU accession. Contradictory evidence in the Cypriot peace process is evaluated and policy lessons to be learned from the CMP ‘success story’ are identified.

Autonomy in English language learning: a case study

The main goal of this study was to analyse the development of a pedagogy for autonomy tuned to the current situation in which Higher Education finds itself, namely of implementation of the Bologna Process in Europe, and in particular at the Escola Superior Agrária of the Polytechnic School at Coimbra. For this purpose new course units were created, new descriptors written, new materials developed and new methodologies tried. A case study was undertaken to observe and analyse the changes the institution was undergoing and to assess the impact of the new methodologies, particularly regarding the development of student autonomy. The target population for this study were the first year students on the Biotechnology degree in the year 2007/2008, to whom a battery of tests were applied, namely proficiency tests, belief tests, metacognitive tests, as well as methods of ethnographic research. The study relied on the European Framework of Reference for Languages and the European Language Portfolio to establish recognised levels and competences, and employed the portfolio as its main tool for measuring student autonomy. This portfolio was simultaneously biographical and descriptive and was organised by the students in their own time. Great incentive was given to this independent work. The ethnographic component of the study was of significant importance being given to students learning histories and to the collection of students’ reflections. This component aimed in particular to allow students the opportunity to express their thoughts on the experience they underwent during 20 weeks. From the analysis of the data, a significant improvement in self-confidence and motivation for lifelong learning is observable in the development of multiple tasks. Regarding the students’ progression towards proficiency, this improvement is less clear, but the final results of educational success were generally of great relevance.

Dynamic cloud service selection using an adaptive learning mechanism in multi-cloud computing

Cloud service selection in a multi-cloud computing environment is receiving more and more attentions. There is an abundance of emerging cloud service resources that makes it hard for users to select the better services for their applications in a changing multi-cloud environment, especially for online real time applications. To assist users to efficiently select their preferred cloud services, a cloud service selection model adopting the cloud service brokers is given, and based on this model, a dynamic cloud service selection strategy named DCS is put forward. In the process of selecting services, each cloud service broker manages some clustered cloud services, and performs the DCS strategy whose core is an adaptive learning mechanism that comprises the incentive, forgetting and degenerate functions. The mechanism is devised to dynamically optimize the cloud service selection and to return the best service result to the user. Correspondingly, a set of dynamic cloud service selection algorithms are presented in this paper to implement our mechanism. The results of the simulation experiments show that our strategy has better overall performance and efficiency in acquiring high quality service solutions at a lower computing cost than existing relevant approaches.

The role of learning-related dopamine signals in addiction vulnerability

Dopaminergic signals play a mathematically precise role in reward-related learning, and variations in dopaminergic signaling have been implicated in vulnerability to addiction. Here, we provide a detailed overview of the relationship between theoretical, mathematical, and experimental accounts of phasic dopamine signaling, with implications for the role of learning-related dopamine signaling in addiction and related disorders. We describe the theoretical and behavioral characteristics of model-free learning based on errors in the prediction of reward, including step-by-step explanations of the underlying equations. We then use recent insights from an animal model that highlights individual variation in learning during a Pavlovian conditioning paradigm to describe overlapping aspects of incentive salience attribution and model-free learning. We argue that this provides a computationally coherent account of some features of addiction.

Response-reinforcement learning is dependent on N-methyl-d-aspartate receptor activation in the nucleus accumbens core

The nucleus accumbens, a site within the ventral striatum, is best known for its prominent role in mediating the reinforcing effects of drugs of abuse such as cocaine, alcohol, and nicotine. Indeed, it is generally believed that this structure subserves motivated behaviors, such as feeding, drinking, sexual behavior, and exploratory locomotion, which are elicited by natural rewards or incentive stimuli. A basic rule of positive reinforcement is that motor responses will increase in magnitude and vigor if followed by a rewarding event. It is likely, therefore, that the nucleus accumbens may serve as a substrate for reinforcement learning. However, there is surprisingly little information concerning the neural mechanisms by which appetitive responses are learned. In the present study, we report that treatment of the nucleus accumbens core with the selective competitive N-methyl-d-aspartate (NMDA) antagonist 2-amino-5-phosphonopentanoic acid (AP-5; 5 nmol/0.5 μl bilaterally) impairs response-reinforcement learning in the acquisition of a simple lever-press task to obtain food. Once the rats learned the task, AP-5 had no effect, demonstrating the requirement of NMDA receptor-dependent plasticity in the early stages of learning. Infusion of AP-5 into the accumbens shell produced a much smaller impairment of learning. Additional experiments showed that AP-5 core-treated rats had normal feeding and locomotor responses and were capable of acquiring stimulus-reward associations. We hypothesize that stimulation of NMDA receptors within the accumbens core is a key process through which motor responses become established in response to reinforcing stimuli. Further, this mechanism, may also play a critical role in the motivational and addictive properties of drugs of abuse.

Organisational learning, climate change and the tragedy of the commons in China

This paper ends with a brief discussion of climate change and suggests that a practical solution would be to transfer much of the current air, sea and long-haul trucking of intercontinental freight between China and Europe (and the USA) to maglev systems. First we review the potential of Asian knowledge management and organisational learning and contrast this against Western precepts finding that there seems to be little incentive to 'look after one's fellows' in China (and perhaps across Asia) outside of tight personal guanxi networks. This is likely to be the case in the intense production regions of China where little time is allowed for 'organisational learning' by the staff and there is little incentive to initiate 'knowledge management' by senior managers. Thus the 'tragedy of the commons' will be enacted by individuals, township, and provincial leaders upwards to top ministers - no one will care for the climate or pollution, only for their own group and their wealth creation prospects. Copyright © 2011 Inderscience Enterprises Ltd.