Multitask learning with expert advice

We consider the problem of prediction with expert advice in the setting where a forecaster is presented with several online prediction tasks. Instead of competing against the best expert separately on each task, we assume the tasks are related, and thus we expect that a few experts will perform well on the entire set of tasks. That is, our forecaster would like, on each task, to compete against the best expert chosen from a small set of experts. While we describe the "ideal" algorithm and its performance bound, we show that the computation required for this algorithm is as hard as computation of a matrix permanent. We present an efficient algorithm based on mixing priors, and prove a bound that is nearly as good for the sequential task presentation case. We also consider a harder case where the task may change arbitrarily from round to round, and we develop an efficient approximate randomized algorithm based on Markov chain Monte Carlo techniques.

Learning the Kernel Matrix with Semi-Definite Programming

Kernel-based learning algorithms work by embedding the data into a Euclidean space, and then searching for linear relations among the embedded data points. The embedding is performed implicitly, by specifying the inner products between each pair of points in the embedding space. This information is contained in the so-called kernel matrix, a symmetric and positive definite matrix that encodes the relative positions of all points. Specifying this matrix amounts to specifying the geometry of the embedding space and inducing a notion of similarity in the input space -- classical model selection problems in machine learning. In this paper we show how the kernel matrix can be learned from data via semi-definite programming (SDP) techniques. When applied to a kernel matrix associated with both training and test data this gives a powerful transductive algorithm -- using the labelled part of the data one can learn an embedding also for the unlabelled part. The similarity between test points is inferred from training points and their labels. Importantly, these learning problems are convex, so we obtain a method for learning both the model class and the function without local minima. Furthermore, this approach leads directly to a convex method to learn the 2-norm soft margin parameter in support vector machines, solving another important open problem. Finally, the novel approach presented in the paper is supported by positive empirical results.

The neurokinin 1 receptor antagonist, ezlopitant, reduces appetitive responding for sucrose and ethanol

Abstract Background: The current obesity epidemic is thought to be partly driven by over-consumption of sugar-sweetened diets and soft drinks. Loss-of-control over eating and addiction to drugs of abuse share overlapping brain mechanisms including changes in motivational drive, such that stimuli that are often no longer ‘liked’ are still intensely ‘wanted’ [7,8]. The neurokinin 1 (NK1) receptor system has been implicated in both learned appetitive behaviors and addiction to alcohol and opioids; however, its role in natural reward seeking remains unknown. Methodology/Principal Findings: We sought to determine whether the NK1-receptor system plays a role in the reinforcing properties of sucrose using a novel selective and clinically safe NK1-receptor antagonist, ezlopitant (CJ-11,974), in three animal models of sucrose consumption and seeking. Furthermore, we compared the effect of ezlopitant on ethanol consumption and seeking in rodents. The NK1-receptor antagonist, ezlopitant decreased appetitive responding for sucrose more potently than for ethanol using an operant self-administration protocol without affecting general locomotor activity. To further evaluate the selectivity of the NK1-receptor antagonist in decreasing consumption of sweetened solutions, we compared the effects of ezlopitant on water, saccharin-, and sodium chloride (NaCl) solution consumption. Ezlopitant decreased intake of saccharin but had no effect on water or salty solution consumption. Conclusions/Significance: The present study indicates that the NK1-receptor may be a part of a common pathway regulating the self-administration, motivational and reinforcing aspects of sweetened solutions, regardless of caloric value, and those of substances of abuse. Additionally, these results indicate that the NK1-receptor system may serve as a therapeutic target for obesity induced by over-consumption of natural reinforcers.

Neuronal nicotinic acetylcholine receptors as pharmacotherapeutic targets for the treatment of alcohol use disorders

Alcohol use disorders (AUDs) are complex and developing effective treatments will require the combination of novel medications and cognitive behavioral therapy approaches. Epidemiological studies have shown there is a high correlation between alcohol consumption and tobacco use, and the prevalence of smoking in alcoholics is as high as 80% compared to about 30% for the general population. Both preclinical and clinical data provide evidence that nicotine administration increases alcohol intake and nonspecific nicotinic receptor antagonists reduce alcohol-mediated behaviors. As nicotine interacts specifically with the neuronal nicotinic acetylcholine receptor (nAChR) system, this suggests that nAChRs play an important role in the behavioral effects of alcohol. In this review, we discuss the importance of nAChRs for the treatment of AUDs and argue that the use of FDA approved nAChR ligands, such as varenicline and mecamylamine, approved as smoking cessation aids may prove to be valuable treatments for AUDs. We also address the importance of combining effective medications with behavioral therapy for the treatment of alcohol dependent individuals.

Chlorzoxazone, an SK-type potassium channel activator used in humans, reduces excessive alcohol intake in rats

Background Alcoholism imposes a tremendous social and economic burden. There are relatively few pharmacological treatments for alcoholism, with only moderate efficacy, and there is considerable interest in identifying additional therapeutic options. Alcohol exposure alters SK-type potassium channel (SK) function in limbic brain regions. Thus, positive SK modulators such as chlorzoxazone (CZX), a US Food and Drug Administration–approved centrally acting myorelaxant, might enhance SK function and decrease neuronal activity, resulting in reduced alcohol intake. Methods We examined whether CZX reduced alcohol consumption under two-bottle choice (20% alcohol and water) in rats with intermittent access to alcohol (IAA) or continuous access to alcohol (CAA). In addition, we used ex vivo electrophysiology to determine whether SK inhibition and activation can alter firing of nucleus accumbens (NAcb) core medium spiny neurons. Results Chlorzoxazone significantly and dose-dependently decreased alcohol but not water intake in IAA rats, with no effects in CAA rats. Chlorzoxazone also reduced alcohol preference in IAA but not CAA rats and reduced the tendency for rapid initial alcohol consumption in IAA rats. Chlorzoxazone reduction of IAA drinking was not explained by locomotor effects. Finally, NAcb core neurons ex vivo showed enhanced firing, reduced SK regulation of firing, and greater CZX inhibition of firing in IAA versus CAA rats. Conclusions The potent CZX-induced reduction of excessive IAA alcohol intake, with no effect on the more moderate intake in CAA rats, might reflect the greater CZX reduction in IAA NAcb core firing observed ex vivo. Thus, CZX could represent a novel and immediately accessible pharmacotherapeutic intervention for human alcoholism. Key Words: Alcohol intake; intermittent; neuro-adaptation; nucleus accumbens; SK potassium channel

Intermittent access to 20% ethanol induces high ethanol consumption in Long-Evans and Wistar rats

BACKGROUND: There has been some difficulty getting standard laboratory rats to voluntarily consume large amounts of ethanol without the use of initiation procedures. It has previously been shown that standard laboratory rats will voluntarily consume high levels of ethanol if given intermittent-access to 20% ethanol in a 2-bottle-choice setting [Wise, Psychopharmacologia 29 (1973), 203]. In this study, we have further characterized this drinking model. METHODS: Ethanol-naïve Long-Evans rats were given intermittent-access to 20% ethanol (three 24-hour sessions per week). No sucrose fading was needed and water was always available ad libitum. Ethanol consumption, preference, and long-term drinking behaviors were investigated. Furthermore, to pharmacologically validate the intermittent-access 20% ethanol drinking paradigm, the efficacy of acamprosate and naltrexone in decreasing ethanol consumption were compared with those of groups given continuous-access to 10 or 20% ethanol, respectively. Additionally, ethanol consumption was investigated in Wistar and out-bred alcohol preferring (P) rats following intermittent-access to 20% ethanol. RESULTS: The intermittent-access 20% ethanol 2-bottle-choice drinking paradigm led standard laboratory rats to escalate their ethanol intake over the first 5 to 6 drinking sessions, reaching stable baseline consumption of high amounts of ethanol (Long-Evans: 5.1 +/- 0.6; Wistar: 5.8 +/- 0.8 g/kg/24 h, respectively). Furthermore, the cycles of excessive drinking and abstinence led to an increase in ethanol preference and increased efficacy of both acamprosate and naltrexone in Long-Evans rats. P-rats initiate drinking at a higher level than both Long-Evans and Wistar rats using the intermittent-access 20% ethanol paradigm and showed a trend toward a further escalation in ethanol intake over time (mean ethanol intake: 6.3 +/- 0.8 g/kg/24 h). CONCLUSION: Standard laboratory rats will voluntarily consume ethanol using the intermittent-access 20% ethanol drinking paradigm without the use of any initiation procedures. This model promises to be a valuable tool in the alcohol research field.

Morphine-induced receptor endocytosis in a novel knockin mouse reduces tolerance and dependence

Abstract Opioid drugs, such as morphine, are among the most effective analgesics available. However, their utility for the treatment of chronic pain is limited by side effects including tolerance and dependence. Morphine acts primarily through the mu-opioid receptor (MOP-R) , which is also a target of endogenous opioids. However, unlike endogenous ligands, morphine fails to promote substantial receptor endocytosis both in vitro, and in vivo. Receptor endocytosis serves at least two important functions in signal transduction. First, desensitization and endocytosis act as an "off" switch by uncoupling receptors from G protein. Second, endocytosis functions as an "on" switch, resensitizing receptors by recycling them to the plasma membrane. Thus, both the off and on function of the MOP-R are altered in response to morphine compared to endogenous ligands. To examine whether the low degree of endocytosis induced by morphine contributes to tolerance and dependence, we generated a knockin mouse that expresses a mutant MOP-R that undergoes morphine-induced endocytosis. Morphine remains an excellent antinociceptive agent in these mice. Importantly, these mice display substantially reduced antinociceptive tolerance and physical dependence. These data suggest that opioid drugs with a pharmacological profile similar to morphine but the ability to promote endocytosis could provide analgesia while having a reduced liability for promoting tolerance and dependence

Partial agonists of the [alpha]3[beta]4[ast] neuronal nicotinic acetylcholine receptor reduce ethanol consumption and seeking in rats

Alcohol use disorders (AUDs) impact millions of individuals and there remain few effective treatment strategies. Despite evidence that neuronal nicotinic acetylcholine receptors (nAChRs) have a role in AUDs, it has not been established which subtypes of the nAChR are involved. Recent human genetic association studies have implicated the gene cluster CHRNA3-CHRNA5-CHRNB4 encoding the α3, α5, and β4 subunits of the nAChR in susceptibility to develop nicotine and alcohol dependence; however, their role in ethanol-mediated behaviors is unknown due to the lack of suitable and selective research tools. To determine the role of the α3, and β4 subunits of the nAChR in ethanol self-administration, we developed and characterized high-affinity partial agonists at α3β4 nAChRs, CP-601932, and PF-4575180. Both CP-601932 and PF-4575180 selectively decrease ethanol but not sucrose consumption and operant self-administration following long-term exposure. We show that the functional potencies of CP-601932 and PF-4575180 at α3β4 nAChRs correlate with their unbound rat brain concentrations, suggesting that the effects on ethanol self-administration are mediated via interaction with α3β4 nAChRs. Also varenicline, an approved smoking cessation aid previously shown to decrease ethanol consumption and seeking in rats and mice, reduces ethanol intake at unbound brain concentrations that allow functional interactions with α3β4 nAChRs. Furthermore, the selective α4β2(*) nAChR antagonist, DHβE, did not reduce ethanol intake. Together, these data provide further support for the human genetic association studies, implicating CHRNA3 and CHRNB4 genes in ethanol-mediated behaviors. CP-601932 has been shown to be safe in humans and may represent a potential novel treatment for AUDs.

Dopamine responsiveness is regulated by targeted sorting of D2 receptors

Abstract Aberrant dopaminergic signaling is a critical determinant in multiple psychiatric disorders, and in many disease states, dopamine receptor number is altered. Here we identify a molecular mechanism that selectively targets D2 receptors for degradation after their activation by dopamine. The degradative fate of D2 receptors is determined by an interaction with G protein coupled receptor-associated sorting protein (GASP). As a consequence of this GASP interaction, D2 responses in rat brain fail to resensitize after agonist treatment. Disruption of the D2-GASP interaction facilitates recovery of D2 responses, suggesting that modulation of the D2-GASP interaction is important for the functional down-regulation of D2 receptors.