Rats Acquire Stronger Preference for Flavors Consumed Towards the End of a High-fat Meal

Rats learn to prefer flavors associated with postingestive effects of nutrients. The physiological signals underlying this postingestive reward are unknown. We have previously shown that rats readily learn to prefer a flavor that was consumed early in a multi-flavored meal when glucose is infused intragastrically (IG), suggesting rapid postingestive reward onset. The present experiments investigate the timing of postingestive fat reward, by providing distinctive flavors in the first and second halves of meals accompanied by IG fat infusion. Learning stronger preference for the earlier or later flavor would indicate when the rewarding postingestive effects are sensed. Rats consumed sweetened, calorically-dilute flavored solutions accompanied by IG high-fat infusion (+ sessions) or water (- sessions). Each session included an "Early" flavor for 8min followed by a "Late" flavor for 8min. Learned preferences were then assessed in two-bottle tests (no IG infusion) between Early(+) vs. Early(-), Late(+) vs. Late(-), Early(+) vs. Late(+), and Early(-) vs. Late(-). Rats only preferred Late(+), not Early(+), relative to their respective (-) flavors. In a second experiment rats trained with a higher fat concentration learned to prefer Early(+) but more strongly preferred Late(+). Learned preferences were evident when rats were tested deprived or recently satiated. Unlike with glucose, ingested fat appears to produce a slower-onset rewarding signal, detected later in a meal or after its termination, becoming more strongly associated with flavors towards the end of the meal. This potentially contributes to enhanced liking for dessert foods, which persists even when satiated.

IMPULSE CONTROL AND COOPERATION IN CAPUCHIN MONKEYS (Cebus apella)

The benefits animals derive from living in social groups have produced the evolution of many forms of cooperative behavior. To cooperate, two or more individuals coordinate their actions to accomplish a common goal. One cognitive process that has the potential to influence cooperation is self control. Individuals delaying their impulsive choice for an immediate reward may potentially receive a larger reward later by cooperating with others. In this study, I measured whether brown capuchin monkeys (Cebus apella) were capable of impulse control and whether impulse control was related to cooperation. Impulse control and cooperation were measured using a lazy susan-like apparatus, on which animals could turn a wheel to receive food rewards. The capuchins went through two training phases that taught them how to turn the wheel efficiently to obtain rewards and how to turn the wheel to obtain the larger of two rewards. After training, I tested impulse control by giving the capuchins a choice between a smaller and a larger reward placed at shorter or more distant locations on the wheel. The capuchins demonstrated impulse control in that they tended to inhibit the impulse to select the smaller reward when it was closer and easier to reach and instead selected the larger reward when it was farther away. Cooperation was tested in all possible dyads of seven individuals, a total of 21 dyads, by allowing each dyad 10 trials to work together with effort on the lazy-susan so that each would obtain a reward. Seventeen out of 21 dyads cooperated by simultaneously moving the wheel in the same direction. The correlation between how often a particular dyad cooperated and their average impulse control score was not statistically significant, r(21) = -.125, p = .591. Capuchins demonstrated impulse control and cooperation using this novel apparatus but the two abilities were not related. Other factors such as the unique social relationship between two individuals may play a more prominent role in the motivation to cooperate rather than the cognitive capacity to inhibit behavior.

Electroencephalographic topography measures of experienced utility

Economic theory distinguishes two concepts of utility: decision utility, objectively quantifiable by choices, and experienced utility, referring to the satisfaction by an obtainment. To date, experienced utility is typically measured with subjective ratings. This study intended to quantify experienced utility by global levels of neuronal activity. Neuronal activity was measured by means of electroencephalographic (EEG) responses to gain and omission of graded monetary rewards at the level of the EEG topography in human subjects. A novel analysis approach allowed approximating psychophysiological value functions for the experienced utility of monetary rewards. In addition, we identified the time windows of the event-related potentials (ERP) and the respective intracortical sources, in which variations in neuronal activity were significantly related to the value or valence of outcomes. Results indicate that value functions of experienced utility and regret disproportionally increase with monetary value, and thus contradict the compressing value functions of decision utility. The temporal pattern of outcome evaluation suggests an initial (∼250 ms) coarse evaluation regarding the valence, concurrent with a finer-grained evaluation of the value of gained rewards, whereas the evaluation of the value of omitted rewards emerges later. We hypothesize that this temporal double dissociation is explained by reward prediction errors. Finally, a late, yet unreported, reward-sensitive ERP topography (∼500 ms) was identified. The sources of these topographical covariations are estimated in the ventromedial prefrontal cortex, the medial frontal gyrus, the anterior and posterior cingulate cortex and the hippocampus/amygdala. The results provide important new evidence regarding “how,” “when,” and “where” the brain evaluates outcomes with different hedonic impact.

Neural correlates of sleepiness induced by catecholamine depletion

Although extensive indirect evidence exists to suggest that the central dopaminergic system plays a significant role in the modulation of arousal, the functional effect of the dopaminergic influence on the regulation of the sleep-wake cycle remains unclear. Thirteen healthy volunteers and 15 unmedicated subjects with a history of major depressive disorder underwent catecholamine depletion (CD) using oral alpha-methyl-para-tyrosine in a randomized, placebo-controlled, double-blind, crossover study. The main outcome measures in both sessions were sleepiness (Stanford-Sleepiness-Scale), cerebral glucose metabolism (positron emission tomography), and serum prolactin concentration. CD consistently induced clinically relevant sleepiness in both groups. The CD-induced prolactin increase significantly correlated with CD-induced sleepiness but not with CD-induced mood and anxiety symptoms. CD-induced sleepiness correlated with CD-induced increases in metabolism in the medial and orbital frontal cortex, bilateral superior temporal cortex, left insula, cingulate motor area and in the vicinity of the periaqueductal gray. This study suggests that the association between dopamine depletion and sleepiness is independent of the brain reward system and the risk for depression. The visceromotor system, the cingulate motor area, the periaqueductal gray and the caudal hypothalamus may mediate the impact of the dopaminergic system on regulation of wakefulness and sleep.

Spike-based decision learning of nash equilibria in two-player games

Humans and animals face decision tasks in an uncertain multi-agent environment where an agent's strategy may change in time due to the co-adaptation of others strategies. The neuronal substrate and the computational algorithms underlying such adaptive decision making, however, is largely unknown. We propose a population coding model of spiking neurons with a policy gradient procedure that successfully acquires optimal strategies for classical game-theoretical tasks. The suggested population reinforcement learning reproduces data from human behavioral experiments for the blackjack and the inspector game. It performs optimally according to a pure (deterministic) and mixed (stochastic) Nash equilibrium, respectively. In contrast, temporal-difference(TD)-learning, covariance-learning, and basic reinforcement learning fail to perform optimally for the stochastic strategy. Spike-based population reinforcement learning, shown to follow the stochastic reward gradient, is therefore a viable candidate to explain automated decision learning of a Nash equilibrium in two-player games.

Gradient estimation in dendritic reinforcement learning

We study synaptic plasticity in a complex neuronal cell model where NMDA-spikes can arise in certain dendritic zones. In the context of reinforcement learning, two kinds of plasticity rules are derived, zone reinforcement (ZR) and cell reinforcement (CR), which both optimize the expected reward by stochastic gradient ascent. For ZR, the synaptic plasticity response to the external reward signal is modulated exclusively by quantities which are local to the NMDA-spike initiation zone in which the synapse is situated. CR, in addition, uses nonlocal feedback from the soma of the cell, provided by mechanisms such as the backpropagating action potential. Simulation results show that, compared to ZR, the use of nonlocal feedback in CR can drastically enhance learning performance. We suggest that the availability of nonlocal feedback for learning is a key advantage of complex neurons over networks of simple point neurons, which have previously been found to be largely equivalent with regard to computational capability.

Use Of Conspecific Gestural Cues To Solve An Object-Choice Task In Tufted Capuchin Monkeys (Cebus Apella)

Capuchin monkeys, Cebus sp., utilize a wide array of gestural displays in the wild, including facial displays such as lip-smacking and bare-teeth displays. In captivity, they have been shown to respond to the head orientation of humans, show sensitivity to human attentional states, as well as follow human gazes behind barriers. In this study, I investigated whether tufted capuchin monkeys (Cebus apella) would attend to and utilize the gestural cues of a conspecific to obtain a hidden reward. Two capuchins faced each other in separate compartments of an apparatus with an open field in between. The open field contained two cups with holes on one side such that only one monkey, a so-called cuing monkey, could see the reward inside one of the cups. I then moved the cups toward the other signal-receiving monkey and assessed whether it would utilize untrained cues provided by the cuing monkey to select the cup containing the reward. Two of four female capuchin monkeys learned to select the cup containing the reward significantly more often than chance. Neither of these two monkeys performed over chance spontaneously, however, and the other two monkeys never performed above chance despite many blocks of trials. Successful choices by two monkeys to obtain hidden rewards provided experimental evidence that capuchin monkeys attend to and utilize the gestural cues of conspecifics.

The Expression Of Motor Planning In Squirrel Monkeys (Saimiri sciureus) And Brown Capuchins (Cebus apella)

Multiple recent studies provide evidence that both human and nonhuman primates possess motor planning abilities. I tested for the demonstration of motor planning in two previously untested primate species through two experiments. In the first experiment, I compared the extent to which squirrel monkeys (Saimiri sciureus) and brown capuchins (Cebus apella) plan their movements in a grasping task. Individuals were presented with an inverted cup that required being turned and held upright in order to extract a food reward from the inside of the cup. This task was most efficiently solved by using an initially awkward inverted grasp that affords a comfortable hand and arm orientation at the end of the movement (known as end-state comfort). While certain individuals from both species exhibited end-state comfort, many of the capuchins never demonstrated this type of motor planning. Furthermore, the squirrel monkeys used the efficient grasp significantly more than the capuchins. In the second experiment, I presented the capuchins with another grasping task to test if they would express motor planning abilities in a different context. Here, the capuchins were offered a dowel that was baited on either the left or right end. A radial grasp with the thumb pointing towards the baited end was considered to be the most efficient grasp because it afforded a comfortable final position. The capuchins switched hands and used an overhand radial grasp on the dowel significantly more often than not, thus demonstrating motor planning in this task. The grasps typically utilized by these two closely related species differ considerably in that capuchins are capable of exercising precision grips, whereas squirrel monkeys are limited to whole-handed power grips. Moreover, unlike capuchins, squirrel monkeys are not particularly dexterous nor are they capable of precise manipulative actions. It is therefore more beneficial for squirrel monkeys to plan their movements efficiently because they are less capable of compensating for inappropriate initial grasps. Due to the appreciable variability in the expression of motor planning skills across species, I proposed that morphological constraints might explain the observed discrepancies in movement planning among different primate species.

Brown Capuchins (Cebus apella) Exhibit Self-Control on a Delay of Gratification Food Exchange Task When Food Options Differ Qualitatively

Self-control allows an individual to obtain a more preferred outcome by forgoing an immediate interest. Self-control is an advanced cognitive process because it involves the ability to weigh the costs and benefits of impulsive versus restrained behavior, determine the consequences of such behavior, and make decisions based on the most advantageous course of action. Self-control has been thoroughly explored in Old World primates, but less so in New World monkeys. There are many ways to test self-control abilities in non-human primates, including exchange tasks in which an animal must forgo an immediate, less preferred reward to receive a delayed, more preferred reward. I examined the self-control abilities of six capuchin monkeys using a task in which a monkey was given a less preferred food and was required to wait a delay interval to trade the fully intact less preferred food for a qualitatively higher, more preferred food. Partially eaten pieces of the less preferred food were not rewarded, and delay intervals increased on an individual basis based on performance. All six monkeys were successful in inhibiting impulsivity and trading a less preferred food for a more preferred food at the end of a delay interval. The maximum duration each subject postponed gratification instead of responding impulsively was considered their delay tolerance. This study was the first to show that monkeys could inhibit impulsivity in a delay of gratification food exchange task in which the immediate and delayed food options differed qualitatively and a partially eaten less preferred food was not rewarded with the more preferred food at the end of a delay interval. These results show that New World monkeys possess advanced cognitive abilities similar to those of Old World primates.

The Use of Human and Conspecific Gestures By Capuchin Monkeys to Solve an Object-Choice Task

Most primates live in highly complex social systems, and therefore have evolved similarly complex methods of communicating with each other. One type of communication is the use of manual gestures, which are only found in primates. No substantial evidence exists indicating that monkeys use communicative gestures in the wild. However, monkeys may demonstrate the ability to learn and/or use gestures in certain experimental paradigms since they¿ve been shown to use other visual cues such as gaze. The purpose of this study was to investigate if ten brown capuchin monkeys (Cebus apella) were able to use gestural cues from monkeys and a pointing cue from a human to obtain a hidden reward. They were then tested to determine if they could transfer this skill from monkeys to humans and from humans to monkeys. One group of monkeys was trained and tested using a conspecific as the cue giver, and was then tested with a human cue-giver. The second group of monkeys began training and testing with a human cue giver, and was then tested with a monkey cue giver. I found that two monkeys were able to use gestural cues from conspecifics (e.g., reaching) to obtain a hidden reward and then transfer this ability to a pointing cue from a human. Four monkeys learned to use the human pointing cue first, and then transferred this ability to use the gestural cues from conspecifics to obtain a hidden reward. However, the number of trials it took for each monkey to transfer the ability varied considerably. Some subjects spontaneously transferred in the minimum number of trials needed to reach my criteria for successfully obtaining hidden rewards (N = 40 trials), while others needed a large number of trials to do so (e.g. N = 190 trials). Two subjects did not perform successfully in any of the conditions in which they were tested. One subject successfully used the human pointing cue and a human pointing plus vocalization cue, but did not learn the conspecific cue. One subject learned to use the conspecific cue but not the human pointing cue. This was the first study to test if brown capuchin monkeys could use gestural cues from conspecifics to solve an object choice task. The study was also the first to test if capuchins could transfer this skill from monkeys to humans and from humans to monkeys. Results showed that capuchin monkeys were able to flexibly use communicative gestures when they were both unintentionally given by a conspecific and intentionally given by a human to indicate a source of food.

Capuchin Monkeys (Cebus apella) Fail to Be Equitable in an Ultimatum Game

The ultimatum game is a commonly used economics game testing humans' sense of fairness. In the game, a "proposer" is given a sum of money and is told they can split it however they want with another human partner. The partner can then either accept the division and both proposer and responder receive the proposed amounts, or the responder can reject the offer and neither player will get anything. Human subjects from most western cultures typically share almost half of an allotted amount, but it remains unknown whether our close primate relatives share this generosity. Recent attempts to present chimpanzees with the ultimatum game have provided inconclusive results, with some studies finding the animals share humans' disposition to behave 'fairly' and others concluding that chimpanzees act selfishly to maximize their own rewards. Capuchin monkeys are known to share many human and chimpanzee social and cooperative behaviors, and this study was the first to present capuchin monkeys with a version of the ultimatum game. Subjects were presented with two differently colored tokens representing different qualitative reward contingencies, one equitable and the other inequitable in favor of the subject proposer. Subjects could select and place one of the tokens in a transfer container. The capuchins were first tested with a "dictator game" where, after the subject monkey selected a token, the rewards (equitable or inequitable) were distributed to the subject and a nearby partner monkey that was not an active participant. The capuchins were then tested on an ultimatum game in which after the subject selected and placed a token in the container, the container was moved to the partner. The partner needed to remove the token and transfer it back to the experimenter for the rewards to be distributed. As such, the partner could reject the subject's offer by refusing to participate and neither would receive a reward. The experiment was conducted to determine if the subject monkey would select the equitable reward option rather than the selfish option in order to maintain the partner's cooperation in the task. Capuchin subjects behaved selfishly and selected the inequitable token significantly more often than the equitable token in both the dictator and ultimatum game with no significant difference in preference between the two games. Interestingly, despite the occasional occurrence of rejection by the partner monkeys (resulting in no reward for the subject), subjects never altered their strategy, continuing to prefer the selfish token. The study may indicate that capuchin monkeys have an inability to judge the effect of their behavior on a conspecific's reward outcome, or an indifference to the outcome if there is an individual cost associated with behaving prosocially.

Investigation of Rudimentary Meta-Cognition in Lion-Tailed Macaques and Tufted Capuchins

Meta-cognition, or "thinking about thinking," has been studied extensively in humans, but very little is known about the process in animals. Although great apes and rhesus macaques (Macaca mulatta) have demonstrated multiple apparently meta-cognitive abilities, other species have either been largely ignored or failed to convincingly display meta-cognitive traits. Recent work by Marsh, however, raised the possibility that some species may possess rudimentary or partial forms of meta-cognition. This thesis sought to further investigate this possibility by running multiple comparative experiments. The goal of the first study was to examine whether lion-tailed macaques, a species that may have a rudimentary form of meta-cognition, are able to use an uncertainty response adaptively, and if so, whether they could use the response flexibly when the stimuli for which the subjects should be uncertain changed. The macaques' acquisition of the initial discrimination task is ongoing, and as such there were not yet data to support a conclusion either way. In the second study, tufted capuchins were required to locate a food reward hidden beneath inverted cups that sat on a Plexiglas tray. In some conditions the capuchins were shown where the food was hidden, in others they could infer its location, and in yet others they were not given information about the location of the food. On all trials, however, capuchins could optionally seek additional information by looking up through the Plexiglas into the cups. In general, capuchins did this less often when they were shown the food reward, but not when they could infer the reward's location. These data suggest capuchins only meta-cognitively control their information seeking in some conditions, and thus, add support to the potential for a rudimentary form of meta-cognition. In convergence with other studies, these results may represent early models for rudimentary meta-cognition, although viable alternative explanations still remain.

Brain activation during craving for alcohol measured by positron emission tomography

OBJECTIVE: Craving for alcohol is probably involved in acquisition and maintenance of alcohol dependence to a substantial degree. However, the brain substrates and mechanisms that underlie alcohol craving await more detailed elucidation. METHOD: Positron emission tomography was used to map regional cerebral blood flow (CBF) in 21 detoxified patients with alcohol dependence during exposure to alcoholic and non-alcoholic beverages. RESULTS: During the alcohol condition compared with the control condition, significantly increased CBF was found in the ventral putamen. Additionally, activated areas included insula, dorsolateral prefrontal cortex and cerebellum. Cerebral blood flow increase in these regions was related to self-reports of craving assessed in the alcoholic patients. CONCLUSIONS: In this investigation, cue-induced alcohol craving was associated with activation of brain regions particularly involved in brain reward mechanisms, memory and attentional processes. These results are consistent with studies on craving for other addictive substances and may offer strategies for more elaborate studies on the neurobiology of addiction.

UNDERSTANDING PEOPLE'S ADOPTION OF INDIVIDUAL-USE RENEWABLE ENERGY TECHNOLOGY

This thesis attempts to understand why people adopt or reject individual-use renewable energy technologies (IURET). I used factors from Everett Rogers' Diffusion of Innovation Theory to understand how people's perceptions towards the characteristics of a given IURET (such as price, compatibility, complexity, etc.), the characteristics of the individual adopter (such as innovativeness and environmental awareness), and the communication network (inter-personal communications and mass media) can influence adoption. An online questionnaire was sent to 101randomly selected Michigan households (using random digit dialing) to ask people whether or not they had adopted at least one IURET and to assess the above-mentioned factors from Rogers' theory. Data analysis was then conducted in SPSS using Chi-squared and binary logistic regression to determine the relationship between adoption behaviors (the dependent variable) and the factors from Rogers' theory (the independent variables) while controlling for education. The results show that Rogers' factors of price and observability and the control variable of education were all significant in explaining adoption but the other factors of Rogers' theory were not. For example, if individuals perceive the price of IURET to be reasonable or if they observe their neighbors using these technologies, then they are more likely to adopt. These results indicate that, if we want to promote greater adoption of IURET, we should focus our efforts on making the price of IURET more affordable through incentives and other mechanisms. Adopters should also be given some form of reward if they provide free demonstrations of their IURET in use to their neighbors to take advantage of the observability effects.

Learning flexible sensori-motor mappings in a complex network

Given the complex structure of the brain, how can synaptic plasticity explain the learning and forgetting of associations when these are continuously changing? We address this question by studying different reinforcement learning rules in a multilayer network in order to reproduce monkey behavior in a visuomotor association task. Our model can only reproduce the learning performance of the monkey if the synaptic modifications depend on the pre- and postsynaptic activity, and if the intrinsic level of stochasticity is low. This favored learning rule is based on reward modulated Hebbian synaptic plasticity and shows the interesting feature that the learning performance does not substantially degrade when adding layers to the network, even for a complex problem.