Characterization of the neural mechanisms supporting the implementation of cognitive control in human decision making

Humans are particularly adept at modifying their behavior in accordance with changing environmental demands. Through various mechanisms of cognitive control, individuals are able to tailor actions to fit complex short- and long-term goals. The research described in this thesis uses functional magnetic resonance imaging to characterize the neural correlates of cognitive control at two levels of complexity: response inhibition and self-control in intertemporal choice. First, we examined changes in neural response associated with increased experience and skill in response inhibition; successful response inhibition was associated with decreased neural response over time in the right ventrolateral prefrontal cortex, a region widely implicated in cognitive control, providing evidence for increased neural efficiency with learned automaticity. We also examined a more abstract form of cognitive control using intertemporal choice. In two experiments, we identified putative neural substrates for individual differences in temporal discounting, or the tendency to prefer immediate to delayed rewards. Using dynamic causal models, we characterized the neural circuit between ventromedial prefrontal cortex, an area involved in valuation, and dorsolateral prefrontal cortex, a region implicated in self-control in intertemporal and dietary choice, and found that connectivity from dorsolateral prefrontal cortex to ventromedial prefrontal cortex increases at the time of choice, particularly when delayed rewards are chosen. Moreover, estimates of the strength of connectivity predicted out-of-sample individual rates of temporal discounting, suggesting a neurocomputational mechanism for variation in the ability to delay gratification. Next, we interrogated the hypothesis that individual differences in temporal discounting are in part explained by the ability to imagine future reward outcomes. Using a novel paradigm, we imaged neural response during the imagining of primary rewards, and identified negative correlations between activity in regions associated the processing of both real and imagined rewards (lateral orbitofrontal cortex and ventromedial prefrontal cortex, respectively) and the individual temporal discounting parameters estimated in the previous experiment. These data suggest that individuals who are better able to represent reward outcomes neurally are less susceptible to temporal discounting. Together, these findings provide further insight into role of the prefrontal cortex in implementing cognitive control, and propose neurobiological substrates for individual variation.

The Regulation of Sleep and Circadian Rhythms: The Role of Melatonin and Adenosine in Zebrafish

Sleep is a highly conserved behavioral state whose regulation is still unclear. In this thesis I initially briefly introduce the known sleep circuitry and regulation in vertebrates, and why zebrafish is seen as a good model to study sleep-regulation. I describe the existing two-process model of sleep regulation, which posits that the two processes C (circadian) and S (homeostatic) control timing of sleep-wake behavior. I then study the role melatonin plays in the circadian regulation of sleep using zebrafish. Firstly, we find that the absence of melatonin results in a reduction of sleep at night, establishing that endogenous melatonin is required for sleep at night. Secondly, melatonin mutants show a reduction in sleep in animals with no functional behavioral rhythms suggesting that melatonin does not require intact circadian rhythms for its effect on sleep. Thirdly, melatonin mutants do not exhibit any changes in circadian rhythms, suggesting that the circadian clock does not require melatonin for its function. Fourthly, we find that in the absence of melatonin, there is no rhythmic expression of sleep, suggesting that melatonin is the output molecule of process C. Lastly, we describe a connection between adenosine signaling (output molecules of process S), and melatonin. Following this we proceed to study the role adenosine signaling plays in sleep-wake behavior. We find that firstly, adenosine receptor A1 and A2 are involved in sleep- wake behavior in zebrafish, based on agonist/antagonist behavioral results. Secondly, we find that several brain regions such as PACAP cells in the rostral midbrain, GABAergic cells in the forebrain and hindbrain, Dopamine and serotonin cells in the caudal hypothalamus and sox2 cells lining the hindbrain ventricle are activated in response to the A1 antagonist and VMAT positive cells are activated in response to the A2A agonist, suggesting these areas are involved in adenosine signaling in zebrafish. Thirdly, we find that knocking out the zebrafish adenosine receptors has no effect on sleep architecture. Lastly, we find that while the A1 agonist phenotype requires the zfAdora1a receptor, the antagonist and the A2A agonist behavioral phenotypes are not mediated by the zfAdora1a, zfAdora1b and zfAdoraA2Aa, zfAdora2Ab receptors respectively.