Contributions of parietal cortex to reach planning

Sensory-motor circuits course through the parietal cortex of the human and monkey brain. How parietal cortex manipulates these signals has been an important question in behavioral neuroscience. This thesis presents experiments that explore the contributions of monkey parietal cortex to sensory-motor processing, with an emphasis on the area's contributions to reaching. First, it is shown that parietal cortex is organized into subregions devoted to specific movements. Area LIP encodes plans to make saccadic eye movements. A nearby area, the parietal reach region (PRR), plans reaches. A series of experiments are then described which explore the contributions of PRR to reach planning. Reach plans are represented in an eye-centered reference frame in PRR. This representation is shown to be stable across eye movements. When a sequence of reaches is planned, only the impending movement is represented in PRR, showing that the area is more related to movement planning than to storing the memory of reach targets. PRR resembles area LIP in each of these properties: the two areas may provide a substrate for hand-eye coordination. These findings yield new perspectives on the functions of the parietal cortex and on the organization of sensory-motor processing in primate brains.

Neural Prosthetics and Parietal Cortex

In the last decade, research efforts into directly interfacing with the neurons of individuals with motor deficits have increased. The goal of such research is clear: Enable individuals affected by paralysis or amputation to regain control of their environments by manipulating external devices with thought alone. Though the motor cortices are the usual brain areas upon which neural prosthetics depend, research into the parietal lobe and its subregions, primarily in non-human primates, has uncovered alternative areas that could also benefit neural interfaces. Similar to the motor cortical areas, parietal regions can supply information about the trajectories of movements. In addition, the parietal lobe also contains cognitive signals like movement goals and intentions. But, these areas are also known to be tuned to saccadic eye movements, which could interfere with the function of a prosthetic designed to capture motor intentions only. In this thesis, we develop and examine the functionality of a neural prosthetic with a non-human primate model using the superior parietal lobe to examine the effectiveness of such an interface and the effects of unconstrained eye movements in a task that more closely simulates clinical applications. Additionally, we examine methods for improving usability of such interfaces.

The parietal cortex is also believed to contain neural signals relating to monitoring of the state of the limbs through visual and somatosensory feedback. In one of the world’s first clinical neural prosthetics based on the human parietal lobe, we examine the extent to which feedback regarding the state of a movement effector alters parietal neural signals and what the implications are for motor neural prosthetics and how this informs our understanding of this area of the human brain.

Psychobiophysics of transcranial magnetic stimulation

Transcranial magnetic stimulation (TMS) is a technique that stimulates the brain using a magnetic coil placed on the scalp. Since it is applicable to humans non-invasively, directly interfering with neural electrical activity, it is potentially a good tool to study the direct relationship between perceptual experience and neural activity. However, it has been difficult to produce a clear perceptible phenomenon with TMS of sensory areas, especially using a single magnetic pulse. Also, the biophysical mechanisms of magnetic stimulation of single neurons have been poorly understood.

In the psychophysical part of this thesis, perceptual phenomena induced by TMS of the human visual cortex are demonstrated as results of the interactions with visual inputs. We first introduce a method to create a hole, or a scotoma, in a flashed, large-field visual pattern using single-pulse TMS. Spatial aspects of the interactions are explored using the distortion effect of the scotoma depending on the visual pattern, which can be luminance-defined or illusory. Its similarity to the distortion of afterimages is also discussed. Temporal interactions are demonstrated in the filling-in of the scotoma with temporally adjacent visual features, as well as in the effective suppression of transient visual features. Also, paired-pulse TMS is shown to lead to different brightness modulations in transient and sustained visual stimuli.

In the biophysical part, we first develop a biophysical theory to simulate the effect of magnetic stimulation on arbitrary neuronal structure. Computer simulations are performed on cortical neuron models with realistic structure and channels, combined with the current injection that simulates magnetic stimulation. The simulation results account for general and basic characteristics of the macroscopic effects of TMS including our psychophysical findings, such as a long inhibitory effect, dependence on the background activity, and dependence on the direction of the induced electric field.

The perceptual effects and the cortical neuron model presented here provide foundations for the study of the relationship between perception and neural activity. Further insights would be obtained from extension of our model to neuronal networks and psychophysical studies based on predictions of the biophysical model.

Responses to auditory stimuli in macaque lateral intraparietal area

The lateral intraparietal area (LIP) of macaque posterior parietal cortex participates in the sensorimotor transformations underlying visually guided eye movements. Area LIP has long been considered unresponsive to auditory stimulation. However, recent studies have shown that neurons in LIP respond to auditory stimuli during an auditory-saccade task, suggesting possible involvement of this area in auditory-to-oculomotor as well as visual-to-oculomotor processing. This dissertation describes investigations which clarify the role of area LIP in auditory-to-oculomotor processing.

Extracellular recordings were obtained from a total of 332 LIP neurons in two macaque monkeys, while the animals performed fixation and saccade tasks involving auditory and visual stimuli. No auditory activity was observed in area LIP before animals were trained to make saccades to auditory stimuli, but responses to auditory stimuli did emerge after auditory-saccade training. Auditory responses in area LIP after auditory-saccade training were significantly stronger in the context of an auditory-saccade task than in the context of a fixation task. Compared to visual responses, auditory responses were also significantly more predictive of movement-related activity in the saccade task. Moreover, while visual responses often had a fast transient component, responses to auditory stimuli in area LIP tended to be gradual in onset and relatively prolonged in duration.

Overall, the analyses demonstrate that responses to auditory stimuli in area LIP are dependent on auditory-saccade training, modulated by behavioral context, and characterized by slow-onset, sustained response profiles. These findings suggest that responses to auditory stimuli are best interpreted as supramodal (cognitive or motor) responses, rather than as modality-specific sensory responses. Auditory responses in area LIP seem to reflect the significance of auditory stimuli as potential targets for eye movements, and may differ from most visual responses in the extent to which they arc abstracted from the sensory parameters of the stimulus.

Analysis of temporal structure in spike trains of visual cortical area MT

The temporal structure of neuronal spike trains in the visual cortex can provide detailed information about the stimulus and about the neuronal implementation of visual processing. Spike trains recorded from the macaque motion area MT in previous studies (Newsome et al., 1989a; Britten et al., 1992; Zohary et al., 1994) are analyzed here in the context of the dynamic random dot stimulus which was used to evoke them. If the stimulus is incoherent, the spike trains can be highly modulated and precisely locked in time to the stimulus. In contrast, the coherent motion stimulus creates little or no temporal modulation and allows us to study patterns in the spike train that may be intrinsic to the cortical circuitry in area MT. Long gaps in the spike train evoked by the preferred direction motion stimulus are found, and they appear to be symmetrical to bursts in the response to the anti-preferred direction of motion. A novel cross-correlation technique is used to establish that the gaps are correlated between pairs of neurons. Temporal modulation is also found in psychophysical experiments using a modified stimulus. A model is made that can account for the temporal modulation in terms of the computational theory of biological image motion processing. A frequency domain analysis of the stimulus reveals that it contains a repeated power spectrum that may account for psychophysical and electrophysiological observations.

Some neurons tend to fire bursts of action potentials while others avoid burst firing. Using numerical and analytical models of spike trains as Poisson processes with the addition of refractory periods and bursting, we are able to account for peaks in the power spectrum near 40 Hz without assuming the existence of an underlying oscillatory signal. A preliminary examination of the local field potential reveals that stimulus-locked oscillation appears briefly at the beginning of the trial.

Response of multiple simultaneously recorded macaque area LIP neurons in a memory saccade task

Cells in the lateral intraparietal cortex (LIP) of rhesus macaques respond vigorously and in spatially-tuned fashion to briefly memorized visual stimuli. Responses to stimulus presentation, memory maintenance, and task completion are seen, in varying combination from neuron to neuron. To help elucidate this functional segmentation a new system for simultaneous recording from multiple neighboring neurons was developed. The two parts of this dissertation discuss the technical achievements and scientific discoveries, respectively.

Technology. Simultanous recordings from multiple neighboring neurons were made with four-wire bundle electrodes, or tetrodes, which were adapted to the awake behaving primate preparation. Signals from these electrodes were partitionable into a background process with a 1/f-like spectrum and foreground spiking activity spanning 300-6000 Hz. Continuous voltage recordings were sorted into spike trains using a state-of-the-art clustering algorithm, producing a mean of 3 cells per site. The algorithm classified 96% of spikes correctly when tetrode recordings were confirmed with simultaneous intracellular signals. Recording locations were verified with a new technique that creates electrolytic lesions visible in magnetic resonance imaging, eliminating the need for histological processing. In anticipation of future multi-tetrode work, the chronic chamber microdrive, a device for long-term tetrode delivery, was developed.

Science. Simultaneously recorded neighboring LIP neurons were found to have similar preferred targets in the memory saccade paradigm, but dissimilar peristimulus time histograms, PSTH). A majority of neighboring cell pairs had a difference in preferred directions of under 45° while the trial time of maximal response showed a broader distribution, suggesting homogeneity of tuning with het erogeneity of function. A continuum of response characteristics was present, rather than a set of specific response types; however, a mapping experiment suggests this may be because a given cell's PSTH changes shape as well as amplitude through the response field. Spike train autocovariance was tuned over target and changed through trial epoch, suggesting different mechanisms during memory versus background periods. Mean frequency-domain spike-to-spike coherence was concentrated below 50 Hz with a significant maximum of 0.08; mean time-domain coherence had a narrow peak in the range ±10 ms with a significant maximum of 0.03. Time-domain coherence was found to be untuned for short lags (10 ms), but significantly tuned at larger lags (50 ms).

Macaque lateral intraparietal area and oculomotor behaviors

Neurons in the primate lateral intraparietal area (area LIP) carry visual, saccade-related and eye position activities. The visual and saccade activities are anchored in a retinotopic framework and the overall response magnitude is modulated by eye position. It was proposed that the modulation by eye position might be the basis of a distributed coding of target locations in a head-centered space. Other recording studies demonstrated that area LIP is involved in oculomotor planning. These results overall suggest that area LIP transforms sensory information for motor functions. In this thesis I further explore the role of area LIP in processing saccadic eye movements by observing the effects of reversible inactivation of this area. Macaque monkeys were trained to do visually guided and memory saccades and a double saccade task to examine the use of eye position signal. Finally, by intermixing visual saccades with trials in which two targets were presented at opposite sides of the fixation point, I examined the behavior of visual extinction.

In chapter 2, I will show that lesion of area LIP results in increased latency of contralesional visual and memory saccades. Contralesional memory saccades are also hypometric and slower in velocity. Moreover, the impairment of memory saccades does not vary with the duration of the delay period. This suggests that the oculomotor deficits observed after inactivation of area LIP is not due to the disruption of spatial memory.

In chapter 3, I will show that lesion of area LIP does not severely affect the processing of spontaneous eye movement. However, the monkeys made fewer contralesional saccades and tended to confine their gaze to the ipsilesional field after inactivation of area LIP. On the other hand, lesion of area LIP results in extinction of the contralesional stimulus. When the initial fixation position was varied so that the retinal and spatial locations of the targets could be dissociated, it was found that the extinction behavior could best be described in a head-centered coordinate.

In chapter 4, I will show that inactivation of area LIP disrupts the use of eye position signal to compute the second movement correctly in the double saccade task. If the first saccade steps into the contralesional field, the error rate and latency of the second saccade are both increased. Furthermore, the direction of the first eye movement largely does not have any effect on the impairment of the second saccade. I will argue that this study provides important evidence that the extraretinal signal used for saccadic localization is eye position rather than a displacement vector.

In chapter 5, I will demonstrate that in parietal monkeys the eye drifts toward the lesion side at the end of the memory saccade in darkness. This result suggests that the eye position activity in the posterior parietal cortex is active in nature and subserves gaze holding.

Overall, these results further support the view that area LIP neurons encode spatial locations in a craniotopic framework and is involved in processing voluntary eye movements.

Various algorithms for optimization and learning in adaptive systems

This thesis discusses various methods for learning and optimization in adaptive systems. Overall, it emphasizes the relationship between optimization, learning, and adaptive systems; and it illustrates the influence of underlying hardware upon the construction of efficient algorithms for learning and optimization. Chapter 1 provides a summary and an overview.

Chapter 2 discusses a method for using feed-forward neural networks to filter the noise out of noise-corrupted signals. The networks use back-propagation learning, but they use it in a way that qualifies as unsupervised learning. The networks adapt based only on the raw input data-there are no external teachers providing information on correct operation during training. The chapter contains an analysis of the learning and develops a simple expression that, based only on the geometry of the network, predicts performance.

Chapter 3 explains a simple model of the piriform cortex, an area in the brain involved in the processing of olfactory information. The model was used to explore the possible effect of acetylcholine on learning and on odor classification. According to the model, the piriform cortex can classify odors better when acetylcholine is present during learning but not present during recall. This is interesting since it suggests that learning and recall might be separate neurochemical modes (corresponding to whether or not acetylcholine is present). When acetylcholine is turned off at all times, even during learning, the model exhibits behavior somewhat similar to Alzheimer's disease, a disease associated with the degeneration of cells that distribute acetylcholine.

Chapters 4, 5, and 6 discuss algorithms appropriate for adaptive systems implemented entirely in analog hardware. The algorithms inject noise into the systems and correlate the noise with the outputs of the systems. This allows them to estimate gradients and to implement noisy versions of gradient descent, without having to calculate gradients explicitly. The methods require only noise generators, adders, multipliers, integrators, and differentiators; and the number of devices needed scales linearly with the number of adjustable parameters in the adaptive systems. With the exception of one global signal, the algorithms require only local information exchange.

Neural routing circuits for forming invariant representations of visual objects

This thesis presents a biologically plausible model of an attentional mechanism for forming position- and scale-invariant representations of objects in the visual world. The model relies on a set of control neurons to dynamically modify the synaptic strengths of intra-cortical connections so that information from a windowed region of primary visual cortex (Vl) is selectively routed to higher cortical areas. Local spatial relationships (i.e., topography) within the attentional window are preserved as information is routed through the cortex, thus enabling attended objects to be represented in higher cortical areas within an object-centered reference frame that is position and scale invariant. The representation in V1 is modeled as a multiscale stack of sample nodes with progressively lower resolution at higher eccentricities. Large changes in the size of the attentional window are accomplished by switching between different levels of the multiscale stack, while positional shifts and small changes in scale are accomplished by translating and rescaling the window within a single level of the stack. The control signals for setting the position and size of the attentional window are hypothesized to originate from neurons in the pulvinar and in the deep layers of visual cortex. The dynamics of these control neurons are governed by simple differential equations that can be realized by neurobiologically plausible circuits. In pre-attentive mode, the control neurons receive their input from a low-level "saliency map" representing potentially interesting regions of a scene. During the pattern recognition phase, control neurons are driven by the interaction between top-down (memory) and bottom-up (retinal input) sources. The model respects key neurophysiological, neuroanatomical, and psychophysical data relating to attention, and it makes a variety of experimentally testable predictions.

Anatomical and developmental patterns of interleukin-2 gene expression in the mouse: analysis of IL-2 expressing cells and partial characterization of interactions involved in mediating IL-2 gene expression in vivo

Interleukin-2 (IL-2) is an important mediator in the vertebrate immune system. IL-2 is a potent growth factor that mature T lymphocytes use as a proliferation signal and the production of IL-2 is crucial for the clonal expansion of antigen-specific T cells in the primary immune response. IL-2 driven proliferation is dependent on the interaction of the lymphokine with its cognate multichain receptor. IL-2 expression is induced only upon stimulation and transcriptional activation of the IL-2 gene relies extensively on the coordinate interaction of numerous inducible and constitutive trans-acting factors. Over the past several years, thousands of papers have been published regarding molecular and cellular aspects of IL-2 gene expression and IL-2 function. The vast majority of these reports describe work that has been carried out in vitro. However, considerably less is known about control of IL-2 gene expression and IL-2 function in vivo.

To gain new insight into the regulation of IL-2 gene expression in vivo, anatomical and developmental patterns of IL-2 gene expression in the mouse were established by employing in situ hybridization and immunohistochemical staining methodologies to tissue sections generated from normal mice and mutant animals in which T -cell development was perturbed. Results from these studies revealed several interesting aspects of IL-2 gene expression, such as (1) induction of IL-2 gene expression and protein synthesis in the thymus, the primary site of T-cell development in the body, (2) cell-type specificity of IL-2 gene expression in vivo, (3) participation of IL-2 in the extrathymic expansion of mature T cells in particular tissues, independent of an acute immune response to foreign antigen, (4) involvement of IL-2 in maintaining immunologic balance in the mucosal immune system, and (5) potential function of IL-2 in early events associated with hematopoiesis.

Extensive analysis of IL-2 mRNA accumulation and protein production in the murine thymus at various stages of development established the existence of two classes of intrathymic IL-2 producing cells. One class of intrathymic IL-2 producers was found exclusively in the fetal thymus. Cells belonging to this subset were restricted to the outermost region of the thymus. IL-2 expression in the fetal thymus was highly transient; a dramatic peak ofiL-2 mRNA accumulation was identified at day 14.5 of gestation and maximal IL-2 protein production was observed 12 hours later, after which both IL-2 mRNA and protein levels rapidly decreased. Significantly, the presence of IL-2 expressing cells in the day 14-15 fetal thymus was not contingent on the generation of T-cell receptor (TcR) positive cells. The second class of IL-2 producing cells was also detectable in the fetal thymus (cells found in this class represented a minority subset of IL-2 producers in the fetal thymus) but persist in the thymus during later stages of development and after birth. Intrathymic IL-2 producers in postnatal animals were located in the subcapsular region and cortex, indicating that these cells reside in the same areas where immature T cells are consigned. The frequency of IL-2 expressing cells in the postnatal thymus was extremely low, indicating that induction of IL-2 expression and protein synthesis are indicative of a rare activation event. Unlike the fetal class of intrathymic IL-2 producers, the presence of IL-2 producing cells in the postnatal thymus was dependent on to the generation of TcR+ cells. Subsequent examination of intrathymic IL-2 production in mutant postnatal mice unable to produce either αβ or γδ T cells showed that postnatal IL-2 producers in the thymus belong to both αβ and γδ lineages. Additionally, further studies indicated that IL-2 synthesis by immature αβ -T cells depends on the expression of bonafide TcR αβ-heterodimers. Taken altogether, IL-2 production in the postnatal thymus relies on the generation of αβ or γδ-TcR^+ cells and induction of IL-2 protein synthesis can be linked to an activation event mediated via the TcR.

With regard to tissue specificity of IL-2 gene expression in vivo, analysis of whole body sections obtained from normal neonatal mouse pups by in situ hybridization demonstrated that IL-2 mRNA^+ cells were found in both lymphoid and nonlymphoid tissues with which T cells are associated, such as the thymus (as described above), dermis and gut. Tissues devoid of IL-2 mRNA^+ cells included brain, heart, lung, liver, stomach, spine, spinal cord, kidney, and bladder. Additional analysis of isolated tissues taken from older animals revealed that IL-2 expression was undetectable in bone marrow and in nonactivated spleen and lymph nodes. Thus, it appears that extrathymic IL-2 expressing cells in nonimmunologically challenged animals are relegated to particular epidermal and epithelial tissues in which characterized subsets of T cells reside and thatinduction of IL-2 gene expression associated with these tissues may be a result of T-cell activation therein.

Based on the neonatal in situ hybridization results, a detailed investigation into possible induction of IL-2 expression resulting in IL-2 protein synthesis in the skin and gut revealed that IL-2 expression is induced in the epidermis and intestine and IL-2 protein is available to drive cell proliferation of resident cells and/or participate in immune function in these tissues. Pertaining to IL-2 expression in the skin, maximal IL-2 mRNA accumulation and protein production were observed when resident Vγ_3^+ T-cell populations were expanding. At this age, both IL-2 mRNA^+ cells and IL-2 protein production were intimately associated with hair follicles. Likewise, at this age a significant number of CD3ε^+ cells were also found in association with follicles. The colocalization of IL-2 expression and CD3ε^+ cells suggests that IL-2 expression is induced when T cells are in contact with hair follicles. In contrast, neither IL-2 mRNA nor IL-2 protein were readily detected once T-cell density in the skin reached steady-state proportions. At this point, T cells were no longer found associated with hair follicles but were evenly distributed throughout the epidermis. In addition, IL-2 expression in the skin was contingent upon the presence of mature T cells therein and induction of IL-2 protein synthesis in the skin did not depend on the expression of a specific TcR on resident T cells. These newly disclosed properties of IL-2 expression in the skin indicate that IL-2 may play an additional role in controlling mature T-cell proliferation by participating in the extrathymic expansion of T cells, particularly those associated with the epidermis.

Finally, regarding IL-2 expression and protein synthesis in the gut, IL-2 producing cells were found associated with the lamina propria of neonatal animals and gut-associated IL-2 production persisted throughout life. In older animals, the frequency of IL-2 producing cells in the small intestine was not identical to that in the large intestine and this difference may reflect regional specialization of the mucosal immune system in response to enteric antigen. Similar to other instances of IL-2 gene expression in vivo, a failure to generate mature T cells also led to an abrogation of IL-2 protein production in the gut. The presence of IL-2 producing cells in the neonatal gut suggested that these cells may be generated during fetal development. Examination of the fetal gut to determine the distribution of IL-2 producing cells therein indicated that there was a tenfold increase in the number of gut-associated IL-2 producers at day 20 of gestation compared to that observed four days earlier and there was little difference between the frequency of IL-2 producing cells in prenatal versus neonatal gut. The origin of these fetally-derived IL-2 producing cells is unclear. Prior to the immigration of IL-2 inducible cells to the fetal gut and/or induction of IL-2 expression therein, IL-2 protein was observed in the fetal liver and fetal omentum, as well as the fetal thymus. Considering that induction of IL-2 protein synthesis may be an indication of future functional capability, detection of IL-2 producing cells in the fetal liver and fetal omentum raises the possibility that IL-2 producing cells in the fetal gut may be extrathymic in origin and IL-2 producing cells in these fetal tissues may not belong solely to the T lineage. Overall, these results provide increased understanding of the nature of IL-2 producing cells in the gut and how the absence of IL-2 production therein and in fetal hematopoietic tissues can result in the acute pathology observed in IL-2 deficient animals.

Microglia in the cerebral and cerebellar cortices in individuals with autism

In this thesis, we explore the density of the microglia in the cerebral and cerebellar cortices of individuals with autism to investigate the hypothesis that neuroinflammation is involved in autism. We describe in our findings an increase in microglial density in two disparate cortical regions, frontal insular cortex and visual cortex, in individuals with autism (Tetreault et al., 2012). Our results imply that there is a global increase in the microglial density and neuroinflammation in the cerebral cortex of individuals with autism.

We expanded our cerebellar study to additional neurodevelopmental disorders that exhibit similar behaviors to autism spectrum disorder and have known cerebellar pathology. We subsequently found a more than threefold increase in the microglial density specific to the molecular layer of the cerebellum, which is the region of the Purkinje and parallel fiber synapses, in individuals with autism and Rett syndrome. Moreover, we report that not only is there an increase in microglia density in the molecular layer, the microglial cell bodies are significantly larger in perimeter and area in individuals with autism spectrum disorder and Rett syndrome compared to controls that implies that the microglia are activated. Additionally, an individual with Angelman syndrome and the sibling of an individual with autism have microglial densities similar to the individuals with autism and Rett syndrome. By contrast, an individual with Joubert syndrome, which is a developmental hypoplasia of the cerebellar vermis, had a normal density of microglia, indicating the specific pathology in the cerebellum does not necessarily result in increased microglial densities. We found a significant decrease in Purkinje cells specific to the cerebellar vermis in individuals with autism.

These findings indicate the importance for investigation of the Purkinje synapses in autism and that the relationship between the microglia and the synapses is of great utility in understanding the pathology in autism. Together, these data provide further evidence for the neuroinflammation hypothesis in autism and a basis for future investigation of neuroinflammation in autism. In particular, investigating the function of microglia in modifying synaptic connectivity in the cerebellum may provide key insights into developing therapeutics in autism spectrum disorder.

Characterization of the neural mechanisms supporting the implementation of cognitive control in human decision making

Humans are particularly adept at modifying their behavior in accordance with changing environmental demands. Through various mechanisms of cognitive control, individuals are able to tailor actions to fit complex short- and long-term goals. The research described in this thesis uses functional magnetic resonance imaging to characterize the neural correlates of cognitive control at two levels of complexity: response inhibition and self-control in intertemporal choice. First, we examined changes in neural response associated with increased experience and skill in response inhibition; successful response inhibition was associated with decreased neural response over time in the right ventrolateral prefrontal cortex, a region widely implicated in cognitive control, providing evidence for increased neural efficiency with learned automaticity. We also examined a more abstract form of cognitive control using intertemporal choice. In two experiments, we identified putative neural substrates for individual differences in temporal discounting, or the tendency to prefer immediate to delayed rewards. Using dynamic causal models, we characterized the neural circuit between ventromedial prefrontal cortex, an area involved in valuation, and dorsolateral prefrontal cortex, a region implicated in self-control in intertemporal and dietary choice, and found that connectivity from dorsolateral prefrontal cortex to ventromedial prefrontal cortex increases at the time of choice, particularly when delayed rewards are chosen. Moreover, estimates of the strength of connectivity predicted out-of-sample individual rates of temporal discounting, suggesting a neurocomputational mechanism for variation in the ability to delay gratification. Next, we interrogated the hypothesis that individual differences in temporal discounting are in part explained by the ability to imagine future reward outcomes. Using a novel paradigm, we imaged neural response during the imagining of primary rewards, and identified negative correlations between activity in regions associated the processing of both real and imagined rewards (lateral orbitofrontal cortex and ventromedial prefrontal cortex, respectively) and the individual temporal discounting parameters estimated in the previous experiment. These data suggest that individuals who are better able to represent reward outcomes neurally are less susceptible to temporal discounting. Together, these findings provide further insight into role of the prefrontal cortex in implementing cognitive control, and propose neurobiological substrates for individual variation.

A model of the olfactory bulb and beyond

The olfactory bulb of mammals aids in the discrimination of odors. A mathematical model based on the bulbar anatomy and electrophysiology is described. Simulations of the highly non-linear model produce a 35-60 Hz modulated activity, which is coherent across the bulb. The decision states (for the odor information) in this system can be thought of as stable cycles, rather than as point stable states typical of simpler neuro-computing models. Analysis shows that a group of coupled non-linear oscillators are responsible for the oscillatory activities. The output oscillation pattern of the bulb is determined by the odor input. The model provides a framework in which to understand the transformation between odor input and bulbar output to the olfactory cortex. This model can also be extended to other brain areas such as the hippocampus, thalamus, and neocortex, which show oscillatory neural activities. There is significant correspondence between the model behavior and observed electrophysiology.

It has also been suggested that the olfactory bulb, the first processing center after the sensory cells in the olfactory pathway, plays a role in olfactory adaptation, odor sensitivity enhancement by motivation, and other olfactory psychophysical phenomena. The input from the higher olfactory centers to the inhibitory cells in the bulb are shown to be able to modulate the response, and thus the sensitivity, of the bulb to odor input. It follows that the bulb can decrease its sensitivity to a pre-existing and detected odor (adaptation) while remaining sensitive to new odors, or can increase its sensitivity to discover interesting new odors. Other olfactory psychophysical phenomena such as cross-adaptation are also discussed.

Biophysical and network mechanisms of high frequency extracellular potentials in the rat hippocampus

A fundamental question in neuroscience is how distributed networks of neurons communicate and coordinate dynamically and specifically. Several models propose that oscillating local networks can transiently couple to each other through phase-locked firing. Coherent local field potentials (LFP) between synaptically connected regions is often presented as evidence for such coupling. The physiological correlates of LFP signals depend on many anatomical and physiological factors, however, and how the underlying neural processes collectively generate features of different spatiotemporal scales is poorly understood. High frequency oscillations in the hippocampus, including gamma rhythms (30-100 Hz) that are organized by the theta oscillations (5-10 Hz) during active exploration and REM sleep, as well as sharp wave-ripples (SWRs, 140-200 Hz) during immobility or slow wave sleep, have each been associated with various aspects of learning and memory. Deciphering their physiology and functional consequences is crucial to understanding the operation of the hippocampal network.

We investigated the origins and coordination of high frequency LFPs in the hippocampo-entorhinal network using both biophysical models and analyses of large-scale recordings in behaving and sleeping rats. We found that the synchronization of pyramidal cell spikes substantially shapes, or even dominates, the electrical signature of SWRs in area CA1 of the hippocampus. The precise mechanisms coordinating this synchrony are still unresolved, but they appear to also affect CA1 activity during theta oscillations. The input to CA1, which often arrives in the form of gamma-frequency waves of activity from area CA3 and layer 3 of entorhinal cortex (EC3), did not strongly influence the timing of CA1 pyramidal cells. Rather, our data are more consistent with local network interactions governing pyramidal cells' spike timing during the integration of their inputs. Furthermore, the relative timing of input from EC3 and CA3 during the theta cycle matched that found in previous work to engage mechanisms for synapse modification and active dendritic processes. Our work demonstrates how local networks interact with upstream inputs to generate a coordinated hippocampal output during behavior and sleep, in the form of theta-gamma coupling and SWRs.

Neural and computational representations of decision variables

These studies explore how, where, and when representations of variables critical to decision-making are represented in the brain. In order to produce a decision, humans must first determine the relevant stimuli, actions, and possible outcomes before applying an algorithm that will select an action from those available. When choosing amongst alternative stimuli, the framework of value-based decision-making proposes that values are assigned to the stimuli and that these values are then compared in an abstract “value space” in order to produce a decision. Despite much progress, in particular regarding the pinpointing of ventromedial prefrontal cortex (vmPFC) as a region that encodes the value, many basic questions remain. In Chapter 2, I show that distributed BOLD signaling in vmPFC represents the value of stimuli under consideration in a manner that is independent of the type of stimulus it is. Thus the open question of whether value is represented in abstraction, a key tenet of value-based decision-making, is confirmed. However, I also show that stimulus-dependent value representations are also present in the brain during decision-making and suggest a potential neural pathway for stimulus-to-value transformations that integrates these two results.

More broadly speaking, there is both neural and behavioral evidence that two distinct control systems are at work during action selection. These two systems compose the “goal-directed system”, which selects actions based on an internal model of the environment, and the “habitual” system, which generates responses based on antecedent stimuli only. Computational characterizations of these two systems imply that they have different informational requirements in terms of input stimuli, actions, and possible outcomes. Associative learning theory predicts that the habitual system should utilize stimulus and action information only, while goal-directed behavior requires that outcomes as well as stimuli and actions be processed. In Chapter 3, I test whether areas of the brain hypothesized to be involved in habitual versus goal-directed control represent the corresponding theorized variables.

The question of whether one or both of these neural systems drives Pavlovian conditioning is less well-studied. Chapter 4 describes an experiment in which subjects were scanned while engaged in a Pavlovian task with a simple non-trivial structure. After comparing a variety of model-based and model-free learning algorithms (thought to underpin goal-directed and habitual decision-making, respectively), it was found that subjects’ reaction times were better explained by a model-based system. In addition, neural signaling of precision, a variable based on a representation of a world model, was found in the amygdala. These data indicate that the influence of model-based representations of the environment can extend even to the most basic learning processes.

Knowledge of the state of hidden variables in an environment is required for optimal inference regarding the abstract decision structure of a given environment and therefore can be crucial to decision-making in a wide range of situations. Inferring the state of an abstract variable requires the generation and manipulation of an internal representation of beliefs over the values of the hidden variable. In Chapter 5, I describe behavioral and neural results regarding the learning strategies employed by human subjects in a hierarchical state-estimation task. In particular, a comprehensive model fit and comparison process pointed to the use of "belief thresholding". This implies that subjects tended to eliminate low-probability hypotheses regarding the state of the environment from their internal model and ceased to update the corresponding variables. Thus, in concert with incremental Bayesian learning, humans explicitly manipulate their internal model of the generative process during hierarchical inference consistent with a serial hypothesis testing strategy.