Stimulus Integration and Parsing in the Primate Auditory Midbrain

Integrating information from multiple sources is a crucial function of the brain. Examples of such integration include multiple stimuli of different modalties, such as visual and auditory, multiple stimuli of the same modality, such as auditory and auditory, and integrating stimuli from the sensory organs (i.e. ears) with stimuli delivered from brain-machine interfaces.

The overall aim of this body of work is to empirically examine stimulus integration in these three domains to inform our broader understanding of how and when the brain combines information from multiple sources.

First, I examine visually-guided auditory, a problem with implications for the general problem in learning of how the brain determines what lesson to learn (and what lessons not to learn). For example, sound localization is a behavior that is partially learned with the aid of vision. This process requires correctly matching a visual location to that of a sound. This is an intrinsically circular problem when sound location is itself uncertain and the visual scene is rife with possible visual matches. Here, we develop a simple paradigm using visual guidance of sound localization to gain insight into how the brain confronts this type of circularity. We tested two competing hypotheses. 1: The brain guides sound location learning based on the synchrony or simultaneity of auditory-visual stimuli, potentially involving a Hebbian associative mechanism. 2: The brain uses a ‘guess and check’ heuristic in which visual feedback that is obtained after an eye movement to a sound alters future performance, perhaps by recruiting the brain’s reward-related circuitry. We assessed the effects of exposure to visual stimuli spatially mismatched from sounds on performance of an interleaved auditory-only saccade task. We found that when humans and monkeys were provided the visual stimulus asynchronously with the sound but as feedback to an auditory-guided saccade, they shifted their subsequent auditory-only performance toward the direction of the visual cue by 1.3-1.7 degrees, or 22-28% of the original 6 degree visual-auditory mismatch. In contrast when the visual stimulus was presented synchronously with the sound but extinguished too quickly to provide this feedback, there was little change in subsequent auditory-only performance. Our results suggest that the outcome of our own actions is vital to localizing sounds correctly. Contrary to previous expectations, visual calibration of auditory space does not appear to require visual-auditory associations based on synchrony/simultaneity.

My next line of research examines how electrical stimulation of the inferior colliculus influences perception of sounds in a nonhuman primate. The central nucleus of the inferior colliculus is the major ascending relay of auditory information before it reaches the forebrain, and thus an ideal target for understanding low-level information processing prior to the forebrain, as almost all auditory signals pass through the central nucleus of the inferior colliculus before reaching the forebrain. Thus, the inferior colliculus is the ideal structure to examine to understand the format of the inputs into the forebrain and, by extension, the processing of auditory scenes that occurs in the brainstem. Therefore, the inferior colliculus was an attractive target for understanding stimulus integration in the ascending auditory pathway.

Moreover, understanding the relationship between the auditory selectivity of neurons and their contribution to perception is critical to the design of effective auditory brain prosthetics. These prosthetics seek to mimic natural activity patterns to achieve desired perceptual outcomes. We measured the contribution of inferior colliculus (IC) sites to perception using combined recording and electrical stimulation. Monkeys performed a frequency-based discrimination task, reporting whether a probe sound was higher or lower in frequency than a reference sound. Stimulation pulses were paired with the probe sound on 50% of trials (0.5-80 µA, 100-300 Hz, n=172 IC locations in 3 rhesus monkeys). Electrical stimulation tended to bias the animals’ judgments in a fashion that was coarsely but significantly correlated with the best frequency of the stimulation site in comparison to the reference frequency employed in the task. Although there was considerable variability in the effects of stimulation (including impairments in performance and shifts in performance away from the direction predicted based on the site’s response properties), the results indicate that stimulation of the IC can evoke percepts correlated with the frequency tuning properties of the IC. Consistent with the implications of recent human studies, the main avenue for improvement for the auditory midbrain implant suggested by our findings is to increase the number and spatial extent of electrodes, to increase the size of the region that can be electrically activated and provide a greater range of evoked percepts.

My next line of research employs a frequency-tagging approach to examine the extent to which multiple sound sources are combined (or segregated) in the nonhuman primate inferior colliculus. In the single-sound case, most inferior colliculus neurons respond and entrain to sounds in a very broad region of space, and many are entirely spatially insensitive, so it is unknown how the neurons will respond to a situation with more than one sound. I use multiple AM stimuli of different frequencies, which the inferior colliculus represents using a spike timing code. This allows me to measure spike timing in the inferior colliculus to determine which sound source is responsible for neural activity in an auditory scene containing multiple sounds. Using this approach, I find that the same neurons that are tuned to broad regions of space in the single sound condition become dramatically more selective in the dual sound condition, preferentially entraining spikes to stimuli from a smaller region of space. I will examine the possibility that there may be a conceptual linkage between this finding and the finding of receptive field shifts in the visual system.

In chapter 5, I will comment on these findings more generally, compare them to existing theoretical models, and discuss what these results tell us about processing in the central nervous system in a multi-stimulus situation. My results suggest that the brain is flexible in its processing and can adapt its integration schema to fit the available cues and the demands of the task.

Advances in Dynamic Modeling and Computation for Count Data

A class of multi-process models is developed for collections of time indexed count data. Autocorrelation in counts is achieved with dynamic models for the natural parameter of the binomial distribution. In addition to modeling binomial time series, the framework includes dynamic models for multinomial and Poisson time series. Markov chain Monte Carlo (MCMC) and Po ́lya-Gamma data augmentation (Polson et al., 2013) are critical for fitting multi-process models of counts. To facilitate computation when the counts are high, a Gaussian approximation to the P ́olya- Gamma random variable is developed.

Three applied analyses are presented to explore the utility and versatility of the framework. The first analysis develops a model for complex dynamic behavior of themes in collections of text documents. Documents are modeled as a “bag of words”, and the multinomial distribution is used to characterize uncertainty in the vocabulary terms appearing in each document. State-space models for the natural parameters of the multinomial distribution induce autocorrelation in themes and their proportional representation in the corpus over time.

The second analysis develops a dynamic mixed membership model for Poisson counts. The model is applied to a collection of time series which record neuron level firing patterns in rhesus monkeys. The monkey is exposed to two sounds simultaneously, and Gaussian processes are used to smoothly model the time-varying rate at which the neuron’s firing pattern fluctuates between features associated with each sound in isolation.

The third analysis presents a switching dynamic generalized linear model for the time-varying home run totals of professional baseball players. The model endows each player with an age specific latent natural ability class and a performance enhancing drug (PED) use indicator. As players age, they randomly transition through a sequence of ability classes in a manner consistent with traditional aging patterns. When the performance of the player significantly deviates from the expected aging pattern, he is identified as a player whose performance is consistent with PED use.

All three models provide a mechanism for sharing information across related series locally in time. The models are fit with variations on the P ́olya-Gamma Gibbs sampler, MCMC convergence diagnostics are developed, and reproducible inference is emphasized throughout the dissertation.

Decision-Making in the Primate Brain

Making decisions is fundamental to everything we do, yet it can be impaired in various disorders and conditions. While research into the neural basis of decision-making has flourished in recent years, many questions remain about how decisions are instantiated in the brain. Here we explored how primates make abstract decisions and decisions in social contexts, as well as one way to non-invasively modulate the brain circuits underlying decision-making. We used rhesus macaques as our model organism. First we probed numerical decision-making, a form of abstract decision-making. We demonstrated that monkeys are able to compare discrete ratios, choosing an array with a greater ratio of positive to negative stimuli, even when this array does not have a greater absolute number of positive stimuli. Monkeys’ performance in this task adhered to Weber’s law, indicating that monkeys—like humans—treat proportions as analog magnitudes. Next we showed that monkeys’ ordinal decisions are influenced by spatial associations; when trained to select the fourth stimulus from the bottom in a vertical array, they subsequently selected the fourth stimulus from the left—and not from the right—in a horizontal array. In other words, they begin enumerating from one side of space and not the other, mirroring the human tendency to associate numbers with space. These and other studies confirmed that monkeys’ numerical decision-making follows similar patterns to that of humans, making them a good model for investigations of the neurobiological basis of numerical decision-making.

We sought to develop a system for exploring the neuronal basis of the cognitive and behavioral effects observed following transcranial magnetic stimulation, a relatively new, non-invasive method of brain stimulation that may be used to treat clinical disorders. We completed a set of pilot studies applying offline low-frequency repetitive transcranial magnetic stimulation to the macaque posterior parietal cortex, which has been implicated in numerical processing, while subjects performed a numerical comparison and control color comparison task, and while electrophysiological activity was recorded from the stimulated region of cortex. We found tentative evidence in one paradigm that stimulation did selectively impair performance in the number task, causally implicating the posterior parietal cortex in numerical decisions. In another paradigm, however, we manipulated the subject’s reaching behavior but not her number or color comparison performance. We also found that stimulation produced variable changes in neuronal firing and local field potentials. Together these findings lay the groundwork for detailed investigations into how different parameters of transcranial magnetic stimulation can interact with cortical architecture to produce various cognitive and behavioral changes.

Finally, we explored how monkeys decide how to behave in competitive social interactions. In a zero-sum computer game in which two monkeys played as a shooter or a goalie during a hockey-like “penalty shot” scenario, we found that shooters developed complex movement trajectories so as to conceal their intentions from the goalies. Additionally, we found that neurons in the dorsolateral and dorsomedial prefrontal cortex played a role in generating this “deceptive” behavior. We conclude that these regions of prefrontal cortex form part of a circuit that guides decisions to make an individual less predictable to an opponent.

Wear and its effects on dental topography measures in howling monkeys (Alouatta palliata).

OBJECTIVES: Three dental topography measurements: Dirichlet Normal Energy (DNE), Relief Index (RFI), and Orientation Patch Count Rotated (OPCR) are examined for their interaction with measures of wear, within and between upper and lower molars in Alouatta palliata. Potential inferences of the "dental sculpting" phenomenon are explored. MATERIALS AND METHODS: Fifteen occluding pairs of howling monkey first molars (15 upper, 15 lower) opportunistically collected from La Pacifica, Costa Rica, were selected to sample wear stages ranging from unworn to heavily worn as measured by the Dentine Exposure Ratio (DER). DNE, RFI, and OPCR were measured from three-dimensional surface reconstructions (PLY files) derived from high-resolution CT scans. Relationships among the variables were tested with regression analyses. RESULTS: Upper molars have more cutting edges, exhibiting significantly higher DNE, but have significantly lower RFI values. However, the relationships among the measures are concordant across both sets of molars. DER and EDJL are curvilinearly related. DER is positively correlated with DNE, negatively correlated with RFI, and uncorrelated with OPCR. EDJL is not correlated with DNE, or RFI, but is positively correlated with OPCR among lower molars only. DISCUSSION: The relationships among these metrics suggest that howling monkey teeth adaptively engage macrowear. DNE increases with wear in this sample presumably improving food breakdown. RFI is initially high but declines with wear, suggesting that the initially high RFI safeguards against dental senescence. OPCR values in howling monkey teeth do not show a clear relationship with wear changes.

Non-auditory Influences on the Auditory Periphery

Once thought to be predominantly the domain of cortex, multisensory integration has now been found at numerous sub-cortical locations in the auditory pathway. Prominent ascending and descending connection within the pathway suggest that the system may utilize non-auditory activity to help filter incoming sounds as they first enter the ear. Active mechanisms in the periphery, particularly the outer hair cells (OHCs) of the cochlea and middle ear muscles (MEMs), are capable of modulating the sensitivity of other peripheral mechanisms involved in the transduction of sound into the system. Through indirect mechanical coupling of the OHCs and MEMs to the eardrum, motion of these mechanisms can be recorded as acoustic signals in the ear canal. Here, we utilize this recording technique to describe three different experiments that demonstrate novel multisensory interactions occurring at the level of the eardrum. 1) In the first experiment, measurements in humans and monkeys performing a saccadic eye movement task to visual targets indicate that the eardrum oscillates in conjunction with eye movements. The amplitude and phase of the eardrum movement, which we dub the Oscillatory Saccadic Eardrum Associated Response or OSEAR, depended on the direction and horizontal amplitude of the saccade and occurred in the absence of any externally delivered sounds. 2) For the second experiment, we use an audiovisual cueing task to demonstrate a dynamic change to pressure levels in the ear when a sound is expected versus when one is not. Specifically, we observe a drop in frequency power and variability from 0.1 to 4kHz around the time when the sound is expected to occur in contract to a slight increase in power at both lower and higher frequencies. 3) For the third experiment, we show that seeing a speaker say a syllable that is incongruent with the accompanying audio can alter the response patterns of the auditory periphery, particularly during the most relevant moments in the speech stream. These visually influenced changes may contribute to the altered percept of the speech sound. Collectively, we presume that these findings represent the combined effect of OHCs and MEMs acting in tandem in response to various non-auditory signals in order to manipulate the receptive properties of the auditory system. These influences may have a profound, and previously unrecognized, impact on how the auditory system processes sounds from initial sensory transduction all the way to perception and behavior. Moreover, we demonstrate that the entire auditory system is, fundamentally, a multisensory system.

Insights into Nonpilus Adhesin Functionality and the Molecular Determinants of Nontypeable Haemophilus influenzae Colonization

Bacterial colonization of the upper respiratory tract is the first step in the pathogenesis of nontypeable Haemophilus influenzae (NTHi) disease. Examination of the determinants of NTHi colonization process has been hampered by the lack of an appropriate animal model. To address this, we have developed a model of NTHi colonization in adult rhesus macaques that involves intranasal inoculation of 1x105 CFU and results in persistent colonization of the upper respiratory tract for at least three weeks with no signs of disease, mimicking asymptomatic colonization of humans. Using this model, we assessed the contributions to colonization of the HMW1 and HMW2 adhesive proteins. In competition experiments, the parent strain expressing both HMW1 and HMW2 was able to efficiently out-compete an isogenic mutant strain expressing neither HMW1 nor HMW2. In experiments involving inoculation of single isogenic derivatives of NTHi strain 12, the strains expressing HMW1 or HMW2 or both were able to colonize efficiently, while the strain expressing neither HMW1 nor HMW2 colonized inefficiently. Furthermore, colonization resulted in antibody production against HMW1 and HMW2 in one-third of the animals, demonstrating that colonization can be an immunizing event. In conclusion, we have established that NTHi is capable of colonizing the upper respiratory tract of rhesus macaques, in some cases associated with stimulation of an immune response. The HMW1 and HMW2 adhesive proteins play a major role in the process of colonization.

After establishing that the HMW1 and HMW2 proteins are colonization factors we further investigated the determinants of HMW1 function. HMW1 is encoded in the same genetic locus as two other proteins, HMW1B and HMW1C, with which HMW1 must interact in order to be functional. Interaction with HMW1C in the cytoplasm results in the glycosylation of HMW1. By employing homologues of HMW1C that glycosylate HMW1 in slightly different patterns we show that the pattern of modification is critical to HMW1 function. Structural analysis showed a change in protein structure when the pattern of HMW1 modification differed. We also identified two specific sites which must be glycosylated for HMW1 to function properly. These point mutations did not have a significant effect on protein structure, suggesting that glycosylation at those specific sites is instead necessary for interaction of HMW1 with its receptor. HMW1B is an outer membrane pore through which HMW1 is transported to reach the bacterial cell surface. We observed that HMW1 isolated from the cytoplasm has a different structure than HMW1 isolated from the bacterial cell surface. By forcing HMW1 to be secreted in a non-HMW1B dependent manner, we show that secretion alone is not sufficient for HMW1 to obtain a functional structure. This leads us to hypothesize that there is something specific in the interaction between HMW1 and HMW1B that aids in proper HMW1 folding.

The NTHi HMW1C glycosyltransferase mediates unconventional N-linked glycosylation of HMW1. In this system, HMW1 is modified in the cytoplasm by sequential transfer of hexose residues. To determine if this mechanism of N-linked glycosylation is employed by species other than NTHi, we examined Kingella kingae and Aggregatibacter aphrophilus homologues of HMW1C. We found both homologues to be functional glycosyltransferases and identified their substrates as the K. kingae Knh and the A. aphrophilus EmaA trimeric autotransporter proteins. LC-MS/MS analysis revealed multiple sites of N-linked glycosylation on Knh and EmaA. Without glycosylation, Knh and EmaA failed to facilitate wild type levels of bacterial autoaggregation or adherence to human epithelial cells, establishing that glycosylation is essential for proper protein function.