The Neural Substrates of Multisensory Speech Perception

Comprehending speech is one of the most important human behaviors, but we are only beginning to understand how the brain accomplishes this difficult task. One key to speech perception seems to be that the brain integrates the independent sources of information available in the auditory and visual modalities in a process known as multisensory integration. This allows speech perception to be accurate, even in environments in which one modality or the other is ambiguous in the context of noise. Previous electrophysiological and functional magnetic resonance imaging (fMRI) experiments have implicated the posterior superior temporal sulcus (STS) in auditory-visual integration of both speech and non-speech stimuli. While evidence from prior imaging studies have found increases in STS activity for audiovisual speech compared with unisensory auditory or visual speech, these studies do not provide a clear mechanism as to how the STS communicates with early sensory areas to integrate the two streams of information into a coherent audiovisual percept. Furthermore, it is currently unknown if the activity within the STS is directly correlated with strength of audiovisual perception. In order to better understand the cortical mechanisms that underlie audiovisual speech perception, we first studied the STS activity and connectivity during the perception of speech with auditory and visual components of varying intelligibility. By studying fMRI activity during these noisy audiovisual speech stimuli, we found that STS connectivity with auditory and visual cortical areas mirrored perception; when the information from one modality is unreliable and noisy, the STS interacts less with the cortex processing that modality and more with the cortex processing the reliable information. We next characterized the role of STS activity during a striking audiovisual speech illusion, the McGurk effect, to determine if activity within the STS predicts how strongly a person integrates auditory and visual speech information. Subjects with greater susceptibility to the McGurk effect exhibited stronger fMRI activation of the STS during perception of McGurk syllables, implying a direct correlation between strength of audiovisual integration of speech and activity within an the multisensory STS.

Structural plasticity can produce metaplasticity.

BACKGROUND: Synaptic plasticity underlies many aspect of learning memory and development. The properties of synaptic plasticity can change as a function of previous plasticity and previous activation of synapses, a phenomenon called metaplasticity. Synaptic plasticity not only changes the functional connectivity between neurons but in some cases produces a structural change in synaptic spines; a change thought to form a basis for this observed plasticity. Here we examine to what extent structural plasticity of spines can be a cause for metaplasticity. This study is motivated by the observation that structural changes in spines are likely to affect the calcium dynamics in spines. Since calcium dynamics determine the sign and magnitude of synaptic plasticity, it is likely that structural plasticity will alter the properties of synaptic plasticity. METHODOLOGY/PRINCIPAL FINDINGS: In this study we address the question how spine geometry and alterations of N-methyl-D-aspartic acid (NMDA) receptors conductance may affect plasticity. Based on a simplified model of the spine in combination with a calcium-dependent plasticity rule, we demonstrated that after the induction phase of plasticity a shift of the long term potentiation (LTP) or long term depression (LTD) threshold takes place. This induces a refractory period for further LTP induction and promotes depotentiation as observed experimentally. That resembles the BCM metaplasticity rule but specific for the individual synapse. In the second phase, alteration of the NMDA response may bring the synapse to a state such that further synaptic weight alterations are feasible. We show that if the enhancement of the NMDA response is proportional to the area of the post synaptic density (PSD) the plasticity curves most likely return to the initial state. CONCLUSIONS/SIGNIFICANCE: Using simulations of calcium dynamics in synaptic spines, coupled with a biophysically motivated calcium-dependent plasticity rule, we find under what conditions structural plasticity can form the basis of synapse specific metaplasticity.

Dynamic population coding in primary visual cortex

More than a century ago Ramon y Cajal pioneered the description of neural circuits. Currently, new techniques are being developed to streamline the characterization of entire neural circuits. Even if this 'connectome' approach is successful, it will represent only a static description of neural circuits. Thus, a fundamental question in neuroscience is to understand how information is dynamically represented by neural populations. In this thesis, I studied two main aspects of dynamical population codes. ^ First, I studied how the exposure or adaptation, for a fraction of a second to oriented gratings dynamically changes the population response of primary visual cortex neurons. The effects of adaptation to oriented gratings have been extensively explored in psychophysical and electrophysiological experiments. However, whether rapid adaptation might induce a change in the primary visual cortex's functional connectivity to dynamically impact the population coding accuracy is currently unknown. To address this issue, we performed multi-electrode recordings in primary visual cortex, where adaptation has been previously shown to induce changes in the selectivity and response amplitude of individual neurons. We found that adaptation improves the population coding accuracy. The improvement was more prominent for iso- and orthogonal orientation adaptation, consistent with previously reported psychophysical experiments. We propose that selective decorrelation is a metabolically inexpensive mechanism that the visual system employs to dynamically adapt the neural responses to the statistics of the input stimuli to improve coding efficiency. ^ Second, I investigated how ongoing activity modulates orientation coding in single neurons, neural populations and behavior. Cortical networks are never silent even in the absence of external stimulation. The ongoing activity can account for up to 80% of the metabolic energy consumed by the brain. Thus, a fundamental question is to understand the functional role of ongoing activity and its impact on neural computations. I studied how the orientation coding by individual neurons and cell populations in primary visual cortex depend on the spontaneous activity before stimulus presentation. We hypothesized that since the ongoing activity of nearby neurons is strongly correlated, it would influence the ability of the entire population of orientation-selective cells to process orientation depending on the prestimulus spontaneous state. Our findings demonstrate that ongoing activity dynamically filters incoming stimuli to shape the accuracy of orientation coding by individual neurons and cell populations and this interaction affects behavioral performance. In summary, this thesis is a contribution to the study of how dynamic internal states such as rapid adaptation and ongoing activity modulate the population code accuracy. ^

BRAIN ACTIVATION AND CONNECTIVITY IN NON-DISABLED MULTIPLE SCLEROSIS PATIENTS

Multiple sclerosis (MS) is the most common demyelinating disease affecting the central nervous system. There is no cure for MS and current therapies have limited efficacy. While the majority of individuals with MS develop significant clinical disability, a subset experiences a disease course with minimal impairment even in the presence of significant apparent tissue damage on magnetic resonance imaging (MRI). The current studies combined functional MRI and diffusion tensor imaging (DTI) to elucidate brain mechanisms associated with lack of clinical disability in patients with MS. Recent evidence has implicated cortical reorganization as a mechanism to limit the clinical manifestation of the disease. Functional MRI was used to test the hypothesis that non-disabled MS patients (Expanded Disability Status Scale ≤ 1.5) show increased recruitment of cognitive control regions (dorsolateral prefrontal and anterior cingulate cortex) while performing sensory, motor and cognitive tasks. Compared to matched healthy controls, patients increased activation of cognitive control brain regions when performing non-dominant hand movements and the 2-back working memory task. Using dynamic causal modeling, we tested whether increased cognitive control recruitment is associated with alterations in connectivity in the working memory functional network. Patients exhibited similar network connectivity to that of control subjects when performing working memory tasks. We subsequently investigated the integrity of major white matter tracts to assess structural connectivity and its relation to activation and functional integration of the cognitive control system. Patients showed substantial alterations in callosal, inferior and posterior white matter tracts and less pronounced involvement of the corticospinal tracts and superior longitudinal fasciculi (SLF). Decreased structural integrity within the right SLF in patients was associated with decreased performance, and decreased activation and connectivity of the cognitive control system when performing working memory tasks. These studies suggest that patient with MS without clinical disability increase cognitive control system recruitment across functional domains and rely on preserved functional and structural connectivity of brain regions associated with this network. Moreover, the current studies show the usefulness of combining brain activation data from functional MRI and structural connectivity data from DTI to improve our understanding of brain adaptation mechanisms to neurological disease.

Confocal analysis of synaptic connectivity of the rod pathway in the rabbit retina

The retina is a specialized neuronal structure that transforms the optical image into electrical signals which are transmitted to the brain via the optic nerve. As part of the strategy to cover a stimulus range as broad as 10 log units, from dim starlight to bright sunlight, retinal circuits are broadly divided into rod and cone pathways, responsible for dark and light-adapted vision, respectively. ^ In this dissertation, confocal microscopy and immunocytochemical methods were combined to study the synaptic connectivity of the rod pathway from the level of individual synapses to whole populations of neurons. The study was focused on synaptic interactions at the rod bipolar terminal. The purpose is to understand the synaptic structure of the dyad synapse made by rod bipolar terminals, including the synaptic components and connections, and their physiological functions in the rod pathway. In addition, some additional components and connections of the rod pathway were also studied in these experiments. The major results can be summarized as following: At the dyad synapse of rod bipolar terminals, three postsynaptic components—processes of All amacrine cells and the varicosities of S1 or S2 amacrine cells express different glutamate receptor subunits, which may underlie the functional diversity of these postsynaptic neurons. A reciprocal feedback system is formed by rod bipolar terminals and S1/S2 amacrine cells. Analysis showed these two wide-field GABA amacrine cells have stereotyped synaptic connections with the appropriate morphology and distribution to perform specific functions. In addition, S1 and S2 cells have different coupling patterns and, in general, there is no coupling between the two types. Besides the classic rod pathway though rod bipolar cells and All amacrine cells, the finding of direct connections between certain types of OFF cone bipolar cells and rods indicates the presence of an alternative rod pathway in the rabbit retina. ^ In summary, this dissertation presents a detailed view of the connection and receptors at rod bipolar terminals. Based on the morphology, distribution and coupling, different functional roles were identified for S1 and S2 amacrine cells. Finally, an alternative to the classic rod pathway was found in the rabbit retina. ^