Auditory-visual multisensory interactions in humans: timing, topography, directionality, and sources.

Current models of brain organization include multisensory interactions at early processing stages and within low-level, including primary, cortices. Embracing this model with regard to auditory-visual (AV) interactions in humans remains problematic. Controversy surrounds the application of an additive model to the analysis of event-related potentials (ERPs), and conventional ERP analysis methods have yielded discordant latencies of effects and permitted limited neurophysiologic interpretability. While hemodynamic imaging and transcranial magnetic stimulation studies provide general support for the above model, the precise timing, superadditive/subadditive directionality, topographic stability, and sources remain unresolved. We recorded ERPs in humans to attended, but task-irrelevant stimuli that did not require an overt motor response, thereby circumventing paradigmatic caveats. We applied novel ERP signal analysis methods to provide details concerning the likely bases of AV interactions. First, nonlinear interactions occur at 60-95 ms after stimulus and are the consequence of topographic, rather than pure strength, modulations in the ERP. AV stimuli engage distinct configurations of intracranial generators, rather than simply modulating the amplitude of unisensory responses. Second, source estimations (and statistical analyses thereof) identified primary visual, primary auditory, and posterior superior temporal regions as mediating these effects. Finally, scalar values of current densities in all of these regions exhibited functionally coupled, subadditive nonlinear effects, a pattern increasingly consistent with the mounting evidence in nonhuman primates. In these ways, we demonstrate how neurophysiologic bases of multisensory interactions can be noninvasively identified in humans, allowing for a synthesis across imaging methods on the one hand and species on the other.

Quantitative distribution of parvalbumin, calretinin, and calbindin D-28k immunoreactive neurons in the visual cortex of normal and Alzheimer cases.

The distribution of parvalbumin (PV), calretinin (CR), and calbindin (CB) immunoreactive neurons was studied with the help of an image analysis system (Vidas/Zeiss) in the primary visual area 17 and associative area 18 (Brodmann) of Alzheimer and control brains. In neither of these areas was there a significant difference between Alzheimer and control groups in the mean number of PV, CR, or CB immunoreactive neuronal profiles, counted in a cortical column going from pia to white matter. Significant differences in the mean densities (numbers per square millimeter of cortex) of PV, CR, and CB immunoreactive neuronal profiles were not observed either between groups or areas, but only between superficial, middle, and deep layers within areas 17 and 18. The optical density of the immunoreactive neuropil was also similar in Alzheimer and controls, correlating with the numerical density of immunoreactive profiles in superficial, middle, and deep layers. The frequency distribution of neuronal areas indicated significant differences between PV, CR, and CB immunoreactive neuronal profiles in both areas 17 and 18, with more large PV than CR and CB positive profiles. There were also significantly more small and less large PV and CR immunoreactive neuronal profiles in Alzheimer than in controls. Our data show that, although the brain pathology is moderate to severe, there is no prominent decrease of PV, CR and CB positive neurons in the visual cortex of Alzheimer brains, but only selective changes in neuronal perikarya.

Visual functions in the healthy and schizophrenic brain : from stimulus control to illusory perceptions using electrical neuroimaging

ABSTRACT (FRENCH)Ce travail de thèse basé sur le système visuel chez les sujets sains et chez les patients schizophrènes, s'articule autour de trois articles scientifiques publiés ou en cours de publication. Ces articles traitent des sujets suivants : le premier article présente une nouvelle méthode de traitement des composantes physiques des stimuli (luminance et fréquence spatiale). Le second article montre, à l'aide d'analyses de données EEG, un déficit de la voie magnocellulaire dans le traitement visuel des illusions chez les patients schizophrènes. Ceci est démontré par l'absence de modulation de la composante PI chez les patients schizophrènes contrairement aux sujets sains. Cette absence est induite par des stimuli de type illusion Kanizsa de différentes excentricités. Finalement, le troisième article, également à l'aide de méthodes de neuroimagerie électrique (EEG), montre que le traitement des contours illusoires se trouve dans le complexe latéro-occipital (LOC), à l'aide d'illusion « misaligned gratings ». De plus il révèle que les activités démontrées précédemment dans les aires visuelles primaires sont dues à des inférences « top- down ».Afin de permettre la compréhension de ces trois articles, l'introduction de ce manuscrit présente les concepts essentiels. De plus des méthodes d'analyses de temps-fréquence sont présentées. L'introduction est divisée en quatre parties : la première présente le système visuel depuis les cellules retino-corticales aux deux voix du traitement de l'information en passant par les régions composant le système visuel. La deuxième partie présente la schizophrénie par son diagnostic, ces déficits de bas niveau de traitement des stimuli visuel et ces déficits cognitifs. La troisième partie présente le traitement des contours illusoires et les trois modèles utilisés dans le dernier article. Finalement, les méthodes de traitement des données EEG seront explicitées, y compris les méthodes de temps-fréquences.Les résultats des trois articles sont présentés dans le chapitre éponyme (du même nom). De plus ce chapitre comprendra les résultats obtenus à l'aide des méthodes de temps-fréquenceFinalement, la discussion sera orientée selon trois axes : les méthodes de temps-fréquence ainsi qu'une proposition de traitement de ces données par une méthode statistique indépendante de la référence. La discussion du premier article en montrera la qualité du traitement de ces stimuli. La discussion des deux articles neurophysiologiques, proposera de nouvelles d'expériences afin d'affiner les résultats actuels sur les déficits des schizophrènes. Ceci pourrait permettre d'établir un marqueur biologique fiable de la schizophrénie.ABSTRACT (ENGLISH)This thesis focuses on the visual system in healthy subjects and schizophrenic patients. To address this research, advanced methods of analysis of electroencephalographic (EEG) data were used and developed. This manuscript is comprised of three scientific articles. The first article showed a novel method to control the physical features of visual stimuli (luminance and spatial frequencies). The second article showed, using electrical neuroimaging of EEG, a deficit in spatial processing associated with the dorsal pathway in chronic schizophrenic patients. This deficit was elicited by an absent modulation of the PI component in terms of response strength and topography as well as source estimations. This deficit was orthogonal to the preserved ability to process Kanizsa-type illusory contours. Finally, the third article resolved ongoing debates concerning the neural mechanism mediating illusory contour sensitivity by using electrical neuroimaging to show that the first differentiation of illusory contour presence vs. absence is localized within the lateral occipital complex. This effect was subsequent to modulations due to the orientation of misaligned grating stimuli. Collectively, these results support a model where effects in V1/V2 are mediated by "top-down" modulation from the LOC.To understand these three articles, the Introduction of this thesis presents the major concepts used in these articles. Additionally, a section is devoted to time-frequency analysis methods not presented in the articles themselves. The introduction is divided in four parts. The first part presents three aspects of the visual system: cellular, regional, and its functional interactions. The second part presents an overview of schizophrenia and its sensoiy-cognitive deficits. The third part presents an overview of illusory contour processing and the three models examined in the third article. Finally, advanced analysis methods for EEG are presented, including time- frequency methodology.The Introduction is followed by a synopsis of the main results in the articles as well as those obtained from the time-frequency analyses.Finally, the Discussion chapter is divided along three axes. The first axis discusses the time frequency analysis and proposes a novel statistical approach that is independent of the reference. The second axis contextualizes the first article and discusses the quality of the stimulus control and direction for further improvements. Finally, both neurophysiologic articles are contextualized by proposing future experiments and hypotheses that may serve to improve our understanding of schizophrenia on the one hand and visual functions more generally.

Auditory motion affects visual biological motion processing.

The processing of biological motion is a critical, everyday task performed with remarkable efficiency by human sensory systems. Interest in this ability has focused to a large extent on biological motion processing in the visual modality (see, for example, Cutting, J. E., Moore, C., & Morrison, R. (1988). Masking the motions of human gait. Perception and Psychophysics, 44(4), 339-347). In naturalistic settings, however, it is often the case that biological motion is defined by input to more than one sensory modality. For this reason, here in a series of experiments we investigate behavioural correlates of multisensory, in particular audiovisual, integration in the processing of biological motion cues. More specifically, using a new psychophysical paradigm we investigate the effect of suprathreshold auditory motion on perceptions of visually defined biological motion. Unlike data from previous studies investigating audiovisual integration in linear motion processing [Meyer, G. F. & Wuerger, S. M. (2001). Cross-modal integration of auditory and visual motion signals. Neuroreport, 12(11), 2557-2560; Wuerger, S. M., Hofbauer, M., & Meyer, G. F. (2003). The integration of auditory and motion signals at threshold. Perception and Psychophysics, 65(8), 1188-1196; Alais, D. & Burr, D. (2004). No direction-specific bimodal facilitation for audiovisual motion detection. Cognitive Brain Research, 19, 185-194], we report the existence of direction-selective effects: relative to control (stationary) auditory conditions, auditory motion in the same direction as the visually defined biological motion target increased its detectability, whereas auditory motion in the opposite direction had the inverse effect. Our data suggest these effects do not arise through general shifts in visuo-spatial attention, but instead are a consequence of motion-sensitive, direction-tuned integration mechanisms that are, if not unique to biological visual motion, at least not common to all types of visual motion. Based on these data and evidence from neurophysiological and neuroimaging studies we discuss the neural mechanisms likely to underlie this effect.

Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds.

Evidence of multisensory interactions within low-level cortices and at early post-stimulus latencies has prompted a paradigm shift in conceptualizations of sensory organization. However, the mechanisms of these interactions and their link to behavior remain largely unknown. One behaviorally salient stimulus is a rapidly approaching (looming) object, which can indicate potential threats. Based on findings from humans and nonhuman primates suggesting there to be selective multisensory (auditory-visual) integration of looming signals, we tested whether looming sounds would selectively modulate the excitability of visual cortex. We combined transcranial magnetic stimulation (TMS) over the occipital pole and psychophysics for "neurometric" and psychometric assays of changes in low-level visual cortex excitability (i.e., phosphene induction) and perception, respectively. Across three experiments we show that structured looming sounds considerably enhance visual cortex excitability relative to other sound categories and white-noise controls. The time course of this effect showed that modulation of visual cortex excitability started to differ between looming and stationary sounds for sound portions of very short duration (80 ms) that were significantly below (by 35 ms) perceptual discrimination threshold. Visual perceptions are thus rapidly and efficiently boosted by sounds through early, preperceptual and stimulus-selective modulation of neuronal excitability within low-level visual cortex.

Transitory glutathione deficit during brain development induces cognitive impairment in juvenile and adult rats: relevance to schizophrenia.

Glutathione (GSH) metabolism dysfunction is one risk factor in schizophrenia. A transitory brain GSH deficit was induced in Wistar (WIS) and mutant (ODS; lacking ascorbic acid synthesis) rats using BSO (l-buthionine-(S,R)-sulfoximine) from post-natal days 5-16. When GSH was re-established to physiological levels, juvenile BSO-ODS rats were impaired in the water maze task. Long after treatment cessation, adult BSO-WIS/-ODS rats showed impaired place discrimination in the homing board with distributed visual or olfactory cues. Their accuracy was restored when a single cue marked the trained position. Similarly, more working memory errors were made by adult BSO-WIS in the radial maze when several olfactory cues were present. These results reveal that BSO rats did not suffer simple sensory impairment. They were selectively impaired in spatial memory when the task required the integration of multimodal or olfactory cues. These results, in part, resemble some of the reported olfactory discrimination and cognitive impairment in schizophrenia.

Cognitive disorganisation in schizotypy is associated with deterioration in visual backward masking.

To understand the causes of schizophrenia, a search for stable markers (endophenotypes) is ongoing. In previous years, we have shown that the shine-through visual backward masking paradigm meets the most important characteristics of an endophenotype. Here, we tested masking performance differences between healthy students with low and high schizotypy scores as determined by the self-report O-Life questionnaire assessing schizotypy along three dimensions, i.e. positive schizotypy (unusual experiences), cognitive disorganisation, and negative schizotypy (introvertive anhedonia). Forty participants performed the shine-through backward masking task and a classical cognitive test, the Wisconsin Card Sorting Task (WCST). We found that visual backward masking was impaired for students scoring high as compared to low on the cognitive disorganisation dimension, whereas the positive and negative schizotypy dimensions showed no link to masking performance. We also found group differences for students scoring high and low on the cognitive disorganisation factor for the WCST. These findings indicate that the shine-through paradigm is sensitive to differences in schizotypy which are closely linked with the pathological expression in schizophrenia.

The Visual Dysphagia Questionnaire: Evaluating the first Tool for Assessing Food Consistency-Dependent Dysphagia in Eosinophilic Esophagitis

Background and Aims: The international EEsAI study group iscurrently developing the first a ctivity index specific forEosinophilic Esophagitis (EoE). None of the existing dysphagiaquestionnaires take into account the consistency of theingested food t hat considerably impacts the symptompresentation. Goal: To d evelop and evaluate an E oE-specificquestionnaire assessing dysphagia caused by foods of differentconsistencies.Methods: B ased on patient interviews and chart reviews, a nexpert panel ( EEsAI study g roup) identified internationallystandardizedfood prototypes t ypically a ssociated with EoErelateddysphagia. Food consistencies were c orrelated withEoE-related d ysphagia, t aking into account p otential f oodavoidance and f ood processing. This V isual D ysphagiaQuestionnaire (VDQ) was piloted in 20 patients and is currentlyevaluated in a cohort of 150 adult EoE patients.Results: T he following 8 food c onsistency prototypes w ereidentified: soft foods (pudding, jelly), grits, toast bread, Frenchfries, dry rice, ground meat, raw fibrous f oods (eg. apple,carrot), s olid m eat. Dysphagia was r anked o n a 4-point Likertscale (0=no difficulties; 3= severe difficulties, food will not pass).First analysis demonstrated that severity of dysphagia is relatedto the eosinophil load and presence of esophageal strictures.Conclusions: T he VDQ i s the first EoE-specific tool f orassessing dysphagia caused by i nternationally-standardizedfoods of different consistencies. This instrument also addressesfood avoidance behaviour and food processing habits. This toolperformed well in a p ilot study a nd is currently evaluated in acohort of 150 adult EoE patients.

Native homing endonucleases can target conserved genes in humans and in animal models.

In recent years, both homing endonucleases (HEases) and zinc-finger nucleases (ZFNs) have been engineered and selected for the targeting of desired human loci for gene therapy. However, enzyme engineering is lengthy and expensive and the off-target effect of the manufactured endonucleases is difficult to predict. Moreover, enzymes selected to cleave a human DNA locus may not cleave the homologous locus in the genome of animal models because of sequence divergence, thus hampering attempts to assess the in vivo efficacy and safety of any engineered enzyme prior to its application in human trials. Here, we show that naturally occurring HEases can be found, that cleave desirable human targets. Some of these enzymes are also shown to cleave the homologous sequence in the genome of animal models. In addition, the distribution of off-target effects may be more predictable for native HEases. Based on our experimental observations, we present the HomeBase algorithm, database and web server that allow a high-throughput computational search and assignment of HEases for the targeting of specific loci in the human and other genomes. We validate experimentally the predicted target specificity of candidate fungal, bacterial and archaeal HEases using cell free, yeast and archaeal assays.

Visual activity predicts auditory recovery from deafness after adult cochlear implantation.

Modern cochlear implantation technologies allow deaf patients to understand auditory speech; however, the implants deliver only a coarse auditory input and patients must use long-term adaptive processes to achieve coherent percepts. In adults with post-lingual deafness, the high progress of speech recovery is observed during the first year after cochlear implantation, but there is a large range of variability in the level of cochlear implant outcomes and the temporal evolution of recovery. It has been proposed that when profoundly deaf subjects receive a cochlear implant, the visual cross-modal reorganization of the brain is deleterious for auditory speech recovery. We tested this hypothesis in post-lingually deaf adults by analysing whether brain activity shortly after implantation correlated with the level of auditory recovery 6 months later. Based on brain activity induced by a speech-processing task, we found strong positive correlations in areas outside the auditory cortex. The highest positive correlations were found in the occipital cortex involved in visual processing, as well as in the posterior-temporal cortex known for audio-visual integration. The other area, which positively correlated with auditory speech recovery, was localized in the left inferior frontal area known for speech processing. Our results demonstrate that the visual modality's functional level is related to the proficiency level of auditory recovery. Based on the positive correlation of visual activity with auditory speech recovery, we suggest that visual modality may facilitate the perception of the word's auditory counterpart in communicative situations. The link demonstrated between visual activity and auditory speech perception indicates that visuoauditory synergy is crucial for cross-modal plasticity and fostering speech-comprehension recovery in adult cochlear-implanted deaf patients.