Selective integration of auditory-visual looming cues by humans.

An object's motion relative to an observer can confer ethologically meaningful information. Approaching or looming stimuli can signal threats/collisions to be avoided or prey to be confronted, whereas receding stimuli can signal successful escape or failed pursuit. Using movement detection and subjective ratings, we investigated the multisensory integration of looming and receding auditory and visual information by humans. While prior research has demonstrated a perceptual bias for unisensory and more recently multisensory looming stimuli, none has investigated whether there is integration of looming signals between modalities. Our findings reveal selective integration of multisensory looming stimuli. Performance was significantly enhanced for looming stimuli over all other multisensory conditions. Contrasts with static multisensory conditions indicate that only multisensory looming stimuli resulted in facilitation beyond that induced by the sheer presence of auditory-visual stimuli. Controlling for variation in physical energy replicated the advantage for multisensory looming stimuli. Finally, only looming stimuli exhibited a negative linear relationship between enhancement indices for detection speed and for subjective ratings. Maximal detection speed was attained when motion perception was already robust under unisensory conditions. The preferential integration of multisensory looming stimuli highlights that complex ethologically salient stimuli likely require synergistic cooperation between existing principles of multisensory integration. A new conceptualization of the neurophysiologic mechanisms mediating real-world multisensory perceptions and action is therefore supported.

Décrire et convaincre: rhétoriques visuelles de la cinématographie en médecine [Describe and convince: visual rhetoric of cinematography in medicine]

The tools of visualisation occupy a central place in medicine. Far from being simple accessories of glance, they literally constitute objects of medicine. Such empirical acknowledgement and epistemological position open a vast field of investigation: visual technologies of medical knowledge. This article studies the development and transformation of medical objects which have permitted to assess the role of temporality in the epistemology of medicine. It firstly examines the general problem of the relationships between cinema, animated image and medicine and secondly, the contribution of the German doctor Martin Weiser to medical cinematography as a method. Finally, a typology is sketched out organising the variety of the visual technology of movement under the perspective of the development of specific visual techniques in medicine.

Net increase of lactate and glutamate concentration in activated human visual cortex detected with magnetic resonance spectroscopy at 7 tesla.

After the landmark studies reporting changes in the cerebral metabolic rate of glucose (CMRGlc ) in excess of those in oxygen (CMRO2 ) during physiological stimulation, several studies have examined the fate of the extra carbon taken up by the brain, reporting a wide range of changes in brain lactate from 20% to 250%. The present study reports functional magnetic resonance spectroscopy measurements at 7 Tesla using the enhanced sensitivity to study a small cohort (n = 6). Small increases in lactate (19% ± 4%, P < 0.05) and glutamate (4% ± 1%, P < 0.001) were seen within the first 2 min of activation. With the exception of glucose (12% ± 5%, P < 0.001), no other metabolite concentration changes beyond experimental error were significantly observed. Therefore, the present study confirms that lactate and glutamate changes during physiological stimulation are small (i.e. below 20%) and shows that the increased sensitivity allows reproduction of previous results with fewer subjects. In addition, the initial rate of glutamate and lactate concentration increases implies an increase in CMRO2 that is slightly below that of CMRGlc during the first 1-2 min of activation.

Visual loss after orthopedic procedures.

Perioperative visual loss (PVL) is a very rare and unpredictable complication of surgery performed at distance from the visual pathways, mostly after spine or cardiac procedures. We report 6 consecutive patients with PVL after routine orthopedic procedures (osteosynthesis for complex fracture of the femur [2], total hip arthroplasty [2], hip prosthesis arthroplasty [1], bilateral simultaneous total knee arthroplasty [1]) and reviewed the literature on the subject. An ischemic optic neuropathy was diagnosed in all cases, and visual loss was bilateral in 5 of 6 patients. Partial visual improvement occurred in only 3 of 11 eyes. No specific therapy is available for PVL. Postoperative visual disturbances should prompt without delay an ophthalmic evaluation because emergent correction of anemia, systemic hypotension, or hypovolemia might improve visual prognosis of PVL.

Time processing in visual cortices: How the visual brain encodes and keeps track of time

Time is embedded in any sensory experience: the movements of a dance, the rhythm of a piece of music, the words of a speaker are all examples of temporally structured sensory events. In humans, if and how visual cortices perform temporal processing remains unclear. Here we show that both primary visual cortex (V1) and extrastriate area V5/MT are causally involved in encoding and keeping time in memory and that this involvement is independent from low-level visual processing. Most importantly we demonstrate that V1 and V5/MT are functionally linked and temporally synchronized during time encoding whereas they are functionally independent and operate serially (V1 followed by V5/MT) while maintaining temporal information in working memory. These data challenge the traditional view of V1 and V5/MT as visuo-spatial features detectors and highlight the functional contribution and the temporal dynamics of these brain regions in the processing of time in millisecond range. The present project resulted in the paper entitled: 'How the visual brain encodes and keeps track of time' by Paolo Salvioni, Lysiann Kalmbach, Micah Murray and Domenica Bueti that is now submitted for publication to the Journal of Neuroscience.

Interchange of callosal and association projections in the developing visual cortex.

Neurons projecting transitorily into the corpus callosum from area 17 of the cat were retrogradely labeled by the fluorescent tracer Fast Blue (FB) injected into contralateral areas 17 and 18 on postnatal days 1-5. During the second postnatal month these neurons were still labeled by the early injection, although they had eliminated their callosal axon. At this time, 15-20% of these neurons could be retrogradely relabeled by injections of Diamidino Yellow (DY) into ipsilateral areas 17 and 18, but few or none by similar injections in the other areas that receive from area 17 (19, 21a, PMLS, 20a, 20b, DLS). Similarly, area 17 neurons projecting transitorily to contralateral area PMLS during the first postnatal week could be relabeled by DY injections in ipsilateral areas 17 and 18 but not in PMLS. Already around birth, many transitorily callosal neurons in area 17 send bifurcating axons both to contralateral areas 17 and 18 and ipsilateral area 18. It is probable that during postnatal development some of these neurons selectively eliminate their callosal axon collaterals and maintain the projection to ipsilateral area 18. In fact, some transitorily callosal neurons in area 17 can be double-labeled by simultaneous perinatal injections of FB in contralateral areas 17 and 18 and of a new long-lasting retrograde tracer, rhodamine-conjugated latex microspheres, in ipsilateral area 18. The same neurons can then be relabeled by reinjecting ipsilateral area 18 with DY during the second postnatal month. This finding, however, does not exclude the possibility that some transitorily callosal neurons send an axon to ipsilateral area 18 after eliminating their callosal axon. In conclusion, area 17 neurons that project transitorily through the corpus callosum later participate, probably permanently, in ipsilateral corticocortical projections but selectively to areas 17-18. The mechanism responsible for this selectivity is unknown, but it may be related to the differential radial distribution (i.e., to birth date) of area 17 neurons engaged in the various corticocortical projections. The problems raised by the use of long-lasting retrograde fluorescent tracers in neurodevelopmental studies and by the quantification of results of double- and triple-labeling paradigms are also discussed.

Comparison of early cortical networks in efficient and inefficient visual search: an event-related potential study.

Functional magnetic resonance imaging studies have indicated that efficient feature search (FS) and inefficient conjunction search (CS) activate partially distinct frontoparietal cortical networks. However, it remains a matter of debate whether the differences in these networks reflect differences in the early processing during FS and CS. In addition, the relationship between the differences in the networks and spatial shifts of attention also remains unknown. We examined these issues by applying a spatio-temporal analysis method to high-resolution visual event-related potentials (ERPs) and investigated how spatio-temporal activation patterns differ for FS and CS tasks. Within the first 450 msec after stimulus onset, scalp potential distributions (ERP maps) revealed 7 different electric field configurations for each search task. Configuration changes occurred simultaneously in the two tasks, suggesting that contributing processes were not significantly delayed in one task compared to the other. Despite this high spatial and temporal correlation, two ERP maps (120-190 and 250-300 msec) differed between the FS and CS. Lateralized distributions were observed only in the ERP map at 250-300 msec for the FS. This distribution corresponds to that previously described as the N2pc component (a negativity in the time range of the N2 complex over posterior electrodes of the hemisphere contralateral to the target hemifield), which has been associated with the focusing of attention onto potential target items in the search display. Thus, our results indicate that the cortical networks involved in feature and conjunction searching partially differ as early as 120 msec after stimulus onset and that the differences between the networks employed during the early stages of FS and CS are not necessarily caused by spatial attention shifts.

Modified Corneal Collagen Crosslinking (CXL) Reduces Corneal Edema and Diurnal Visual Fluctuations in Fuchs' Dystrophy

Purpose: Crosslinking of corneal collagen with riboflavin and ultraviolet-A irradiation (CXL) induces crosslinks within and between collagen fibers. CXL increases corneal biomechanical and biochemical stability and is currently used clinically to treat keratectasia. CXL also significantly reduces the stromal swelling capacity. We investigated whether a modified CXL treatment protocol would be beneficial in early Fuchs' dystrophy with various degrees of corneal edema and diurnal variations in visual acuity. Methods: CXL was performed as published previously with the following modification: in cases where the stroma was thicker than 450 µm after abrasion and 30 minutes of instillation of isoosmolar riboflavin solution, glycerol 70% solution was applied every 5 seconds for two minutes, and central corneal thickness (CCT) was measured using ultrasound pachymetry. Glycerol 70% solution was administered repeatedly until the target corneal thickness of 370-430 µm was reached. During irradiation, CCT was monitored by ultrasound pachymetry every five minutes and glycerol 70% solution was applied, if necessary. Results: Three eyes in two patients were treated using the modified CXL protocol. Representative case: a 50-year-old woman with Fuchs' dystrophy and a history of 3 years of diurnal visual fluctuations was referred to us in March 2008. Preoperative best spectacle-corrected visual acuity (BSCVA) was 20/50. We performed modified CXL in the left eye. At one month after CXL, Scheimpflug analysis of CCT showed a reduction of more than 100 µm, and the Corneal Thickness Spatial Profile (CTSP) and Percentage of Increase in Thickness (PIT) showed a regularization of the "flattening" typical for Fuchs' dystrophy. Accordingly, diurnal analysis of corneal thickness showed a distinct postoperative reduction in CCT at all time points measured. At one month after CXL, the patient reported a reduction of diurnal visual fluctuations and we measured an increase in BSCVA to 20/32. The patient showed stable topographical and visual acuity at the three months follow-up. Conclusions: We saw a distinct reduction in CCT, an improvement of the corneal thickness spatial profile (CTSP) and an increase in BSCVA at one month after treatment, which remained stable at the three months follow-up. Patients with early Fuchs' dystrophy and disturbing diurnal visual fluctuations represent a novel application for CXL. Although CXL may not prevent the outcome of the dystrophy, it may increase the patients' visual comfort until keratoplasty becomes necessary.

Auditory-visual multisensory interactions in humans: timing, topography, directionality, and sources.

Current models of brain organization include multisensory interactions at early processing stages and within low-level, including primary, cortices. Embracing this model with regard to auditory-visual (AV) interactions in humans remains problematic. Controversy surrounds the application of an additive model to the analysis of event-related potentials (ERPs), and conventional ERP analysis methods have yielded discordant latencies of effects and permitted limited neurophysiologic interpretability. While hemodynamic imaging and transcranial magnetic stimulation studies provide general support for the above model, the precise timing, superadditive/subadditive directionality, topographic stability, and sources remain unresolved. We recorded ERPs in humans to attended, but task-irrelevant stimuli that did not require an overt motor response, thereby circumventing paradigmatic caveats. We applied novel ERP signal analysis methods to provide details concerning the likely bases of AV interactions. First, nonlinear interactions occur at 60-95 ms after stimulus and are the consequence of topographic, rather than pure strength, modulations in the ERP. AV stimuli engage distinct configurations of intracranial generators, rather than simply modulating the amplitude of unisensory responses. Second, source estimations (and statistical analyses thereof) identified primary visual, primary auditory, and posterior superior temporal regions as mediating these effects. Finally, scalar values of current densities in all of these regions exhibited functionally coupled, subadditive nonlinear effects, a pattern increasingly consistent with the mounting evidence in nonhuman primates. In these ways, we demonstrate how neurophysiologic bases of multisensory interactions can be noninvasively identified in humans, allowing for a synthesis across imaging methods on the one hand and species on the other.

Quantitative distribution of parvalbumin, calretinin, and calbindin D-28k immunoreactive neurons in the visual cortex of normal and Alzheimer cases.

The distribution of parvalbumin (PV), calretinin (CR), and calbindin (CB) immunoreactive neurons was studied with the help of an image analysis system (Vidas/Zeiss) in the primary visual area 17 and associative area 18 (Brodmann) of Alzheimer and control brains. In neither of these areas was there a significant difference between Alzheimer and control groups in the mean number of PV, CR, or CB immunoreactive neuronal profiles, counted in a cortical column going from pia to white matter. Significant differences in the mean densities (numbers per square millimeter of cortex) of PV, CR, and CB immunoreactive neuronal profiles were not observed either between groups or areas, but only between superficial, middle, and deep layers within areas 17 and 18. The optical density of the immunoreactive neuropil was also similar in Alzheimer and controls, correlating with the numerical density of immunoreactive profiles in superficial, middle, and deep layers. The frequency distribution of neuronal areas indicated significant differences between PV, CR, and CB immunoreactive neuronal profiles in both areas 17 and 18, with more large PV than CR and CB positive profiles. There were also significantly more small and less large PV and CR immunoreactive neuronal profiles in Alzheimer than in controls. Our data show that, although the brain pathology is moderate to severe, there is no prominent decrease of PV, CR and CB positive neurons in the visual cortex of Alzheimer brains, but only selective changes in neuronal perikarya.

Visual functions in the healthy and schizophrenic brain : from stimulus control to illusory perceptions using electrical neuroimaging

ABSTRACT (FRENCH)Ce travail de thèse basé sur le système visuel chez les sujets sains et chez les patients schizophrènes, s'articule autour de trois articles scientifiques publiés ou en cours de publication. Ces articles traitent des sujets suivants : le premier article présente une nouvelle méthode de traitement des composantes physiques des stimuli (luminance et fréquence spatiale). Le second article montre, à l'aide d'analyses de données EEG, un déficit de la voie magnocellulaire dans le traitement visuel des illusions chez les patients schizophrènes. Ceci est démontré par l'absence de modulation de la composante PI chez les patients schizophrènes contrairement aux sujets sains. Cette absence est induite par des stimuli de type illusion Kanizsa de différentes excentricités. Finalement, le troisième article, également à l'aide de méthodes de neuroimagerie électrique (EEG), montre que le traitement des contours illusoires se trouve dans le complexe latéro-occipital (LOC), à l'aide d'illusion « misaligned gratings ». De plus il révèle que les activités démontrées précédemment dans les aires visuelles primaires sont dues à des inférences « top- down ».Afin de permettre la compréhension de ces trois articles, l'introduction de ce manuscrit présente les concepts essentiels. De plus des méthodes d'analyses de temps-fréquence sont présentées. L'introduction est divisée en quatre parties : la première présente le système visuel depuis les cellules retino-corticales aux deux voix du traitement de l'information en passant par les régions composant le système visuel. La deuxième partie présente la schizophrénie par son diagnostic, ces déficits de bas niveau de traitement des stimuli visuel et ces déficits cognitifs. La troisième partie présente le traitement des contours illusoires et les trois modèles utilisés dans le dernier article. Finalement, les méthodes de traitement des données EEG seront explicitées, y compris les méthodes de temps-fréquences.Les résultats des trois articles sont présentés dans le chapitre éponyme (du même nom). De plus ce chapitre comprendra les résultats obtenus à l'aide des méthodes de temps-fréquenceFinalement, la discussion sera orientée selon trois axes : les méthodes de temps-fréquence ainsi qu'une proposition de traitement de ces données par une méthode statistique indépendante de la référence. La discussion du premier article en montrera la qualité du traitement de ces stimuli. La discussion des deux articles neurophysiologiques, proposera de nouvelles d'expériences afin d'affiner les résultats actuels sur les déficits des schizophrènes. Ceci pourrait permettre d'établir un marqueur biologique fiable de la schizophrénie.ABSTRACT (ENGLISH)This thesis focuses on the visual system in healthy subjects and schizophrenic patients. To address this research, advanced methods of analysis of electroencephalographic (EEG) data were used and developed. This manuscript is comprised of three scientific articles. The first article showed a novel method to control the physical features of visual stimuli (luminance and spatial frequencies). The second article showed, using electrical neuroimaging of EEG, a deficit in spatial processing associated with the dorsal pathway in chronic schizophrenic patients. This deficit was elicited by an absent modulation of the PI component in terms of response strength and topography as well as source estimations. This deficit was orthogonal to the preserved ability to process Kanizsa-type illusory contours. Finally, the third article resolved ongoing debates concerning the neural mechanism mediating illusory contour sensitivity by using electrical neuroimaging to show that the first differentiation of illusory contour presence vs. absence is localized within the lateral occipital complex. This effect was subsequent to modulations due to the orientation of misaligned grating stimuli. Collectively, these results support a model where effects in V1/V2 are mediated by "top-down" modulation from the LOC.To understand these three articles, the Introduction of this thesis presents the major concepts used in these articles. Additionally, a section is devoted to time-frequency analysis methods not presented in the articles themselves. The introduction is divided in four parts. The first part presents three aspects of the visual system: cellular, regional, and its functional interactions. The second part presents an overview of schizophrenia and its sensoiy-cognitive deficits. The third part presents an overview of illusory contour processing and the three models examined in the third article. Finally, advanced analysis methods for EEG are presented, including time- frequency methodology.The Introduction is followed by a synopsis of the main results in the articles as well as those obtained from the time-frequency analyses.Finally, the Discussion chapter is divided along three axes. The first axis discusses the time frequency analysis and proposes a novel statistical approach that is independent of the reference. The second axis contextualizes the first article and discusses the quality of the stimulus control and direction for further improvements. Finally, both neurophysiologic articles are contextualized by proposing future experiments and hypotheses that may serve to improve our understanding of schizophrenia on the one hand and visual functions more generally.

Auditory motion affects visual biological motion processing.

The processing of biological motion is a critical, everyday task performed with remarkable efficiency by human sensory systems. Interest in this ability has focused to a large extent on biological motion processing in the visual modality (see, for example, Cutting, J. E., Moore, C., & Morrison, R. (1988). Masking the motions of human gait. Perception and Psychophysics, 44(4), 339-347). In naturalistic settings, however, it is often the case that biological motion is defined by input to more than one sensory modality. For this reason, here in a series of experiments we investigate behavioural correlates of multisensory, in particular audiovisual, integration in the processing of biological motion cues. More specifically, using a new psychophysical paradigm we investigate the effect of suprathreshold auditory motion on perceptions of visually defined biological motion. Unlike data from previous studies investigating audiovisual integration in linear motion processing [Meyer, G. F. & Wuerger, S. M. (2001). Cross-modal integration of auditory and visual motion signals. Neuroreport, 12(11), 2557-2560; Wuerger, S. M., Hofbauer, M., & Meyer, G. F. (2003). The integration of auditory and motion signals at threshold. Perception and Psychophysics, 65(8), 1188-1196; Alais, D. & Burr, D. (2004). No direction-specific bimodal facilitation for audiovisual motion detection. Cognitive Brain Research, 19, 185-194], we report the existence of direction-selective effects: relative to control (stationary) auditory conditions, auditory motion in the same direction as the visually defined biological motion target increased its detectability, whereas auditory motion in the opposite direction had the inverse effect. Our data suggest these effects do not arise through general shifts in visuo-spatial attention, but instead are a consequence of motion-sensitive, direction-tuned integration mechanisms that are, if not unique to biological visual motion, at least not common to all types of visual motion. Based on these data and evidence from neurophysiological and neuroimaging studies we discuss the neural mechanisms likely to underlie this effect.