Multisensory Integration and Perceptual Enhancement

We perceive our environment through multiple sensory channels. Nonetheless, research has traditionally focused on the investigation of sensory processing within single modalities. Thus, investigating how our brain integrates multisensory information is of crucial importance for understanding how organisms cope with a constantly changing and dynamic environment. During my thesis I have investigated how multisensory events impact our perception and brain responses, either when auditory-visual stimuli were presented simultaneously or how multisensory events at one point in time impact later unisensory processing. In "Looming signals reveal synergistic principles of multisensory integration" (Cappe, Thelen et al., 2012) we investigated the neuronal substrates involved in motion detection in depth under multisensory vs. unisensory conditions. We have shown that congruent auditory-visual looming (i.e. approaching) signals are preferentially integrated by the brain. Further, we show that early effects under these conditions are relevant for behavior, effectively speeding up responses to these combined stimulus presentations. In "Electrical neuroimaging of memory discrimination based on single-trial multisensory learning" (Thelen et al., 2012), we investigated the behavioral impact of single encounters with meaningless auditory-visual object parings upon subsequent visual object recognition. In addition to showing that these encounters lead to impaired recognition accuracy upon repeated visual presentations, we have shown that the brain discriminates images as soon as ~100ms post-stimulus onset according to the initial encounter context. In "Single-trial multisensory memories affect later visual and auditory object recognition" (Thelen et al., in review) we have addressed whether auditory object recognition is affected by single-trial multisensory memories, and whether recognition accuracy of sounds was similarly affected by the initial encounter context as visual objects. We found that this is in fact the case. We propose that a common underlying brain network is differentially involved during encoding and retrieval of images and sounds based on our behavioral findings. - Nous percevons l'environnement qui nous entoure à l'aide de plusieurs organes sensoriels. Antérieurement, la recherche sur la perception s'est focalisée sur l'étude des systèmes sensoriels indépendamment les uns des autres. Cependant, l'étude des processus cérébraux qui soutiennent l'intégration de l'information multisensorielle est d'une importance cruciale pour comprendre comment notre cerveau travail en réponse à un monde dynamique en perpétuel changement. Pendant ma thèse, j'ai ainsi étudié comment des événements multisensoriels impactent notre perception immédiate et/ou ultérieure et comment ils sont traités par notre cerveau. Dans l'étude " Looming signals reveal synergistic principles of multisensory integration" (Cappe, Thelen et al., 2012), nous nous sommes intéressés aux processus neuronaux impliqués dans la détection de mouvements à l'aide de l'utilisation de stimuli audio-visuels seuls ou combinés. Nos résultats ont montré que notre cerveau intègre de manière préférentielle des stimuli audio-visuels combinés s'approchant de l'observateur. De plus, nous avons montré que des effets précoces, observés au niveau de la réponse cérébrale, influencent notre comportement, en accélérant la détection de ces stimuli. Dans l'étude "Electrical neuroimaging of memory discrimination based on single-trial multisensory learning" (Thelen et al., 2012), nous nous sommes intéressés à l'impact qu'a la présentation d'un stimulus audio-visuel sur l'exactitude de reconnaissance d'une image. Nous avons étudié comment la présentation d'une combinaison audio-visuelle sans signification, impacte, au niveau comportementale et cérébral, sur la reconnaissance ultérieure de l'image. Les résultats ont montré que l'exactitude de la reconnaissance d'images, présentées dans le passé, avec un son sans signification, est inférieure à celle obtenue dans le cas d'images présentées seules. De plus, notre cerveau différencie ces deux types de stimuli très tôt dans le traitement d'images. Dans l'étude "Single-trial multisensory memories affect later visual and auditory object recognition" (Thelen et al., in review), nous nous sommes posés la question si l'exactitude de ia reconnaissance de sons était affectée de manière semblable par la présentation d'événements multisensoriels passés. Ceci a été vérifié par nos résultats. Nous avons proposé que cette similitude puisse être expliquée par le recrutement différentiel d'un réseau neuronal commun.

EEG alpha activity reflects motor preparation rather than the mode of action selection

Alpha-band activity (8-13 Hz) is not only suppressed by sensory stimulation and movements, but also modulated by attention, working memory and mental tasks, and could be sensitive to higher motor control functions. The aim of the present study was to examine alpha oscillatory activity during the preparation of simple left or right finger movements, contrasting the external and internal mode of action selection. Three preparation conditions were examined using a precueing paradigm with S1 as the preparatory and S2 as the imperative cue: Full, laterality instructed by S1; Free, laterality freely selected and None, laterality instructed by S2. Time-frequency (TF) analysis was performed in the alpha frequency range during the S1-S2 interval, and alpha motor-related amplitude asymmetries (MRAA) were also calculated. The significant MRAA during the Full and Free conditions indicated effective external and internal motor response preparation. In the absence of specific motor preparation (None), a posterior alpha event-related desynchronization (ERD) dominated, reflecting the main engagement of attentional resources. In Full and Free motor preparation, posterior alpha ERD was accompanied by a midparietal alpha event-related synchronization (ERS), suggesting a concomitant inhibition of task-irrelevant visual activity. In both Full and Free motor preparation, analysis of alpha power according to MRAA amplitude revealed two types of functional activation patterns: (1) a motor alpha pattern, with predominantly midparietal alpha ERS and large MRAA corresponding to lateralized motor activation/visual inhibition and (2) an attentional alpha pattern, with dominating right posterior alpha ERD and small MRAA reflecting visuospatial attention. The present results suggest that alpha oscillatory patterns do not resolve the selection mode of action, but rather distinguish separate functional strategies of motor preparation.

Recirculating CD4 memory T cells mount rapid secondary responses without major contributions from follicular CD4 effectors and B cells.

For weeks after primary immunization with thymus-dependent antigens the responding lymph nodes contain effector CD4 T cells in T zones and germinal centers as well as recirculating memory T cells. Conversely, remote nodes, not exposed to antigen, only receive recirculating memory cells. We assessed whether lymph nodes with follicular effector CD4 T cells in addition to recirculating memory CD4 T cells mount a more rapid secondary response than nodes that only contain recirculating memory cells. Also, the extent to which T cell frequency governs accelerated CD4 T cell recall responses was tested. For this, secondary antibody responses to a superantigen, where the frequency of responding T cells is not increased at the time of challenge, were compared with those to conventional protein antigens. With both types of antigens similar accelerated responses were elicited in the node draining the site of primary immunization and in the contralateral node, not previously exposed to antigen. Thus recirculating memory cells are fully capable of mounting accelerated secondary responses, without the assistance of CD4 effector T cells, and accelerated memory responses are not solely dependent on higher T cell frequencies. Accelerated memory CD4 T cell responses were also seen in B cell-deficient mice.

Visual activity predicts auditory recovery from deafness after adult cochlear implantation.

Modern cochlear implantation technologies allow deaf patients to understand auditory speech; however, the implants deliver only a coarse auditory input and patients must use long-term adaptive processes to achieve coherent percepts. In adults with post-lingual deafness, the high progress of speech recovery is observed during the first year after cochlear implantation, but there is a large range of variability in the level of cochlear implant outcomes and the temporal evolution of recovery. It has been proposed that when profoundly deaf subjects receive a cochlear implant, the visual cross-modal reorganization of the brain is deleterious for auditory speech recovery. We tested this hypothesis in post-lingually deaf adults by analysing whether brain activity shortly after implantation correlated with the level of auditory recovery 6 months later. Based on brain activity induced by a speech-processing task, we found strong positive correlations in areas outside the auditory cortex. The highest positive correlations were found in the occipital cortex involved in visual processing, as well as in the posterior-temporal cortex known for audio-visual integration. The other area, which positively correlated with auditory speech recovery, was localized in the left inferior frontal area known for speech processing. Our results demonstrate that the visual modality's functional level is related to the proficiency level of auditory recovery. Based on the positive correlation of visual activity with auditory speech recovery, we suggest that visual modality may facilitate the perception of the word's auditory counterpart in communicative situations. The link demonstrated between visual activity and auditory speech perception indicates that visuoauditory synergy is crucial for cross-modal plasticity and fostering speech-comprehension recovery in adult cochlear-implanted deaf patients.

Olfactory cues potentiate learning of distant visuospatial information

The influence of proximal olfactory cues on place learning and memory was tested in two different spatial tasks. Rats were trained to find a hole leading to their home cage or a single food source in an array of petri dishes. The two apparatuses differed both by the type of reinforcement (return to the home cage or food reward) and the local characteristics of the goal (masked holes or salient dishes). In both cases, the goal was in a fixed location relative to distant visual landmarks and could be marked by a local olfactory cue. Thus, the position of the goal was defined by two sets of redundant cues, each of which was sufficient to allow the discrimination of the goal location. These experiments were conducted with two strains of hooded rats (Long-Evans and PVG), which show different speeds of acquisition in place learning tasks. They revealed that the presence of an olfactory cue marking the goal facilitated learning of its location and that the facilitation persisted after the removal of the cue. Thus, the proximal olfactory cue appeared to potentiate learning and memory of the goal location relative to distant environmental cues. This facilitating effect was only detected when the expression of spatial memory was not already optimal, i.e., during the early phase of acquisition. It was not limited to a particular strain.

Dynamic changes in brain functional connectivity during concurrent dual-task performance.

This study investigated the spatial, spectral, temporal and functional proprieties of functional brain connections involved in the concurrent execution of unrelated visual perception and working memory tasks. Electroencephalography data was analysed using a novel data-driven approach assessing source coherence at the whole-brain level. Three connections in the beta-band (18-24 Hz) and one in the gamma-band (30-40 Hz) were modulated by dual-task performance. Beta-coherence increased within two dorsofrontal-occipital connections in dual-task conditions compared to the single-task condition, with the highest coherence seen during low working memory load trials. In contrast, beta-coherence in a prefrontal-occipital functional connection and gamma-coherence in an inferior frontal-occipitoparietal connection was not affected by the addition of the second task and only showed elevated coherence under high working memory load. Analysis of coherence as a function of time suggested that the dorsofrontal-occipital beta-connections were relevant to working memory maintenance, while the prefrontal-occipital beta-connection and the inferior frontal-occipitoparietal gamma-connection were involved in top-down control of concurrent visual processing. The fact that increased coherence in the gamma-connection, from low to high working memory load, was negatively correlated with faster reaction time on the perception task supports this interpretation. Together, these results demonstrate that dual-task demands trigger non-linear changes in functional interactions between frontal-executive and occipitoparietal-perceptual cortices.

Generation and function of mouse central memory and effector memory T cells

1. SUMMARY Based on functional and homing properties, two subsets of memory T lymphocytes have been defined both in humans and in mice. Central memory T cells (TCM cells) express the lymph node homing receptors CD62L and CCR7, have poor effector function and proliferate efficiently upon antigenic stimulation. Effector memory T cells (TEM cells) do not express CCR7, are mostly CD62L negative and therefore are excluded from lymph nodes, but are able to migrate to sites of inflammation where they exert immediate effector function by producing inflammatory cytokines and cytotoxic mediators. In the present work we have addressed two questions that emerged since the definition of TCM and TEM cells. Firstly, what are the priming conditions for generation of TCM and TEM and, secondly, what is the migratory capacity of TCM and TEM cells in inflammatory conditions. By using naive TCR-transgenic OT-I CD8+ T cells and OT-II CD4+ T cells and ovalbumin pulsed-mature dendritic cells (DCs) we set up an in vitro system in which the strength of T cell stimulation is controlled by varying the ratio of T cells and DCs and the duration of DC-T cell interaction. Using this system we found that precursors of TCM and TEM cells are generated at different strength of stimulation and that T cells capable of persisting in vivo in the absence of antigen and of mounting recall responses is optimally induced by intermediate stimulatory strength. In addition, we found that lymph nodes draining sites of mature DC or adjuvant inoculation recruit CD8+ CD62L- CCR7- effector and TEM cells. CD8+ T cell recruitment in reactive lymph nodes requires CXCR3 expression on T cells and occurs through high endothelial venules (HEVs) in concert with HEV lurninal expression of the CXCR3 ligand CXCL9. In reactive lymph nodes, recruited T cells establish stable interactions with and kill antigen-bearing DCs, limiting the ability of these DCs to activate CD4+ and CD8+ T cells. Taken togther these data define conditions for the generation of TCM and TEM cells and define an inflammatory pathway of effector T cell migration in lymph nodes. The inducible recruitment of blood-borne effector and TEM CD8+ cells to lymph nodes may represent a mechanism for terminating primary and limiting secondary immune responses.

Cognition and brain function in schizotypy : a selective review

Schizotypy refers to a set of personality traits thought to reflect the subclinical expression of the signs and symptoms of schizophrenia. Here, we review the cognitive and brain functional profile associated with high questionnaire scores in schizotypy. We discuss empirical evidence from the domains of perception, attention, memory, imagery and representation, language, and motor control. Perceptual deficits occur early and across various modalities. Whilst the neural mechanisms underlying visual impairments may be linked to magnocellular dysfunction, further effects may be seen downstream in higher cognitive functions. Cognitive deficits are observed in inhibitory control, selective and sustained attention, incidental learning and memory. In concordance with the cognitive nature of many of the aberrations of schizotypy, higher levels of schizotypy are associated with enhanced vividness and better performance on tasks of mental rotation. Language deficits seem most pronounced in higher-level processes. Finally, higher levels of schizotypy are associated with reduced performance on oculomotor tasks, resembling the impairments seen in schizophrenia. Some of these deficits are accompanied by reduced brain activation, akin to the pattern of hypoactivations in schizophrenia spectrum individuals. We conclude that schizotypy is a construct with apparent phenomenological overlap with schizophrenia and stable inter-individual differences that covary with performance on a wide range of perceptual, cognitive and motor tasks known to be impaired in schizophrenia. The importance of these findings lies not only in providing a fine-grained neurocognitive characterisation of a personality constellation known to be associated with real-life impairments, but also in generating hypotheses concerning the aetiology of schizophrenia.

Auditory Neurons with Transitory Axons to Visual Areas Form Short Permanent Projections.

The kitten's auditory cortex (including the first and second auditory fields AI and AII) is known to send transient axons to either ipsi- or contralateral visual areas 17 and 18. By the end of the first postnatal month the transitory axons, but not their neurons of origin, are eliminated. Here we investigated where these neurons project after the elimination of the transitory axon. Eighteen kittens received early (postnatal day (pd) 2 - 5) injections of long lasting retrograde fluorescent traces in visual areas 17 and 18 and late (pd 35 - 64) injections of other retrograde fluorescent tracers in either hemisphere, mostly in areas known to receive projections from AI and AII in the adult cat. The middle ectosylvian gyrus was analysed for double-labelled neurons in the region corresponding approximately to AI and AII. Late injections in the contralateral (to the analysed AI, AII) hemisphere including all of the known auditory areas, as well as some visual and 'association' areas, did not relabel neurons which had had transient projections to either ipsi- or contralateral visual areas 17 - 18. Thus, AI and AII neurons after eliminating their transient juvenile projections to visual areas 17 and 18 do not project to the other hemisphere. In contrast, relabelling was obtained with late injections in several locations in the ipsilateral hemisphere; it was expressed as per cent of the population labelled by the early injections. Few neurons (0 - 2.5%) were relabelled by large injections in the caudal part of the posterior ectosylvian gyrus and the adjacent posterior suprasylvian sulcus (areas DP, P, VP). Multiple injections in the middle ectosylvian gyrus relabelled a considerably larger percentage of neurons (13%). Single small injections in the middle ectosylvian gyrus (areas AI, AII), the caudal part of the anterior ectosylvian gyrus and the rostral part of the posterior ectosylvian gyrus relabelled 3.1 - 7.0% of neurons. These neurons were generally near (<2.0 mm) the outer border of the late injection sites. Neurons with transient projections to ipsi- or contralateral visual areas 17 and 18 were relabelled in similar proportions by late injections at any given location. Thus, AI or AII neurons which send a transitory axon to ipsi- or contralateral visual areas 17 and 18 are most likely to form short permanent cortical connections. In that respect, they are similar to medial area 17 neurons that form transitory callosal axons and short permanent axons to ipsilateral visual areas 17 and 18.