Interaction of directional, neuromuscular and egocentric constraints on the stability of preferred bimanual coordination patterns

We investigated how the relative direction of limb movements in external space (iso- and non-isodirectionality), muscular constraints (the relative timing of homologous muscle activation) and the egocentric frame of reference (moving simultaneously toward/away the longitudinal axis of the body) contribute to the stability of coordinated movements. In the first experiment, we attempted to determine the respective stability of isodirectional and non-isodirectional movements in between-persons coordination. In a second experiment, we determined the effect of the relative direction in external space, and of muscular constraints, on pattern stability during a within-person bimanual coordination task. In the third experiment we dissociated the effects on pattern stability of the muscular constraints, relative direction and egocentric frame of reference. The results showed that (1) simultaneous activation of homologous muscles resulted in more stable performance than simultaneous activation of non-homologous muscles during within-subject coordination, and that (2) isodirectional movements were more stable than non-isodirectional movements during between-persons coordination, confirming the role of the relative direction of the moving limbs in the stability of bimanual coordination. Moreover, the egocentric constraint was to some extent found distinguishable from the effect of the relative direction of the moving limbs in external space, and from the effect of the relative timing of muscle activation. In summary, the present study showed that relative direction of the moving limbs in external space and muscular constraints may interact either to stabilize or destabilize coordination patterns. (C) 2003 Published by Elsevier B.V.

Parental predictors of poor visual outcome with occlusion treatment for unilateral amblyopia

Aim: Visual acuity outcome of amblyopia treatment depends on the compliance. This study aimed to determine parental predictors of poor visual outcome with occlusion treatment in unilateral amblyopia and identify the relationship between occlusion recommendations and the patient's actual dose of occlusion reported by the parents. Methods: This study comprised three phases: refractive adaptation for a period of 18 weeks after spectacle correction; occlusion of 3 to 6 hours per day during a period of 6 months; questionnaire administration and completion by parents. Visual acuity as assessed using the Sheridan-Gardiner singles or Snellen acuity chart was used as a measure of visual outcome. Correlation analysis was used to describe the strength and direction of two variables: prescribed occlusion reported by the doctor and actual dose reported by parents. A logistic binary model was adjusted using the following variables: severity, vulnerability, self-efficacy, behaviour intentions, perceived efficacy and treatment barriers, parents' and childrens' age, and parents' level of education. Results: The study included 100 parents (mean age 38.9 years, SD approx 9.2) of 100 children (mean age 6.3 years, SD approx 2.4) with amblyopia. Twenty-eight percent of children had no improvement in visual acuity. The results showed a positive mild correlation (kappa = 0.54) between the prescribed occlusion and actual dose reported by parents. Three predictors for poor visual outcome with occlusion were identified: parents' level of education (OR = 9.28; 95%CI 1.32-65.41); treatment barriers (OR = 2.75; 95%CI 1.22-6.20); interaction between severity and vulnerability (OR = 3.64; 95%CI 1.21-10.93). Severity (OR = 0.07; 95%CI 0.00-0.72) and vulnerability (OR = 0.06; 95%CI 0.05-0.74) when considered in isolation were identified as protective factors. Conclusions: Parents frequently do not use the correct dosage of occlusion as recommended. Parents' educational level and awareness of treatment barriers were predictors of poor visual outcome. Lower levels of education represented a 9-times higher risk of having a poor visual outcome with occlusion treatment.

Agrupamento de dados visual interactivo

Com a crescente geração, armazenamento e disseminação da informação nos últimos anos, o anterior problema de falta de informação transformou-se num problema de extracção do conhecimento útil a partir da informação disponível. As representações visuais da informação abstracta têm sido utilizadas para auxiliar a interpretação os dados e para revelar padrões de outra forma escondidos. A visualização de informação procura aumentar a cognição humana aproveitando as capacidades visuais humanas, de forma a tornar perceptível a informação abstracta, fornecendo os meios necessários para que um humano possa absorver quantidades crescentes de informação, com as suas capacidades de percepção. O objectivo das técnicas de agrupamento de dados consiste na divisão de um conjunto de dados em vários grupos, em que dados semelhantes são colocados no mesmo grupo e dados dissemelhantes em grupos diferentes. Mais especificamente, o agrupamento de dados com restrições tem o intuito de incorporar conhecimento a priori no processo de agrupamento de dados, com o objectivo de aumentar a qualidade do agrupamento de dados e, simultaneamente, encontrar soluções apropriadas a tarefas e interesses específicos. Nesta dissertação é estudado a abordagem de Agrupamento de Dados Visual Interactivo que permite ao utilizador, através da interacção com uma representação visual da informação, incorporar o seu conhecimento prévio acerca do domínio de dados, de forma a influenciar o agrupamento resultante para satisfazer os seus objectivos. Esta abordagem combina e estende técnicas de visualização interactiva de informação, desenho de grafos de forças direccionadas e agrupamento de dados com restrições. Com o propósito de avaliar o desempenho de diferentes estratégias de interacção com o utilizador, são efectuados estudos comparativos utilizando conjuntos de dados sintéticos e reais.

Avaliação por fMRI do córtex visual, motor e auditivo através de estimulação sensoriomotora e sonora em desportistas invisuais e desportistas sem deficiência visual

Mestrado em Radiações Aplicadas às Tecnologias da Saúde - Ramo de especialização: Imagem por Ressonância Magnética

Effects of emotional valence and three-dimensionality of visual stimuli on brain activation: an fMRI study

BACKGROUND: Examining changes in brain activation linked with emotion-inducing stimuli is essential to the study of emotions. Due to the ecological potential of techniques such as virtual reality (VR), inspection of whether brain activation in response to emotional stimuli can be modulated by the three-dimensional (3D) properties of the images is important. OBJECTIVE: The current study sought to test whether the activation of brain areas involved in the emotional processing of scenarios of different valences can be modulated by 3D. Therefore, the focus was made on the interaction effect between emotion-inducing stimuli of different emotional valences (pleasant, unpleasant and neutral valences) and visualization types (2D, 3D). However, main effects were also analyzed.METHODS: The effect of emotional valence and visualization types and their interaction were analyzed through a 3x2 repeated measures ANOVA. Post-hoc t-tests were performed under a ROI-analysis approach. RESULTS: The results show increased brain activation for the 3D affective-inducing stimuli in comparison with the same stimuli in 2D scenarios, mostly in cortical and subcortical regions that are related to emotional processing, in addition to visual processing regions. CONCLUSIONS: This study has the potential of clarify brain mechanisms involved in the processing of emotional stimuli (scenarios’ valence) and their interaction with three-dimensionality.

A questão visual na oftalmologia pediátrica da região de Lisboa

RESUMO: Na parte inicial incluem-se algumas notas sucintas com base no panorama científico,histórico e cultural da visão considerada segundo três abordagens - o olho (o olho humano na especificidade da sua posição filogenética, elemento anátomo-funcional básico do sistema visual ao qual o cérebro pertence), os olhos (unidades gémeas essenciais do rosto na sua actividade consensual e conjugada da binocularidade), o olhar (carregado de expressão psicológica e o seu efeito sobre o observador, sinal para o comportamento e criador de sentimentos, sedimentado em obras de arte e em formas de superstição dos povos). Segue-se a apresentação de um estudo descritivo transversal, como contribuição para o conhecimento do estado de saúde visual da população infantil da região de Lisboa e determinar factores que o influenciam. Entre Outubro de 2005 e Agosto de 2006 examinaram-se 649 crianças com idade inferior a 10 anos da Consulta de Oftalmologia Pediátrica dos Serviços de Assistência Médico-Social do Sindicato dos Bancários do Sul e Ilhas (SAMS). Colheram-se dados respeitantes a mais de 250 variáveis primárias que cobriram a maior parte dos itens do exame oftalmológico habitual. Na análise dos dados teve-se especialmente em conta a idade, com um papel decisivo nas principais fases de desenvolvimento do sistema visual. No caso das crianças de 6 a 7 anos de idade põem-se lado a lado resultados dos SAMS e das Escolas. A profusão de dados numéricos ditou a necessidade da determinação frequente da significância estatística dos resultados de subgrupos. Alguns resultados do estudo, na sua maioria do grupo SAMS: Crianças de 6-7 anos, 71,1% (SAMS) e 91,5% (Escolas) não tinham sido examinadas com menos de 4 anos. Frequência global de alterações miópicas 9,4%, de alterações hipermetrópicas 25,3%, umas e outras com variações acentuadas com a idade. Estrabismo convergente 3,9%. Ambliopia 2,6% (13/491 crianças >=4 anos de idade), mais frequente no sexo feminino, naquelas que tiveram a sua 1ª observação depois dos 4 anos e em que os pais não aderiam à terapêutica prescrita. Objectivos específicos ocuparam-se da acuidade visual e da refracção ocular. O estudo comparativo da refractometria automática sem e com cicloplegia permitiu evidenciar que o teste da acuidade visual é insuficiente, por si só, para fazer o diagnóstico correcto. A análise dos antecedentes familiares oftalmológicos demonstrou a importância do seu conhecimento e pôs em evidência, entre outras, as seguintes relações: 10 pag1.qxp 27-11-2001 18:28 Page 10 Índice Geral 11 Crianças com antecedentes de alterações miópicas têm maior frequência de diagnóstico de alterações miópicas e de refracção negativa, uma taxa mais elevada de correspondência quantitativa diagnóstico/refracção nas alterações miópicas. Estas crianças também têm, em geral, características inversas no que diz respeito a alterações hipermetrópicas. Crianças com antecedentes de alterações hipermetrópicas têm maior frequência de diagnóstico de alterações hipermetrópicas. Crianças com antecedentes de estrabismo têm maior frequência de diagnóstico de estrabismo convergente manifesto e de esodesvios no seu todo. Crianças com antecedentes familiares de astigmatismo têm maior frequência de diagnóstico de astigmatismo. Traçam-se alguns perfis oftalmológicos infantis que permitem apreciar de forma sinóptica um conjunto de parâmetros da saúde da visão. Os dados colhidos sobre a aderência dos pais à terapêutica prescrita e sobre a atitude em relação ao uso de óculos assim como os dados sobre o comportamento da criança na sala de aula e dificuldades de aprendizagem foram em geral escassos para permitirem tirar conclusões, embora mostrem indícios a investigar futuramente. Paralelamente ortoptistas e enfermeiras efectuaram um rastreio escolar da acuidade visual <0,8 e de alterações da motilidade ocular extrínseca que abrangeu 520 alunos do 1º ano do 1º ciclo do ensino básico (2005/2006) das escolas públicas da cidade de Lisboa. 101 destas crianças foram observadas no consultório da autora, umas referidas a partir do rastreio, outras como controlo deste. Quanto à acuidade visual o valor preditivo do teste negativo foi de 91% mas o do teste positivo de apenas 67% (33% de falsos positivos, consequentemente uma alta taxa de sobrerreferenciação). A qualidade do rastreio efectuado por ortoptistas foi inferior à do efectuado por enfermeiras. O rastreio não teve qualidade aceitável. Foi feito um inquérito a médicos e enfermeiros de centros de saúde sobre conhecimentos, atitudes e práticas em relação com os cuidados de oftalmologia pediátrica. Discutem-se os resultados, tiram-se conclusões e fazem-se recomendações susceptíveis de contribuir para uma melhor saúde visual das crianças. ABSTRACT: Firstly some brief remarks are made based on the scientific, historical and cultural panorama of the human vision with regard to three approaches: the eye (the human eye in its specific filogenetic place, fundamental anatomofunctional element of the visual system in interaction with the brain), the eyes (essential twin units of the face with their consensual and conjugated binocular activity), the gaze (psychologicaly overloaded, a means to express oneself and to influence the observer, a guide to other persons' behaviour, consolidated in works of art and in people's traditional superstitious believes and ways of thinking). A report is made on a cross-sectional descriptive study whose goal is to contribute to the knowledge of the level of visual health of children in the Lisbon Region and to identify factors which determine it. Between October 2005 and August 2006 649 children under 10 years were observed at the pediatric ophthalmologic consultation in the SAMS (Serviços de Assistência Médico-Social do Sindicato dos Bancários do Sul e Ilhas). Data were collected concerning more than 250 primary variables covering most itens of the usual ophthalmological examination. Special attention was paid to children's age since it plays a crucial role in main stages of visual system development. In the case of children age 6 to 7 SAMS and school results are often put side by side. On account of the great number of numerical data it was often necessary to look at the degree of statistical significancy of differencies between subgroups. Some of the study's results (mostly SAMS): Children age 6 to 7 - 71,1% (SAMS) and 91,5% (Schools) had not an ophthalmologic examination before 4 years old. Total frequency of myopic disorders 9,4%, of hypermetropic disorders 25,3%, both showing great differences between age groups; convergent strabismus 3,9%; amblyopia 2,6% (13/491 children over 3 years old), more frequent among little girls, in those with 1st examination after 4 years old and in those whose parents didn´t complied to the therapy ordered for the child. Specific objectives dealt with visual acuity and ocular refraction. The comparison of automatic refractometry without and with cycloplegy showed that visual acuity testing is often not enough for a correct diagnosis. Eye disorders in the family history proved to be a very important information. Analysis of corresponding data disclosed a lot of relationships among others: 12 pag1.qxp 27-11-2001 18:28 Page 12 Índice Geral 13 Children with a family history of myopic disorders have more frequently a diagnosis of myopic disorders and a negative refraction, a higher rate of quantitative diagnosis/refraction matching concerning myopic disorders. Those children have in general inverse characteristics regarding hypermetropic disorders. Children with a family history of hypermetropic disorders have more frequently a diagnosis of hypermetropic disorders. Children with a family history of strabismus have more frequently a diagnosis of manifest convergent strabismus and all forms of esodeviations. Children with a family history of astigmatism have more frequently a diagnosis of astigmatism. Ophthalmologic profiles are drawn allowing to take into account in a synoptic way a set of visual health parameters. Data on parents' compliance with therapy ordered for the child, and attitudes regarding child's glass wearing, as well as data on child's behaviour in the classroom and learning difficulties were as a rule too few to allow conclusions but still need more studies in the future. Orthoptists and nurses performed in the same study period a screening of visual acuity <0,8 and of ocular motility disorders addressed to children of 1srt degree of public schools (term 2005/2006) in the town of Lisbon. 520 of such children were screened. 101 of them were examined by the author in her medical office; some were refered, the others taken as a control. Regarding visual acuity the predictive value of a negative test was 91% but the predictive value of a positive test was only 67% (33% of false positive results, consequently a too high rate of overreferal). Performed by orthoptists screening quality was inferior in comparison with screening done by nurses. On the whole this screening had not the required quality. A survey on physicians' and nurses' knowledge, attitudes and practices related to pediatric ophthalmologic care was carried out in health centers. Results are discussed, conclusions drawn. Some suggestions are made aiming at a better children's visual health.

Visualization and interaction in a simulation system for flood emergencies

Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do grau de Mestre em Engenharia Informática

Analysis of exploratory eye movements in patients with schizophrenia during visual scanning of projective tests' figures

OBJECTIVE: Compare pattern of exploratory eye movements during visual scanning of the Rorschach and TAT test cards in people with schizophrenia and controls. METHOD: 10 participants with schizophrenia and 10 controls matched by age, schooling and intellectual level participated in the study. Severity of symptoms was evaluated with the Positive and Negative Syndrome Scale. Test cards were divided into three groups: TAT cards with scenes content, TAT cards with interaction content (TAT-faces), and Rorschach cards with abstract images. Eye movements were analyzed for: total number, duration and location of fixation; and length of saccadic movements. RESULTS: Different pattern of eye movement was found, with schizophrenia participants showing lower number of fixations but longer fixation duration in Rorschach cards and TAT-faces. The biggest difference was observed in Rorschach, followed by TAT-faces and TAT-scene cards. CONCLUSIONS: Results suggest alteration in visual exploration mechanisms possibly related to integration of abstract visual information.

Promoção da motivação e da autonomia com recurso às tecnologias de informação e comunicação em alunos normovisuais e em alunos com deficiência visual

Relatório de estágio de mestrado em Ensino de Informática

A comunicação online: a página Web como o BIO Empresarial: estratégias de comunicação visual e web design

Dissertação de mestrado em Ciências da Comunicação (área de especialização em Audiovisuais e Multimédia)

Modularity of auditory spatial representations

Abstract : Auditory spatial functions are of crucial importance in everyday life. Determining the origin of sound sources in space plays a key role in a variety of tasks including orientation of attention, disentangling of complex acoustic patterns reaching our ears in noisy environments. Following brain damage, auditory spatial processing can be disrupted, resulting in severe handicaps. Complaints of patients with sound localization deficits include the inability to locate their crying child or being over-loaded by sounds in crowded public places. Yet, the brain bears a large capacity for reorganization following damage and/or learning. This phenomenon is referred as plasticity and is believed to underlie post-lesional functional recovery as well as learning-induced improvement. The aim of this thesis was to investigate the organization and plasticity of different aspects of auditory spatial functions. Overall, we report the outcomes of three studies: In the study entitled "Learning-induced plasticity in auditory spatial representations" (Spierer et al., 2007b), we focused on the neurophysiological and behavioral changes induced by auditory spatial training in healthy subjects. We found that relatively brief auditory spatial discrimination training improves performance and modifies the cortical representation of the trained sound locations, suggesting that cortical auditory representations of space are dynamic and subject to rapid reorganization. In the same study, we tested the generalization and persistence of training effects over time, as these are two determining factors in the development of neurorehabilitative intervention. In "The path to success in auditory spatial discrimination" (Spierer et al., 2007c), we investigated the neurophysiological correlates of successful spatial discrimination and contribute to the modeling of the anatomo-functional organization of auditory spatial processing in healthy subjects. We showed that discrimination accuracy depends on superior temporal plane (STP) activity in response to the first sound of a pair of stimuli. Our data support a model wherein refinement of spatial representations occurs within the STP and that interactions with parietal structures allow for transformations into coordinate frames that are required for higher-order computations including absolute localization of sound sources. In "Extinction of auditory stimuli in hemineglect: space versus ear" (Spierer et al., 2007a), we investigated auditory attentional deficits in brain-damaged patients. This work provides insight into the auditory neglect syndrome and its relation with neglect symptoms within the visual modality. Apart from contributing to a basic understanding of the cortical mechanisms underlying auditory spatial functions, the outcomes of the studies also contribute to develop neurorehabilitation strategies, which are currently being tested in clinical populations.

Bihippocampal damage with emotional dysfunction: impaired auditory recognition of fear.

A right-handed man developed a sudden transient, amnestic syndrome associated with bilateral hemorrhage of the hippocampi, probably due to Urbach-Wiethe disease. In the 3rd month, despite significant hippocampal structural damage on imaging, only a milder degree of retrograde and anterograde amnesia persisted on detailed neuropsychological examination. On systematic testing of recognition of facial and vocal expression of emotion, we found an impairment of the vocal perception of fear, but not that of other emotions, such as joy, sadness and anger. Such selective impairment of fear perception was not present in the recognition of facial expression of emotion. Thus emotional perception varies according to the different aspects of emotions and the different modality of presentation (faces versus voices). This is consistent with the idea that there may be multiple emotion systems. The study of emotional perception in this unique case of bilateral involvement of hippocampus suggests that this structure may play a critical role in the recognition of fear in vocal expression, possibly dissociated from that of other emotions and from that of fear in facial expression. In regard of recent data suggesting that the amygdala is playing a role in the recognition of fear in the auditory as well as in the visual modality this could suggest that the hippocampus may be part of the auditory pathway of fear recognition.

GABA receptor subunits in human auditory cortex in normal and stroke cases.

GABA receptors are ubiquitous in the cerebral cortex and play a major role in shaping responses of cortical neurons. GABAA and GABAB receptor subunit expression was visualized by immunohistochemistry in human auditory areas from both hemispheres in 9 normal subjects (aged 43-85 years; time between death and fixation 6-24 hours) and in 4 stroke patients (aged 59-87 years; time between death and fixation 7-24 hours) and analyzed qualitatively for GABAA and semiquantitatively for GABAB receptor subunits. In normal brains, the primary auditory area (TC) and the surrounding areas TB and TA displayed distinct GABAA receptor subunit labeling with differences among cortical layers and areas. In postacute and chronic stroke we found a layer-selective downregulation of the alpha-2 subunit in the anatomically intact cerebral cortex of the intact and of the lesioned hemisphere, whereas the alpha-1, alpha-3 and beta-2/3 subunits maintained normal levels of expression. The GABAB receptors had a distinct laminar pattern in auditory areas and minor differences among areas. Unlike in other pathologies, there is no modulation of the GABAB receptor expression in subacute or chronic stroke.

Decoding decisions in healthy subjects and auditory discrimination in comatose patients through single-trial topographic EEG analyses

Neuroimaging studies analyzing neurophysiological signals are typically based on comparing averages of peri-stimulus epochs across experimental conditions. This approach can however be problematic in the case of high-level cognitive tasks, where response variability across trials is expected to be high and in cases where subjects cannot be considered part of a group. The main goal of this thesis has been to address this issue by developing a novel approach for analyzing electroencephalography (EEG) responses at the single-trial level. This approach takes advantage of the spatial distribution of the electric field on the scalp (topography) and exploits repetitions across trials for quantifying the degree of discrimination between experimental conditions through a classification scheme. In the first part of this thesis, I developed and validated this new method (Tzovara et al., 2012a,b). Its general applicability was demonstrated with three separate datasets, two in the visual modality and one in the auditory. This development allowed then to target two new lines of research, one in basic and one in clinical neuroscience, which represent the second and third part of this thesis respectively. For the second part of this thesis (Tzovara et al., 2012c), I employed the developed method for assessing the timing of exploratory decision-making. Using single-trial topographic EEG activity during presentation of a choice's payoff, I could predict the subjects' subsequent decisions. This prediction was due to a topographic difference which appeared on average at ~516ms after the presentation of payoff and was subject-specific. These results exploit for the first time the temporal correlates of individual subjects' decisions and additionally show that the underlying neural generators start differentiating their responses already ~880ms before the button press. Finally, in the third part of this project, I focused on a clinical study with the goal of assessing the degree of intact neural functions in comatose patients. Auditory EEG responses were assessed through a classical mismatch negativity paradigm, during the very early phase of coma, which is currently under-investigated. By taking advantage of the decoding method developed in the first part of the thesis, I could quantify the degree of auditory discrimination at the single patient level (Tzovara et al., in press). Our results showed for the first time that even patients who do not survive the coma can discriminate sounds at the neural level, during the first hours after coma onset. Importantly, an improvement in auditory discrimination during the first 48hours of coma was predictive of awakening and survival, with 100% positive predictive value. - L'analyse des signaux électrophysiologiques en neuroimagerie se base typiquement sur la comparaison des réponses neurophysiologiques à différentes conditions expérimentales qui sont moyennées après plusieurs répétitions d'une tâche. Pourtant, cette approche peut être problématique dans le cas des fonctions cognitives de haut niveau, où la variabilité des réponses entre les essais peut être très élevéeou dans le cas où des sujets individuels ne peuvent pas être considérés comme partie d'un groupe. Le but principal de cette thèse est d'investiguer cette problématique en développant une nouvelle approche pour l'analyse des réponses d'électroencephalographie (EEG) au niveau de chaque essai. Cette approche se base sur la modélisation de la distribution du champ électrique sur le crâne (topographie) et profite des répétitions parmi les essais afin de quantifier, à l'aide d'un schéma de classification, le degré de discrimination entre des conditions expérimentales. Dans la première partie de cette thèse, j'ai développé et validé cette nouvelle méthode (Tzovara et al., 2012a,b). Son applicabilité générale a été démontrée avec trois ensembles de données, deux dans le domaine visuel et un dans l'auditif. Ce développement a permis de cibler deux nouvelles lignes de recherche, la première dans le domaine des neurosciences cognitives et l'autre dans le domaine des neurosciences cliniques, représentant respectivement la deuxième et troisième partie de ce projet. En particulier, pour la partie cognitive, j'ai appliqué cette méthode pour évaluer l'information temporelle de la prise des décisions (Tzovara et al., 2012c). En se basant sur l'activité topographique de l'EEG au niveau de chaque essai pendant la présentation de la récompense liée à un choix, on a pu prédire les décisions suivantes des sujets (en termes d'exploration/exploitation). Cette prédiction s'appuie sur une différence topographique qui apparaît en moyenne ~516ms après la présentation de la récompense. Ces résultats exploitent pour la première fois, les corrélés temporels des décisions au niveau de chaque sujet séparément et montrent que les générateurs neuronaux de ces décisions commencent à différentier leurs réponses déjà depuis ~880ms avant que les sujets appuient sur le bouton. Finalement, pour la dernière partie de ce projet, je me suis focalisée sur une étude Clinique afin d'évaluer le degré des fonctions neuronales intactes chez les patients comateux. Des réponses EEG auditives ont été examinées avec un paradigme classique de mismatch negativity, pendant la phase précoce du coma qui est actuellement sous-investiguée. En utilisant la méthode de décodage développée dans la première partie de la thèse, j'ai pu quantifier le degré de discrimination auditive au niveau de chaque patient (Tzovara et al., in press). Nos résultats montrent pour la première fois que même des patients comateux qui ne vont pas survivre peuvent discriminer des sons au niveau neuronal, lors de la phase aigue du coma. De plus, une amélioration dans la discrimination auditive pendant les premières 48heures du coma a été observée seulement chez des patients qui se sont réveillés par la suite (100% de valeur prédictive pour un réveil).

Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment.

Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.