Investigating perceptual multisensory impairments in Autism through a neural network: a possible neural implementation for the shift from cross-modal competition to facilitation

Resolution of multisensory deficits has been observed in teenagers with Autism Spectrum Disorders (ASD) for complex, social speech stimuli; this resolution extends to more basic multisensory processing, involving low-level stimuli. In particular, a delayed transition of multisensory integration (MSI) from a default state of competition to one of facilitation has been observed in ASD children. In other terms, the complete maturation of MSI is achieved later in ASD. In the present study a neuro-computational model is used to reproduce some patterns of behavior observed experimentally, modeling a bisensory reaction time task, in which auditory and visual stimuli are presented in random sequence alone (A or V) or together (AV). The model explains how the default competitive state can be implemented via mutual inhibition between primary sensory areas, and how the shift toward the classical multisensory facilitation, observed in adults, is the result of inhibitory cross-modal connections becoming excitatory during the development. Model results are consistent with a stronger cross-modal inhibition in ASD children, compared to normotypical (NT) ones, suggesting that the transition toward a cooperative interaction between sensory modalities takes longer to occur. Interestingly, the model also predicts the difference between unisensory switch trials (in which sensory modality switches) and unisensory repeat trials (in which sensory modality repeats). This is due to an inhibitory mechanism, characterized by a slow dynamics, driven by the preceding stimulus and inhibiting the processing of the incoming one, when of the opposite sensory modality. These findings link the cognitive framework delineated by the empirical results to a plausible neural implementation.

Governing coordination: Behavioural principles and neural correlates

The coordination of movement is governed by a coalition of constraints. The expression of these constraints ranges from the concrete—the restricted range of motion offered by the mechanical configuration of our muscles and joints; to the abstract—the difficulty that we experience in combining simple movements into complex rhythms. We seek to illustrate that the various constraints on coordination are complementary and inclusive, and the means by which their expression and interaction are mediated systematically by the integrative action of the central nervous system (CNS). Beyond identifying the general principles at the behavioural level that govern the mutual interplay of constraints, we attempt to demonstrate that these principles have as their foundation specific functional properties of the cortical motor systems. We propose that regions of the brain upstream of the motor cortex may play a significant role in mediating interactions between the functional representations of muscles engaged in sensorimotor coordination tasks. We also argue that activity in these ldquosupramotorrdquo regions may mediate the stabilising role of augmented sensory feedback.

Sensor-driven agenda for intelligent home care of the elderly

The exponential increase of home-bound persons who live alone and are in need of continuous monitoring requires new solutions to current problems. Most of these cases present illnesses such as motor or psychological disabilities that deprive of a normal living. Common events such as forgetfulness or falls are quite common and have to be prevented or dealt with. This paper introduces a platform to guide and assist these persons (mostly elderly people) by providing multisensory monitoring and intelligent assistance. The platform operates at three levels. The lower level, denominated ‘‘Data acquisition and processing’’performs the usual tasks of a monitoring system, collecting and processing data from the sensors for the purpose of detecting and tracking humans. The aim is to identify their activities in an intermediate level called ‘‘activity detection’’. The upper level, ‘‘Scheduling and decision-making’’, consists of a scheduler which provides warnings, schedules events in an intelligent manner and serves as an interface to the rest of the platform. The idea is to use mobile and static sensors performing constant monitoring of the user and his/her environment, providing a safe environment and an immediate response to severe problems. A case study on elderly fall detection in a nursery home bedroom demonstrates the usefulness of the proposal.

A influência da poesia no desenvolvimento da linguagem oral de uma aluna com Trissomia 21

O conceito de poesia é uma forma de arte e traduz-se como um espelho do pensamento do homem realizado na palavra oral e escrita. A poesia poderá ensinar o homem no estudo da palavra, através do seu significado nos valores denotativo e/ou conotativo. A aplicação destes conceitos faz sentido, a partir da ideia de que a palavra no contexto da poesia pode produzir emoções e sensações nas pessoas a quem ela é transmitida. A poesia tem funções multissensoriais que podem definir o input linguístico como forma de desenvolver a linguagem. Vários são os estudos que apontam para as principais competências deficitárias nos indivíduos com Trissomia 21, mas poucas são as investigações que se debruçam sobre a influência da poesia nas várias competências linguísticas. Uma perceção mais ampla e visionária da Arte na voz da poesia pela parte da escola, professores e, em particular, professores de Educação Especial permitirá adotar estratégias de intervenção inovadoras. Pretende este estudo investigar e analisar a forma como a poesia pode influenciar o desenvolvimento da linguagem oral numa aluna com Trissomia 21. Neste projeto, a partir da identificação do caso-problema e da constatação da ausência da poesia no currículo da aluna, procurou-se intervir, no sentido de melhorar as suas competências linguísticas, utilizando para tanto a poesia. A implementação do projeto aconteceu ao longo de seis meses durante quinze sessões de intervenção individuais. Os resultados do projeto mostram que, em todas as competências linguísticas, houve um processo evolutivo, sendo particularmente significativo o desenvolvimento da competência fonológica, aumento de vocabulário e uma maior noção da palavra em contexto. Estes dados levam-nos a crer que a utilização da poesia poderá, também, constituir uma forma de promover a socialização e a autonomia, revelando os efeitos colaterais que poderão decorrer deste tipo de intervenção. - Abstract The concept of poetry is a form of art, showing the man's thought held in the spoken and written word. Poetry can teach man in the study of the word, its meaning through denotative and/or connotative values. The application of these concepts makes sense, from the idea that the word in the context of poetry can stir emotions and feelings in the people to whom it is transmitted. Poetry has multisensory functions that can set the linguistic input as a way to develop language at phonological, lexical, semantics, pragmatic and morfosyntactic skills. There are several studies that point out to the key skills deficit in individuals with Trisomy 21, but there are few investigations that focus on the influence of poetry in various language skills. A broader perception and vision of poetry as art given by school, and teachers, and, particularly teachers of Special Education will allow a more effective intervention strategies. This study aims to investigate and analyze how poetry can influence the development of oral language in a student with Trisomy 21. In this project, we tried to intervene, improving the language skills of the student, using poetry from the identification case-problem and confirmation of the absence of poetry in her curriculum. The implementation of the project took place throughout six months for fifteen individual intervention sessions. The project results show that, in all language skills, there was a progressive process, being particularly significant the development of the phonological skills, increased vocabulary and a greater sense of the word into context. These data lead us to believe that the use of poetry can also be a way to promote socialization and autonomy, revealing the side effects that may result from this type of intervention.

O uso de histórias multisensoriais numa biblioteca pública

Projeto de Intervenção apresentado à Escola Superior de Educação de Lisboa para a obtenção do grau de mestre em Educação Especial

O lugar da Hispanoamérica no processo de ensinoaprendizagem de Espanhol como Língua Estrangeira no Ensino Secundário Português

Tendo em conta um enfoque comunicativo experiencial (Fernández- Corbacho, 2014) e uma pedagogia crítica emancipatória (Jiménez Raya, Lamb & Vieira, 2007), enriquecida por enfoques multissensoriais (Arslan, 2009), é nossa intenção, com este projeto, contribuir para a implementação de práticas que espelhem as variedades linguísticas e culturais da Hispanoamérica (Liceras, 1995; Beave, 2000) na aula de espanhol como língua estrangeira no ensino secundário português. Neste estudo, através duma perspetiva metodológica de índole qualitativa, pretendemos, como ponto de partida, analisar: a) as representações de alunos portugueses sobre o lugar da Hispanoamérica no processo de ensino-aprendizagem de espanhol como língua estrangeira (Altmann & Vences, 2004; Pérez, 2003), através de inquéritos por questionário; e, ainda, b) as abordagens das variedades linguísticas e culturais do espanhol, que surgem nos manuais utilizados no ensino secundário português. Por outro lado, através de um estudo de caso (Benson, Chik, Gao, Huang & Wang, 2009), procurámos evidenciar uma mostra de possíveis boas práticas didático-pedagógicas e materiais, com vista a um trabalho sistemático e próativo com as variedades linguísticas e culturais do espanhol, baseado numa (hiper)pedagogia crítica e encarando a língua enquanto objeto manipulável e potenciador de cidadãos verdadeiramente conscientes do mundo. Para tal, criámos materiais físicos e digitais, que foram posteriormente implementados com alunos do 11º ano de escolaridade, no nível de iniciação de espanhol, num agrupamento de escolas da região de Aveiro. Os resultados mostram que práticas e materiais desta natureza poderão favorecer aprendizagens comunicativas experienciais, quanto à criação de futuros cidadãos críticos e ativos, fomentando o desenvolvimento das suas competências comunicativa plurilingue e pluricultural e duma consciência cultural crítica (Byram, Gribkova & Starkey, 2002) dos alunos, no contexto de ensino-aprendizagem do ensino secundário.

Dificuldades de prendizagem na quisição da leitura: um estudo de caso

A aprendizagem da leitura e da escrita consiste num dos maiores desafios que as crianças têm de enfrentar no início da sua escolarização. Conseguir vencer esse desafio dá-lhes a oportunidade de se tornarem cidadãos livres, autónomos e informados (Silva, 2003). Contudo, o ato de ler pode tornar-se um desafio árduo de atingir, com muitas dificuldades pelo meio, podendo exigir bastante sensibilidade, conhecimento, informação e até arte por parte de quem ensina. Sabemos que a informação não chega a todos os alunos da mesma forma. Uns necessitam de mais tempo para aprender, mais oportunidades, outras estratégias. Este trabalho teve como objetivo principal encontrar um conjunto de estratégias que fossem ao encontro das necessidades educativas de uma aluna com oito anos de idade que revela grandes dificuldades na aquisição desta competência. Numa primeira fase da intervenção foram aplicadas provas diagnósticas para aferir as aquisições que a aluna já tinha feito de modo a delinear uma intervenção eficaz e motivadora que fosse ao encontro das suas necessidades. A intervenção baseou-se na aplicação de um método multissensorial que trabalhasse todos os mecanismos inerentes ao ato de ler. Esperava-se que com esta intervenção a aluna lesse e escrevesse pequenas frases, tendo adquirido a base para o desenvolvimento da leitura. Os resultados obtidos foram positivos, sendo que os fonemas trabalhados foram adquiridos, tendo chegado a aluna ao fim da intervenção a ler frases simples

Use of multi-sensory marketing techniques and its influence on brand experience in retail and HORECA sector

Double degree. A Work Project presented as part of the requirements for the Award of a Masters Degree in Management from the NOVA- School of Business and Economics and Warsaw School of Economics

Bimodal information increases spontaneous interpersonal synchronization of goal directed upper limb movements

When interacting with each other, people often synchronize spontaneously their movements, e.g. during pendulum swinging, chair rocking[5], walking [4][7], and when executing periodic forearm movements[3].Although the spatiotemporal information that establishes the coupling, leading to synchronization, might be provided by several perceptual systems, the systematic study of different sensory modalities contribution is widely neglected. Considering a) differences in the sensory dominance on the spatial and temporal dimension[5] , b) different cue combination and integration strategies [1][2], and c) that sensory information might provide different aspects of the same event, synchronization should be moderated by the type of sensory modality. Here, 9 naïve participants placed a bottle periodically between two target zones, 40 times, in 12 conditions while sitting in front of a confederate executing the same task. The participant could a) see and hear, b) see , c) hear the confederate, d) or audiovisual information about the movements of the confederate was absent. The couple started in 3 different relative positions (i.e., in-phase, anti-phase, out of phase). A retro-reflective marker was attached to the top of the bottles. Bottle displacement was captured by a motion capture system. We analyzed the variability of the continuous relative phase reflecting the degree of synchronization. Results indicate the emergence of spontaneous synchronization, an increase with bimodal information, and an influence of the initial phase relation on the particular synchronization pattern. Results have theoretical implication for studying cue combination in interpersonal coordination and are consistent with coupled oscillator models.

Sensorimotor synchronization when walking side by side with a point light walker

[Excerpt] Synchronization of periodic movements like side-by-side walking [7] is frequently modeled by coupled oscillators [5] and the coupling strength is defined quantitatively [3]. In contrast, in most studies on sensorimotor synchronization (SMS), simple movements like finger taps are synchronized with simple stimuli like metronomes [4]. While the latter paradigm simplifies matters and allows for the assessment of the relative weights of sensory modalities through systematic variation of the stimuli [1], it might lack ecological validity. Conversely, using more complex movements and stimuli might complicate the specification of mechanisms underlying coupling. We merged the positive aspects of both approaches to study the contribution of auditory and visual information on synchronization during side-by-side walking. As stimuli, we used Point Light Walkers (PLWs) and auralized steps sound; both were constructed from previously captured walking individuals [2][6]. PLWs were retro-projected on a screen and matched according to gender, hip height, and velocity. The participant walked for 7.20m side by side with 1) a PLW, 2) steps sound, or 3) both displayed in temporal congruence. Instruction to participants was to synchronize with the available stimuli. [...]

Dynamic visual information plays a critical role for spatial navigation in water but not on solid ground.

In the Morris water maze (MWM) task, proprioceptive information is likely to have a poor accuracy due to movement inertia. Hence, in this condition, dynamic visual information providing information on linear and angular acceleration would play a critical role in spatial navigation. To investigate this assumption we compared rat's spatial performance in the MWM and in the homing hole board (HB) tasks using a 1.5 Hz stroboscopic illumination. In the MWM, rats trained in the stroboscopic condition needed more time than those trained in a continuous light condition to reach the hidden platform. They expressed also little accuracy during the probe trial. In the HB task, in contrast, place learning remained unaffected by the stroboscopic light condition. The deficit in the MWM was thus complete, affecting both escape latency and discrimination of the reinforced area, and was thus task specific. This dissociation confirms that dynamic visual information is crucial to spatial navigation in the MWM whereas spatial navigation on solid ground is mediated by a multisensory integration, and thus less dependent on visual information.

Selective integration of auditory-visual looming cues by humans.

An object's motion relative to an observer can confer ethologically meaningful information. Approaching or looming stimuli can signal threats/collisions to be avoided or prey to be confronted, whereas receding stimuli can signal successful escape or failed pursuit. Using movement detection and subjective ratings, we investigated the multisensory integration of looming and receding auditory and visual information by humans. While prior research has demonstrated a perceptual bias for unisensory and more recently multisensory looming stimuli, none has investigated whether there is integration of looming signals between modalities. Our findings reveal selective integration of multisensory looming stimuli. Performance was significantly enhanced for looming stimuli over all other multisensory conditions. Contrasts with static multisensory conditions indicate that only multisensory looming stimuli resulted in facilitation beyond that induced by the sheer presence of auditory-visual stimuli. Controlling for variation in physical energy replicated the advantage for multisensory looming stimuli. Finally, only looming stimuli exhibited a negative linear relationship between enhancement indices for detection speed and for subjective ratings. Maximal detection speed was attained when motion perception was already robust under unisensory conditions. The preferential integration of multisensory looming stimuli highlights that complex ethologically salient stimuli likely require synergistic cooperation between existing principles of multisensory integration. A new conceptualization of the neurophysiologic mechanisms mediating real-world multisensory perceptions and action is therefore supported.

Physical activity and energy expenditure in haemodialysis patients: an international survey.

BACKGROUND: The assessment of physical activity and energy expenditure is relevant to the care of maintenance haemodialysis (MHD) patients. In the current study, we aimed to evaluate measurements of physical activity and energy expenditure in MHD patients from different centres and countries and explored the predictors of physical activity in these patients.¦METHODS: In this cross-sectional multicentre study, 134 MHD patients from four countries (France, Switzerland, Sweden and Brazil) were included. The physical activity was evaluated for 5.0 ± 1.4 days (mean ± SD) by a multisensory device (SenseWear Armband) and comprised the assessment of number of steps per day, activity-related energy expenditure (activity-related EE) and physical activity level (PAL).¦RESULTS: The number of steps per day, activity-related EE and PAL from the MHD patients were compatible with a sedentary lifestyle. In addition, all parameters were significantly lower in dialysis days when compared to non-dialysis days (P < 0.001). The multivariate regression analysis revealed that diabetes and higher body mass index (BMI) predicted a lower PAL and older age and diabetes predicted a reduced number of steps.¦CONCLUSIONS: The physical activity parameters of MHD patients were compatible with a sedentary lifestyle. This inactivity was worsened by aging, diabetes and higher BMI. Our results indicate that MHD patients should be encouraged by the health care team to increase their physical activity.

New insights into pathophysiology of vestibular migraine.

Vestibular migraine (VM) is a common disorder in which genetic, epigenetic, and environmental factors probably contribute to its development. The pathophysiology of VM is unknown; nevertheless in the last few years, several studies are contributing to understand the neurophysiological pathways involved in VM. The current hypotheses are mostly based on the knowledge of migraine itself. The evidence of trigeminal innervation of the labyrinth vessels and the localization of vasoactive neuropeptides in the perivascular afferent terminals of these trigeminal fibers support the involvement of the trigemino-vascular system. The neurogenic inflammation triggered by activation of the trigeminal-vestibulocochlear reflex, with the subsequent inner ear plasma protein extravasation and the release of inflammatory mediators, can contribute to a sustained activation and sensitization of the trigeminal primary afferent neurons explaining VM symptoms. The reciprocal connections between brainstem vestibular nuclei and the structures that modulate trigeminal nociceptive inputs (rostral ventromedial medulla, ventrolateral periaqueductal gray, locus coeruleus, and nucleus raphe magnus) are critical to understand the pathophysiology of VM. Although cortical spreading depression can affect cortical areas involved in processing vestibular information, functional neuroimaging techniques suggest a dysmodulation in the multimodal sensory integration and processing of vestibular and nociceptive information, resulting from a vestibulo-thalamo-cortical dysfunction, as the pathogenic mechanism underlying VM. The elevated prevalence of VM suggests that multiple functional variants may confer a genetic susceptibility leading to a dysregulation of excitatory-inhibitory balance in brain structures involved in the processing of sensory information, vestibular inputs, and pain. The interactions among several functional and structural neural networks could explain the pathogenic mechanisms of VM.

Temporo-Parietal Junction encodes the Embodied Self: Neuro-Robotics, fMRI, and Lesion mapping.

Introduction: Neuroimaging of the self focused on high-level mechanisms such as language, memory or imagery of the self. Recent evidence suggests that low-level mechanisms of multisensory and sensorimotor integration may play a fundamental role in encoding self-location and the first-person perspective (Blanke and Metzinger, 2009). Neurological patients with out-of body experiences (OBE) suffer from abnormal self-location and the first-person perspective due to a damage in the temporo-parietal junction (Blanke et al., 2004). Although self-location and the first-person perspective can be studied experimentally (Lenggenhager et al., 2009), the neural underpinnings of self-location have yet to be investigated. To investigate the brain network involved in self-location and first-person perspective we used visuo-tactile multisensory conflict, magnetic resonance (MR)-compatible robotics, and fMRI in study 1, and lesion analysis in a sample of 9 patients with OBE due to focal brain damage in study 2. Methods: Twenty-two participants saw a video showing either a person's back or an empty room being stroked (visual stimuli) while the MR-compatible robotic device stroked their back (tactile stimulation). Direction and speed of the seen stroking could either correspond (synchronous) or not (asynchronous) to those of the seen stroking. Each run comprised the four conditions according to a 2x2 factorial design with Object (Body, No-Body) and Synchrony (Synchronous, Asynchronous) as main factors. Self-location was estimated using the mental ball dropping (MBD; Lenggenhager et al., 2009). After the fMRI session participants completed a 6-item adapted from the original questionnaire created by Botvinick and Cohen (1998) and based on questions and data obtained by Lenggenhager et al. (2007, 2009). They were also asked to complete a questionnaire to disclose the perspective they adopted during the illusion. Response times (RTs) for the MBD and fMRI data were analyzed with a 3-way mixed model ANOVA with the in-between factor Perspective (up, down) and the two with-in factors Object (body, no-body) and Stroking (synchronous, asynchronous). Quantitative lesion analysis was performed using MRIcron (Rorden et al., 2007). We compared the distributions of brain lesions confirmed by multimodality imaging (Knowlton, 2004) in patients with OBE with those showing complex visual hallucinations involving people or faces, but without any disturbance of self-location and first person perspective. Nine patients with OBE were investigated. The control group comprised 8 patients. Structural imaging data were available for normalization and co-registration in all the patients. Normalization of each patient's lesion into the common MNI (Montreal Neurological Institute) reference space permitted simple, voxel-wise, algebraic comparisons to be made. Results: Even if in the scanner all participants were lying on their back and were facing upwards, analysis of perspective showed that half of the participants had the impression to be looking down at the virtual human body below them, despite any cues about their body position (Down-group). The other participants had the impression to be looking up at the virtual body above them (Up-group). Analysis of Q3 ("How strong was the feeling that the body you saw was you?") indicated stronger self-identification with the virtual body during the synchronous stroking. RTs in the MBD task confirmed these subjective data (significant 3-way interaction between perspective, object and stroking). fMRI results showed eight cortical regions where the BOLD signal was significantly different during at least one of the conditions resulting from the combination of Object and Stroking, relative to baseline: right and left temporo-parietal junction, right EBA, left middle occipito-temporal gyrus, left postcentral gyrus, right medial parietal lobe, bilateral medial occipital lobe (Fig 1). The activation patterns in right and left temporo-parietal junction and right EBA reflected changes in self-location and perspective as revealed by statistical analysis that was performed on the percentage of BOLD change with respect to the baseline. Statistical lesion overlap comparison (using nonparametric voxel based lesion symptom mapping) with respect to the control group revealed the right temporo-parietal junction, centered at the angular gyrus (Talairach coordinates x = 54, y =-52, z = 26; p>0.05, FDR corrected). Conclusions: The present questionnaire and behavioural results show that - despite the noisy and constraining MR environment) our participants had predictable changes in self-location, self-identification, and first-person perspective when robotic tactile stroking was applied synchronously with the robotic visual stroking. fMRI data in healthy participants and lesion data in patients with abnormal self-location and first-person perspective jointly revealed that the temporo-parietal cortex especially in the right hemisphere encodes these conscious experiences. We argue that temporo-parietal activity reflects the experience of the conscious "I" as embodied and localized within bodily space.