Interactive sensory objects for and by people with learning disabilities

This project engages people with learning disabilities to participate as co-researchers and explore museum interpretation through multisensory workshops using microcontrollers and sensors to enable alternative interactive visitor experiences in museums and heritage sites. This article describes how the project brings together artists, engineers, and experts in multimedia advocacy, as well as people with learning disabilities in the co-design of interactive multisensory objects that replicate or respond to objects of cultural significance in our national collections. Through a series of staged multi-sensory art and electronics workshops, people with learning disabilities explore how the different senses could be utilised to augment existing artefacts or create entirely new ones. The co-researchers employ multimedia advocacy tools to reflect on and to communicate their experiences and findings.

Sensory objects at the British Museum

The Sensory Objects project creates multisensory interactive artworks that respond to museum collections and generate alternative ideas for museum interpretation.

Interactive sensory objects for and by people with learning disabilities

This project engages people with learning disabilities to participate as co-researchers and explore museum interpretation through multisensory workshops using microcontrollers and sensors to enable alternative interactive visitor experiences in museums and heritage sites. This article describes how the project brings together artists, engineers, and experts in multimedia advocacy, as well as people with learning disabilities in the co-design of interactive multisensory objects that replicate or respond to objects of cultural significance in our national collections. Through a series of staged multi-sensory art and electronics workshops, people with learning disabilities explore how the different senses could be utilised to augment existing artefacts or create entirely new ones. The co-researchers employ multimedia advocacy tools to reflect on and to communicate their experiences and findings.

Collabowrighting the hyper(play)text: a postdramatic digital poetics

The aim of this research is to exhibit how literary playtexts can evoke multisensory trends prevalent in 21st century theatre. In order to do so, it explores a range of practical forms and theoretical contexts for creating participatory, site-specific and immersive theatre. With reference to literary theory, specifically to semiotics, reader-response theory, postmodernism and deconstruction, it attempts to revise dramatic theory established by Aristotle’s Poetics. Considering Gertrude Stein’s essay, Plays (1935), and relevant trends in theatre and performance, shaped by space, technology and the everchanging role of the audience member, a postdramatic poetics emerges from which to analyze the plays of Mac Wellman and Suzan-Lori Parks. Distinguishing the two textual lives of a play as the performance playtext and the literary playtext, it examines the conventions of the printed literary playtext, with reference to models of practice that radicalize the play form, including works by Mabou Mines, The Living Theatre and Fiona Templeton. The arguments of this practice-led Ph.D. developed out of direct engagement with the practice project, which explores the multisensory potential of written language when combined with hypermedia. The written thesis traces the development process of a new play, Rumi High, which is presented digitally as a ‘hyper(play)text,’ accessible through the Internet at www.RumiHigh.org. Here, ‘playwrighting’ practice is expanded spatially, collaboratively and textually. Plays are built, designed and crafted with many layers of meaning that explore both linguistic and graphic modes of poetic expression. The hyper(play)text of Rumi High establishes playwrighting practice as curatorial, where performance and literary playtexts are in a reciprocal relationship. This thesis argues that digital writing and reading spaces enable new approaches to expressing the many languages of performance, while expanding the collaborative network that produces the work. It questions how participatory forms of immersive and site-specific theatre can be presented as interactive literary playtexts, which enable the reader to have a multisensory experience. Through a reflection on process and an evaluation of the practice project, this thesis problematizes notions of authorship and text.

Dynamics of inter-modality re-weighting during human postural control

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Sensorimotor Integration in Dyslexic Children under Different Sensory Stimulations

Dyslexic children, besides difficulties in mastering literacy, also show poor postural control that might be related to how sensory cues coming from different sensory channels are integrated into proper motor activity. Therefore, the aim of this study was to examine the relationship between sensory information and body sway, with visual and somatosensory information manipulated independent and concurrently, in dyslexic children. Thirty dyslexic and 30 non-dyslexic children were asked to stand as still as possible inside of a moving room either with eyes closed or open and either lightly touching a moveable surface or not for 60 seconds under five experimental conditions: (1) no vision and no touch; (2) moving room; (3) moving bar; (4) moving room and stationary touch; and (5) stationary room and moving bar. Body sway magnitude and the relationship between room/bar movement and body sway were examined. Results showed that dyslexic children swayed more than non-dyslexic children in all sensory condition. Moreover, in those trials with conflicting vision and touch manipulation, dyslexic children swayed less coherent with the stimulus manipulation compared to non-dyslexic children. Finally, dyslexic children showed higher body sway variability and applied higher force while touching the bar compared to non-dyslexic children. Based upon these results, we can suggest that dyslexic children are able to use visual and somatosensory information to control their posture and use the same underlying neural control processes as non-dyslexic children. However, dyslexic children show poorer performance and more variability while relating visual and somatosensory information and motor action even during a task that does not require an active cognitive and motor involvement. Further, in sensory conflict conditions, dyslexic children showed less coherent and more variable body sway. These results suggest that dyslexic children have difficulties in multisensory integration because they may suffer from integrating sensory cues coming from multiple sources. © 2013 Viana et al.

Efeitos do inseticida fipronil sobre os corpos pedunculados de operárias de Scaptotrigona postica (Hymenoptera, Apidae, Meliponini)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Mindware semiótico-comunicativo: campos conceituais no ensino de física para deficientes visuais utilizando uma interface cérebro-computador

Pós-graduação em Educação para a Ciência - FC

Estudo exploratório comparativo do declínio cognitivo senil após estimulação multissensorial e cognitiva em idosos institucionalizados e não institucionalizados

O objetivo do presente trabalho foi investigar, empregando testes neuropsicológicos selecionados, a duração dos efeitos benéficos do programa de estimulação multissensorial e cognitiva realizado em idosos vivendo em instituições de longa permanência ou em comunidade. Os participantes do estudo foram idosos institucionalizados (n=20, 75,1 ± 6,8 anos de idade) e não institucionalizados (n=15, 74,1 ± 3,9 anos de idade), com 65 anos de idade ou mais, sem histórico de traumatismo crânio-encefálico, acidente vascular encefálico ou depressão primária, acuidade visual mínima 20/30 mensurada pelo Teste de Snellen e que participaram regularmente do Programa de Estimulação Multissensorial e Cognitiva. Foram realizadas reavaliações em cinco períodos (2, 4, 6, 8 e 12 meses) após a finalização da intervenção multissensorial e cognitiva. Para isso empregou-se o Mini Exame do Estado Mental (MEEM); nomeação de Boston; fluência verbal semântica (FVS) e fonológica (FVF), testes da Bateria Montreal de Avaliação da Comunicação (MAC), Teste de Narrativa “Roubo de Biscoitos” e testes neuropsicológicos selecionados da Bateria Cambridge (CANTAB) incluindo: Triagem Motora (Motor Screening – MOT); Processamento Rápido de Informação Visual (Rapid Visual Information Processing – RVP); Tempo de Reação (Reaction Time - RTI); Aprendizagem Pareada (Paired Associates Learning - PAL); Memória de Trabalho Espacial (Spatial Working Memory - SWM) e Pareamento com Atraso (Delayed matching to sample - DMS). Os resultados apontaram diferenças estatisticamente significativas entre os grupos revelando taxa de declínio cognitivo maior nos idosos institucionalizados. Esses resultados confirmam sugestão anterior de que o ambiente pobre de estímulos somato-motores e cognitivos das instituições de longa permanência aceleram o declínio cognitivo senil. Além disso, a análise das curvas ROC seguido dos cálculos de sensibilidade, especificidade e eficiência para cada teste revelou que os testes da bateria CANTAB para memória e aprendizado espacial pareado assim como para memória espacial de trabalho permitiram a distinção entre os grupos I e NI em todas janelas de reavaliação. Os resultados demonstraram que uma vez cessado o programa de estimulação, se observa em ambos os grupos declínio cognitivo progressivo, com perdas mais precoces e mais intensas nos idosos institucionalizados do que naqueles vivendo em comunidade com suas famílias. Além disso, observou-se que a duração dos efeitos benéficos sobre o desempenho nos testes neuropsicológicos de ambos os grupos é heterogêneo, e que os efeitos de proteção guardam relação estreita com a natureza das oficinas. Por conta disso os escores dos testes de linguagem declinaram mais lentamente. Os resultados reúnem evidências que permitem a recomendação de programas regulares de estimulação somatomotora e cognitiva para idosos institucionalizados com o intuito de promover a redução da taxa de progressão do declínio cognitivo senil.

A influência da integração multissensorial na construção do espaço semântico no sistema Kansei de engenharia: um estudo de Design Ergonômico com barbeadores descartáveis

Pós-graduação em Design - FAAC

Deficiência visual e educação científica: orientações didáticas com um aporte na neurociência cognitiva e teoria dos campos conceituais

The aim of this paper is to present an educational proposal with didactic and pedagogical orientations, to the Science Education for people with visual impairments. Then, we use as main reference, Gérard Vergnaud’s Theory of Conceptual Fields, joining with a translational focus, applying empirical results of Cognitive Neuroscience. Within this, we highlight the role of educational activities related with 'multisensory scientific literacy ', focusing on the linguistic triad: read, interpretation and textual representation. We hope this perspective, become in the future an important component on guidelines for composing a 'semiotic protocol' for Science Education. Realizing too, epistemological peculiarities, pedagogic and didactic specificities in this area, and, revealing such properties on the cognitive constructs, for science and technology education.

Didática multissensorial e o ensino inclusivo de ciências

Considering the discussions about the inclusion of disabled people in the regular education and the need to find methodologies that meet the diverse needs of students, this work brings to the discussion the multisensory didactic perspective as an alternative to science inclusive teaching.

Segregated anatomical input to sub-regions of the rodent superior colliculus associated with approach and defense

The superior colliculus (SC) is responsible for sensorimotor transformations required to direct gaze toward or a way from unexpected, biologically salient events. Significant changes in the external world are signaled to SC through primary multisensory afferents, spatially organized according to a retinotopic topography. For animals, where anunexpected event could indicate the presence of either predator or prey, early decisions to approach or avoid are particularly important. Rodents' ecology dictates predators are most often detected initially as movements in upper visual field (mapped in medial SC), while appetitive stimuli are normally found in lower visual field (mapped in lateral SC). Our purpose was to exploit this functional segregation to reveal neural sites that can bias or modulate initial approach or avoidance responses. Small injections of Fluoro-Gold were made into medial or lateral sub-regions of intermediate and deep layers of SC (SCm/SCl). A remarkable segregation of input to these two functionally defined areas was found. (i) There were structures that projected only to SCm (e.g., specific cortical areas, lateral geniculate and suprageniculate thalamic nuclei, ventromedial and premammillary hypothalamic nuclei, and several brain-stem areas) or SCl (e.g., primary somatosensory cortex representing upper body parts and vibrissae and parvicellular reticular nucleus in the brainstem). (ii) Other structures projected to both SCm and SCl but from topographically segregated populations of neurons (e.g., zona incerta and substantia nigra pars reticulata). (iii) There were a few brainstem areas in which retrogradely labeled neurons were spatially overlapping (e.g., pedunculopontine nucleus and locus coeruleus). These results indicate significantly more structures across the rat neuraxis are in a position to modulate defense responses evoked from SCm, and that neural mechanisms modulating SC-mediated defense or appetitive behavior are almost entirely segregated.

Computer game-based and traditional learning method: a comparison regarding students’ knowledge retention

Abstract Background Educational computer games are examples of computer-assisted learning objects, representing an educational strategy of growing interest. Given the changes in the digital world over the last decades, students of the current generation expect technology to be used in advancing their learning requiring a need to change traditional passive learning methodologies to an active multisensory experimental learning methodology. The objective of this study was to compare a computer game-based learning method with a traditional learning method, regarding learning gains and knowledge retention, as means of teaching head and neck Anatomy and Physiology to Speech-Language and Hearing pathology undergraduate students. Methods Students were randomized to participate to one of the learning methods and the data analyst was blinded to which method of learning the students had received. Students’ prior knowledge (i.e. before undergoing the learning method), short-term knowledge retention and long-term knowledge retention (i.e. six months after undergoing the learning method) were assessed with a multiple choice questionnaire. Students’ performance was compared considering the three moments of assessment for both for the mean total score and for separated mean scores for Anatomy questions and for Physiology questions. Results Students that received the game-based method performed better in the pos-test assessment only when considering the Anatomy questions section. Students that received the traditional lecture performed better in both post-test and long-term post-test when considering the Anatomy and Physiology questions. Conclusions The game-based learning method is comparable to the traditional learning method in general and in short-term gains, while the traditional lecture still seems to be more effective to improve students’ short and long-term knowledge retention.

Models for the study of neuronal activity during cognitive tasks

Assessment of brain connectivity among different brain areas during cognitive or motor tasks is a crucial problem in neuroscience today. Aim of this research study is to use neural mass models to assess the effect of various connectivity patterns in cortical EEG power spectral density (PSD), and investigate the possibility to derive connectivity circuits from EEG data. To this end, two different models have been built. In the first model an individual region of interest (ROI) has been built as the parallel arrangement of three populations, each one exhibiting a unimodal spectrum, at low, medium or high frequency. Connectivity among ROIs includes three parameters, which specify the strength of connection in the different frequency bands. Subsequent studies demonstrated that a single population can exhibit many different simultaneous rhythms, provided that some of these come from external sources (for instance, from remote regions). For this reason in the second model an individual ROI is simulated only with a single population. Both models have been validated by comparing the simulated power spectral density with that computed in some cortical regions during cognitive and motor tasks. Another research study is focused on multisensory integration of tactile and visual stimuli in the representation of the near space around the body (peripersonal space). This work describes an original neural network to simulate representation of the peripersonal space around the hands, in basal conditions and after training with a tool used to reach the far space. The model is composed of three areas for each hand, two unimodal areas (visual and tactile) connected to a third bimodal area (visual-tactile), which is activated only when a stimulus falls within the peripersonal space. Results show that the peripersonal space, which includes just a small visual space around the hand in normal conditions, becomes elongated in the direction of the tool after training, thanks to a reinforcement of synapses.