Secular Possession: Cinematic Iconography of Addiction

Addiction, and the experience of being addicted, is notoriously difficult to describe verbally and explain rationally. Would multifaceted and multisensory cinematic images work better in making addiction understandable? This study enquires how cinematic expression can render visible the experience of being addicted which is invisible as such. The basic data consists of circa 50 mainly North American and European fiction films from the early 1900s to the early 2000s that deal with addictive disorders as defined in the psychiatric DSM-V classification (substance dependence- and gambling disorders). The study develops an approach for analyzing and interpreting a large volume of digital film data: digital cinematic iconography is a framework to study the multifaceted cinematic images by processing and viewing them in the “digital image-laboratory” of the computer. Images are cut and classified by editing software and algorithmic sorting. The approach draws on early 1900s German art historian Aby Waburg’s image research and media archaeology, that are connected to film studies inspired by the phenomenology of the body and Gilles Deleuze’s film-philosophy. The first main chapter, “Montage”, analyses montage, gestural and postural images, and colors in addiction films. The second main chapter, “Thingness”, focuses on the close-ups of material objects and faces, and their relation to the theme of spirituality in cinema and art history, The study argues that the cinema engages the spectator to "feel" what addiction is through everyday experience and art historical imagery. There is a particular, historically transmitted cinematic iconography of addiction that is profane, material, thing-centered, abject, and repetitive. The experience of being addicted is visualized through montages of images characterized by dark and earthy colors, horizontal compositions and downward- directed movements. This is very profane and secular imagery that, however, circulates image-historical traces of Christian iconography, such as that of being in the grip of an unknown power.

Perennial negotiations/elemental encounters autoethnographic perspectives on approaching food sovereignty

This thesis uses a multifaceted process to engage with the topic of food sovereignty in California. It employs diverse methods, including critical and creative prose, photography, autoethnographic mixed media, storytelling and poetry. I am particularly concerned with the " " challenges of approaching food sovereignty, a radical praxis that combines subsistence practices with anti-capitalist resistance, while in my own "skin," which is thoroughly embedded in white, urban, middle classed culture and in corltextualizing ecological relationshipslkinships via cultural, historical and economic trajectories. The project utilizes a processual methodlology drawing substantially from the work of Brian Massumi to explore these issues through four creative narrative pieces which coalesce around the elemental metaphors of air, fire, water and earth. Following Deleuze and Guatarri's concept ofrhizomatic plateaus, the thesis narratives are comprised of many non-hierarchical layers and can be read from many angles. Each is offered "in process" rather than as a finished piece, thus practically validating the concept of the ongoing work of research and suggesting the equally omnipresent possibility of change and mutation in the formation relationally based knowledges. Cultivating ecological ethic and healing on multisensory levels, as well as commitment to emergent and re-productivist worldviews are goals of this project's research.

Geographical Applications for Sound Walks

Geography has long been a predominantly visual discipline, but recent work in geography has sought to explore the multisensory, embodied, emotional and affective dimensions of people’s relations with places. One way to engage this type of exploration is through the use of sound walks: walks along a specified route accompanied by a soundtrack (on headphones or stationary speakers) that conveys information, enacts a story, produces an ambience or atmosphere, or illuminates certain aspects of the environment through which the listener is walking. This thesis aims to show how geographers can benefit from using sound walks as thinking tools, representational tools and teaching tools. Drawing on my own experiences producing sound walks, I first examine the ways that sound walk production processes help generate productive geographical thinking for those producing sound walks (Chapter Two). The various stages of producing a sound walk require different skill sets, pose different challenges, and require different sorts of environmental awareness, and therefore present novel opportunities for developing geographical insights about specific places or spatial relations. Second, I focus on four experientially-oriented aspects of sound walks – using multiple senses, walking, contingency, and moments of interaction – to argue that sound walks can be useful representational tools for geographers, whether those creating sound walks subscribe to a representational or non-representational theory of knowledge (Chapter Three). The value of sound walks as representational tools is in the experience of ‘doing’ them. That is, audiences discover for themselves through interaction what is being represented, rather than having it delivered to them. The experiential elements of ‘doing’ sound walks recommend them as potentially helpful representational tools for geographers. Third, by examining the work of a small sample of fourth year “Advanced Geography of Music” students, I develop the argument that sound walks can be effective tools for teaching students and for creating circumstances for students to learn independently (Chapter Four). Sound walks have potential to be effective pedagogical tools because they are commensurate with several key pedagogical schools of thought that emphasise the importance of requiring students to engage actively with their environment using a combination of senses. The thesis demonstrates that sound walks are a worthwhile resource for geographers to use theoretically, representationally and pedagogically in their work. The next step is for geographers to put them into practice and realize this potential.

Implications fonctionnelles du collicule inférieur chez l'humain

Le rôle du collicule inférieur dans les divers processus auditif demeure à ce jour méconnu chez l’humain. À l’aide d’évaluations comportementales et électrophysiologiques, le but des études consiste à examiner l’intégrité fonctionnelle du système nerveux auditif chez une personne ayant une lésion unilatérale du collicule inférieur. Les résultats de ces études suggèrent que le collicule inférieur n’est pas impliqué dans la détection de sons purs, la reconnaissance de la parole dans le silence et l’interaction binaurale. Cependant, ces données suggèrent que le collicule inférieur est impliqué dans la reconnaissance de mots dans le bruit présentés monauralement, la discrimination de la fréquence, la reconnaissance de la durée, la séparation binaurale, l’intégration binaurale, la localisation de sources sonores et, finalement, l’intégration multisensorielle de la parole.

Étude psychophysique d'une illusion visuelle induite par le son

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal

Exploring the neural entrainment to musical rhythms and meter : a steady-state evoked potential approach

Thèse de doctorat réalisé en cotutelle avec l'Université catholique de Louvain, Belgique (Faculté de médecine, Institut de Neuroscience)

Interactions multimodales visuelles et tactiles dans l’espace

L’intégration de stimulations provenant de modalités sensorielles différentes nous offre des avantages perceptifs tels qu’une meilleure discrimination et une accélération des temps de réponse (TR) face aux évènements environnementaux. Cette thèse a investigué les effets de la position spatiale de stimulations visuelles et tactiles sur le gain de redondance (GR), qui correspond à une réduction du temps de réaction lorsque deux stimulations sont présentées simultanément plutôt qu’isolément. La première étude a comparé le GR lorsque les mêmes stimulations visuotactiles sont présentées dans une tâche de détection et une tâche de discrimination spatiale. Les stimulations étaient présentées unilatéralement dans le même hémichamp ou bilatéralement dans les hémichamps opposés. Dans la tâche de détection, les participants devaient répondre à toutes les stimulations, peu importe leur localisation. Les résultats de cette tâche démontrent que les stimulations unilatérales et bilatérales produisent un GR et une violation du modèle de course indissociables. Dans la tâche de discrimination spatiale où les participants devaient répondre seulement aux stimulations présentées dans l’hémichamp droit, les TR aux stimulations bilatérales étaient moins rapides. Nous n’avons pas observé de différence entre le GR maximal obtenu dans l’une ou l’autre des tâches de cette étude. Nous concluons que lorsque l’information spatiale n’est pas pertinente pour accomplir la tâche, les stimulations unilatérales et bilatérales sont équivalentes. La manipulation de la pertinence de l’information spatiale permet donc d’induire une altération du GR en fonction de la localisation des stimulations. Lors d’une seconde étude, nous avons investigué si la différence entre les gains comportementaux résultants de l’intégration multimodale et intramodale dépend de la configuration spatiale des stimulations. Les résultats montrent que le GR obtenu pour les conditions multimodales surpasse celui obtenu pour les stimulations intramodales. De plus, le GR des conditions multimodales n’est pas influencé par la configuration spatiale des stimulations. À l’opposé, les stimulations intramodales produisent un GR plus important iii lorsque les stimulations sont présentées bilatéralement. Nos résultats suggèrent que l’intégration multimodale et intramodale se distinguent quant au GR qu’ils produisent et quant aux conditions nécessaires à cette amélioration. La troisième étude examine le rôle du corps calleux (CC) dans l’observation du GR obtenu pour les stimulations multimodales et intramodales lorsque celles-ci sont présentées unilatéralement et bilatéralement. Quatre patients ayant une agénésie congénitale du corps calleux (AgCC) et un patient callosotomisé ont été comparés à des individus normaux dans une tâche de détection. Dans l’ensemble, les résultats suggèrent que le CC n’est pas nécessaire pour l’intégration interhémisphérique de stimulations multimodales. Sur la base d’études précédentes démontrant le rôle des collicules supérieurs (CS) dans l’intégration multimodale, nous concluons qu’en l’absence du CC, les bénéfices comportementaux résultants d’un traitement sous-cortical par les CS ne reflètent pas les règles d’intégration observées dans les études neurophysiologiques chez l’animal.

Réadaptation et performance visuelle chez la personne hémianopsique : une étude de cas portant sur les saccades oculaires et le blindsight.

But: La perte unilatérale du cortex visuel postérieur engendre une cécité corticale controlatérale à la lésion, qu’on appelle hémianopsie homonyme (HH). Celle-ci est notamment accompagnée de problèmes d’exploration visuelle dans l’hémichamp aveugle dus à des stratégies oculaires déficitaires, qui ont été la cible des thérapies de compensation. Or, cette perte de vision peut s’accompagner d’une perception visuelle inconsciente, appelée blindsight. Notre hypothèse propose que le blindsight soit médié par la voie rétino-colliculaire extrastriée, recrutant le colliculus supérieur (CS), une structure multisensorielle. Notre programme a pour objectif d’évaluer l’impact d’un entraînement multisensoriel (audiovisuel) sur la performance visuelle inconsciente des personnes hémianopsiques et les stratégies oculaires. Nous essayons, ainsi, de démontrer l’implication du CS dans le phénomène de blindsight et la pertinence de la technique de compensation multisensorielle comme thérapie de réadaptation. Méthode: Notre participante, ML, atteinte d’une HH droite a effectué un entraînement d’intégration audiovisuel pour une période de 10 jours. Nous avons évalué la performance visuelle en localisation et en détection ainsi que les stratégies oculaires selon trois comparaisons principales : (1) entre l’hémichamp normal et l’hémichamp aveugle; (2) entre la condition visuelle et les conditions audiovisuelles; (3) entre les sessions de pré-entraînement, post-entraînement et 3 mois post-entraînement. Résultats: Nous avons démontré que (1) les caractéristiques des saccades et des fixations sont déficitaires dans l’hémichamp aveugle; (2) les stratégies saccadiques diffèrent selon les excentricités et les conditions de stimulations; (3) une adaptation saccadique à long terme est possible dans l’hémichamp aveugle si l’on considère le bon cadre de référence; (4) l’amélioration des mouvements oculaires est liée au blindsight. Conclusion(s): L’entraînement multisensoriel conduit à une amélioration de la performance visuelle pour des cibles non perçues, tant en localisation qu’en détection, ce qui est possiblement induit par le développement de la performance oculomotrice.

Optokinetic stimulation induces illusory movement of both out-of-the-body and on-the-body hand-held visual objects

The coding of body part location may depend upon both visual and proprioceptive information, and allows targets to be localized with respect to the body. The present study investigates the interaction between visual and proprioceptive localization systems under conditions of multisensory conflict induced by optokinetic stimulation (OKS). Healthy subjects were asked to estimate the apparent motion speed of a visual target (LED) that could be located either in the extrapersonal space (visual encoding only, V), or at the same distance, but stuck on the subject's right index finger-tip (visual and proprioceptive encoding, V-P). Additionally, the multisensory condition was performed with the index finger kept in position both passively (V-P passive) and actively (V-P active). Results showed that the visual stimulus was always perceived to move, irrespective of its out- or on-the-body location. Moreover, this apparent motion speed varied consistently with the speed of the moving OKS background in all conditions. Surprisingly, no differences were found between V-P active and V-P passive conditions in the speed of apparent motion. The persistence of the visual illusion during the active posture maintenance reveals a novel condition in which vision totally dominates over proprioceptive information, suggesting that the hand-held visual stimulus was perceived as a purely visual, external object despite its contact with the hand.

Working with Dyslexic Learners: Authoring in a Multimedia Environment

The fundamental principles of the teaching methodology followed for dyslexic learners evolve around the need for a multisensory approach, which would advocate repetition of learning tasks in an enjoyable way. The introduction of multimedia technologies in the field of education has supported the merging of new tools (digital camera, scanner) and techniques (sounds, graphics, animation) in a meaningful whole. Dyslexic learners are now given the opportunity to express their ideas using these alternative media and participate actively in the educational process. This paper discussed the preliminary findings of a single case study of two English monolingual dyslexic children working together to create an open-ended multimedia project on a laptop computer. The project aimed to examine whether and if the multimedia environment could enhance the dyslexic learners’ skills in composition. Analysis of the data has indicated that the technological facilities gave the children the opportunity to enhance the style and content of their work for a variety of audiences and to develop responsibilities connected to authorship.

Does tool use extend peripersonal space? A review and re-analysis

The fascinating idea that tools become extensions of our body appears in artistic, literary, philosophical, and scientific works alike. In the last fifteen years, this idea has been re-framed into several related hypotheses, one of which states that tool use extends the neural representation of the multisensory space immediately surrounding the hands (variously termed peripersonal space, peri-hand space, peri-cutaneous space, action space, or near space). This and related hypotheses have been tested extensively in the cognitive neurosciences, with evidence from molecular, neurophysiological, neuroimaging, neuropsychological, and behavioural fields. Here, I briefly review the evidence for and against the hypothesis that tool use extends a neural representation of the space surrounding the hand, concentrating on neurophysiological, neuropsychological, and behavioural evidence. I then provide a re-analysis of data from six published and one unpublished experiments using the crossmodal congruency task to test this hypothesis. While the re-analysis broadly confirms the previously-reported finding that tool use does not literally extend peripersonal space, the overall effect-sizes are small and statistical power is low. I conclude by questioning whether the crossmodal congruency task can indeed be used to test the hypothesis that tool use modifies peripersonal space.

Top down influence on visuo-tactile interaction modulates neural oscillatory responses

Multisensory integration involves bottom-up as well as top-down processes. We investigated the influences of top-down control on the neural responses to multisensory stimulation using EEG recording and time-frequency analyses. Participants were stimulated at the index or thumb of the left hand, using tactile vibrators mounted on a foam cube. Simultaneously they received a visual distractor from a light emitting diode adjacent to the active vibrator (spatially congruent trial) or adjacent to the inactive vibrator (spatially incongruent trial). The task was to respond to the elevation of the tactile stimulus (upper or lower), while ignoring the simultaneous visual distractor. To manipulate top-down control on this multisensory stimulation, the proportion of spatially congruent (vs. incongruent) trials was changed across blocks. Our results reveal that the behavioral cost of responding to incongruent than congruent trials (i.e., the crossmodal congruency effect) was modulated by the proportion of congruent trials. Most importantly, the EEG gamma band response and the gamma-theta coupling were also affected by this modulation of top-down control, whereas the late theta band response related to the congruency effect was not. These findings suggest that gamma band response is more than a marker of multisensory binding, being also sensitive to the correspondence between expected and actual multisensory stimulation. By contrast, theta band response was affected by congruency but appears to be largely immune to stimulation expectancy.

Interactive sensory objects for improving access to heritage

In this project we explore how to enhance the experience and understanding of cultural heritage in museums and heritage sites by creating interactive multisensory objects collaboratively with artists, technologists and people with learning disabilities. We focus here on workshops conducted during the first year of a three year project in which people with learning disabilities each constructed a 'sensory box' to represent their experiences of Speke Hall, a heritage site in the UK. The box is developed further in later workshops which explore aspects of physicality and how to appeal to the entire range of senses, making use of Arduino technology and basic sensors to enable an interactive user experience.

N1 enhancement in synesthesia during visual and audio-visual perception in semantic cross-modal conflict situations: an ERP study

Synesthesia entails a special kind of sensory perception, where stimulation in one sensory modality leads to an internally generated perceptual experience of another, not stimulated sensory modality. This phenomenon can be viewed as an abnormal multisensory integration process as here the synesthetic percept is aberrantly fused with the stimulated modality. Indeed, recent synesthesia research has focused on multimodal processing even outside of the specific synesthesia-inducing context and has revealed changed multimodal integration, thus suggesting perceptual alterations at a global level. Here, we focused on audio-visual processing in synesthesia using a semantic classification task in combination with visually or auditory-visually presented animated and in animated objects in an audio-visual congruent and incongruent manner. Fourteen subjects with auditory-visual and/or grapheme-color synesthesia and 14 control subjects participated in the experiment. During presentation of the stimuli, event-related potentials were recorded from 32 electrodes. The analysis of reaction times and error rates revealed no group differences with best performance for audio-visually congruent stimulation indicating the well-known multimodal facilitation effect. We found enhanced amplitude of the N1 component over occipital electrode sites for synesthetes compared to controls. The differences occurred irrespective of the experimental condition and therefore suggest a global influence on early sensory processing in synesthetes.

Interactive sensory objects for and by people with learning disabilities

This project engages people with learning disabilities as co-researchers and co-designers in the development of multisensory interactive artworks, with the aim of making museums or heritage sites more interesting, meaningful, and fun. This article describes our explorations, within this context, of a range of technologies including squishy circuits, littleBits, and easy-build websites, and presents examples of objects created by the co-researchers such as “sensory boxes” and interactive buckets, baskets, and boots. Public engagement is an important part of the project and includes an annual public event and seminar day, a blog rich with photos and videos of the workshops, and an activities book to give people ideas for creating their own sensory explorations of museums and heritage sites.