The Trembling Line

The Trembling Line is a film and multi-channel sound installation exploring the visual and acoustic echoes between decipherable musical gestures and abstract patterning, orchestral swells and extreme high-speed slow-motion close-ups of strings and percussion. It features a score by Leo Grant and a newly devised multichannel audio system by the Institute of Sound and Vibration Research, University of Southampton. The multi-channel speaker array is devised as an intimate sound spatialisation system in which each element of sound can be pried apart and reconfigured, to create a dynamically disorienting sonic experience. It becomes the inside of a musical instrument, an acoustic envelope or cage of sorts, through which viewers are invited to experience the film and generate cross-sensory connections and counterpoints between the sound and the visuals. Funded by a Leverhulme Artist-in-Residence Award and John Hansard Gallery, with support from ISVR and the Music Department, University of Southampton. The project provided a rare opportunity to work creatively with new cutting edge developments in sound distribution devised by ISVR, devising a new speaker array, a multi- channel surround listening sphere which spatialises the auditory experience. The sphere is currently used by ISVR for outreach and teaching purposes, and has enables future collaborations between music staff and students at Southampton University and staff and ISVR. Exhibitions: Solo exhibition at John Hansard Gallery, Southampton (Dec 2015-Jan 2016), across 5 rooms, including a retrospective of five previous film-works and a new series of photographic stills. Public lectures: two within the gallery. Reviews and interviews: Art Monthly, Studio International, The Quietus, The Wire Magazine.

Multi-scale cortical keypoints for realtime hand tracking and gesture recognition

Human-robot interaction is an interdisciplinary research area which aims at integrating human factors, cognitive psychology and robot technology. The ultimate goal is the development of social robots. These robots are expected to work in human environments, and to understand behavior of persons through gestures and body movements. In this paper we present a biological and realtime framework for detecting and tracking hands. This framework is based on keypoints extracted from cortical V1 end-stopped cells. Detected keypoints and the cells’ responses are used to classify the junction type. By combining annotated keypoints in a hierarchical, multi-scale tree structure, moving and deformable hands can be segregated, their movements can be obtained, and they can be tracked over time. By using hand templates with keypoints at only two scales, a hand’s gestures can be recognized.

Biologically Inspired Vision for Indoor Robot Navigation

Ultrasonic, infrared, laser and other sensors are being applied in robotics. Although combinations of these have allowed robots to navigate, they are only suited for specific scenarios, depending on their limitations. Recent advances in computer vision are turning cameras into useful low-cost sensors that can operate in most types of environments. Cameras enable robots to detect obstacles, recognize objects, obtain visual odometry, detect and recognize people and gestures, among other possibilities. In this paper we present a completely biologically inspired vision system for robot navigation. It comprises stereo vision for obstacle detection, and object recognition for landmark-based navigation. We employ a novel keypoint descriptor which codes responses of cortical complex cells. We also present a biologically inspired saliency component, based on disparity and colour.

A aula universitária:figurações das coreografias de ensino

Tese de doutoramento, Educação (Formação de Professores), Universidade de Lisboa, Instituto de Educação, 2013

A trajectória do auto-retrato pintado na história da arte em Portugal : da emergência à afirmação do género, na contemporaneidade, 1470-1975

Tese de doutoramento, História (História da Arte), Universidade de Lisboa, Faculdade de Letras, 2015

Reconhecimento de língua gestual

Trabalho Final de Mestrado para obtenção do grau de Mestre em Engenharia Informática e Computadores

O Peso da gravidade: corpos e gestos na poesia galego-portuguesa

This article studies how galician-portuguese medieval poetry deals with the human body and the human gestures, taking in account the three major poetical genres, the love song, the "amiga" song (feminine voices) and the satyrical song.

Análise da tradução e legendagem da sátira no mockumentary

O presente trabalho foi elaborado no âmbito da dissertação do Mestrado em Tradução e Interpretação Especializadas, e tem como objectivo estudar o formato mockumentary, no qual se baseia a minha análise, e compreender as especificidades da tradução do elemento satírico de que este híbrido se pode revestir, enquanto elemento potenciador de comicidade. A Tradução Audiovisual é um fenómeno com que nos deparamos diariamente, seja a partir de uma televisão, de um ecrã de computador ou de um dispositivo móvel, em que estamos perante um conjunto de elementos semióticos diversos, para os quais concorre uma combinação essencial de quatro canais, a saber, o canal visual, acústico, verbal e não-verbal. O tradutor deve ter em consideração não só o código verbal, como também os elementos que não são estritamente linguísticos, como gestos, música, expressões faciais, etc. Dado que Uma Família Muito Moderna, sobre a qual baseei a minha análise, é uma série humorística com um forte pendor satírico, afigurou-se como primeiro objecto de estudo por descrever o mockumentary e analisar como esse humor se verifica na versão portuguesa. Deste modo, impõe-se abordar a questão da tradução do humor, neste caso de trocadilhos (wordplay), puns e casos de polissemia, bem como da tradução de referências culturais e intertextuais. Para esse efeito, procedi a uma análise contrastiva entre o texto original, em língua inglesa, e verificar a recuperação do tom satírico potenciador de humor nas legendas, na língua de chegada, em língua portuguesa. Em conjunto, estes elementos concorrem para a construção de um texto que, no caso deste mockumentary, se reveste de um forte tom satírico - mock - para a criação de humor, apresentando uma série que, apesar de indubitavelmente fictícia, revela determinados traços associados a formatos televisivos informativos - documentary - , transmitindo ao espectador uma ilusão de realidade e de factualidade.

Neurophysiological origin of human brain asymmetry for speech and language.

The physiological basis of human cerebral asymmetry for language remains mysterious. We have used simultaneous physiological and anatomical measurements to investigate the issue. Concentrating on neural oscillatory activity in speech-specific frequency bands and exploring interactions between gestural (motor) and auditory-evoked activity, we find, in the absence of language-related processing, that left auditory, somatosensory, articulatory motor, and inferior parietal cortices show specific, lateralized, speech-related physiological properties. With the addition of ecologically valid audiovisual stimulation, activity in auditory cortex synchronizes with left-dominant input from the motor cortex at frequencies corresponding to syllabic, but not phonemic, speech rhythms. Our results support theories of language lateralization that posit a major role for intrinsic, hardwired perceptuomotor processing in syllabic parsing and are compatible both with the evolutionary view that speech arose from a combination of syllable-sized vocalizations and meaningful hand gestures and with developmental observations suggesting phonemic analysis is a developmentally acquired process.

"Man of science, man of faith" : Lost, consumer agency and the fate/free will binary in the post-9/11 context

In 2004, Lost debuted on ABC and quickly became a cultural phenomenon. Its postmodem take on the classic Robinson Crusoe desert island scenario gestures to a variety of different issues circulating within the post-9II1 cultural consciousness, such as terrorism, leadership, anxieties involving air travel, torture, and globalization. Lost's complex interwoven flashback and flash-forward narrative structure encourages spectators to creatively hypothesize solutions to the central mysteries of the narrative, while also thematically addressing archetypal questions of freedom of choice versus fate. Through an examination of the narrative structure, the significance of technological shifts in television, and fan cultures in Lost, this thesis discusses the tenuous notion of consumer agency within the current cultural context. Furthermore, I also explore these issues in relation to the wider historical post-9/II context.

The influence of emotional body posture on adults' and 8-year-olds' perception facial expressions

The present set of experiments was designed to investigate the development of children's sensitivity of facial expressions observed within emotional contexts. Past research investigating both adults' and children's perception of facial expressions has been limited primarily to the presentation of isolated faces. During daily social interactions, however, facial expressions are encountered within contexts conveying emotions (e.g., background scenes, body postures, gestures). Recently, research has shown that adults' perception of facial expressions is influenced by these contexts. When emotional faces are shown in incongruent contexts (e.g., when an angry face is presented in a context depicting fear) adults' accuracy decreases and their reaction times increase (e.g., Meeren et a1. 2005). To examine the influence of emotional body postures on children's perception of facial expressions, in each of the experiments in the current study adults and 8-year-old children made two-alternative forced choice decisions about facial expressions presented in congruent (e.g., a face displayed sadness on a body displaying sadness) and incongruent (e.g., a face displaying fear on a body displaying sadness) contexts. Consistent with previous studies, a congruency effect (better performance on congruent than incongruent trials) was found for both adults and 8-year-olds when the emotions displayed by the face and body were similar to each other (e.g., fear and sad, Experiment l a ) ; the influence of context was greater for 8-year-olds than adults for these similar expressions. To further investigate why the congruency effect was larger for children than adults in Experiment 1 a, Experiment 1 b was conducted to examine if increased task difficulty would increase the magnitude of adults' congruency effects. Adults were presented with subtle facial and despite successfully increasing task difficulty the magnitude of the. congruency effect did not increase suggesting that the difference between children's and adults' congruency effects in Experiment l a cannot be explained by 8-year-olds finding the task difficult. In contrast, congruency effects were not found when the expressions displayed by the face and body were dissimilar (e.g., sad and happy, see Experiment 2). The results of the current set of studies are examined with respect to the Dimensional theory and the Emotional Seed model and the developmental timeline of children's sensitivity to facial expressions. A secondary aim of the series of studies was to examine one possible mechanism underlying congruency effe cts-holistic processing. To examine the influence of holistic processing, participants completed both aligned trials and misaligned trials in which the faces were detached from the body (designed to disrupt holistic processing). Based on the principles of holistic face processing we predicted that participants would benefit from misalignment of the face and body stimuli on incongruent trials but not on congruent trials. Collectively, our results provide some evidence that both adults and children may process emotional faces and bodies holistically. Consistent with the pattern of results for congruency effects, the magnitude of the effect of misalignment varied with the similarity between emotions. Future research is required to further investigate whether or not facial expressions and emotions conveyed by the body are perceived holistically.

Impact des émotions sur les performances

Les émotions jouent un rôle primordial dans les processus cognitifs et plus particulièrement dans les tâches d’apprentissage. D’ailleurs, plusieurs recherches neurologiques ont montré l’interrelation qui existe entre la cognition et les émotions. Elles ont aussi déterminé plusieurs formes d’intelligence humaine autre que l’intelligence rationnelle parmi lesquelles nous distinguons la forme ayant comme dimension émotionnelle, à savoir l’intelligence émotionnelle, vu son impact sur les processus d’apprentissage. L’intelligence émotionnelle est alors un facteur significatif de réussite scolaire et professionnelle. Sous la lumière de ces constatations présentées, les informaticiens à leur tour, vont alors tenter de consentir de plus en plus de place au facteur émotionnel dans les systèmes informatiques et plus particulièrement dans ceux dédiés à l’apprentissage. L’intégration de l’intelligence émotionnelle dans ces systèmes et plus précisément, dans les Systèmes Tutoriels Intelligents (STI), va leur permettre de gérer les émotions de l’apprenant et par la suite améliorer ses performances. Dans ce mémoire, notre objectif principal est d’élaborer une stratégie d’apprentissage visant à favoriser et accentuer la mémorisation chez les enfants. Pour atteindre cet objectif, nous avons développé un cours d’anglais en ligne ainsi qu’un tuteur virtuel utilisant des ressources multimédia tels que le ton de la voix, la musique, les images et les gestes afin de susciter des émotions chez l’apprenant. Nous avons conduit une expérience pour tester l’efficacité de quelques stratégies émotionnelles ainsi qu’évaluer l’impact des émotions suscitées sur la capacité de mémorisation des connaissances à acquérir par l’apprenant. Les résultats de cette étude expérimentale ont prouvé que l’induction implicite des émotions chez ce dernier a une influence significative sur ses performances. Ils ont également montré qu’il n’existe pas une stratégie efficace pour tous les apprenants à la fois, cependant l’efficacité d’une telle stratégie par rapport à une autre dépend essentiellement du profil comportemental de l’apprenant déterminé à partir de son tempérament.

Le rapport geste-son en musique électroacoustique

La version intégrale de ce mémoire est disponible uniquement pour consultation individuelle à la Bibliothèque de musique de l’Université de Montréal (www.bib.umontreal.ca/MU).

De l'ethnicité dans les langages musicaux contemporains : au-delà de l'exotisme : processus de composition de quatre oeuvres : Deux tempêtes et une langueur, Sept gestes ludiques, Azabache, Landocinogena

La version intégrale de ce mémoire est disponible uniquement pour consultation individuelle à la Bibliothèque de musique de l’Université de Montréal.

Lecture pragmatique de trois contes québécois contemporains : Jos Gallant d’André Lemelin, Ti Pinge de Joujou Turenne, L’entrain à vapeur de Fred Pellerin

Dans ce mémoire, les contes de trois conteurs contemporains du Québec – Jos Gallant d’André Lemelin, Ti Pinge de Joujou Turenne et L’entrain à vapeur, de Fred Pellerin – font avant tout l’objet d’une lecture pragmatique afin de mieux comprendre comment le conteur, qui emploie le canevas en spectacle, transmet une fiction à un auditoire ou à un lectorat. L’étude présente d’abord une analyse comparative de chacune des prestations avec la version publiée d’un même récit et met ainsi en relief leurs points de convergence et de divergence. Selon l’hypothèse avancée, l’analyse de la prestation des conteurs qui suivent un canevas révèlerait comment s’y manifestent les dimensions performatives et les articulations du discours fictionnel. Corrélativement, l’examen des rapports entre le conteur et son public permet ensuite de s’interroger sur le statut du narrateur et de voir en quoi et comment, durant la performance, la fiction est partagée avec l’auditoire. L’analyse des énoncés performatifs, inspirés des travaux de Kerbrat-Orechionni et la dynamique de vectorisation proposée par Pavis pour l’étude de la gestuelle, des mimiques et de la voix, sont mises à contribution et visent également à dégager les outils pouvant servir à l’analyse des spectacles de contes. Au terme de cette recherche, l’auteure démontre les avantages liés au canevas, notamment en ce qui concerne les interactions qu’il favorise avec le public et dans la liberté qu’il procure, en permettant de modifier ou d’adapter le discours et les ressources expressives du conteur à chacune de ses représentations.