Subtractive and divisive adaptation in visual motion computations

Models of visual motion processing that introduce priors for low speed through Bayesian computations are sometimes treated with scepticism by empirical researchers because of the convenient way in which parameters of the Bayesian priors have been chosen. Using the effects of motion adaptation on motion perception to illustrate, we show that the Bayesian prior, far from being convenient, may be estimated on-line and therefore represents a useful tool by which visual motion processes may be optimized in order to extract the motion signals commonly encountered in every day experience. The prescription for optimization, when combined with system constraints on the transmission of visual information, may lead to an exaggeration of perceptual bias through the process of adaptation. Our approach extends the Bayesian model of visual motion proposed byWeiss et al. [Weiss Y., Simoncelli, E., & Adelson, E. (2002). Motion illusions as optimal perception Nature Neuroscience, 5:598-604.], in suggesting that perceptual bias reflects a compromise taken by a rational system in the face of uncertain signals and system constraints. © 2007.

Perception des vocalisations : études comportementales et d'imagerie par résonance magnétique fonctionnelle événementielle

Thèse numérisée par la Direction des bibliothèques de l'Université de Montréal.

Perception des vocalisations : études comportementales et d'imagerie par résonance magnétique fonctionnelle événementielle

Thèse numérisée par la Direction des bibliothèques de l'Université de Montréal.

Design and implementation of an optimal motion cueing algorithm for the Stuttgart Driving Simulator

Driving simulators emulate a real vehicle drive in a virtual environment. One of the most challenging problems in this field is to create a simulated drive as real as possible to deceive the driver's senses and cause the believing to be in a real vehicle. This thesis first provides an overview of the Stuttgart driving simulator with a description of the overall system, followed by a theoretical presentation of the commonly used motion cueing algorithms. The second and predominant part of the work presents the implementation of the classical and optimal washout algorithms in a Simulink environment. The project aims to create a new optimal washout algorithm and compare the obtained results with the results of the classical washout. The classical washout algorithm, already implemented in the Stuttgart driving simulator, is the most used in the motion control of the simulator. This classical algorithm is based on a sequence of filters in which each parameter has a clear physical meaning and a unique assignment to a single degree of freedom. However, the effects on human perception are not exploited, and each parameter must be tuned online by an engineer in the control room, depending on the driver's feeling. To overcome this problem and also consider the driver's sensations, the optimal washout motion cueing algorithm was implemented. This optimal control-base algorithm treats motion cueing as a tracking problem, forcing the accelerations perceived in the simulator to track the accelerations that would have been perceived in a real vehicle, by minimizing the perception error within the constraints of the motion platform. The last chapter presents a comparison between the two algorithms, based on the driver's feelings after the test drive. Firstly it was implemented an off-line test with a step signal as an input acceleration to verify the behaviour of the simulator. Secondly, the algorithms were executed in the simulator during a test drive on several tracks.

The dorsomedial visual areas in New World and Old World monkeys: homology and function

The extrastriate cortex near the dorsal midline has been described as part of an 'express' pathway that provides visual input to the premotor cortex. This pathway is considered important for the integration of sensory information about the visual field periphery and the skeletomotor system, especially in relation to the control of arm movements. However, a better understanding of the functional contributions of different parts of this complex has been hampered by the lack of data on the extent and boundaries of its constituent visual areas. Recent studies in macaques have provided the first detailed view of the topographical organization of this region in Old World monkeys. Despite differences in nomenclature, a comparison of the visuotopic organization, myeloarchitecture and connections of the relevant visual areas with those previously studied in New World monkeys reveals a remarkable degree of similarity and helps to clarify the subdivision of function between different areas of the dorsomedial complex. A caudal visual area, named DM or V6, appears to be important for the detection of coherent patterns of movement across wide regions of the visual field, such as those induced during self-motion. A rostral area, named M or V6A, is more directly involved with visuomotor integration. This area receives projections both from DM/V6 and from a separate motion analysis channel, centred on the middle temporal visual area (or V5), which detects the movement of objects in extrapersonal space. These results support the suggestion, made earlier on the basis of more fragmentary evidence, that the areas rostral to the second visual area in dorsal cortex are homologous in all simian primates. Moreover, they emphasize the importance of determining the anatomical organization of the cortex as a prerequisite for elucidating the function of different cortical areas.

Selective integration of auditory-visual looming cues by humans.

An object's motion relative to an observer can confer ethologically meaningful information. Approaching or looming stimuli can signal threats/collisions to be avoided or prey to be confronted, whereas receding stimuli can signal successful escape or failed pursuit. Using movement detection and subjective ratings, we investigated the multisensory integration of looming and receding auditory and visual information by humans. While prior research has demonstrated a perceptual bias for unisensory and more recently multisensory looming stimuli, none has investigated whether there is integration of looming signals between modalities. Our findings reveal selective integration of multisensory looming stimuli. Performance was significantly enhanced for looming stimuli over all other multisensory conditions. Contrasts with static multisensory conditions indicate that only multisensory looming stimuli resulted in facilitation beyond that induced by the sheer presence of auditory-visual stimuli. Controlling for variation in physical energy replicated the advantage for multisensory looming stimuli. Finally, only looming stimuli exhibited a negative linear relationship between enhancement indices for detection speed and for subjective ratings. Maximal detection speed was attained when motion perception was already robust under unisensory conditions. The preferential integration of multisensory looming stimuli highlights that complex ethologically salient stimuli likely require synergistic cooperation between existing principles of multisensory integration. A new conceptualization of the neurophysiologic mechanisms mediating real-world multisensory perceptions and action is therefore supported.

Consensus paper: the role of the cerebellum in perceptual processes.

Various lines of evidence accumulated over the past 30 years indicate that the cerebellum, long recognized as essential for motor control, also has considerable influence on perceptual processes. In this paper, we bring together experts from psychology and neuroscience, with the aim of providing a succinct but comprehensive overview of key findings related to the involvement of the cerebellum in sensory perception. The contributions cover such topics as anatomical and functional connectivity, evolutionary and comparative perspectives, visual and auditory processing, biological motion perception, nociception, self-motion, timing, predictive processing, and perceptual sequencing. While no single explanation has yet emerged concerning the role of the cerebellum in perceptual processes, this consensus paper summarizes the impressive empirical evidence on this problem and highlights diversities as well as commonalities between existing hypotheses. In addition to work with healthy individuals and patients with cerebellar disorders, it is also apparent that several neurological conditions in which perceptual disturbances occur, including autism and schizophrenia, are associated with cerebellar pathology. A better understanding of the involvement of the cerebellum in perceptual processes will thus likely be important for identifying and treating perceptual deficits that may at present go unnoticed and untreated. This paper provides a useful framework for further debate and empirical investigations into the influence of the cerebellum on sensory perception.

Auditory localisation and recognition after left inferior collicular lesion: effects of work load on cortical activation patterns (fMRI study)

Evidence from neuropsychological and activation studies (Clarke et al., 2oo0, Maeder et al., 2000) suggests that sound recognitionand localisation are processed by two anatomically and functionally distinct cortical networks. We report here on a case of a patientthat had an interruption of auditory information and we show: i) the effects of this interruption on cortical auditory processing; ii)the effect of the workload on activation pattern.A 36 year old man suffered from a small left mesencephalic haemotrhage, due to cavernous angioma; the let% inferior colliculuswas resected in the surgical approach of the vascular malformation. In the acute stage, the patient complained of auditoryhallucinations and of auditory loss in right ear, while tonal audiometry was normal. At 12 months, auditory recognition, auditorylocalisation (assessed by lTD and IID cues) and auditory motion perception were normal (Clarke et al., 2000), while verbal dichoticlistening was deficient on the right side.Sound recognition and sound localisation activation patterns were investigated with fMRI, using a passive and an activeparadigm. In normal subjects, distinct cortical networks were involved in sound recognition and localisation, both in passive andactive paradigm (Maeder et al., 2OOOa, 2000b).Passive listening of environmental and spatial stimuli as compared to rest strongly activated right auditory cortex, but failed toactivate left primary auditory cortex. The specialised networks for sound recognition and localisation could not be visual&d onthe right and only minimally on the left convexity. A very different activation pattern was obtained in the active condition wherea motor response was required. Workload not only increased the activation of the right auditory cortex, but also allowed theactivation of the left primary auditory cortex. The specialised networks for sound recognition and localisation were almostcompletely present in both hemispheres.These results show that increasing the workload can i) help to recruit cortical region in the auditory deafferented hemisphere;and ii) lead to processing auditory information within specific cortical networks.References:Clarke et al. (2000). Neuropsychologia 38: 797-807.Mae.der et al. (2OOOa), Neuroimage 11: S52.Maeder et al. (2OOOb), Neuroimage 11: S33

Visual vertigo: an observational case series of eleven patients.

BACKGROUND: Dizziness is a common symptom which is frequently due to either peripheral or central vestibular dysfunction. However, some patients may lack typical signs suggesting a vestibular or cerebellar lesion and they mostly complain of vertigo or posture imbalance induced by visual stimulation. The symptoms immediately improve either on cessation of the visual input or upon closure of the eyes. Such a presentation is typical of visual vertigo. PATIENTS AND METHODS: From 1993 to 2003, 242 patients were examined for either "vertigo" or "dizziness". The diagnosis of visual vertigo was based on both history and clinical examination and was present in 11 patients. RESULTS: Visual vertigo was diagnosed in 11/242 patients (4.5 %). Age range was 31 - 77 years (mean 47 years) with a sex ratio of 8 females for 3 males. Neuro-ophthalmological examination was normal in all cases. CONCLUSIONS: Visual vertigo is not a rare condition but the disease is underdiagnosed. The symptoms result from a mismatch between vestibular, proprioceptive and visual inputs. Neuro-ophthalmological, neurological and neuro-otological examination are often normal or not relevant and the diagnosis is largely based on history. It is important to recognize this entity because the symptoms might improve if the patients are treated with psycho-motor rehabilitation.

Mouvement biologique et entraînement perceptivo-cognitif chez les personnes âgées

Lorsque nous cherchons un ami dans une foule ou attendons un proche sur le quai d’une gare, l’identification de cette personne nous est souvent possible grâce à la reconnaissance de sa démarche. Plusieurs chercheurs se sont intéressés à la façon de se mouvoir de l’être humain en étudiant le mouvement biologique. Le mouvement biologique est la représentation, par un ensemble structuré de points lumineux animés, des gestes d’un individu en mouvement dans une situation particulière (marche, golf, tennis, etc.). Une des caractéristiques du patron de mouvement biologique peu étudiée et néanmoins essentielle est sa taille. La plupart des études concernées utilisent des patrons de petite taille correspondant à une personne située à 16 mètres de l’observateur. Or les distances d’interaction sociale, chez l’humain, sont généralement inférieures à 16 mètres. D’autre part, les résultats des études portant sur la perception des patrons de mouvement biologique et le vieillissement demeurent contradictoires. Nous avons donc, dans un premier temps, évalué, dans une voûte d’immersion en réalité virtuelle, l’importance de la distance entre l’observateur et le patron de mouvement biologique, chez des adultes jeunes et des personnes âgées. Cette étude a démontré que l’évaluation de la direction de mouvement d’un patron devient difficile pour les personnes âgées lorsque le patron est situé à moins de 4 mètres, alors que les résultats des jeunes sont comparables pour toutes distances, à partir d’un mètre et au-delà. Cela indique que les gens âgés peinent à intégrer l’information occupant une portion étendue de leur champ visuel, ce qui peut s’avérer problématique dans des espaces où les distances d’interaction sont inférieures à 4 mètres. Nombre de recherches indiquent aussi clairement que les gens âgés s’adaptent difficilement à des situations complexes. Nous avons donc cherché, dans un second temps, à minimiser ces altérations liées à l’âge de l’intégration des processus complexes, en utilisant une tâche adaptée à l’entraînement et à l’évaluation de l’intégration de ces processus : la poursuite multiple d’objets dans l’espace ou 3D-MOT (3 Dimensions Multiple Object Tracking). Le 3D-MOT consiste à suivre simultanément plusieurs objets d’intérêt en mouvement parmi des distracteurs également en mouvement. Nous avons évalué les habiletés de participants jeunes et âgés à une telle tâche dans un environnement virtuel en 3D en déterminant la vitesse maximale de déplacement des objets à laquelle la tâche pouvait être exécutée. Les résultats des participants âgés étaient initialement inférieurs à ceux des jeunes. Cependant, après plusieurs semaines d’entraînement, les personnes âgées ont obtenu des résultats comparables à ceux des sujets jeunes non entraînés. Nous avons enfin évalué, pour ces mêmes participants, l’impact de cet entraînement sur la perception de patrons de mouvement biologique présentés à 4 et 16 mètres dans l’espace virtuel : les habiletés des personnes âgées entraînées obtenues à 4 mètres ont augmenté de façon significative pour atteindre le niveau de celles obtenues à 16 mètres. Ces résultats suggèrent que l’entraînement à certaines tâches peut réduire les déclins cognitivo-perceptifs liés à l’âge et possiblement aider les personnes âgées dans leurs déplacements quotidiens.

Aprendizagem motora baseada em demonstrações de movimento biológico

O objetivo deste estudo foi avaliar o processo de aprendizagem motora de uma habilidade complexa da Ginástica Artística a partir da observação de demonstrações de modelos de pontos de luz e vídeo. Dezesseis participantes divididas em grupos dos respectivos modelos executaram um pré-teste, seguido de 100 tentativas de uma parada de mãos, igualmente distribuídas em blocos de 10 tentativas em dois dias, alternando períodos de demonstração e prática, com um teste de retenção após um dia. Cinemática de braço, tronco e perna das participantes possibilitaram análise da semelhança entre a coordenação de cada participante e do modelo e do tempo de movimento; a performance das participantes também foi avaliada por duas especialistas em Ginástica Artística. Ambas as análises indicaram que os grupos não diferiram. Os resultados são discutidos em termos da hipótese de suficiência de informação nos modelos de movimento biológico particularmente aplicada ao processo de aprendizagem de habilidades motoras complexas.

Seeking one's heading through eye movements

A study of eye movements during simulated travel toward a grove of four stationary trees revealed that observers looked most at pairs of trees that converged or decelerated apart. Such pairs specify that one's direction of travel, called heading, is to the outside of the near member of the pair. Observers looked at these trees more than those that accelerated apart; such pairs do not offer trustworthy heading information. Observers also looked at gaps between trees less often when they converged or diverged apart, and heading can never be between such pairs. Heading responses were in accord with eye movements. In general, if observers responded accurately, they had looked at trees that converged or decelerated apart; if they were inaccurate, they had not. Results support the notion that observers seek out their heading through eye movements, saccading to and fixating on the most informative locations in the field of view.

Exploration time of static images implying different body movements causes time distortions

Studies of subjective time have adopted different methods to understand different processes of time perception. Four sculptures, with implied movement ranked as 1.5-, 3.0-, 4.5-, and 6.0-point stimuli on the Body Movement Ranking Scale, were randomly presented to 42 university students untrained in visual arts and ballet. Participants were allowed to observe the images for any length of time (exploration time) and, immediately after each image was observed, recorded the duration as they perceived it. The results of temporal ratio (exploration time/time estimation) showed that exploration time of images also affected perception of time, i.e., the subjective time for sculptures representing implied movement were overestimated.\

Untersuchung zum Beitrag des ON-Kanals zu zeitlichen und chromatischen Verarbeitungsmechanismen in der Retina

Ziel der vorliegenden Arbeit war es, mithilfe von Dressurexperimenten in Kombination mit dem Einsatz von Neuropharmaka die Bedeutung des retinalen ON-Kanals für zwei visuelle Leistungen des Goldfisches – das kontrastabhängige zeitliche Auflösungsvermögen sowie die Wellenlängenunterscheidungsfähigkeit - zu untersuchen. Da die Tiere nach der pharmakologischen Blockade keinerlei verändertes Verhalten zeigten, kann davon ausgegangen werden, dass der retinale ON-Kanal weder für die Prozessierung des kontrastabhängigen zeitlichen Auflösungsvermögens noch für die Wellenlängenunterscheidungsfähigkeit eine maßgebliche Rolle spielt. Aus den Versuchen zur Wellenlängenunterscheidungsfähigkeit kann des Weiteren abgeleitet werden, dass der ON-Kanal auch für die spektrale Empfindlichkeit der Tiere bei der gegebenen Beleuchtungs- und Dressurbedingungen (L+-Dressur) keine Bedeutung zu haben scheint. Nach den Versuchen zum kontrastabhängigen zeitlichen Auflösungsvermögen kann festgehalten werden, dass das zeitliche Auflösungsvermögen des Goldfisches sich mit abnehmendem Stimuluskontrast verändert: Der für die Tiere wahrnehmbare Flickerfrequenzbereich wird mit abnehmendem Kontrast geringer. Die Flimmerfusionsfrequenz wird im oberen Frequenzbereich früher erreicht; im unteren Flickerfrequenzbereich tritt mit abnehmendem Kontrast auch eine untere Grenze des zeitlichen Auflösungsvermögens auf. Des Weiteren zeigen die Ergebnisse aus den Verhaltensversuchen zu den kontrastabhängigen zeitlichen Übertragungseigenschaften eine gute Vergleichbarkeit zu elektrophysiologisch gewonnenen Antworten von ON bzw. OFF-Bipolarzellen. Ebenso ähneln sich die Kurvenverläufe zum kontrastabhängigen zeitlichen Auflösungsvermögen und die aus den Versuchen zur kontrastabhängigen Ganzfeldbewegungswahrnehmung – einer visuellen Leistung, deren Prozessierung eines ON-Kanal-Beitrages bedarf. Diese Ergebnisse deuten darauf hin, dass das zeitliche Auflösungsvermögen wie auch die Ganzfeldbewegungswahrnehmung hauptsächlich von retinalen Verarbeitungsprozessen abhängen.

Influence of optic flow on postural control

The study of optic flow on postural control may explain how self-motion perception contributes to postural stability in young males and females and how such function changes in the old falls risk population. Study I: The aim was to examine the optic flow effect on postural control in young people (n=24), using stabilometry and surface-electromyography. Subjects viewed expansion and contraction optic flow stimuli which were presented full field, in the foveral or in the peripheral visual field. Results showed that optic flow stimulation causes an asymmetry in postural balance and a different lateralization of postural control in men and women. Gender differences evoked by optic flow were found both in the muscle activity and in the prevalent direction of oscillation. The COP spatial variability was reduced during the view of peripheral stimuli which evoked a clustered prevalent direction of oscillation, while foveal and random stimuli induced non-distributed directions. Study II was aimed at investigating the age-related mechanisms of postural stability during the view of optic flow stimuli in young (n=17) and old (n=19) people, using stabilometry and kinematic. Results showed that old people showed a greater effort to maintain posture during the view of optic flow stimuli than the young. Elderly seems to use the head stabilization on trunk strategy. Visual stimuli evoke an excitatory input on postural muscles, but the stimulus structure produces different postural effects. Peripheral optic flow stabilizes postural sway, while random and foveal stimuli provoke larger sway variability similar to those evoked in baseline. Postural control uses different mechanisms within each leg to produce the appropriate postural response to interact with extrapersonal environment. Ageing reduce the effortlessness to stabilize posture during optic flow, suggesting a neuronal processing decline associated with difficulty integrating multi-sensory information of self-motion perception and increasing risk of falls.