From saccades to smooth pursuit: real-time gaze control using motion feedback

The authors present an active vision system which performs a surveillance task in everyday dynamic scenes. The system is based around simple, rapid motion processors and a control strategy which uses both position and velocity information. The surveillance task is defined in terms of two separate behavioral subsystems, saccade and smooth pursuit, which are demonstrated individually on the system. It is shown how these and other elementary responses to 2D motion can be built up into behavior sequences, and how judicious close cooperation between vision and control results in smooth transitions between the behaviors. These ideas are demonstrated by an implementation of a saccade to smooth pursuit surveillance system on a high-performance robotic hand/eye platform.

Saccadic and smooth pursuit eye movements attenuate postural sway similarly

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Enhancing treatment effects by combining continuous theta burst stimulation with smooth pursuit training

Continuous theta burst stimulation (cTBS) represents a promising approach in the treatment of neglect syndrom. However, it is not known whether cTBS in conjunction with another technique may enhance the therapeutic effects. In the present sham-controlled study, we aimed to combine cTBS with smooth pursuit training (SPT), another method known to effectively improve neglect symptoms, and to evaluate whether this combination would result in a stronger effect than SPT alone. Eighteen patients with left spatial neglect after right-hemispheric stroke were included in the study and performed a cancellation task on a large 54.6" touchscreen monitor. A sequential application of cTBS and SPT induced a significantly greater improvement of neglect than SPT alone. After the combined application of these two methods, patients detected significantly more targets and their cancellation behaviour presented a significantly greater shift towards the contralesional hemispace. We suggest that a combined, sequential application of cTBS and SPT is a promising new approach to treat neglect.

Impairments of peripheral motion change detection during smooth pursuit eye movements

Introduction: In team sports the ability to use peripheral vision is essential to track a number of players and the ball. By using eye-tracking devices it was found that players either use fixations and saccades to process information on the pitch or use smooth pursuit eye movements (SPEM) to keep track of single objects (Schütz, Braun, & Gegenfurtner, 2011). However, it is assumed that peripheral vision can be used best when the gaze is stable while it is unknown whether motion changes can be equally well detected when SPEM are used especially because contrast sensitivity is reduced during SPEM (Schütz, Delipetkose, Braun, Kerzel, & Gegenfurtner, 2007). Therefore, peripheral motion change detection will be examined by contrasting a fixation condition with a SPEM condition. Methods: 13 participants (7 male, 6 female) were presented with a visual display consisting of 15 white and 1 red square. Participants were instructed to follow the red square with their eyes and press a button as soon as a white square begins to move. White square movements occurred either when the red square was still (fixation condition) or moving in a circular manner with 6 °/s (pursuit condition). The to-be-detected white square movements varied in eccentricity (4 °, 8 °, 16 °) and speed (1 °/s, 2 °/s, 4 °/s) while movement time of white squares was constant at 500 ms. 180 events should be detected in total. A Vicon-integrated eye-tracking system and a button press (1000 Hz) was used to control for eye-movements and measure detection rates and response times. Response times (ms) and missed detections (%) were measured as dependent variables and analysed with a 2 (manipulation) x 3 (eccentricity) x 3 (speed) ANOVA with repeated measures on all factors. Results: Significant response time effects were found for manipulation, F(1,12) = 224.31, p < .01, ηp2 = .95, eccentricity, F(2,24) = 56.43; p < .01, ηp2 = .83, and the interaction between the two factors, F(2,24) = 64.43; p < .01, ηp2 = .84. Response times increased as a function of eccentricity for SPEM only and were overall higher than in the fixation condition. Results further showed missed events effects for manipulation, F(1,12) = 37.14; p < .01, ηp2 = .76, eccentricity, F(2,24) = 44.90; p < .01, ηp2 = .79, the interaction between the two factors, F(2,24) = 39.52; p < .01, ηp2 = .77 and the three-way interaction manipulation x eccentricity x speed, F(2,24) = 3.01; p = .03, ηp2 = .20. While less than 2% of events were missed on average in the fixation condition as well as at 4° and 8° eccentricity in the SPEM condition, missed events increased for SPEM at 16 ° eccentricity with significantly more missed events in the 4 °/s speed condition (1 °/s: M = 34.69, SD = 20.52; 2 °/s: M = 33.34, SD = 19.40; 4 °/s: M = 39.67, SD = 19.40). Discussion: It could be shown that using SPEM impairs the ability to detect peripheral motion changes at the far periphery and that fixations not only help to detect these motion changes but also to respond faster. Due to high temporal constraints especially in team sports like soccer or basketball, fast reaction are necessary for successful anticipation and decision making. Thus, it is advised to anchor gaze at a specific location if peripheral changes (e.g. movements of other players) that require a motor response have to be detected. In contrast, SPEM should only be used if a single object, like the ball in cricket or baseball, is necessary for a successful motor response. References: Schütz, A. C., Braun, D. I., & Gegenfurtner, K. R. (2011). Eye movements and perception: A selective review. Journal of Vision, 11, 1-30. Schütz, A. C., Delipetkose, E., Braun, D. I., Kerzel, D., & Gegenfurtner, K. R. (2007). Temporal contrast sensitivity during smooth pursuit eye movements. Journal of Vision, 7, 1-15.

Visuospatial working memory deficits and visual pursuit impairments are not directly related in schizophrenia.

OBJECTIVE: Patients with schizophrenia show deficits in visuospatial working memory and visual pursuit processes. It is currently unclear, however, whether both impairments are related to a common neuropathological origin. The purpose of the present study was therefore to examine the possible relations between the encoding and the discrimination of dynamic visuospatial stimuli in schizophrenia. METHOD: Sixteen outpatients with schizophrenia and 16 control subjects were asked to encode complex disc displacements presented on a screen. After a delay, participants had to identify the previously presented disc trajectory from a choice of six static linear paths, among which were five incorrect paths. The precision of visual pursuit eye movements during the initial presentation of the dynamic stimulus was assessed. The fixations and scanning time in definite regions of the six paths presented during the discrimination phase were investigated. RESULTS: In comparison with controls, patients showed poorer task performance, reduced pursuit accuracy during incorrect trials and less time scanning the correct stimulus or the incorrect paths approximating its global structure. Patients also spent less time scanning the leftmost portion of the correct path even when making a correct choice. The accuracy of visual pursuit and head movements, however, was not correlated with task performance. CONCLUSIONS: The present study provides direct support for the hypothesis that active integration of visuospatial information within working memory is deficient in schizophrenia. In contrast, a general impairment of oculomotor mechanisms involved in smooth pursuit did not appear to be directly related to lower visuospatial working memory performance in schizophrenia.

Driving saccade to pursuit using image motion

Within the context of active vision, scant attention has been paid to the execution of motion saccades—rapid re-adjustments of the direction of gaze to attend to moving objects. In this paper we first develop a methodology for, and give real-time demonstrations of, the use of motion detection and segmentation processes to initiate capture saccades towards a moving object. The saccade is driven by both position and velocity of the moving target under the assumption of constant target velocity, using prediction to overcome the delay introduced by visual processing. We next demonstrate the use of a first order approximation to the segmented motion field to compute bounds on the time-to-contact in the presence of looming motion. If the bound falls below a safe limit, a panic saccade is fired, moving the camera away from the approaching object. We then describe the use of image motion to realize smooth pursuit, tracking using velocity information alone, where the camera is moved so as to null a single constant image motion fitted within a central image region. Finally, we glue together capture saccades with smooth pursuit, thus effecting changes in both what is being attended to and how it is being attended to. To couple the different visual activities of waiting, saccading, pursuing and panicking, we use a finite state machine which provides inherent robustness outside of visual processing and provides a means of making repeated exploration. We demonstrate in repeated trials that the transition from saccadic motion to tracking is more likely to succeed using position and velocity control, than when using position alone.

Fear of heights: cognitive performance and postural control

Fear of heights, or acrophobia, is one of the most frequent subtypes of specific phobia frequently associated to depression and other anxiety disorders. Previous evidence suggests a correlation between acrophobia and abnormalities in balance control, particularly involving the use of visual information to keep postural stability. This study investigates the hypotheses that (1) abnormalities in balance control are more frequent in individuals with acrophobia even when not exposed to heights, that (2) acrophobic symptoms are associated to abnormalities in visual perception of movement; and that (3) individuals with acrophobia are more sensitive to balance-cognition interactions. Thirty-one individuals with specific phobia of heights and thirty one non-phobic controls were compared using dynamic posturography and a manual tracking task. Acrophobics had poorer performance in both tasks, especially when carried out simultaneously. Previously described interference between posture control and cognitive activity seems to play a major role in these individuals. The presence of physiologic abnormalities is compatible with the hypothesis of a non-associative acquisition of fear of heights, i.e., not associated to previous traumatic events or other learning experiences. Clinically, this preliminary study corroborates the hypothesis that vestibular physical therapy can be particularly useful in treating individuals with fear of heights.

On the function of the floccular complex of the vertebrate cerebellum: implications in paleoneuroanatomy

The cerebellum floccular complex lobes (FCLs) are housed in the FCL fossa of the periotic complex. There is experimental evidence indicating that the FCLs integrate visual and vestibular information, responsible for the vestibulo-ocular reflex, vestibulo-collic reflex, smooth pursuit and gaze holding. Thus, the behavior of extinct animals has been correlated with FCLs dimension in multiple paleoneuroanatomy studies. Here I analyzed braincase endocasts of a representative sample of Mammalia (48 species) and Aves (59 species) rendered using tomography and image segmentation and tested statistical correlations between the floccular complex volume, ecological and behavioral traits to assess various previously formulated paleobiological speculations. My results demonstrate: 1) there is no significant correlation between relative FCL volume and body mass; 2) there is no significant correlation between relative FCL and optic lobes size in birds; 3) average relative FCL size is larger in diurnal than in nocturnal birds but there is no statistically significant difference in mammals; 4) feeding strategies are related with different FCL size patterns in birds, but not in mammals; 5) locomotion type is not related with relative FCL size in mammals; 6) agility is not significantly correlated with FCL size in mammals. I conclude that, despite the apparent relation between FCL size and ecology in birds, the cerebellum of tetrapods is a highly plastic structure and may be adapted to control different functions across different taxonomic levels. For example, the european mole (Talpa europaea) which is fossorial and practically blind, has a FCL fossae relative size larger than those of bats, which are highly maneuverable. Therefore, variation in FCL size may be better explained by a combination of multiple factors with relation to anatomical and phylogenetic evolutionary constraints.

Altered vision during motion: an unusual symptom of cerebellar dysfunction, quantifiable by a simple clinical test.

PURPOSE: To report a series of patients with cerebellar dysfunction and altered vision during motion, and to quantify their visual impairment in motion with a simple clinical test. METHODS: Twenty consecutive patients suffering from cerebellar dysfunction and altered vision during motion were examined between 1994 and 2007. A control group consisted of 20 age- and sex-matched healthy people. All patients had a full neuro-ophthalmic examination. Near visual acuity (NVA) was measured at rest (static NVA) and during chair rotation (dynamic NVA). Distance visual acuity (DVA) was measured at rest (static DVA) and during rotation of the patient's head (dynamic DVA). RESULTS: Only four of the 20 patients reported altered vision during motion spontaneously. The remaining 16 patients admitted this unusual visual disturbance only when asked specifically. All patients exhibited abnormal eye movements, including saccadic smooth pursuit (20/20), dysmetric saccades (15/20), nystagmus (19/20) and impaired suppression of vestibulo-ocular reflex (VOR) (20/20). During rotation of the examination chair (dynamic NVA), the drop in NVA averaged 5.6 lines (range 1-10 lines). During rotation of the patient's head (dynamic DVA), the drop in DVA averaged only 2.5 lines (range 0-10 lines). For the control group, there was no significant drop in NVA under dynamic conditions. CONCLUSION: Patients with cerebellar dysfunction rarely complain spontaneously of altered vision during motion. However, specific questioning may bring up this unusual symptom. The use of a simple clinical test, consisting of NVA measurement during rotation of the examination chair (dynamic NVA), allows practitioners to quantify the level of visual impairment in patients presenting altered VOR modulation.

Reactions to peripheral image motion using a head/eye platform

The authors demonstrate four real-time reactive responses to movement in everyday scenes using an active head/eye platform. They first describe the design and realization of a high-bandwidth four-degree-of-freedom head/eye platform and visual feedback loop for the exploration of motion processing within active vision. The vision system divides processing into two scales and two broad functions. At a coarse, quasi-peripheral scale, detection and segmentation of new motion occurs across the whole image, and at fine scale, tracking of already detected motion takes place within a foveal region. Several simple coarse scale motion sensors which run concurrently at 25 Hz with latencies around 100 ms are detailed. The use of these sensors are discussed to drive the following real-time responses: (1) head/eye saccades to moving regions of interest; (2) a panic response to looming motion; (3) an opto-kinetic response to continuous motion across the image and (4) smooth pursuit of a moving target using motion alone.

The ocular motor features of adult-onset alexander disease: a case and review of the literature

A 51-year-old Chinese man presented with gaze-evoked nystagmus, impaired smooth pursuit and vestibular ocular reflex cancellation, and saccadic dysmetria, along with a family history suggestive of late-onset autosomal dominant parkinsonism. MRI revealed abnormalities of the medulla and cervical spinal cord typical of adult-onset Alexander disease, and genetic testing showed homozygosity for the p.D295N polymorphic allele in the gene encoding the glial fibrillary acidic protein. A review of the literature shows that ocular signs are frequent in adult-onset Alexander disease, most commonly gaze-evoked nystagmus, pendular nystagmus, and/or oculopalatal myoclonus, and less commonly ptosis, miosis, and saccadic dysmetria. These signs are consistent with the propensity of adult-onset Alexander disease to cause medullary abnormalities on neuroimaging.

The relationship of cervical joint position error to balance and eye movement disturbances in persistent whiplash

Cervical joint position error (JPE) has been used as a measure of cervical afferent input to detect disturbances in sensori-motor control as a possible contributor to a neck pain syndrome. This study aimed to investigate the relationship between cervical JPE, balance and eye movement control. It was of particular interest whether assessment of cervical ME alone was sufficient to signal the presence of disturbances in the two other tests. One hundred subjects with persistent whiplash-associated disorders (WADs) and 40 healthy controls subjects were assessed on measures of cervical JPE, standing balance and the smooth pursuit neck torsion test (SPNT). The results indicated that over all subjects, significant but weak-to-moderate correlations existed between all comfortable stance balance tests and both the SPNT and rotation cervical ME tests. A weak correlation was found between the SPNT and right rotation cervical JPE. An abnormal rotation cervical JPE score had a high positive prediction value (88%) but low sensitivity (60%) and specificity (54%) to determine abnormality in balance and or SPNT test. The results suggest that in patients with persistent WAD, it is not sufficient to measure ME alone. All three measures are required to identify disturbances in the postural control system. (C) 2005 Elsevier Ltd. All rights reserved.

Reflexive optokinetic nystagmus in younger and older observers under photopic and mesopic viewing conditions

PURPOSE. To investigate the effect of age on optokinetic nystagmus (OKN) in response to stimuli designed to preferentially stimulate the M-pathway. METHOD. OKN was recorded in 10 younger (32.3 +/- 5.98 years) and 10 older (65.6 +/- 6.53) subjects with normal vision. Vertical gratings of 0.43 or 1.08 cpd drifting at 5 degrees/s or 20 degrees/s and presented at either 8% or 80% contrast were displayed on a large screen as full-field stimulation, central stimulation within a central Gaussian-blurred window of 15 diameter, or peripheral stimulation outside this window. All conditions apart from the high-contrast condition were presented in a random order at two light levels, mesopic (1.8 cdm(-2)) and photopic (71.5 cdm(-2)). RESULTS. Partial-field data indicated that central stimulation, mesopic light levels, and lower temporal frequency each significantly increased slow-phase velocity (SPV). Although there was no overall difference between groups for partial-field stimulation, full-field stimulation, or low-contrast stimulation, a change in illumination revealed a significant interaction with age: there was a larger decrease in SPV going from photopic to mesopic conditions for the older group than the younger group, especially for higher temporal frequency stimulation. CONCLUSIONS. OKN becomes reflexive in conditions conducive to M-pathway stimulation, and this rOKN response is significantly diminished in older healthy adults than in younger healthy adults, indicative of decreased M-pathway sensitivity.

Visual signs and symptoms of Parkinson's disease

Parkinson's disease (PD) is a common disorder of middle-aged and elderly people, in which there is degeneration of the extra-pyramidal motor system. In some patients, the disease is associated with a range of visual signs and symptoms, including defects in visual acuity, colour vision, the blink reflex, pupil reactivity, saccadic and smooth pursuit movements and visual evoked potentials. In addition, there may be psychophysical changes, disturbances of complex visual functions such as visuospatial orientation and facial recognition, and chronic visual hallucinations. Some of the treatments associated with PD may have adverse ocular reactions. If visual problems are present, they can have an important effect on overall motor function, and quality of life of patients can be improved by accurate diagnosis and correction of such defects. Moreover, visual testing is useful in separating PD from other movement disorders with visual symptoms, such as dementia with Lewy bodies (DLB), multiple system atrophy (MSA) and progressive supranuclear palsy (PSP). Although not central to PD, visual signs and symptoms can be an important though obscure aspect of the disease and should not be overlooked.