Evaluation of Binocular Eye Trackers and Algorithms for 3D Gaze Interaction in Virtual Reality Environments

Tracking user’s visual attention is a fundamental aspect in novel human-computer interaction paradigms found in Virtual Reality. For example, multimodal interfaces or dialogue-based communications with virtual and real agents greatly benefit from the analysis of the user’s visual attention as a vital source for deictic references or turn-taking signals. Current approaches to determine visual attention rely primarily on monocular eye trackers. Hence they are restricted to the interpretation of two-dimensional fixations relative to a defined area of projection. The study presented in this article compares precision, accuracy and application performance of two binocular eye tracking devices. Two algorithms are compared which derive depth information as required for visual attention-based 3D interfaces. This information is further applied to an improved VR selection task in which a binocular eye tracker and an adaptive neural network algorithm is used during the disambiguation of partly occluded objects.

Eye-head coordination abnormalities in schizophrenia

Eye-movement abnormalities in schizophrenia are a well-established phenomenon that has been observed in many studies. In such studies, visual targets are usually presented in the center of the visual field, and the subject's head remains fixed. However, in every-day life, targets may also appear in the periphery. This study is among the first to investigate eye and head movements in schizophrenia by presenting targets in the periphery of the visual field.

Analysis of eye and head coordination in a visual peripheral recognition task

Coordinated eye and head movements simultaneously occur to scan the visual world for relevant targets. However, measuring both eye and head movements in experiments allowing natural head movements may be challenging. This paper provides an approach to study eye-head coordination: First, we demonstra- te the capabilities and limits of the eye-head tracking system used, and compare it to other technologies. Second, a beha- vioral task is introduced to invoke eye-head coordination. Third, a method is introduced to reconstruct signal loss in video- based oculography caused by cornea reflection artifacts in order to extend the tracking range. Finally, parameters of eye- head coordination are identified using EHCA (eye-head co- ordination analyzer), a MATLAB software which was developed to analyze eye-head shifts. To demonstrate the capabilities of the approach, a study with 11 healthy subjects was performed to investigate motion behavior. The approach presented here is discussed as an instrument to explore eye-head coordination, which may lead to further insights into attentional and motor symptoms of certain neurological or psychiatric diseases, e.g., schizophrenia.

Finale Fixationen, sportmotorische Leistung und eine Inhibitionshypothese. Mechanismen des "Quiet Eye"

Vielfach konnte in den letzten Jahren die Bedeutung einer langen letzten Fixation vor Bewegungsbeginn – des sogenannten "Quiet Eye" – für die sportmotorische Leistung aufgezeigt werden. Obgleich dieses Phänomens breit untersucht wurde, mangelt es bislang an einer zufriedenstellenden Erklärung. In diesem Beitrag werden daher aktuelle Erklärungsversuche diskutiert. Es zeigt sich, dass vorliegende Beiträge aus der Kognitions- und der ökologischen Psychologie konzeptuelle oder methodische Mängel aufweisen. Aus diesen Gründen wird – zunächst für Aufgaben mit hohen Präzisionsanforderungen – ein Inhibitionsmechanismus zur Erklärung des Quiet-Eye-Phänomens vorgeschlagen mit der zentralen Aussage, dass die Verarbeitung leistungsrelevanter Hinweisreize durch ein "ruhiges Auge" von Störungen abgeschirmt wird. Abschließend kann gezeigt werden, dass sich der vorgeschlagene Mechanismus mit der bestehenden Befundlage als kompatibel erweist und er die Ableitung weitergehender Vorhersagen erlaubt.

The "Quiet Eye" and Motor Performance: Task Demands Matter!

Evidence suggests that superior motor performance coincides with a longer duration of the last fixation before movement initiation, an observation called “quiet eye” (QE). Although the empirical findings over the last two decades underline the robustness of the phenomenon, little is known about its functional role in motor performance. Therefore, a novel paradigm is introduced, testing QE duration as an independent variable by experimentally manipulating the onset of the last fixation before movement unfolding. Furthermore, this paradigm is employed to investigate the functional mechanisms behind the QE phenomenon by manipulating the predictability of the target position and thereby the amount of information to be processed over the QE period. The results further support the assumption that QE affects motor performance, with experimentally prolonged QE durations increasing accuracy in a throwing task. However, it is only under a high information-processing load that a longer QE duration is beneficial for throwing performance. Therefore, the optimization of information processing, particularly in motor execution, turns out to be a promising candidate for explaining QE benefits on a functional level.

Zielinstruktionen, räumliche Quiet-Eye-Verankerung und Bewegungsparametrisierung: Hinweise auf einen Wirkmechanismus

Die motorikwissenschaftliche Befundlage zum sogenannten „Quiet Eye“ weist darauf hin, dass hohe sportmotorische Leistungen, insbesondere in Präzisionsaufgaben, mit einer langen finalen Fixation vor der Bewegungsentfaltung einhergehen. Ein Mechanismus, der diesen Zusammenhang aus einer kognitionspsychologischen Perspektive erklären könnte, ist die Optimierung von Informationsverarbeitungsprozessen der Bewegungsparametrisierung. Diese Annahme wurde durch eine experimentelle Manipulation von Zielinstruktionen in einer Ballwurfaufgabe untersucht. Zum einen zeigen die Ergebnisse, dass sich die räumliche Verankerung des Quiet Eye in Abhängigkeit der variierten Aufgabenziele verändert; zum anderen deuten die Befunde darauf hin, dass sich Veränderungen der Verankerung im Bewegungsresultat niederschlagen. Damit wird ein kognitiver Wirkmechanismus plausibilisiert, nach dem die Bewegungsgenauigkeit durch Zielinstruktion via räumliche Quiet-Eye-Verankerung bestimmt wird.

Complex visual hallucinations and attentional performance in eye disease and dementia: a test of the Perception and Attention Deficit model

OBJECTIVE This study aimed to test the prediction from the Perception and Attention Deficit model of complex visual hallucinations (CVH) that impairments in visual attention and perception are key risk factors for complex hallucinations in eye disease and dementia. METHODS Two studies ran concurrently to investigate the relationship between CVH and impairments in perception (picture naming using the Graded Naming Test) and attention (Stroop task plus a novel Imagery task). The studies were in two populations-older patients with dementia (n = 28) and older people with eye disease (n = 50) with a shared control group (n = 37). The same methodology was used in both studies, and the North East Visual Hallucinations Inventory was used to identify CVH. RESULTS A reliable relationship was found for older patients with dementia between impaired perceptual and attentional performance and CVH. A reliable relationship was not found in the population of people with eye disease. CONCLUSIONS The results add to previous research that object perception and attentional deficits are associated with CVH in dementia, but that risk factors for CVH in eye disease are inconsistent, suggesting that dynamic rather than static impairments in attentional processes may be key in this population.

Saccadic eye movement changes in Parkinson's disease dementia and dementia with Lewy bodies.

Neurodegeneration in Parkinson's disease dementia (PDD) and dementia with Lewy bodies (DLB) affect cortical and subcortical networks involved in saccade generation. We therefore expected impairments in saccade performance in both disorders. In order to improve the pathophysiological understanding and to investigate the usefulness of saccades for differential diagnosis, saccades were tested in age- and education-matched patients with PDD (n = 20) and DLB (n = 20), Alzheimer's disease (n = 22) and Parkinson's disease (n = 24), and controls (n = 24). Reflexive (gap, overlap) and complex saccades (prediction, decision and antisaccade) were tested with electro-oculography. PDD and DLB patients had similar impairment in all tasks (P > 0.05, not significant). Compared with controls, they were impaired in both reflexive saccade execution (gap and overlap latencies, P < 0.0001; gains, P < 0.004) and complex saccade performance (target prediction, P < 0.0001; error decisions, P < 0.003; error antisaccades: P < 0.0001). Patients with Alzheimer's disease were only impaired in complex saccade performance (Alzheimer's disease versus controls, target prediction P < 0.001, error decisions P < 0.0001, error antisaccades P < 0.0001), but not reflexive saccade execution (for all, P > 0.05). Patients with Parkinson's disease had, compared with controls, similar complex saccade performance (for all, P > 0.05) and only minimal impairment in reflexive tasks, i.e. hypometric gain in the gap task (P = 0.04). Impaired saccade execution in reflexive tasks allowed discrimination between DLB versus Alzheimer's disease (sensitivity > or =60%, specificity > or =77%) and between PDD versus Parkinson's disease (sensitivity > or =60%, specificity > or =88%) when +/-1.5 standard deviations was used for group discrimination. We conclude that impairments in reflexive saccades may be helpful for differential diagnosis and are minimal when either cortical (Alzheimer's disease) or nigrostriatal neurodegeneration (Parkinson's disease) exists solely; however, they become prominent with combined cortical and subcortical neurodegeneration in PDD and DLB. The similarities in saccade performance in PDD and DLB underline the overlap between these conditions and underscore differences from Alzheimer's disease and Parkinson's disease.