The human eye as human-machine interface

Eye tracking as an interface to operate a computer is under research for a while and new systems are still being developed nowadays that provide some encouragement to those bound to illnesses that incapacitates them to use any other form of interaction with a computer. Although using computer vision processing and a camera, these systems are usually based on head mount technology being considered a contact type system. This paper describes the implementation of a human-computer interface based on a fully non-contact eye tracking vision system in order to allow people with tetraplegia to interface with a computer. As an assistive technology, a graphical user interface with special features was developed including a virtual keyboard to allow user communication, fast access to pre-stored phrases and multimedia and even internet browsing. This system was developed with the focus on low cost, user friendly functionality and user independency and autonomy.

Measuring end-to-end delay in real-time auralisation systems

One of the major challenges in the development of an immersive system is handling the delay between the tracking of the user’s head position and the updated projection of a 3D image or auralised sound, also called end-to-end delay. Excessive end-to-end delay can result in the general decrement of the “feeling of presence”, the occurrence of motion sickness and poor performance in perception-action tasks. These latencies must be known in order to provide insights on the technological (hardware/software optimization) or psychophysical (recalibration sessions) strategies to deal with them. Our goal was to develop a new measurement method of end-to-end delay that is both precise and easily replicated. We used a Head and Torso simulator (HATS) as an auditory signal sensor, a fast response photo-sensor to detect a visual stimulus response from a Motion Capture System, and a voltage input trigger as real-time event. The HATS was mounted in a turntable which allowed us to precisely change the 3D sound relative to the head position. When the virtual sound source was at 90º azimuth, the correspondent HRTF would set all the intensity values to zero, at the same time a trigger would register the real-time event of turning the HATS 90º azimuth. Furthermore, with the HATS turned 90º to the left, the motion capture marker visualization would fell exactly in the photo-sensor receptor. This method allowed us to precisely measure the delay from tracking to displaying. Moreover, our results show that the method of tracking, its tracking frequency, and the rendering of the sound reflections are the main predictors of end-to-end delay.

Peripheral refraction with eye and head rotation with contact lenses

Purpose: To evaluate the impact of eye and head rotation in the measurement of peripheral refraction with an open-field autorefractometer in myopic eyes wearing two different center-distance designs of multifocal contact lenses (MFCLs). Methods: Nineteen right eyes from 19 myopic patients (average central M ± SD = −2.67 ± 1.66 D) aged 20–27 years (mean ± SD = 23.2 ± 3.3 years) were evaluated using a Grand-Seiko autorefractometer. Patients were fitted with one multifocal aspheric center-distance contact lens (Biofinity Multifocal D®) and with one multi-concentric MFCL (Acuvue Oasys for Presbyopia). Axial and peripheral refraction were evaluated by eye rotation and by head rotation under naked eye condition and with each MFCL fitted randomly and in independent sessions. Results: For the naked eye, refractive pattern (M, J0 and J45) across the central 60◦ of the horizontal visual field values did not show significant changes measured by rotating the eye or rotating the head (p > 0.05). Similar results were obtained wearing the Biofinity D, for both testing methods, no obtaining significant differences to M, J0 and J45 values (p > 0.05). For Acuvue Oasys for presbyopia, also no differences were found when comparing measurements obtained by eye and head rotation (p > 0.05). Multivariate analysis did not showed a significant interaction between testing method and lens type neither with measuring locations (MANOVA, p > 0.05). There were significant differences in M and J0 values between naked eyes and each MFCL. Conclusion: Measurements of peripheral refraction by rotating the eye or rotating the head in myopic patients wearing dominant design or multi-concentric multifocal silicone hydrogel contact lens are comparable.

Interação multimodal de dispositivos robóticos em ambiente simulado

Dissertação de mestrado integrado em Engenharia e Gestão de Sistemas de Informação

A Real-Time intelligent system for tracking patient condition

Hospitals have multiple data sources, such as embedded systems, monitors and sensors. The number of data available is increasing and the information are used not only to care the patient but also to assist the decision processes. The introduction of intelligent environments in health care institutions has been adopted due their ability to provide useful information for health professionals, either in helping to identify prognosis or also to understand patient condition. Behind of this concept arises this Intelligent System to track patient condition (e.g. critic events) in health care. This system has the great advantage of being adaptable to the environment and user needs. The system is focused in identifying critic events from data streaming (e.g. vital signs and ventilation) which is particularly valuable for understanding the patient’s condition. This work aims to demonstrate the process of creating an intelligent system capable of operating in a real environment using streaming data provided by ventilators and vital signs monitors. Its development is important to the physician because becomes possible crossing multiple variables in real-time by analyzing if a value is critic or not and if their variation has or not clinical importance.

Pinterest: um estudo de eye tracking

Dissertação de mestrado em Média Interativos