Eye gaze in virtual environments: evaluating the need and initial work on implementation

For efficient collaboration between participants, eye gaze is seen as being critical for interaction. Video conferencing either does not attempt to support eye gaze (e.g. AcessGrid) or only approximates it in round table conditions (e.g. life size telepresence). Immersive collaborative virtual environments represent remote participants through avatars that follow their tracked movements. By additionally tracking people's eyes and representing their movement on their avatars, the line of gaze can be faithfully reproduced, as opposed to approximated. This paper presents the results of initial work that tested if the focus of gaze could be more accurately gauged if tracked eye movement was added to that of the head of an avatar observed in an immersive VE. An experiment was conducted to assess the difference between user's abilities to judge what objects an avatar is looking at with only head movements being displayed, while the eyes remained static, and with eye gaze and head movement information being displayed. The results from the experiment show that eye gaze is of vital importance to the subjects correctly identifying what a person is looking at in an immersive virtual environment. This is followed by a description of the work that is now being undertaken following the positive results from the experiment. We discuss the integration of an eye tracker more suitable for immersive mobile use and the software and techniques that were developed to integrate the user's real-world eye movements into calibrated eye gaze in an immersive virtual world. This is to be used in the creation of an immersive collaborative virtual environment supporting eye gaze and its ongoing experiments. Copyright (C) 2009 John Wiley & Sons, Ltd.

Diacylglycerol-induced protection against injury during ischemia and reperfusion can be achieved without activation of protein kinase C in the rat heart: Comparative studies with ischemic preconditioning

The role of protein kinase C (PKC) activation in ischemic preconditioning remains controversial. Since diacylglycerol is the endogenous activator of PKC and as such might be expected cardioprotective, we have investigated whether: (i) the diacylglycerol analog 1,2-dioctanoyl-sn-glycerol (DOG) can protect against injury during ischemia and reperfusion; (ii) any effect is mediated via PKC activation; and (iii) the outcome is influenced by the time of administration. Isolated rat hearts were perfused with buffer at 37°C and paced at 400 bpm. In Study 1, hearts (n=6/group) were subjected to one of the following: (1) 36 min aerobic perfusion (controls); (2) 20 min aerobic perfusion plus ischemic preconditioning (3 min ischemia/3 min reperfusion+5 min ischemia/5 min reperfusion); (3) aerobic perfusion with buffer containing DOG (10 μM) given as a substitute for ischemic preconditioning; (4) aerobic perfusion with DOG (10 μM) during the last 2 min of aerobic perfusion. All hearts then were subjected to 35 min of global ischemia and 40 min reperfusion. A further group (5) were perfused with DOG (10 μM) for the first 2 min of reperfusion. Ischemic preconditioning improved postischemic recovery of LVDP from 24±3% in controls to 71±2% (P<0.05). Recovery of LVDP also was enhanced by DOG when given just before ischemia (54±4%), however, DOG had no effect on the recovery of LVDP when used as a substitute for ischemic preconditioning (22±5%) or when given during reperfusion (29±6%). In Study 2, the first four groups of study were repeated (n=4–5/group) without imposing the periods of ischemia and reperfusion, instead hearts were taken for the measurement of PKC activity (pmol/min/mg protein±SEM). PKC activity after 36 min in groups (1), (2), (3) and (4) was: 332±102, 299±63, 521±144, and 340±113 and the membrane:cytosolic PKC activity ratio was: 5.6±1.5, 5.3±1.8, 6.6±2.7, and 3.9±2.1 (P=NS in each instance). In conclusion, DOG is cardioprotective but under the conditions of the present study is less cardioprotective than ischemic preconditioning, furthermore the protection does not appear to necessitate PKC activation prior to ischemia.

Involvement of ERK, Akt and JNK signalling in H2O2-induced cell injury and protection by hydroxytyrosol and its metabolite homovanillic alcohol

The olive oil polyphenol, hydroxytyrosol (HT), is believed to be capable of exerting protection against oxidative kidney injury. In this study we have investigated the ability of HT and its O-methylated metabolite, homovanillic alcohol (HVA) to protect renal cells against oxidative damage induced by hydrogen peroxide. We show that both compounds were capable of inhibiting hydrogen peroxide-induced kidney cell injury via an ability to interact with both MAP kinase and PI3 kinase signalling pathways, albeit at different concentrations. HT strongly inhibited death and prevented peroxide-induced increases in ERK1/2 and JNK1/2/3 phosphorylation at 0.3 microM, whilst HVA was effective at 10 microM. At similar concentrations, both compounds also prevented peroxide-induced reductions in Akt phosphorylation. We suggest that one potential protective effect exerted by olive oil polyphenols against oxidative kidney cell injury may be attributed to the interactions of HT and HVA with these important intracellular signalling pathways.

A modular head/eye platform for real-time reactive vision

This paper describes the design, implementation and testing of a high speed controlled stereo “head/eye” platform which facilitates the rapid redirection of gaze in response to visual input. It details the mechanical device, which is based around geared DC motors, and describes hardware aspects of the controller and vision system, which are implemented on a reconfigurable network of general purpose parallel processors. The servo-controller is described in detail and higher level gaze and vision constructs outlined. The paper gives performance figures gained both from mechanical tests on the platform alone, and from closed loop tests on the entire system using visual feedback from a feature detector.

Complete robot-eye calibration without special calibration objects

A robot mounted camera is useful in many machine vision tasks as it allows control over view direction and position. In this paper we report a technique for calibrating both the robot and the camera using only a single corresponding point. All existing head-eye calibration systems we have encountered rely on using pre-calibrated robots, pre- calibrated cameras, special calibration objects or combinations of these. Our method avoids using large scale non-linear optimizations by recovering the parameters in small dependent groups. This is done by performing a series of planned, but initially uncalibrated robot movements. Many of the kinematic parameters are obtained using only camera views in which the calibration feature is at, or near the image center, thus avoiding errors which could be introduced by lens distortion. The calibration is shown to be both stable and accurate. The robotic system we use consists of camera with pan-tilt capability mounted on a Cartesian robot, providing a total of 5 degrees of freedom.

An eye for an eye: robust motion segmentation by applying the latest in human vision research

Automatically extracting interesting objects from videos is a very challenging task and is applicable to many research areas such robotics, medical imaging, content based indexing and visual surveillance. Automated visual surveillance is a major research area in computational vision and a commonly applied technique in an attempt to extract objects of interest is that of motion segmentation. Motion segmentation relies on the temporal changes that occur in video sequences to detect objects, but as a technique it presents many challenges that researchers have yet to surmount. Changes in real-time video sequences not only include interesting objects, environmental conditions such as wind, cloud cover, rain and snow may be present, in addition to rapid lighting changes, poor footage quality, moving shadows and reflections. The list provides only a sample of the challenges present. This thesis explores the use of motion segmentation as part of a computational vision system and provides solutions for a practical, generic approach with robust performance, using current neuro-biological, physiological and psychological research in primate vision as inspiration.

Stars in their eyes: what eye-tracking reveal about multimedia perceptual quality

Perceptual multimedia quality is of paramount importance to the continued take-up and proliferation of multimedia applications: users will not use and pay for applications if they are perceived to be of low quality. Whilst traditionally distributed multimedia quality has been characterised by Quality of Service (QoS) parameters, these neglect the user perspective of the issue of quality. In order to redress this shortcoming, we characterise the user multimedia perspective using the Quality of Perception (QoP) metric, which encompasses not only a user’s satisfaction with the quality of a multimedia presentation, but also his/her ability to analyse, synthesise and assimilate informational content of multimedia. In recognition of the fact that monitoring eye movements offers insights into visual perception, as well as the associated attention mechanisms and cognitive processes, this paper reports on the results of a study investigating the impact of differing multimedia presentation frame rates on user QoP and eye path data. Our results show that provision of higher frame rates, usually assumed to provide better multimedia presentation quality, do not significantly impact upon the median coordinate value of eye path data. Moreover, higher frame rates do not significantly increase level of participant information assimilation, although they do significantly improve overall user enjoyment and quality perception of the multimedia content being shown.

Feasibility of using eye tracking to increase resolution for visual telepresence

Visual telepresence seeks to extend existing teleoperative capability by supplying the operator with a 3D interactive view of the remote environment. This is achieved through the use of a stereo camera platform which, through appropriate 3D display devices, provides a distinct image to each eye of the operator, and which is slaved directly from the operator's head and eye movements. However, the resolution within current head mounted displays remains poor, thereby reducing the operator's visual acuity. This paper reports on the feasibility of incorporation of eye tracking to increase resolution and investigates the stability and control issues for such a system. Continuous domain and discrete simulations are presented which indicates that eye tracking provides a stable feedback loop for tracking applications, though some empirical testing (currently being initiated) of such a system will be required to overcome indicated stability problems associated with micro saccades of the human operator.

Reactions to peripheral image motion using a head/eye platform

The authors demonstrate four real-time reactive responses to movement in everyday scenes using an active head/eye platform. They first describe the design and realization of a high-bandwidth four-degree-of-freedom head/eye platform and visual feedback loop for the exploration of motion processing within active vision. The vision system divides processing into two scales and two broad functions. At a coarse, quasi-peripheral scale, detection and segmentation of new motion occurs across the whole image, and at fine scale, tracking of already detected motion takes place within a foveal region. Several simple coarse scale motion sensors which run concurrently at 25 Hz with latencies around 100 ms are detailed. The use of these sensors are discussed to drive the following real-time responses: (1) head/eye saccades to moving regions of interest; (2) a panic response to looming motion; (3) an opto-kinetic response to continuous motion across the image and (4) smooth pursuit of a moving target using motion alone.

Intestinal injury and endotoxemia in children undergoing surgery for congenital heart disease

RATIONALE: Children with congenital heart disease are at risk of gut barrier dysfunction and translocation of gut bacterial antigens into the bloodstream. This may contribute to inflammatory activation and organ dysfunction postoperatively. OBJECTIVES: To investigate the role of intestinal injury and endotoxemia in the pathogenesis of organ dysfunction after surgery for congenital heart disease. METHODS: We analyzed blood levels of intestinal fatty acid binding protein and endotoxin (endotoxin activity assay) alongside global transcriptomic profiling and assays of monocyte endotoxin receptor expression in children undergoing surgery for congenital heart disease. MEASUREMENTS AND MAIN RESULTS: Levels of intestinal fatty acid binding protein and endotoxin were greater in children with duct-dependent cardiac lesions. Endotoxemia was associated with severity of vital organ dysfunction and intensive care stay. We identified activation of pathogen-sensing, antigen-processing, and immune-suppressing pathways at the genomic level postoperatively and down-regulation of pathogen-sensing receptors on circulating immune cells. CONCLUSIONS: Children undergoing surgery for congenital heart disease are at increased risk of intestinal mucosal injury and endotoxemia. Endotoxin activity correlates with a number of outcome variables in this population, and may be used to guide the use of gut-protective strategies.