Feasibility of using eye tracking to increase resolution for visual telepresence

Visual telepresence seeks to extend existing teleoperative capability by supplying the operator with a 3D interactive view of the remote environment. This is achieved through the use of a stereo camera platform which, through appropriate 3D display devices, provides a distinct image to each eye of the operator, and which is slaved directly from the operator's head and eye movements. However, the resolution within current head mounted displays remains poor, thereby reducing the operator's visual acuity. This paper reports on the feasibility of incorporation of eye tracking to increase resolution and investigates the stability and control issues for such a system. Continuous domain and discrete simulations are presented which indicates that eye tracking provides a stable feedback loop for tracking applications, though some empirical testing (currently being initiated) of such a system will be required to overcome indicated stability problems associated with micro saccades of the human operator.

Differences between naïve and expert observers’ vergence and accommodative responses to a range of targets

Purpose: Vergence and accommodation studies often use adult participants with experience of vision science. Reports of infant and clinical responses are generally more variable and of lower gain, with the implication that differences lie in immaturity or sub-optimal clinical characteristics but expert/naïve differences are rarely considered or quantified. Methods: Sixteen undergraduates, naïve to vision science, were individually matched by age, visual acuity, refractive error, heterophoria, stereoacuity and near point of accommodation to second- and third-year orthoptics and optometry undergraduates (‘experts’). Accommodation and vergence responses were assessed to targets moving between 33 cm, 50 cm, 1 m and 2 m using a haploscopic device incorporating a PlusoptiX SO4 autorefractor. Disparity, blur and looming cues were separately available or minimised in all combinations. Instruction set was minimal. Results: In all cases, vergence and accommodation response slopes (gain) were steeper and closer to 1.0 in the expert group (p = 0.001), with the largest expert/naïve differences for both vergence and accommodation being for near targets (p = 0.012). For vergence, the differences between expert and naïve response slopes increased with increasingly open-loop targets (linear trend p = 0.025). Although we predicted that proximal cues would drive additional response in the experts, the proximity-only cue was the only condition that showed no statistical effect of experience. Conclusions: Expert observers provide more accurate responses to near target demand than closely matched naïve observers. We suggest that attention, practice, voluntary and proprioceptive effects may enhance responses in experienced participants when compared to a more typical general population. Differences between adult reports and the developmental and clinical literature may partially reflect expert/naïve effects, as well as developmental change. If developmental and clinical studies are to be compared to adult normative data, uninstructed naïve adult data should be used.

Hypo-accommodation responses in hypermetropic infants and children

Aims: Accommodation to overcome hypermetropia is implicated in emmetropisation. This study recorded accommodation responses in a wide range of emmetropising infants and older children with clinically significant hypermetropia to assess common characteristics and differences. Methods: A PlusoptiXSO4 photorefractor in a laboratory setting was used to collect binocular accommodation data from participants viewing a detailed picture target moving between 33cm and 2m. 38 typically developing infants were studied between 6-26 weeks of age and were compared with cross-sectional data from children 5-9 years of age with clinically significant hypermetropia (n=15), corrected fully accommodative strabismus (n=14) and 27 age-matched controls. Results: Hypermetropes of all ages under-accommodated compared to controls at all distances, whether corrected or not (p<0.00001) and lag related to manifest refraction. Emmetropising infants under-accommodated most in the distance, while the hypermetropic patient groups underaccommodated most for near. Conclusions: Better accommodation for near than distance is demonstrated in those hypermetropic children who go on to emmetropise. This supports the approach of avoiding refractive correction in such children. In contrast, hypermetropic children referred for treatment for reduced distance visual acuity are not likely to habitually accommodate to overcome residual hypermetropia left by an under-correction.

The relationship between rapid naming and word spelling in English

A study of the concurrent relationships between naming speed, phonological awareness and spelling ability in 146 children in Year 3 and 4 of state funded school in SE England (equivalent to US Grades 2 and 3) is reported. Seventy-two children identified as having normal phonological awareness but reduced rapid automatized naming (RAN) performance (1 standard deviation below the mean) participated in the study. A group of 74 children were further identified. These children were matched on phonological awareness, verbal and non verbal IQ, and visual acuity but all members of this group showed normal rapid automatized naming performance. Rapid automatized naming made a significant unique contribution to spelling performance. Further analyses showed that the participants with low naming performance were significantly poorer spellers overall and had a specific difficulty in spelling irregular words. The findings support the view that rapid automatized naming may be indexing processes that are implicated in the establishment of fully specified orthographic representations.

Developmental changes in the balance of disparity, blur and looming/proximity cues to drive ocular alignment and focus

Accurate co-ordination of accommodation and convergence is necessary to view near objects and develop fine motor co-ordination. We used a remote haploscopic videorefraction paradigm to measure longitudinal changes in simultaneous ocular accommodation and vergence to targets at different depths, and to all combinations of blur, binocular disparity, and change-in-size (“proximity”) cues. Infants were followed longitudinally and compared to older children and young adults, with the prediction that sensitivity to different cues would change during development. Mean infant responses to the most naturalistic condition were similar to those of adults from 6-7 weeks (accommodation) and 8-9 weeks (vergence). Proximity cues influenced responses most in infants less than 14 weeks of age, but sensitivity declined thereafter. Between 12-28 weeks of age infants were equally responsive to all three cues, while in older children and adults manipulation of disparity resulted in the greatest changes in response. Despite rapid development of visual acuity (thus increasing availability of blur cues), responses to blur were stable throughout development. Our results suggest that during much of infancy, vergence and accommodation responses are not dependent on the development of specific depth cues, but make use of any cues available to drive appropriate changes in response.

A new calibrated sunspot group series since 1749: statistics of active day fractions

Although the sunspot-number series have existed since the mid-19th century, they are still the subject of intense debate, with the largest uncertainty being related to the "calibration" of the visual acuity of individual observers in the past. Daisy-chain regression methods are applied to inter-calibrate the observers which may lead to significant bias and error accumulation. Here we present a novel method to calibrate the visual acuity of the key observers to the reference data set of Royal Greenwich Observatory sunspot groups for the period 1900-1976, using the statistics of the active-day fraction. For each observer we independently evaluate their observational thresholds [S_S] defined such that the observer is assumed to miss all of the groups with an area smaller than S_S and report all the groups larger than S_S. Next, using a Monte-Carlo method we construct, from the reference data set, a correction matrix for each observer. The correction matrices are significantly non-linear and cannot be approximated by a linear regression or proportionality. We emphasize that corrections based on a linear proportionality between annually averaged data lead to serious biases and distortions of the data. The correction matrices are applied to the original sunspot group records for each day, and finally the composite corrected series is produced for the period since 1748. The corrected series displays secular minima around 1800 (Dalton minimum) and 1900 (Gleissberg minimum), as well as the Modern grand maximum of activity in the second half of the 20th century. The uniqueness of the grand maximum is confirmed for the last 250 years. It is shown that the adoption of a linear relationship between the data of Wolf and Wolfer results in grossly inflated group numbers in the 18th and 19th centuries in some reconstructions.

The effect of colored lenses on the visual evoked response in children with visual stress

Purpose. Some children with visual stress and/or headaches have fewer symptoms when wearing colored lenses. Although subjective reports of improved perception exist, few objective correlates of these effects have been established. Methods. In a pilot study, 10 children who wore Intuitive Colorimeter lenses, and claimed benefit, and two asymptomatic children were tested. Steady-state potentials were measured in response to low contrast patterns modulating at a frequency of 12 Hz. Four viewing conditions were compared: 1) no lens; 2) Colorimeter lens; 3) lens of complementary color; and 4) spectrally neutral lens with similar photopic transmission. Results. The asymptomatic children showed little or no difference between the lens and no lens conditions. When all the symptomatic children were tested together, a similar result was found. However, when the symptomatic children were divided into two groups depending on their symptoms, an interaction emerged. Children with visual stress but no headaches showed the largest amplitude visual evoked potential response in the no lens condition, whereas those children whose symptoms included severe headaches or migraine showed the largest amplitude visual evoked potential response when wearing their prescribed lens. Conclusions. The results suggest that it is possible to measure objective correlates of the beneficial subjective perceptual effects of colored lenses, at least in some children who have a history of migraine or severe headaches.

Irrelevant sound effects amongst younger and older adults: objective findings and subjective insights

Two experiments examine the effects of extraneous speech and nonspeech noise on a visual short-term memory task administered to younger and older adults. Experiment 1 confirms an earlier report that playing task-irrelevant speech is no more distracting for older adults than for younger adults (Rouleau T Belleville, 1996), indicating that "irrelevant sound effects" in short-term memory operate in a different manner to recalling targets in the presence of competing speech (Tun, O'Kane, T Wingfield, 2002). Experiment 2 extends this result to nonspeech noise and demonstrates that the result cannot be ascribed to hearing difficulties amongst the older age group, although the data also show that older adults rated the noise as less annoying and uncomfortable than younger adults. Implications for theories of the irrelevant sound effect, and for cognitive ageing, are discussed.

A helmet mounted display system with active gaze control for visual telepresence

The objective of a Visual Telepresence System is to provide the operator with a high fidelity image from a remote stereo camera pair linked to a pan/tilt device such that the operator may reorient the camera position by use of head movement. Systems such as these which utilise virtual reality style helmet mounted displays have a number of limitations. The geometry of the camera positions and of the displays is generally fixed and is most suitable only for viewing elements of a scene at a particular distance. To address such limitations, a prototype system has been developed where the geometry of the displays and cameras is dynamically controlled by the eye movement of the operator. This paper explores why it is necessary to actively adjust the display system as well as the cameras and justifies the use of mechanical adjustment of the displays as an alternative to adjustment by electronic or image processing methods. The electronic and mechanical design is described including optical arrangements and control algorithms. The performance and accuracy of the system is assessed with respect to eye movement.

Decreasing the interference of visual-based P300 BCI using facial expression changes

Interferences from the spatially adjacent non-target stimuli evoke ERPs during non-target sub-trials and lead to false positives. This phenomenon is commonly seen in visual attention based BCIs and affects the performance of BCI system. Although, users or subjects tried to focus on the target stimulus, they still could not help being affected by conspicuous changes of the stimuli (flashes or presenting images) which were adjacent to the target stimulus. In view of this case, the aim of this study is to reduce the adjacent interference using new stimulus presentation pattern based on facial expression changes. Positive facial expressions can be changed to negative facial expressions by minor changes to the original facial image. Although the changes are minor, the contrast will be big enough to evoke strong ERPs. In this paper, two different conditions (Pattern_1, Pattern_2) were used to compare across objective measures such as classification accuracy and information transfer rate as well as subjective measures. Pattern_1 was a “flash-only” pattern and Pattern_2 was a facial expression change of a dummy face. In the facial expression change patterns, the background is a positive facial expression and the stimulus is a negative facial expression. The results showed that the interferences from adjacent stimuli could be reduced significantly (P<;0.05) by using the facial expression change patterns. The online performance of the BCI system using the facial expression change patterns was significantly better than that using the “flash-only” patterns in terms of classification accuracy (p<;0.01), bit rate (p<;0.01), and practical bit rate (p<;0.01). Subjects reported that the annoyance and fatigue could be significantly decreased (p<;0.05) using the new stimulus presentation pattern presented in this paper.

Objective Empirical Mode Decomposition metric

Empirical Mode Decomposition (EMD) is a data driven technique for extraction of oscillatory components from data. Although it has been introduced over 15 years ago, its mathematical foundations are still missing which also implies lack of objective metrics for decomposed set evaluation. Most common technique for assessing results of EMD is their visual inspection, which is very subjective. This article provides objective measures for assessing EMD results based on the original definition of oscillatory components.