The Perception of Natural, Cell Phone, and Computer-Synthesized Speech During The Performance Of Simultaneous Visual-Motor Tasks

This study investigated the influence of top-down and bottom-up information on speech perception in complex listening environments. Specifically, the effects of listening to different types of processed speech were examined on intelligibility and on simultaneous visual-motor performance. The goal was to extend the generalizability of results in speech perception to environments outside of the laboratory. The effect of bottom-up information was evaluated with natural, cell phone and synthetic speech. The effect of simultaneous tasks was evaluated with concurrent visual-motor and memory tasks. Earlier works on the perception of speech during simultaneous visual-motor tasks have shown inconsistent results (Choi, 2004; Strayer & Johnston, 2001). In the present experiments, two dual-task paradigms were constructed in order to mimic non-laboratory listening environments. In the first two experiments, an auditory word repetition task was the primary task and a visual-motor task was the secondary task. Participants were presented with different kinds of speech in a background of multi-speaker babble and were asked to repeat the last word of every sentence while doing the simultaneous tracking task. Word accuracy and visual-motor task performance were measured. Taken together, the results of Experiments 1 and 2 showed that the intelligibility of natural speech was better than synthetic speech and that synthetic speech was better perceived than cell phone speech. The visual-motor methodology was found to demonstrate independent and supplemental information and provided a better understanding of the entire speech perception process. Experiment 3 was conducted to determine whether the automaticity of the tasks (Schneider & Shiffrin, 1977) helped to explain the results of the first two experiments. It was found that cell phone speech allowed better simultaneous pursuit rotor performance only at low intelligibility levels when participants ignored the listening task. Also, simultaneous task performance improved dramatically for natural speech when intelligibility was good. Overall, it could be concluded that knowledge of intelligibility alone is insufficient to characterize processing of different speech sources. Additional measures such as attentional demands and performance of simultaneous tasks were also important in characterizing the perception of different kinds of speech in complex listening environments.

Do optic nerve head and visual field parameters in patients with obstructive sleep apnea syndrome differ from those in control individuals?

BACKGROUND It has been suggested that sleep apnea syndrome may play a role in normal-tension glaucoma contributing to optic nerve damage. The purpose of this study was to evaluate if optic nerve and visual field parameters in individuals with sleep apnea syndrome differ from those in controls. PATIENTS AND METHODS From the records of the sleep laboratory at the University Hospital in Bern, Switzerland, we recruited consecutive patients with severe sleep apnea syndrome proven by polysomnography, apnea-hypopnea index >20, as well as no sleep apnea controls with apnea-hypopnea index <10. Participants had to be unknown to the ophtalmology department and had to have no recent eye examination in the medical history. All participants underwent a comprehensive eye examination, scanning laser polarimetry (GDx VCC, Carl Zeiss Meditec, Dublin, California), scanning laser ophthalmoscopy (Heidelberg Retina Tomograph II, HRT II), and automated perimetry (Octopus 101 Programm G2, Haag-Streit Diagnostics, Koeniz, Switzerland). Mean values of the parameters of the two groups were compared by t-test. RESULTS The sleep apnea group consisted of 69 eyes of 35 patients; age 52.7 ± 9.7 years, apnea-hypopnea index 46.1 ± 24.8. As controls served 38 eyes of 19 patients; age 45.8 ± 11.2 years, apnea-hypopnea index 4.8 ± 1.9. A difference was found in mean intraocular pressure, although in a fully overlapping range, sleep apnea group: 15.2 ± 3.1, range 8-22 mmHg, controls: 13.6 ± 2.3, range 9-18 mmHg; p<0.01. None of the extended visual field, optic nerve head (HRT) and retinal nerve fiber layer (GDx VCC) parameters showed a significant difference between the groups. CONCLUSION Visual field, optic nerve head, and retinal nerve fiber layer parameters in patients with sleep apnea did not differ from those in the control group. Our results do not support a pathogenic relationship between sleep apnea syndrome and glaucoma.

Study and analysis of the Leap Motion sensor and the Software Development Kit (SDK) for the implementation of visual Human Computer Interfaces

En este proyecto, se presenta un informe técnico sobre la cámara Leap Motion y el Software Development Kit correspondiente, el cual es un dispositivo con una cámara de profundidad orientada a interfaces hombre-máquina. Esto es realizado con el propósito de desarrollar una interfaz hombre-máquina basada en un sistema de reconocimiento de gestos de manos. Después de un exhaustivo estudio de la cámara Leap Motion, se han realizado diversos programas de ejemplo con la intención de verificar las capacidades descritas en el informe técnico, poniendo a prueba la Application Programming Interface y evaluando la precisión de las diferentes medidas obtenidas sobre los datos de la cámara. Finalmente, se desarrolla un prototipo de un sistema de reconocimiento de gestos. Los datos sobre la posición y orientación de la punta de los dedos obtenidos de la Leap Motion son usados para describir un gesto mediante un vector descriptor, el cual es enviado a una Máquina Vectores Soporte, utilizada como clasificador multi-clase.

Human-computer interaction based on visual hand-gesture recognition using volumetric spatiograms of local binary patterns

A more natural, intuitive, user-friendly, and less intrusive Human–Computer interface for controlling an application by executing hand gestures is presented. For this purpose, a robust vision-based hand-gesture recognition system has been developed, and a new database has been created to test it. The system is divided into three stages: detection, tracking, and recognition. The detection stage searches in every frame of a video sequence potential hand poses using a binary Support Vector Machine classifier and Local Binary Patterns as feature vectors. These detections are employed as input of a tracker to generate a spatio-temporal trajectory of hand poses. Finally, the recognition stage segments a spatio-temporal volume of data using the obtained trajectories, and compute a video descriptor called Volumetric Spatiograms of Local Binary Patterns (VS-LBP), which is delivered to a bank of SVM classifiers to perform the gesture recognition. The VS-LBP is a novel video descriptor that constitutes one of the most important contributions of the paper, which is able to provide much richer spatio-temporal information than other existing approaches in the state of the art with a manageable computational cost. Excellent results have been obtained outperforming other approaches of the state of the art.

Inclusion of immersive virtual learning environments and visual control systems to support the learning of students with Asperger syndrome

This paper presents the use of immersive virtual reality systems in the educational intervention with Asperger students. The starting points of this study are features of these students' cognitive style that requires an explicit teaching style supported by visual aids and highly structured environments. The proposed immersive virtual reality system, not only to assess the student's behavior and progress, but also is able to adapt itself to the student's specific needs. Additionally, the immersive reality system is equipped with sensors that can determine certain behaviors of the students. This paper determines the possible inclusion of immersive virtual reality as a support tool and learning strategy in these particular students' intervention. With this objective two task protocols have been defined with which the behavior and interaction situations performed by participant students are recorded. The conclusions from this study talks in favor of the inclusion of these virtual immersive environments as a support tool in the educational intervention of Asperger syndrome students as their social competences and executive functions have improved.

Computer methods for analysis and synthesis of visual texture,

"C00-2118-0048."

Pathological changes in the primary visual cortex (Area V1) in Creutzfeldt-Jakob syndrome

About 10% of patients with Creutzfeldt-Jakob syndrome (disease) (CJD) exhibit visual symptoms at presentation and approximately 50% during the course of the disease. The objectives of the present study were to determine, in two subtypes of CJD, viz., sporadic CJD (sCJD) and variant CJD (vCJD), the degree of pathological change in the primary visual cortex (area V1) and the extent to which pathology in V1 may influence visual function. The vacuolation (‘spongiform change’), surviving neurons, glial cell nuclei, and deposits of prion protein (PrP) were quantified in V1 obtained post-mortem in nine cases of sCJD and eleven cases of vCJD. In sCJD, the vacuoles and PrP deposits were regularly distributed along the cortex parallel to the pia mater in clusters with a mean dimension from 450 to 1000 µm. Across the cortex, the vacuolation was most severe in laminae II/III and the glial cell reaction in laminae V/VI. Surviving neurons were most abundant in laminae II/III while PrP deposition either affected all laminae equally or was maximal in lamina II/III. In vCJD, the vacuoles and diffuse PrP deposits were distributed relatively uniformly parallel to the pia mater while the florid deposits were consistently distributed in regular clusters. Across V1, the vacuoles either exhibited a bimodal distribution or were uniformly distributed. The diffuse PrP deposits occurred most frequently in laminae II/III while the florid deposits were more generally distributed. The data suggest that in both sCJD and vCJD, pathological changes in area V1 may affect the processing of visual information in laminae II/III and its transmission from V1 to V2 and to subcortical visual areas. In addition, the data suggest an association in sCJD between the developing pathology and the functional domains of V1 while in vCJD the pathology is more uniformly distributed. These changes could be a factor in the development of poor visual acuity, visual field defects, cortical blindness, diplopia, and vertical gaze palsy that have been observed in Creutzfeldt-Jakob syndrome.

Characteristics of visual function in Asperger’s syndrome and the autism spectrum

Autism is a pervasive developmental disorder and Asperger’s syndrome is part of the spectrum of autism disorders. This thesis aims to: • Review and investigate current theories concerning visual function in individuals with Asperger’s syndrome and high functioning autism spectrum disorder and to translate the findings into clinical practice by developing a specific protocol for the eye examination of individuals of this population. • Investigate whether those with Asperger’s syndrome are more likely to suffer from Meares-Irlen syndrome and/or dyslexia. • Assess the integrity of the M-cell pathway in Asperger’s syndrome using perimetric tests available in optometric practice to investigate and also to describe the nature of any defects. • Evaluate eye movement strategies in Asperger’s whilst viewing both text and images. Also to evaluate the most appropriate methodology for investigating eye movements; namely optical digital eye tracking and electrophysiology methodologies. Findings of the investigations include • Eye examinations for individuals with Asperger’s syndrome should contain the same testing methods as for the general population, with special consideration for clear communication. • There is a depression of M-pathway visual field sensitivity in 57% (8/14) of people with Asperger’s syndrome, supporting previous evidence for an M-cell deficit in some individuals. • There is a raised prevalence of dyslexia in Asperger’s syndrome (26% of a sample of 31) but not necessarily of Meares-Irlen syndrome. • Gaze strategies are abnormal in Asperger’s syndrome, for both reading and viewing of images. With increased saccadic movement and decreased viewing of faces in comparison to background detail.

Which physiological components are more suitable for visual ERP based brain-computer interface?:A preliminary MEG/EEG study

We investigated which evoked response component occurring in the first 800 ms after stimulus presentation was most suitable to be used in a classical P300-based brain-computer interface speller protocol. Data was acquired from 275 Magnetoencephalographic sensors in two subjects and from 61 Electroencephalographic sensors in four. To better characterize the evoked physiological responses and minimize the effect of response overlap, a 1000 ms Inter Stimulus Interval was preferred to the short (

A method for enhancing digital information displayed to computer users with visual refractive errors via spatial and spectral processing

This research pursued the conceptualization, implementation, and verification of a system that enhances digital information displayed on an LCD panel to users with visual refractive errors. The target user groups for this system are individuals who have moderate to severe visual aberrations for which conventional means of compensation, such as glasses or contact lenses, does not improve their vision. This research is based on a priori knowledge of the user's visual aberration, as measured by a wavefront analyzer. With this information it is possible to generate images that, when displayed to this user, will counteract his/her visual aberration. The method described in this dissertation advances the development of techniques for providing such compensation by integrating spatial information in the image as a means to eliminate some of the shortcomings inherent in using display devices such as monitors or LCD panels. Additionally, physiological considerations are discussed and integrated into the method for providing said compensation. In order to provide a realistic sense of the performance of the methods described, they were tested by mathematical simulation in software, as well as by using a single-lens high resolution CCD camera that models an aberrated eye, and finally with human subjects having various forms of visual aberrations. Experiments were conducted on these systems and the data collected from these experiments was evaluated using statistical analysis. The experimental results revealed that the pre-compensation method resulted in a statistically significant improvement in vision for all of the systems. Although significant, the improvement was not as large as expected for the human subject tests. Further analysis suggest that even under the controlled conditions employed for testing with human subjects, the characterization of the eye may be changing. This would require real-time monitoring of relevant variables (e.g. pupil diameter) and continuous adjustment in the pre-compensation process to yield maximum viewing enhancement.

Dynamic image precompensation for improving visual performance of computer users with ocular aberrations

With the progress of computer technology, computers are expected to be more intelligent in the interaction with humans, presenting information according to the user's psychological and physiological characteristics. However, computer users with visual problems may encounter difficulties on the perception of icons, menus, and other graphical information displayed on the screen, limiting the efficiency of their interaction with computers. In this dissertation, a personalized and dynamic image precompensation method was developed to improve the visual performance of the computer users with ocular aberrations. The precompensation was applied on the graphical targets before presenting them on the screen, aiming to counteract the visual blurring caused by the ocular aberration of the user's eye. A complete and systematic modeling approach to describe the retinal image formation of the computer user was presented, taking advantage of modeling tools, such as Zernike polynomials, wavefront aberration, Point Spread Function and Modulation Transfer Function. The ocular aberration of the computer user was originally measured by a wavefront aberrometer, as a reference for the precompensation model. The dynamic precompensation was generated based on the resized aberration, with the real-time pupil diameter monitored. The potential visual benefit of the dynamic precompensation method was explored through software simulation, with the aberration data from a real human subject. An "artificial eye'' experiment was conducted by simulating the human eye with a high-definition camera, providing objective evaluation to the image quality after precompensation. In addition, an empirical evaluation with 20 human participants was also designed and implemented, involving image recognition tests performed under a more realistic viewing environment of computer use. The statistical analysis results of the empirical experiment confirmed the effectiveness of the dynamic precompensation method, by showing significant improvement on the recognition accuracy. The merit and necessity of the dynamic precompensation were also substantiated by comparing it with the static precompensation. The visual benefit of the dynamic precompensation was further confirmed by the subjective assessments collected from the evaluation participants.

A method for enhancing digital information displayed to computer users with visual refractive errors via spatial and spectral processing

This research pursued the conceptualization, implementation, and verification of a system that enhances digital information displayed on an LCD panel to users with visual refractive errors. The target user groups for this system are individuals who have moderate to severe visual aberrations for which conventional means of compensation, such as glasses or contact lenses, does not improve their vision. This research is based on a priori knowledge of the user's visual aberration, as measured by a wavefront analyzer. With this information it is possible to generate images that, when displayed to this user, will counteract his/her visual aberration. The method described in this dissertation advances the development of techniques for providing such compensation by integrating spatial information in the image as a means to eliminate some of the shortcomings inherent in using display devices such as monitors or LCD panels. Additionally, physiological considerations are discussed and integrated into the method for providing said compensation. In order to provide a realistic sense of the performance of the methods described, they were tested by mathematical simulation in software, as well as by using a single-lens high resolution CCD camera that models an aberrated eye, and finally with human subjects having various forms of visual aberrations. Experiments were conducted on these systems and the data collected from these experiments was evaluated using statistical analysis. The experimental results revealed that the pre-compensation method resulted in a statistically significant improvement in vision for all of the systems. Although significant, the improvement was not as large as expected for the human subject tests. Further analysis suggest that even under the controlled conditions employed for testing with human subjects, the characterization of the eye may be changing. This would require real-time monitoring of relevant variables (e.g. pupil diameter) and continuous adjustment in the pre-compensation process to yield maximum viewing enhancement.

The Visual Arts as a Canvas for Teaching Computer Programming

We explore the relationships between the construction of a work of art and the crafting of a computer program in Java and suggest that the structure of paintings and drawings may be used to teach the fundamental concepts of computer programming. This movement "from Art to Science", using art to drive computing, complements the common use of computing to inform art. We report on initial experiences using this approach with undergraduate and postgraduate students. An embryonic theory of the correspondence between art and computing is presented and a methodology proposed to develop this project further.

Carpal tunnel syndrome and computer exposure at work in two large complementary cohorts.

International audience