Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations.

BACKGROUND Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. METHODS Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. RESULTS Both aphasic patients and healthy controls mainly fixated the speaker's face. We found a significant co-speech gesture × ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction × ROI × group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker's face compared to healthy controls. CONCLUSION Co-speech gestures guide the observer's attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker's face.

The Neuroscience of Visual Hallucinations

Each year, some two million people in the United Kingdom experience visual hallucinations. Infrequent, fleeting visual hallucinations, often around sleep, are a usual feature of life. In contrast, consistent, frequent, persistent hallucinations during waking are strongly associated with clinical disorders; in particular delirium, eye disease, psychosis, and dementia. Research interest in these disorders has driven a rapid expansion in investigatory techniques, new evidence, and explanatory models. In parallel, a move to generative models of normal visual function has resolved the theoretical tension between veridical and hallucinatory perceptions. From initial fragmented areas of investigation, the field has become increasingly coherent over the last decade. Controversies and gaps remain, but for the first time the shapes of possible unifying models are becoming clear, along with the techniques for testing these. This book provides a comprehensive survey of the neuroscience of visual hallucinations and the clinical techniques for testing these. It brings together the very latest evidence from cognitive neuropsychology, neuroimaging, neuropathology, and neuropharmacology, placing this within current models of visual perception. Leading researchers from a range of clinical and basic science areas describe visual hallucinations in their historical and scientific context, combining introductory information with up-to-date discoveries. They discuss results from the main investigatory techniques applied in a range of clinical disorders. The final section outlines future research directions investigating the potential for new understandings of veridical and hallucinatory perceptions, and for treatments of problematic hallucinations. Fully comprehensive, this is an essential reference for clinicians in the fields of the psychology and psychiatry of hallucinations, as well as for researchers in departments, research institutes and libraries. It has strong foundations in neuroscience, cognitive science, optometry, psychiatry, psychology, clinical medicine, and philosophy. With its lucid explanation and many illustrations, it is a clear resource for educators and advanced undergraduate and graduate students.

Real-time computer-based visual feedback improves visual acuity in downbeat nystagmus - a pilot study.

BACKGROUND Patients with downbeat nystagmus syndrome suffer from oscillopsia, which leads to an unstable visual perception and therefore impaired visual acuity. The aim of this study was to use real-time computer-based visual feedback to compensate for the destabilizing slow phase eye movements. METHODS The patients were sitting in front of a computer screen with the head fixed on a chin rest. The eye movements were recorded by an eye tracking system (EyeSeeCam®). We tested the visual acuity with a fixed Landolt C (static) and during real-time feedback driven condition (dynamic) in gaze straight ahead and (20°) sideward gaze. In the dynamic condition, the Landolt C moved according to the slow phase eye velocity of the downbeat nystagmus. The Shapiro-Wilk test was used to test for normal distribution and one-way ANOVA for comparison. RESULTS Ten patients with downbeat nystagmus were included in the study. Median age was 76 years and the median duration of symptoms was 6.3 years (SD +/- 3.1y). The mean slow phase velocity was moderate during gaze straight ahead (1.44°/s, SD +/- 1.18°/s) and increased significantly in sideward gaze (mean left 3.36°/s; right 3.58°/s). In gaze straight ahead, we found no difference between the static and feedback driven condition. In sideward gaze, visual acuity improved in five out of ten subjects during the feedback-driven condition (p = 0.043). CONCLUSIONS This study provides proof of concept that non-invasive real-time computer-based visual feedback compensates for the SPV in DBN. Therefore, real-time visual feedback may be a promising aid for patients suffering from oscillopsia and impaired text reading on screen. Recent technological advances in the area of virtual reality displays might soon render this approach feasible in fully mobile settings.

Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations

Background: Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. Methods: Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. Results: Both aphasic patients and healthy controls mainly fixated the speaker’s face. We found a significant co-speech gesture x ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction x ROI x group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker’s face compared to healthy controls. Conclusion: Co-speech gestures guide the observer’s attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker’s face. Keywords: Gestures, visual exploration, dialogue, aphasia, apraxia, eye movements

Influence of the vitreomacular interface on the efficacy of intravitreal therapy for uveitis-associated cystoid macular oedema.

PURPOSE To evaluate the effect of the vitreomacular interface (VMI) on treatment efficacy of intravitreal therapy in uveitic cystoid macular oedema (CME). METHODS Retrospective analysis of CME resolution, CME recurrence rate and monthly course of central retinal thickness (CRT), retinal volume (RV) and best corrected visual acuity (BCVA) after intravitreal injection with respect to the VMI configuration on spectral-domain OCT using chi-squared test and repeated measures anova adjusted for confounding covariates epiretinal membrane, administered drug and subretinal fluid. RESULTS Fifty-nine eyes of 53 patients (mean age: 47.4 ± 16.9 years) were included. VMI status had no effect on complete CME resolution rate (p = 0.16, corrected p-value: 0.32), time until resolution (p = 0.09, corrected p-value: 0.27) or CME relapse rate (p = 0.29, corrected p-value: 0.29). Change over time did not differ among the VMI configuration groups for BVCA (p = 0.82) and RV (p = 0.18), but CRT decrease was greater and faster in the posterior vitreous detachment (PVD) group compared to the posterior vitreous attachment (PVA) and vitreous macular adhesion (VMA) groups (p = 0.04). Also, the percentage of patients experiencing a ≥ 20% CRT thickness decrease after intravitreal injection was greater in the PVD group (83%) compared to the VMA (64%) and the PVA (16%) group (p = 0.027), however, not after correction for multiple testing (corrected p-value: 0.11). CONCLUSION The VMI configuration seems to be a factor contributing to treatment efficacy in uveitic CME in terms of CRT decrease, although BCVA outcome did not differ according to VMI status.