The modulation of reading strategies by language opacity in early bilinguals: an eye movement study

Converging evidences from eye movement experiments indicate that linguistic contexts influence reading strategies. However, the question of whether different linguistic contexts modulate eye movements during reading in the same bilingual individuals remains unresolved. We examined reading strategies in a transparent (German) and an opaque (French) language of early, highly proficient French–German bilinguals: participants read aloud isolated French and German words and pseudo-words while the First Fixation Location (FFL), its duration and latency were measured. Since transparent linguistic contexts and pseudo-words would favour a direct grapheme/phoneme conversion, the reading strategy should be more local for German than for French words (FFL closer to the beginning) and no difference is expected in pseudo-words’ FFL between contexts. Our results confirm these hypotheses, providing the first evidence that the same individuals engage different reading strategy depending on language opacity, suggesting that a given brain process can be modulated by a given context.

Analysis of fixational eye micromovements through pupil tracking

Póster presentado en OPTYKA Optical Fair 2012, Poznan, Polonia, 9-10 noviembre 2012.

The Impact of Language Opacity and Proficiency on Reading Strategies in Bilinguals: An Eye Movement Study

Reading strategies vary across languages according to orthographic depth - the complexity of the grapheme in relation to phoneme conversion rules - notably at the level of eye movement patterns. We recently demonstrated that a group of early bilinguals, who learned both languages equally under the age of seven, presented a first fixation location (FFL) closer to the beginning of words when reading in German as compared with French. Since German is known to be orthographically more transparent than French, this suggested that different strategies were being engaged depending on the orthographic depth of the used language. Opaque languages induce a global reading strategy, and transparent languages force a local/serial strategy. Thus, pseudo-words were processed using a local strategy in both languages, suggesting that the link between word forms and their lexical representation may also play a role in selecting a specific strategy. In order to test whether corresponding effects appear in late bilinguals with low proficiency in their second language (L2), we present a new study in which we recorded eye movements while two groups of late German-French and French-German bilinguals read aloud isolated French and German words and pseudo-words. Since, a transparent reading strategy is local and serial, with a high number of fixations per stimuli, and the level of the bilingual participants' L2 is low, the impact of language opacity should be observed in L1. We therefore predicted a global reading strategy if the bilinguals' L1 was French (FFL close to the middle of the stimuli with fewer fixations per stimuli) and a local and serial reading strategy if it was German. Thus, the L2 of each group, as well as pseudo-words, should also require a local and serial reading strategy. Our results confirmed these hypotheses, suggesting that global word processing is only achieved by bilinguals with an opaque L1 when reading in an opaque language; the low level in the L2 gives way to a local and serial reading strategy. These findings stress the fact that reading behavior is influenced not only by the linguistic mode but also by top-down factors, such as readers' proficiency.

Relational Memory Is Evident in Eye Movement Behavior despite the Use of Subliminal Testing Methods

While it is generally agreed that perception can occur without awareness, there continues to be debate about the type of representational content that is accessible when awareness is minimized or eliminated. Most investigations that have addressed this issue evaluate access to well-learned representations. Far fewer studies have evaluated whether or not associations encountered just once prior to testing might also be accessed and influence behavior. Here, eye movements were used to examine whether or not memory for studied relationships is evident following the presentation of subliminal cues. Participants (assigned to experimental or control groups) studied scene-face pairs and test trials evaluated implicit and explicit memory for these pairs. Each test trial began with a subliminal scene cue, followed by three visible studied faces. For experimental group participants, one face was the studied associate of the scene (implicit test); for controls none were a match. Subsequently, the Display containing a match was presented to both groups, but now it was preceded by a visible scene cue (explicit test). Eye movements were recorded and recognition Memory responses were made. Participants in the experimental group looked disproportionately at matching faces on implicit test trials and participants from both groups looked disproportionately at matching faces on explicit test trials, even when that face had not been successfully identified as the associate. Critically, implicit memory-based viewing effects seemed not to depend on residual awareness of subliminal scenes cues, as subjective and objective measures indicated that scenes were successfully masked from view. The reported outcomes indicate that memory for studied relationships can be expressed in eye movement behavior without awareness.

Eye Gaze Behavior at Turn Transition: How Aphasic Patients Process Speakers' Turns during Video Observation

The human turn-taking system regulates the smooth and precise exchange of speaking turns during face-to-face interaction. Recent studies investigated the processing of ongoing turns during conversation by measuring the eye movements of noninvolved observers. The findings suggest that humans shift their gaze in anticipation to the next speaker before the start of the next turn. Moreover, there is evidence that the ability to timely detect turn transitions mainly relies on the lexico-syntactic content provided by the conversation. Consequently, patients with aphasia, who often experience deficits in both semantic and syntactic processing, might encounter difficulties to detect and timely shift their gaze at turn transitions. To test this assumption, we presented video vignettes of natural conversations to aphasic patients and healthy controls, while their eye movements were measured. The frequency and latency of event-related gaze shifts, with respect to the end of the current turn in the videos, were compared between the two groups. Our results suggest that, compared with healthy controls, aphasic patients have a reduced probability to shift their gaze at turn transitions but do not show significantly increased gaze shift latencies. In healthy controls, but not in aphasic patients, the probability to shift the gaze at turn transition was increased when the video content of the current turn had a higher lexico-syntactic complexity. Furthermore, the results from voxel-based lesion symptom mapping indicate that the association between lexico-syntactic complexity and gaze shift latency in aphasic patients is predicted by brain lesions located in the posterior branch of the left arcuate fasciculus. Higher lexico-syntactic processing demands seem to lead to a reduced gaze shift probability in aphasic patients. This finding may represent missed opportunities for patients to place their contributions during everyday conversation.

Alzheimer’s disease and the eye

Dementia, including Alzheimer’s disease (AD), is a major disorder causing visual problems in the elderly population. The pathology of AD includes the deposition in the brain of abnormal aggregates of ß-amyloid (Aß) in the form of senile plaques (SP) and abnormally phosphorylated tau in the form of neurofibrillary tangles (NFT). A variety of visual problems have been reported in patients with AD including loss of visual acuity (VA), colour vision and visual fields; changes in pupillary response to mydriatics, defects in fixation and in smooth and saccadic eye movements; changes in contrast sensitivity and in visual evoked potentials (VEP); and disturbances of complex visual functions such as reading, visuospatial function, and in the naming and identification of objects. Many of these changes are controversial with conflicting data in the literature and no ocular or visual feature can be regarded as particularly diagnostic of AD. In addition, some pathological changes have been observed to affect the eye, visual pathway, and visual cortex in AD. The optometrist has a role in helping a patient with AD, if it is believed that signs and symptoms of the disease are present, so as to optimize visual function and improve the quality of life. (J Optom 2009;2:103-111 ©2009 Spanish Council of Optometry)

Eye movement problems and differential diagnosis of the parkinsonian syndromes

Differential clinical diagnosis of the parkinsonian syndromes, viz., Parkinson’s disease (PD), progressive supranuclear palsy (PSP), dementia with Lewy bodies (DLB), and multiple system atrophy (MSA) can be difficult. Eye movement problems, however, are a chronic complication of many of these disorders and may be a useful aid to diagnosis. Hence, the presence in PSP of vertical supranuclear gaze palsy, fixation instability, lid retraction, blepharospasm, and apraxia of eyelid opening and closing is useful in separating PD from PSP. Moreover, atypical features of PSP include slowing of upward saccades, moderate slowing of downward saccades, the presence of a full range of voluntary vertical eye movements, a curved trajectory of oblique saccades, and absence of square-wave jerks. Downgaze palsy is probably the most useful diagnostic clinical symptom of PSP. By contrast, DLB patients are specifically impaired in both reflexive and saccadic execution and in the performance of more complex saccadic eye movement tasks. Problems in convergence in DLB are also followed by akinesia and rigidity. Abnormal ocular fixation may occur in a significant proportion of MSA patients along with excessive square-wave jerks, a mild supranuclear gaze palsy, a gaze-evoked nystagmus, a positioning down-beat nystagmus, mild-moderate saccadic hypometria, impaired smooth pursuit movements, and reduced vestibulo-ocular reflex (VOR) suppression. There may be considerable overlap between the eye movement problems characteristic of the various parkinsonian disorders, but taken together with other signs and symptoms, can be a useful aid in differential diagnosis, especially in the separation of PD and PSP.

Eye movement analysis in congenital nystagmus:concise parameters estimation

Along with other diseases that can affect binocular vision, reducing the visual quality of a subject, Congenital Nystagmus (CN) is of peculiar interest. CN is an ocular-motor disorder characterized by involuntary, conjugated ocular oscillations and, while identified more than forty years ago, its pathogenesis is still under investigation. This kind of nystagmus is termed congenital (or infantile) since it could be present at birth or it can arise in the first months of life. The majority of CN patients show a considerable decrease of their visual acuity: image fixation on the retina is disturbed by nystagmus continuous oscillations, mainly horizontal. However, the image of a given target can still be stable during short periods in which eye velocity slows down while the target image is placed onto the fovea (called foveation intervals). To quantify the extent of nystagmus, eye movement recordings are routinely employed, allowing physicians to extract and analyze nystagmus main features such as waveform shape, amplitude and frequency. Use of eye movement recording, opportunely processed, allows computing "estimated visual acuity" predictors, which are analytical functions that estimate expected visual acuity using signal features such as foveation time and foveation position variability. Hence, it is fundamental to develop robust and accurate methods to measure both those parameters in order to obtain reliable values from the predictors. In this chapter the current methods to record eye movements in subjects with congenital nystagmus will be discussed and the present techniques to accurately compute foveation time and eye position will be presented. This study aims to disclose new methodologies in congenital nystagmus eye movements analysis, in order to identify nystagmus cycles and to evaluate foveation time, reducing the influence of repositioning saccades and data noise on the critical parameters of the estimation functions. Use of those functions extends the information acquired with typical visual acuity measurement (e.g., Landolt C test) and could be a support for treatment planning or therapy monitoring. © 2010 by Nova Science Publishers, Inc. All rights reserved.

Characterisation of baseline oscillation in congenital nystagmus eye movement recordings

Congenital nystagmus is an ocular-motor disorder that develops in the first few months of life; its pathogenesis is still unknown. Patients affected by congenital nystagmus show continuous, involuntary, rhythmical oscillations of the eyes. Monitoring eye movements, nystagmus main features such as shape, amplitude and frequency, can be extracted and analysed. Previous studies highlighted, in some cases, a much slower and smaller oscillation, which appears added up to the ordinary nystagmus waveform. This sort of baseline oscillation, or slow nystagmus, hinder precise cycle-to-cycle image placement onto the fovea. Such variability of the position may reduce patient visual acuity. This study aims to analyse more extensively eye movements recording including the baseline oscillation and investigate possible relationships between these slow oscillations and nystagmus. Almost 100 eye movement recordings (either infrared-oculographic or electrooculographic), relative to different gaze positions, belonging to 32 congenital nystagmus patients were analysed. The baseline oscillation was assumed sinusoidal; its amplitude and frequency were computed and compared with those of the nystagmus by means of a linear regression analysis. The results showed that baseline oscillations were characterised by an average frequency of 0.36 Hz (SD 0.11 Hz) and an average amplitude of 2.1° (SD 1.6°). It also resulted in a considerable correlation (R2 scored 0.78) between nystagmus amplitude and baseline oscillation amplitude; the latter, on average, resulted to be about one-half of the correspondent nystagmus amplitude. © 2009 Elsevier Ltd. All rights reserved.

Neural Network Evidence for the Coupling of Presaccadic Visual Remapping to Predictive Eye Position Updating.

As we look around a scene, we perceive it as continuous and stable even though each saccadic eye movement changes the visual input to the retinas. How the brain achieves this perceptual stabilization is unknown, but a major hypothesis is that it relies on presaccadic remapping, a process in which neurons shift their visual sensitivity to a new location in the scene just before each saccade. This hypothesis is difficult to test in vivo because complete, selective inactivation of remapping is currently intractable. We tested it in silico with a hierarchical, sheet-based neural network model of the visual and oculomotor system. The model generated saccadic commands to move a video camera abruptly. Visual input from the camera and internal copies of the saccadic movement commands, or corollary discharge, converged at a map-level simulation of the frontal eye field (FEF), a primate brain area known to receive such inputs. FEF output was combined with eye position signals to yield a suitable coordinate frame for guiding arm movements of a robot. Our operational definition of perceptual stability was "useful stability," quantified as continuously accurate pointing to a visual object despite camera saccades. During training, the emergence of useful stability was correlated tightly with the emergence of presaccadic remapping in the FEF. Remapping depended on corollary discharge but its timing was synchronized to the updating of eye position. When coupled to predictive eye position signals, remapping served to stabilize the target representation for continuously accurate pointing. Graded inactivations of pathways in the model replicated, and helped to interpret, previous in vivo experiments. The results support the hypothesis that visual stability requires presaccadic remapping, provide explanations for the function and timing of remapping, and offer testable hypotheses for in vivo studies. We conclude that remapping allows for seamless coordinate frame transformations and quick actions despite visual afferent lags. With visual remapping in place for behavior, it may be exploited for perceptual continuity.

Supplementary Eye Fields

The supplementary eye fields (SEFs) are located in dorsomedial frontal cortex and contribute to high-level control of eye movements. Recordings in the SEF reveal neural activity related to vision, saccades, and fixations, and electrical stimulation in the SEF evokes saccades and fixations. Inactivations and lesions of the SEF, however, cause minimal oculomotor deficits. The SEF thus processes information relevant to eye movements and influences critical oculomotor centers but seems unnecessary for generating action. Instead, the SEF has overarching, subtle functions that include limb-eye coordination, the timing and sequencing of actions, learning, monitoring conflict, prediction, supervising behavior, value-based decision making, and the monitoring of decisions.

Supplementary Eye Fields

The supplementary eye fields (SEFs) are located in dorsomedial frontal cortex and contribute to high-level control of eye movements. Recordings in the SEF reveal neural activity related to vision, saccades, and fixations, and electrical stimulation in the SEF evokes saccades and fixations. Inactivations and lesions of the SEF, however, cause minimal oculomotor deficits. The SEF thus processes information relevant to eye movements and influences critical oculomotor centers but seems unnecessary for generating action. Instead, the SEF has overarching, subtle functions that include limb-eye coordination, the timing and sequencing of actions, learning, monitoring conflict, prediction, supervising behavior, value-based decision making, and the monitoring of decisions.

Effects of efficient fronto-temporal circuitry on lexical ambiguity resolution: converging evidence from cross-age comparisons in eye-tracking and ERP data

Eye-tracking was used to examine how younger and older adults use syntactic and semantic information to disambiguate noun/verb (NV) homographs (e.g., park). We find that young adults exhibit inflated first fixations to NV-homographs when only syntactic cues are available for disambiguation (i.e., in syntactic prose). This effect is eliminated with the addition of disambiguating semantic information. Older adults (60+) as a group fail to show the first fixation effect in syntactic prose; they instead reread NV homographs longer. This pattern mirrors that in prior event-related potential work (Lee & Federmeier, 2009, 2011), which reported a sustained frontal negativity to NV-homographs in syntactic prose for young adults, which was eliminated by semantic constraints. The frontal negativity was not observed in older adults as a group, although older adults with high verbal fluency showed the young-like pattern. Analyses of individual differences in eye-tracking patterns revealed a similar effect of verbal fluency in both young and older adults: high verbal fluency groups of both ages show larger first fixation effects, while low verbal fluency groups show larger downstream costs (rereading and/or refixating NV homographs). Jointly, the eye-tracking and ERP data suggest that effortful meaning selection recruits frontal brain areas important for suppressing contextually inappropriate meanings, which also slows eye movements. Efficacy of fronto-temporal circuitry, as captured by verbal fluency, predicts the success of engaging these mechanisms in both young and older adults. Failure to recruit these processes requires compensatory rereading or leads to comprehension failures (Lee & Federmeier, in press).

ROLE OF THE FRONTAL EYE FIELD, SUPERIOR COLLICULUS, AND BASAL GANGLIA IN FLEXIBLE SACCADE BEHAVIOR

A distributed network of cortical and subcortical brain regions mediates the control of voluntary behavior, but it is unclear how this complex system may flexibly shift between different behavioral events. This thesis describes the neurophysiological changes in several key nuclei across the brain during flexible behavior, using saccadic eye movements in rhesus macaque monkeys. We examined five nuclei critical for saccade initiation and modulation: the frontal eye field (FEF) in the cerebral cortex, the subthalamic nucleus (STN), caudate nucleus (CD), and substantia nigra pars reticulata (SNr) in the basal ganglia (BG), and the superior colliculus (SC) in the midbrain. The first study tested whether a ‘threshold’ theory of how neuronal activity cues saccade initiation is consistent with the flexible control of behavior. The theory suggests there is a fixed level of FEF and SC neuronal activation at which saccades are initiated. Our results provide strong evidence against a fixed saccade threshold in either structure during flexible behavior, and indicate that threshold variability might depend on the level of inhibitory signals applied to the FEF or SC. The next two studies investigated the BG network as a likely candidate to modulate a saccade initiation mechanism, based on strong inhibitory output signals from the BG to the FEF and SC. We investigated the STN and CD (BG input), and the SNr (BG oculomotor output) to examine changes across the BG network. This revealed robust task-contingent shifts in BG signaling (Chapter 3), which uniquely impacted saccade initiation according to behavioral condition (Chapters 3 and 4). The thesis concludes with a published short review of the mechanistic effects of BG deep brain stimulation (Chapter 5), and a general discussion including proof of concept saccade behavioral changes in an MPTP-induced Parkinsonian model (Chapter 6). The studies presented here demonstrate that the conditions for saccade initiation by the FEF and SC vary according to behavioral condition, while simultaneously, large-scale task dependent shifts occur in BG signaling consistent with the observed modulation of FEF and SC activity. Taken together, these describe a mechanistic framework by which the cortico-BG loop may contribute to the flexible control of behavior.

Effects of visuospatial tasks on desensitization to emotive memories

Objectives. Intrusive memories of extreme trauma can disrupt a stepwise approach to imaginal exposure. Concurrent tasks that load the visuospatial sketchpad (VSSP) of working memory reduce the vividness of recalled images. This study tested whether relief of distress from competing VSSP tasks during imaginal exposure is at the cost of impaired desensitization . Design. This study examined repeated exposure to emotive memories using 18 unselected undergraduates and a within-subjects design with three exposure conditions (Eye Movement, Visual Noise, Exposure Alone) in random, counterbalanced order. Method. At baseline, participants recalled positive and negative experiences, and rated the vividness and emotiveness of each image. A different positive and negative recollection was then used for each condition. Vividness and emotiveness were rated after each of eight exposure trials. At a post-exposure session 1 week later, participants rated each image without any concurrent task. Results. Consistent with previous research, vividness and distress during imaging were lower during Eye Movements than in Exposure Alone, with passive visual interference giving intermediate results. A reduction in emotional responses from Baseline to Post was of similar size for the three conditions. Conclusion. Visuospatial tasks may offer a temporary response aid for imaginal exposure without affecting desensitization.