Looking left with left neglect: the role of spatial attention when active vision selects local image features for fixation

When we actively explore the visual environment, our gaze preferentially selects regions characterized by high contrast and high density of edges, suggesting that the guidance of eye movements during visual exploration is driven to a significant degree by perceptual characteristics of a scene. Converging findings suggest that the selection of the visual target for the upcoming saccade critically depends on a covert shift of spatial attention. However, it is unclear whether attention selects the location of the next fixation uniquely on the basis of global scene structure or additionally on local perceptual information. To investigate the role of spatial attention in scene processing, we examined eye fixation patterns of patients with spatial neglect during unconstrained exploration of natural images and compared these to healthy and brain-injured control participants. We computed luminance, colour, contrast, and edge information contained in image patches surrounding each fixation and evaluated whether they differed from randomly selected image patches. At the global level, neglect patients showed the characteristic ipsilesional shift of the distribution of their fixations. At the local level, patients with neglect and control participants fixated image regions in ipsilesional space that were closely similar with respect to their local feature content. In contrast, when directing their gaze to contralesional (impaired) space neglect patients fixated regions of significantly higher local luminance and lower edge content than controls. These results suggest that intact spatial attention is necessary for the active sampling of local feature content during scene perception.

Vertical bias in neglect: A question of time?

Neglect is defined as the failure to attend and to orient to the contralesional side of space. A horizontal bias towards the right visual field is a classical finding in patients who suffered from a right-hemispheric stroke. The vertical dimension of spatial attention orienting has only sparsely been investigated so far. The aim of this study was to investigate the specificity of this vertical bias by means of a search task, which taps a more pronounced top-down attentional component. Eye movements and behavioural search performance were measured in thirteen patients with left-sided neglect after right hemispheric stroke and in thirteen age-matched controls. Concerning behavioural performance, patients found significantly less targets than healthy controls in both the upper and lower left quadrant. However, when targets were located in the lower left quadrant, patients needed more visual fixations (and therefore longer search time) to find them, suggesting a time-dependent vertical bias.

Semantic, perceptual and number space: relations between category width and spatial processing.

Coarse semantic encoding and broad categorization behavior are the hallmarks of the right cerebral hemisphere's contribution to language processing. We correlated 40 healthy subjects' breadth of categorization as assessed with Pettigrew's category width scale with lateral asymmetries in perceptual and representational space. Specifically, we hypothesized broader category width to be associated with larger leftward spatial biases. For the 20 men, but not the 20 women, this hypothesis was confirmed both in a lateralized tachistoscopic task with chimeric faces and a random digit generation task; the higher a male participant's score on category width, the more pronounced were his left-visual field bias in the judgement of chimeric faces and his small-number preference in digit generation ("small" is to the left of "large" in number space). Subjects' category width was unrelated to lateral displacements in a blindfolded tactile-motor rod centering task. These findings indicate that visual-spatial functions of the right hemisphere should not be considered independent of the same hemisphere's contribution to language. Linguistic and spatial cognition may be more tightly interwoven than is currently assumed.

Spatial biases during mental arithmetic: evidence from eye movements on a blank screen

While the influence of spatial-numerical associations in number categorization tasks has been well established, their role in mental arithmetic is less clear. It has been hypothesized that mental addition leads to rightward and upward shifts of spatial attention (along the “mental number line”), whereas subtraction leads to leftward and downward shifts. We addressed this hypothesis by analyzing spontaneous eye movements during mental arithmetic. Participants solved verbally presented arithmetic problems (e.g., 2 + 7, 8–3) aloud while looking at a blank screen. We found that eye movements reflected spatial biases in the ongoing mental operation: Gaze position shifted more upward when participants solved addition compared to subtraction problems, and the horizontal gaze position was partly determined by the magnitude of the operands. Interestingly, the difference between addition and subtraction trials was driven by the operator (plus vs. minus) but was not influenced by the computational process. Thus, our results do not support the idea of a mental movement toward the solution during arithmetic but indicate a semantic association between operation and space.

The functional significance of EEG microstates-Associations with modalities of thinking

The momentary, global functional state of the brain is reflected by its electric field configuration. Cluster analytical approaches consistently extracted four head-surface brain electric field configurations that optimally explain the variance of their changes across time in spontaneous EEG recordings. These four configurations are referred to as EEG microstate classes A, B, C, and D and have been associated with verbal/phonological, visual, attention reorientation, and subjective interoceptive-autonomic processing, respectively. The present study tested these associations via an intra-individual and inter-individual analysis approach. The intra-individual approach tested the effect of task-induced increased modality-specific processing on EEG microstate parameters. The inter-individual approach tested the effect of personal modality-specific parameters on EEG microstate parameters. We obtained multichannel EEG from 61 healthy, right-handed, male students during four eyes-closed conditions: object-visualization, spatial-visualization, verbalization (6 runs each), and resting (7 runs). After each run, we assessed participants' degrees of object-visual, spatial-visual, and verbal thinking using subjective reports. Before and after the recording, we assessed modality-specific cognitive abilities and styles using nine cognitive tests and two questionnaires. The EEG of all participants, conditions, and runs was clustered into four classes of EEG microstates (A, B, C, and D). RMANOVAs, ANOVAs and post-hoc paired t-tests compared microstate parameters between conditions. TANOVAs compared microstate class topographies between conditions. Differences were localized using eLORETA. Pearson correlations assessed interrelationships between personal modality-specific parameters and EEG microstate parameters during no-task resting. As hypothesized, verbal as opposed to visual conditions consistently affected the duration, occurrence, and coverage of microstate classes A and B. Contrary to associations suggested by previous reports, parameters were increased for class A during visualization, and class B during verbalization. In line with previous reports, microstate D parameters were increased during no-task resting compared to the three internal, goal-directed tasks. Topographic differences between conditions concerned particular sub-regions of components of the metabolic default mode network. Modality-specific personal parameters did not consistently correlate with microstate parameters except verbal cognitive style which correlated negatively with microstate class A duration and positively with class C occurrence. This is the first study that aimed to induce EEG microstate class parameter changes based on their hypothesized functional significance. Beyond, the associations of microstate classes A and B with visual and verbal processing, respectively and microstate class D with interoceptive-autonomic processing, our results suggest that a finely-tuned interplay between all four EEG microstate classes is necessary for the continuous formation of visual and verbal thoughts, as well as interoceptive-autonomic processing. Our results point to the possibility that the EEG microstate classes may represent the head-surface measured activity of intra-cortical sources primarily exhibiting inhibitory functions. However, additional studies are needed to verify and elaborate on this hypothesis.

Structural Organization of the Corpus Callosum Predicts Attentional Shifts after Continuous Theta Burst Stimulation

Repetitive transcranial magnetic stimulation (rTMS) applied over the right posterior parietal cortex (PPC) in healthy participants has been shown to trigger a significant rightward shift in the spatial allocation of visual attention, temporarily mimicking spatial deficits observed in neglect. In contrast, rTMS applied over the left PPC triggers a weaker or null attentional shift. However, large interindividual differences in responses to rTMS have been reported. Studies measuring changes in brain activation suggest that the effects of rTMS may depend on both interhemispheric and intrahemispheric interactions between cortical loci controlling visual attention. Here, we investigated whether variability in the structural organization of human white matter pathways subserving visual attention, as assessed by diffusion magnetic resonance imaging and tractography, could explain interindividual differences in the effects of rTMS. Most participants showed a rightward shift in the allocation of spatial attention after rTMS over the right intraparietal sulcus (IPS), but the size of this effect varied largely across participants. Conversely, rTMS over the left IPS resulted in strikingly opposed individual responses, with some participants responding with rightward and some with leftward attentional shifts. We demonstrate that microstructural and macrostructural variability within the corpus callosum, consistent with differential effects on cross-hemispheric interactions, predicts both the extent and the direction of the response to rTMS. Together, our findings suggest that the corpus callosum may have a dual inhibitory and excitatory function in maintaining the interhemispheric dynamics that underlie the allocation of spatial attention. SIGNIFICANCE STATEMENT: The posterior parietal cortex (PPC) controls allocation of attention across left versus right visual fields. Damage to this area results in neglect, characterized by a lack of spatial awareness of the side of space contralateral to the brain injury. Transcranial magnetic stimulation over the PPC is used to study cognitive mechanisms of spatial attention and to examine the potential of this technique to treat neglect. However, large individual differences in behavioral responses to stimulation have been reported. We demonstrate that the variability in the structural organization of the corpus callosum accounts for these differences. Our findings suggest novel dual mechanism of the corpus callosum function in spatial attention and have broader implications for the use of stimulation in neglect rehabilitation.

Moving along the mental number line: Interactions between whole-body motion and numerical cognition

Active head turns to the left and right have recently been shown to influence numerical cognition by shifting attention along the mental number line. In the present study, we found that passive whole-body motion influences numerical cognition. In a random-number generation task (Experiment 1), leftward and downward displacement of participants facilitated small number generation, whereas rightward and upward displacement facilitated the generation of large numbers. Influences of leftward and rightward motion were also found for the processing of auditorily presented numbers in a magnitude-judgment task (Experiment 2). Additionally, we investigated the reverse effect of the number-space association (Experiment 3). Participants were displaced leftward or rightward and asked to detect motion direction as fast as possible while small or large numbers were auditorily presented. When motion detection was difficult, leftward motion was detected faster when hearing small number and rightward motion when hearing large number. We provide new evidence that bottom-up vestibular activation is sufficient to interact with the higher-order spatial representation underlying numerical cognition. The results show that action planning or motor activity is not necessary to influence spatial attention. Moreover, our results suggest that self-motion perception and numerical cognition can mutually influence each other.

Self-motion perception influences number processing: evidence from a parity task

We investigated the role of horizontal body motion on the processing of numbers. We hypothesized that leftward self-motion leads to shifts in spatial attention and therefore facilitates the processing of small numbers, and vice versa, we expected that rightward self-motion facilitates the processing of large numbers. Participants were displaced by means of a motion platform during a parity judgment task. We found a systematic influence of self-motion direction on number processing, suggesting that the processing of numbers is intertwined with the processing of self-motion perception. The results differed from known spatial numerical compatibility effects in that self-motion exerted a differential influence on inner and outer numbers of the given interval. The results highlight the involvement of sensory body motion information in higher-order spatial cognition.

Grapheme-color synaesthesia is associated with a distinct cognitive style

In this study we investigated whether synaesthesia is associated with a particular cognitive style. Cognitive style refers to preferred modes of information processing, such as a verbal style or a visual style. We reasoned that related to the enriched world of experiences created by synaesthesia, its association with enhanced verbal and visual memory, higher imagery and creativity, synaesthetes might show enhanced preference for a verbal as well as for a visual cognitive style compared to non-synaesthetes. In Study 1 we tested a large convenience sample of 1046 participants, who classified themselves as grapheme-color, sound-color, lexical-gustatory, sequence-space, or as non-synaesthetes. To assess cognitive style, we used the revised verbalizer-visualizer questionnaire (VVQ), which involves three independent cognitive style dimensions (verbal style, visual-spatial style, and vivid imagery style). The most important result was that those who reported grapheme-color synaesthesia showed higher ratings on the verbal and vivid imagery style dimensions, but not on the visual-spatial style dimension. In Study 2 we replicated this finding in a laboratory study involving 24 grapheme-color synaesthetes with objectively confirmed synaesthesia and a closely matched control group. Our results indicate that grapheme-color synaesthetes prefer both a verbal and a specific visual cognitive style. We suggest that this enhanced preference, probably together with the greater ease to switch between a verbal and a vivid visual imagery style, may be related to cognitive advantages associated with grapheme color synaesthesia such as enhanced memory performance and creativity.

A novel computer test to assess driving-relevant cognitive functions - a pilot study

BACKGROUND: The assessment of driving-relevant cognitive functions in older drivers is a difficult challenge as there is no clear-cut dividing line between normal cognition and impaired cognition and not all cognitive functions are equally important for driving. METHODS: To support decision makers, the Bern Cognitive Screening Test (BCST) for older drivers was designed. It is a computer-assisted test battery assessing visuo-spatial attention, executive functions, eye-hand coordination, distance judgment, and speed regulation. Here we compare the performance in BCST with the performance in paper and pencil cognitive screening tests and the performance in the driving simulator testing of 41 safe drivers (without crash history) and 14 unsafe drivers (with crash history). RESULTS: Safe drivers performed better than unsafe drivers in BCST (Mann-Whitney U test: U = 125.5; p = 0.001) and in the driving simulator (Student's t-test: t(44) = -2.64, p = 0.006). No clear group differences were found in paper and pencil screening tests (p > 0.05; ns). BCST was best at identifying older unsafe drivers (sensitivity 86%; specificity 61%) and was also better tolerated than the driving simulator test with fewer dropouts. CONCLUSIONS: BCST is more accurate than paper and pencil screening tests, and better tolerated than driving simulator testing when assessing driving-relevant cognition in older drivers.

When looking back to nothing goes back to nothing

Previous research showed that the eyes revisit the location in which the stimulus has been encoded when visual or verbal information is retrieved from memory. A recent study showed that this behavior still occurs 1 week after encoding, suggesting that visual, spatial and linguistic information is tightly associated with the oculomotor trace and stored as an integrated memory representation. However, it is yet unclear whether looking behavior simply remains stable between encoding and recall or whether it changes over time in a more fine-tuned manner. Here, we investigate the time course of looking behavior during recall in multiple sessions across 1 week. Participants encoded visual objects presented in one of the four locations on the computer screen. In five sessions during the week after encoding, they performed on a visual memory recall task. During retrieval, participants looked back to the encoding location, but only in the recall sessions within 1 day of encoding. We discuss different explanations for the temporal dynamics of looking behavior during recall, searching for the role of eye movements in memory.

The influence of naturalistic, directionally non-specific motion on the spatial deployment of visual attention in right-hemispheric stroke

An impairment of the spatial deployment of visual attention during exploration of static (i.e., motionless) stimuli is a common finding after an acute, right-hemispheric stroke. However, less is known about how these deficits: a) are modulated through naturalistic motion (i.e., without directional, specific spatial features); and, b) evolve in the subacute/chronic post-stroke phase. In the present study, we investigated free visual exploration in three patient groups with subacute/chronic right-hemispheric stroke and in healthy subjects. The first group included patients with left visual neglect and a left visual field defect (VFD), the second patients with a left VFD but no neglect, and the third patients without neglect or VFD. Eye movements were measured in all participants while they freely explored a traffic scene without (static condition) and with (dynamic condition) naturalistic motion, i.e., cars moving from the right or left. In the static condition, all patient groups showed similar deployment of visual exploration (i.e., as measured by the cumulative fixation duration) as compared to healthy subjects, suggesting that recovery processes took place, with normal spatial allocation of attention. However, the more demanding dynamic condition with moving cars elicited different re-distribution patterns of visual attention, quite similar to those typically observed in acute stroke. Neglect patients with VFD showed a significant decrease of visual exploration in the contralesional space, whereas patients with VFD but no neglect showed a significant increase of visual exploration in the contralesional space. No differences, as compared to healthy subjects, were found in patients without neglect or VFD. These results suggest that naturalistic motion, without directional, specific spatial features, may critically influence the spatial distribution of visual attention in subacute/chronic stroke patients.

The role of the right frontal eye field in overt visual attention deployment as assessed by free visual exploration

The frontal eye field (FEF) is known to be involved in saccade generation and visual attention control. Studies applying covert attentional orienting paradigms have shown that the right FEF is involved in attentional shifts to both the left and the right hemifield. In the current study, we aimed at examining the effects of inhibitory continuous theta burst (cTBS) transcranial magnetic stimulation over the right FEF on overt attentional orienting, as measured by a free visual exploration paradigm. In forty-two healthy subjects, free visual exploration of naturalistic pictures was tested in three conditions: (1) after cTBS over the right FEF; (2) after cTBS over a control site (vertex); and, (3) without any stimulation. The results showed that cTBS over the right FEF-but not cTBS over the vertex-triggered significant changes in the spatial distribution of the cumulative fixation duration. Compared to the group without stimulation and the group with cTBS over the vertex, cTBS over the right FEF decreased cumulative fixation duration in the left and in the right peripheral regions, and increased cumulative fixation duration in the central region. The present study supports the view that the right FEF is involved in the bilateral control of not only covert, but also of overt, peripheral visual attention.

Callosal connections of primary visual cortex predict the spatial spreading of binocular rivalry across the visual hemifields

In binocular rivalry, presentation of different images to the separate eyes leads to conscious perception alternating between the two possible interpretations every few seconds. During perceptual transitions, a stimulus emerging into dominance can spread in a wave-like manner across the visual field. These traveling waves of rivalry dominance have been successfully related to the cortical magnification properties and functional activity of early visual areas, including the primary visual cortex (V1). Curiously however, these traveling waves undergo a delay when passing from one hemifield to another. In the current study, we used diffusion tensor imaging (DTI) to investigate whether the strength of interhemispheric connections between the left and right visual cortex might be related to the delay of traveling waves across hemifields. We measured the delay in traveling wave times (ΔTWT) in 19 participants and repeated this test 6 weeks later to evaluate the reliability of our behavioral measures. We found large interindividual variability but also good test-retest reliability for individual measures of ΔTWT. Using DTI in connection with fiber tractography, we identified parts of the corpus callosum connecting functionally defined visual areas V1-V3. We found that individual differences in ΔTWT was reliably predicted by the diffusion properties of transcallosal fibers connecting left and right V1, but observed no such effect for neighboring transcallosal visual fibers connecting V2 and V3. Our results demonstrate that the anatomical characteristics of topographically specific transcallosal connections predict the individual delay of interhemispheric traveling waves, providing further evidence that V1 is an important site for neural processes underlying binocular rivalry.

Complex visual hallucinations and attentional performance in eye disease and dementia: a test of the Perception and Attention Deficit model

OBJECTIVE This study aimed to test the prediction from the Perception and Attention Deficit model of complex visual hallucinations (CVH) that impairments in visual attention and perception are key risk factors for complex hallucinations in eye disease and dementia. METHODS Two studies ran concurrently to investigate the relationship between CVH and impairments in perception (picture naming using the Graded Naming Test) and attention (Stroop task plus a novel Imagery task). The studies were in two populations-older patients with dementia (n = 28) and older people with eye disease (n = 50) with a shared control group (n = 37). The same methodology was used in both studies, and the North East Visual Hallucinations Inventory was used to identify CVH. RESULTS A reliable relationship was found for older patients with dementia between impaired perceptual and attentional performance and CVH. A reliable relationship was not found in the population of people with eye disease. CONCLUSIONS The results add to previous research that object perception and attentional deficits are associated with CVH in dementia, but that risk factors for CVH in eye disease are inconsistent, suggesting that dynamic rather than static impairments in attentional processes may be key in this population.