Visual attention to surfaces in three-dimensional space.

Although attention plays a significant role in vision, its spatial deployment and spread in the third dimension is not well understood. In visual search experiments we show that we cannot easily focus attention across isodepth loci unless they are part of a well-formed surface with locally coplanar elements. Yet we can easily spread our attention selectively across well-formed surfaces that span an extreme range of stereoscopic depths. In cueing experiments, we show that this spread of attention is, in part, obligatory. Attentional selectivity is reduced when targets and distractors are coplanar with or rest on a common receding stereoscopic plane. We conclude that attention cannot be efficiently allocated to arbitrary depths and extents in space but is linked to and spreads automatically across perceived surfaces.

Semantic feature-based visual attention model for pedestrian detection

Objective
Pedestrian detection under video surveillance systems has always been a hot topic in computer vision research. These systems are widely used in train stations, airports, large commercial plazas, and other public places. However, pedestrian detection remains difficult because of complex backgrounds. Given its development in recent years, the visual attention mechanism has attracted increasing attention in object detection and tracking research, and previous studies have achieved substantial progress and breakthroughs. We propose a novel pedestrian detection method based on the semantic features under the visual attention mechanism.
Method
The proposed semantic feature-based visual attention model is a spatial-temporal model that consists of two parts: the static visual attention model and the motion visual attention model. The static visual attention model in the spatial domain is constructed by combining bottom-up with top-down attention guidance. Based on the characteristics of pedestrians, the bottom-up visual attention model of Itti is improved by intensifying the orientation vectors of elementary visual features to make the visual saliency map suitable for pedestrian detection. In terms of pedestrian attributes, skin color is selected as a semantic feature for pedestrian detection. The regional and Gaussian models are adopted to construct the skin color model. Skin feature-based visual attention guidance is then proposed to complete the top-down process. The bottom-up and top-down visual attentions are linearly combined using the proper weights obtained from experiments to construct the static visual attention model in the spatial domain. The spatial-temporal visual attention model is then constructed via the motion features in the temporal domain. Based on the static visual attention model in the spatial domain, the frame difference method is combined with optical flowing to detect motion vectors. Filtering is applied to process the field of motion vectors. The saliency of motion vectors can be evaluated via motion entropy to make the selected motion feature more suitable for the spatial-temporal visual attention model.
Result
Standard datasets and practical videos are selected for the experiments. The experiments are performed on a MATLAB R2012a platform. The experimental results show that our spatial-temporal visual attention model demonstrates favorable robustness under various scenes, including indoor train station surveillance videos and outdoor scenes with swaying leaves. Our proposed model outperforms the visual attention model of Itti, the graph-based visual saliency model, the phase spectrum of quaternion Fourier transform model, and the motion channel model of Liu in terms of pedestrian detection. The proposed model achieves a 93% accuracy rate on the test video.
Conclusion
This paper proposes a novel pedestrian method based on the visual attention mechanism. A spatial-temporal visual attention model that uses low-level and semantic features is proposed to calculate the saliency map. Based on this model, the pedestrian targets can be detected through focus of attention shifts. The experimental results verify the effectiveness of the proposed attention model for detecting pedestrians.

Evidence for divided automatic attention

A long-standing debate in the literature is whether attention can form two or more independent spatial foci in addition to the well-known unique spatial focus. There is evidence that voluntary visual attention divides in space. The possibility that this also occurs for automatic visual attention was investigated here. Thirty-six female volunteers were tested. In each trial, a prime stimulus was presented in the left or right visual hemifield. This stimulus was characterized by the blinking of a superior, middle or inferior ring, the blinking of all these rings, or the blinking of the superior and inferior rings. A target stimulus to which the volunteer should respond with the same side hand or a target stimulus to which she should not respond was presented 100 ms later in a primed location, a location between two primed locations or a location in the contralateral hemifield. Reaction time to the positive target stimulus in a primed location was consistently shorter than reaction time in the horizontally corresponding contralateral location. This attentional effect was significantly smaller or absent when the positive target stimulus appeared in the middle location after the double prime stimulus. These results suggest that automatic visual attention can focus on two separate locations simultaneously, to some extent sparing the region in between.

An exploration of varieties of visual attention: ERP findings

A set of five tasks was designed to examine dynamic aspects of visual attention: selective attention to color, selective attention to pattern, dividing and switching attention between color and pattern, and selective attention to pattern with changing target. These varieties of visual attention were examined using the same set of stimuli under different instruction sets; thus differences between tasks cannot be attributed to differences in the perceptual features of the stimuli. ERP data are presented for each of these tasks. A within-task analysis of different stimulus types varying in similarity to the attended target feature revealed that an early frontal selection positivity (FSP) was evident in selective attention tasks, regardless of whether color was the attended feature. The scalp distribution of a later posterior selection negativity (SN) was affected by whether the attended feature was color or pattern. The SN was largely unaffected by dividing attention across color and pattern. A large widespread positivity was evident in most conditions, consisting of at least three subcomponents which were differentially affected by the attention conditions. These findings are discussed in relation to prior research and the time course of visual attention processes in the brain. (C) 1999 Elsevier Science B.V. All rights reserved.

Cognitive rehabilitation in a visual variant of Alzheimer's disease

Alzheimer's disease (AD) is commonly associated with marked memory deficits; however, nonamnestic variants have been consistently described as well. Posterior cortical atrophy (PCA) is a progressive degenerative condition in which posterior regions of the brain are predominantly affected, therefore resulting in a pattern of distinctive and marked visuospatial symptoms, such as apraxia, alexia, and spatial neglect. Despite the growing number of studies on cognitive and neural bases of the visual variant of AD, intervention studies remain relatively sparse. Current pharmacological treatments offer modest efficacy. Also, there is a scarcity of complementary nonpharmacological interventions with only two previous studies of PCA. Here we describe a highly educated 57-year-old patient diagnosed with a visual variant of AD who participated in a cognitive intervention program (comprising reality orientation, cognitive stimulation, and cognitive training exercises). Neuropsychological assessment was performed across moments (baseline, postintervention, follow-up) and consisted mainly of verbal and visual memory. Baseline neuropsychological assessment showed deficits in perceptive and visual-constructive abilities, learning and memory, and temporal orientation. After neuropsychological rehabilitation, we observed small improvements in the patient's cognitive functioning, namely in verbal memory, attention, and psychomotor abilities. This study shows evidence of small beneficial effects of cognitive intervention in PCA and is the first report of this approach with a highly educated patient in a moderate stage of the disease. Controlled studies are needed to assess the potential efficacy of cognition-focused approaches in these patients, and, if relevant, to grant their availability as a complementary therapy to pharmacological treatment and visual aids.

spatiotemporal profile of visual attention

Visual attention, focus of attention, mexican hat profile, surround inhibition

Reward- and attention-related determinants of color selection in human visual cortex

Magdeburg, Univ., Fak. für Naturwiss., Diss., 2015

Modularity of auditory spatial representations

Abstract : Auditory spatial functions are of crucial importance in everyday life. Determining the origin of sound sources in space plays a key role in a variety of tasks including orientation of attention, disentangling of complex acoustic patterns reaching our ears in noisy environments. Following brain damage, auditory spatial processing can be disrupted, resulting in severe handicaps. Complaints of patients with sound localization deficits include the inability to locate their crying child or being over-loaded by sounds in crowded public places. Yet, the brain bears a large capacity for reorganization following damage and/or learning. This phenomenon is referred as plasticity and is believed to underlie post-lesional functional recovery as well as learning-induced improvement. The aim of this thesis was to investigate the organization and plasticity of different aspects of auditory spatial functions. Overall, we report the outcomes of three studies: In the study entitled "Learning-induced plasticity in auditory spatial representations" (Spierer et al., 2007b), we focused on the neurophysiological and behavioral changes induced by auditory spatial training in healthy subjects. We found that relatively brief auditory spatial discrimination training improves performance and modifies the cortical representation of the trained sound locations, suggesting that cortical auditory representations of space are dynamic and subject to rapid reorganization. In the same study, we tested the generalization and persistence of training effects over time, as these are two determining factors in the development of neurorehabilitative intervention. In "The path to success in auditory spatial discrimination" (Spierer et al., 2007c), we investigated the neurophysiological correlates of successful spatial discrimination and contribute to the modeling of the anatomo-functional organization of auditory spatial processing in healthy subjects. We showed that discrimination accuracy depends on superior temporal plane (STP) activity in response to the first sound of a pair of stimuli. Our data support a model wherein refinement of spatial representations occurs within the STP and that interactions with parietal structures allow for transformations into coordinate frames that are required for higher-order computations including absolute localization of sound sources. In "Extinction of auditory stimuli in hemineglect: space versus ear" (Spierer et al., 2007a), we investigated auditory attentional deficits in brain-damaged patients. This work provides insight into the auditory neglect syndrome and its relation with neglect symptoms within the visual modality. Apart from contributing to a basic understanding of the cortical mechanisms underlying auditory spatial functions, the outcomes of the studies also contribute to develop neurorehabilitation strategies, which are currently being tested in clinical populations.

Impaired early visual response modulations to spatial information in chronic schizophrenia.

Early visual processing stages have been demonstrated to be impaired in schizophrenia patients and their first-degree relatives. The amplitude and topography of the P1 component of the visual evoked potential (VEP) are both affected; the latter of which indicates alterations in active brain networks between populations. At least two issues remain unresolved. First, the specificity of this deficit (and suitability as an endophenotype) has yet to be established, with evidence for impaired P1 responses in other clinical populations. Second, it remains unknown whether schizophrenia patients exhibit intact functional modulation of the P1 VEP component; an aspect that may assist in distinguishing effects specific to schizophrenia. We applied electrical neuroimaging analyses to VEPs from chronic schizophrenia patients and healthy controls in response to variation in the parafoveal spatial extent of stimuli. Healthy controls demonstrated robust modulation of the VEP strength and topography as a function of the spatial extent of stimuli during the P1 component. By contrast, no such modulations were evident at early latencies in the responses from patients with schizophrenia. Source estimations localized these deficits to the left precuneus and medial inferior parietal cortex. These findings provide insights on potential underlying low-level impairments in schizophrenia.

As the world turns: short-term human spatial memory in egocentric and allocentric coordinates

We aimed to determine whether human subjects' reliance on different sources of spatial information encoded in different frames of reference (i.e., egocentric versus allocentric) affects their performance, decision time and memory capacity in a short-term spatial memory task performed in the real world. Subjects were asked to play the Memory game (a.k.a. the Concentration game) without an opponent, in four different conditions that controlled for the subjects' reliance on egocentric and/or allocentric frames of reference for the elaboration of a spatial representation of the image locations enabling maximal efficiency. We report experimental data from young adult men and women, and describe a mathematical model to estimate human short-term spatial memory capacity. We found that short-term spatial memory capacity was greatest when an egocentric spatial frame of reference enabled subjects to encode and remember the image locations. However, when egocentric information was not reliable, short-term spatial memory capacity was greater and decision time shorter when an allocentric representation of the image locations with respect to distant objects in the surrounding environment was available, as compared to when only a spatial representation encoding the relationships between the individual images, independent of the surrounding environment, was available. Our findings thus further demonstrate that changes in viewpoint produced by the movement of images placed in front of a stationary subject is not equivalent to the movement of the subject around stationary images. We discuss possible limitations of classical neuropsychological and virtual reality experiments of spatial memory, which typically restrict the sensory information normally available to human subjects in the real world.

Dynamic visual information plays a critical role for spatial navigation in water but not on solid ground.

In the Morris water maze (MWM) task, proprioceptive information is likely to have a poor accuracy due to movement inertia. Hence, in this condition, dynamic visual information providing information on linear and angular acceleration would play a critical role in spatial navigation. To investigate this assumption we compared rat's spatial performance in the MWM and in the homing hole board (HB) tasks using a 1.5 Hz stroboscopic illumination. In the MWM, rats trained in the stroboscopic condition needed more time than those trained in a continuous light condition to reach the hidden platform. They expressed also little accuracy during the probe trial. In the HB task, in contrast, place learning remained unaffected by the stroboscopic light condition. The deficit in the MWM was thus complete, affecting both escape latency and discrimination of the reinforced area, and was thus task specific. This dissociation confirms that dynamic visual information is crucial to spatial navigation in the MWM whereas spatial navigation on solid ground is mediated by a multisensory integration, and thus less dependent on visual information.

Olfactory and/or visual cues for spatial navigation through ontogeny: olfactory cues enable the use of visual cues

This study analyzed the spatial memory capacities of rats in darkness with visual and/or olfactory cues through ontogeny. Tests were conducted with the homing board, where rats had to find the correct escape hole. Four age groups (24 days, 48 days, 3-6 months, and 12 months) were trained in 3 conditions: (a) 3 identical light cues; (b) 5 different olfactory cues; and (c) both types of cues, followed by removal of the olfactory cues. Results indicate that immature rats first take into account olfactory information but are unable to orient with only the help of discrete visual cues. Olfaction enables the use of visual information by 48-day-old rats. Visual information predominantly supports spatial cognition in adult and 12-month-old rats. Results point out cooperation between vision and olfaction for place navigation during ontogeny in rats.

Imaging Properties of MS Lesions Correlate with Attention Deficits in Early Multiple Sclerosis

Introduction: Cognitive impairment affects 40-65% of multiple sclerosis (MS) patients, often since early stages of the disease (relapsing remitting MS, RRMS). Frequently affected functions are memory, attention or executive abilities but the most sensitive measure of cognitive deficits in early MS is the information processing speed (Amato, 2008). MRI has been extensively exploited to investigate the substrate of cognitive dysfunction in MS but the underlying physiopathological mechanisms remain unclear. White matter lesion load, whole-brain atrophy and cortical lesions' number play a role but correlations are in some cases modest (Rovaris, 2006; Calabrese, 2009). In this study, we aimed at characterizing and correlating the T1 relaxation times of cortical and sub-cortical lesions with cognitive deficits detected by neuropsychological tests in a group of very early RR MS patients. Methods: Ten female patients with very early RRMS (age: 31.6 ±4.7y; disease duration: 3.8 ±1.9y; EDSS disability score: 1.8 ±0.4) and 10 age- and gender-matched healthy volunteers (mean age: 31.2 ±5.8y) were included in the study. All participants underwent the following neuropsychological tests: Rao's Brief Repeatable Battery of Neuropsychological tests (BRB-N), Stockings of Cambridge, Trail Making Test (TMT, part A and B), Boston Naming Test, Hooper Visual Organization Test and copy of the Rey-Osterrieth Complex Figure. Within 2 weeks from neuropsychological assessment, participants underwent brain MRI at 3T (Magnetom Trio a Tim System, Siemens, Germany) using a 32-channel head coil. The imaging protocol included 3D sequences with 1x1x1.2 mm3 resolution and 256x256x160 matrix, except for axial 2D-FLAIR: -DIR (T2-weighted, suppressing both WM and CSF; Pouwels, 2006) -MPRAGE (T1-weighted; Mugler, 1991) -MP2RAGE (T1-weighted with T1 maps; Marques, 2010) -FLAIR SPACE (only for patient 4-10, T2-weighted; Mugler, 2001) -2D Axial FLAIR (0.9x0.9x2.5 mm3, 256x256x44 matrix). Lesions were identified by one experienced neurologist and radiologist using all contrasts, manually contoured and assigned to regional locations (cortical or sub-cortical). Lesion number, volume and T1 relaxation time were calculated for lesions in each contrast and in a merged mask representing the union of the lesions from all contrasts. T1 relaxation times of lesions were normalized with the mean T1 value in corresponding control regions of the healthy subjects. Statistical analysis was performed using GraphPad InStat software. Cognitive scores were compared between patients and controls with paired t-tests; p values ≤ 0.05 were considered significant. Spearmann correlation tests were performed between the cognitive tests, which differed significantly between patients and controls, and lesions' i) number ii) volume iii) T1 relaxation time iv) disease duration and v) years of study. Results: Cortical and sub-cortical lesions count, T1 values and volume are reported in Table 1 (A and B). All early RRMS patients showed cortical lesions (CLs) and the majority consisted of CLs type I (lesions with a cortical component extending to the sub-cortical tissue). The rest of cortical lesions were characterized as type II (intra-cortical lesions). No type III/IV lesions (large sub-pial lesions) were detected. RRMS patients were slightly less educated (13.5±2.5y vs. 16.3±1.8y of study, p=0.02) than the controls. Signs of cortical dysfunction (i.e. impaired learning, language, visuo-spatial skills or gnosis) were rare in all patients. However, patients showed on average lower scores on measures of visual attention and information processing speed (TMT-part A: p=0.01; TMT-part B: p=0.006; PASAT-included in the BRB-N: p=0.04). The T1 relaxation values of CLs type I negatively correlated with the TMT-part A score (r=0.78, p<0.01). The correlations of TMT-part B score and PASAT score with T1 relaxation time of lesions as well and the correlation between TMT-part A, TMT-part B and PASAT score with lesions' i) number ii) volume iii) disease duration and iv) years of study did not reach significance. In order to preclude possible influences from partial volume effects on the T1 values, the correlation between lesion volume and T1 value of CLs type I was calculated; no correlation was found, suggesting that partial volume effects did not affect the statistics. Conclusions: The present pilot study reports for the first time the presence and the T1 characteristics at 3 T of cortical lesions in very early RRMS (< 6 y disease duration). It also shows that CLS type I represents the most frequent cortical lesion type in this cohort of RRMS patients. In addition, it reveals a negative correlation between the attentional test TMT-part A and the T1 properties of cortical lesions type I. In other words, lower attention deficits are concomitant with longer T1-relaxation time in cortical lesions. In respect to this last finding, it could be speculated that long relaxation time correspond to a certain degree of tissue loss that is enough to stimulate compensatory mechanisms. This hypothesis is in line with previous fMRI studies showing functional compensatory mechanisms to help maintaining normal or sub-normal attention performances in RR MS patients (Penner, 2003).

Age-associated modulations of cerebral oscillatory patterns related to attention control.

Visual attention depends on bottom-up sensory activation and top-down attentional guidance. Although aging is known to affect sensory processing, its impact on the top-down control of attention remains a matter of debate. We investigated age-related modulations of brain oscillatory activity during visual attention using a variant of the attention network test (ANT) in 20 young and 28 elderly adults. We examined the EEG oscillatory responses to warning and target signals, and explored the correlates of temporal and spatial orienting as well as conflict resolution at target presentation. Time-frequency analysis was performed between 4 and 30Hz, and the relationship between behavioral and brain oscillatory responses was analyzed. Whereas temporal cueing and conflict had similar reaction time effects in both age groups, spatial cueing was more beneficial to older than younger subjects. In the absence of cue, posterior alpha activation was drastically reduced in older adults, pointing to an age-related decline in anticipatory attention. Following both cues and targets, older adults displayed pronounced motor-related activation in the low beta frequency range at the expense of attention-related posterior alpha activation prominent in younger adults. These findings support the recruitment of alternative motor-related circuits in the elderly, in line with the dedifferentiation hypothesis. Furthermore, older adults showed reduced midparietal alpha inhibition induced by temporal orienting as well as decreased posterior alpha activation associated with both spatial orienting and conflict resolution. Altogether, the results are consistent with an overall reduction of task-related alpha activity in the elderly, and provide functional evidence that younger and older adults engage distinct brain circuits at different oscillatory frequencies during attentional functions.