Semantic feature-based visual attention model for pedestrian detection

Objective
Pedestrian detection under video surveillance systems has always been a hot topic in computer vision research. These systems are widely used in train stations, airports, large commercial plazas, and other public places. However, pedestrian detection remains difficult because of complex backgrounds. Given its development in recent years, the visual attention mechanism has attracted increasing attention in object detection and tracking research, and previous studies have achieved substantial progress and breakthroughs. We propose a novel pedestrian detection method based on the semantic features under the visual attention mechanism.
Method
The proposed semantic feature-based visual attention model is a spatial-temporal model that consists of two parts: the static visual attention model and the motion visual attention model. The static visual attention model in the spatial domain is constructed by combining bottom-up with top-down attention guidance. Based on the characteristics of pedestrians, the bottom-up visual attention model of Itti is improved by intensifying the orientation vectors of elementary visual features to make the visual saliency map suitable for pedestrian detection. In terms of pedestrian attributes, skin color is selected as a semantic feature for pedestrian detection. The regional and Gaussian models are adopted to construct the skin color model. Skin feature-based visual attention guidance is then proposed to complete the top-down process. The bottom-up and top-down visual attentions are linearly combined using the proper weights obtained from experiments to construct the static visual attention model in the spatial domain. The spatial-temporal visual attention model is then constructed via the motion features in the temporal domain. Based on the static visual attention model in the spatial domain, the frame difference method is combined with optical flowing to detect motion vectors. Filtering is applied to process the field of motion vectors. The saliency of motion vectors can be evaluated via motion entropy to make the selected motion feature more suitable for the spatial-temporal visual attention model.
Result
Standard datasets and practical videos are selected for the experiments. The experiments are performed on a MATLAB R2012a platform. The experimental results show that our spatial-temporal visual attention model demonstrates favorable robustness under various scenes, including indoor train station surveillance videos and outdoor scenes with swaying leaves. Our proposed model outperforms the visual attention model of Itti, the graph-based visual saliency model, the phase spectrum of quaternion Fourier transform model, and the motion channel model of Liu in terms of pedestrian detection. The proposed model achieves a 93% accuracy rate on the test video.
Conclusion
This paper proposes a novel pedestrian method based on the visual attention mechanism. A spatial-temporal visual attention model that uses low-level and semantic features is proposed to calculate the saliency map. Based on this model, the pedestrian targets can be detected through focus of attention shifts. The experimental results verify the effectiveness of the proposed attention model for detecting pedestrians.

Pseudoneglect and visual attention networks

Pseudoneglect represents the tendency for healthy individuals to show a slight but consistent bias in favour of stimuli appearing in the left visual field. The bias is often measured using variants of the line bisection task. An accurate model of the functional architecture of the visuospatial attention system must account for this widely observed phenomenon, as well as for modulation of the direction and magnitude of the bias within individuals by a variety of factors relating to the state of the participant and/or stimulus characteristics. To date, the neural correlates of pseudoneglect remain relatively unmapped. In the current thesis, I employed a combination of psychophysical measurements, electroencephalography (EEG) recording and transcranial direct current stimulation (tDCS) in an attempt to probe the neural generator(s) of pseudoneglect. In particular, I wished to utilise and investigate some of the factors known to modulate the bias (including age, time-on-task and the length of the to-be-bisected line) in order to identify neural processes and activity that are necessary and sufficient for the lateralized bias to arise. Across four experiments utilising a computerized version of a perceptual line bisection task, pseudoneglect was consistently observed at baseline in healthy young participants. However, decreased line length (experiments 1, 2 and 3), time-on-task (experiment 1) and healthy aging (experiment 3) were all found to modulate the bias. Specifically, all three modulations induced a rightward shift in subjective midpoint estimation. Additionally, the line length and time-on-task effects (experiment 1) and the line length and aging effects (experiment 3) were found to have additive relationships. In experiment 2, EEG measurements revealed the line length effect to be reflected in neural activity 100 – 200ms post-stimulus onset over source estimated posterior regions of the right hemisphere (RH: temporo-parietal junction (TPJ)). Long lines induced a hemispheric asymmetry in processing (in favour of the RH) during this period that was absent in short lines. In experiment 4, bi-parietal tDCS (Left Anodal/Right Cathodal) induced a polarity-specific rightward shift in bias, highlighting the crucial role played by parietal cortex in the genesis of pseudoneglect. The opposite polarity (Left Cathodal/Right Anodal) did not induce a change in bias. The combined results from the four experiments of the current thesis provide converging evidence as to the crucial role played by the RH in the genesis of pseudoneglect and in the processing of visual input more generally. The reduction in pseudoneglect with decreased line length, increased time-on-task and healthy aging may be explained by a reduction in RH function, and hence contribution to task processing, induced by each of these modulations. I discuss how behavioural and neuroimaging studies of pseudoneglect (and its various modulators) can provide empirical data upon which accurate formal models of visuospatial attention networks may be based and further tested.

Automatic attention lateral asymmetry in visual discrimination tasks

There is evidence that automatic visual attention favors the right side. This study investigated whether this lateral asymmetry interacts with the right hemisphere dominance for visual location processing and left hemisphere dominance for visual shape processing. Volunteers were tested in a location discrimination task and a shape discrimination task. The target stimuli (S2) could occur in the left or right hemifield. They were preceded by an ipsilateral, contralateral or bilateral prime stimulus (S1). The attentional effect produced by the right S1 was larger than that produced by the left S1. This lateral asymmetry was similar between the two tasks suggesting that the hemispheric asymmetries of visual mechanisms do not contribute to it. The finding that it was basically due to a longer reaction time to the left S2 than to the right S2 for the contralateral S1 condition suggests that the inhibitory component of attention is laterally asymmetric.

Complex visual hallucinations and attentional performance in eye disease and dementia: a test of the Perception and Attention Deficit model

OBJECTIVE This study aimed to test the prediction from the Perception and Attention Deficit model of complex visual hallucinations (CVH) that impairments in visual attention and perception are key risk factors for complex hallucinations in eye disease and dementia. METHODS Two studies ran concurrently to investigate the relationship between CVH and impairments in perception (picture naming using the Graded Naming Test) and attention (Stroop task plus a novel Imagery task). The studies were in two populations-older patients with dementia (n = 28) and older people with eye disease (n = 50) with a shared control group (n = 37). The same methodology was used in both studies, and the North East Visual Hallucinations Inventory was used to identify CVH. RESULTS A reliable relationship was found for older patients with dementia between impaired perceptual and attentional performance and CVH. A reliable relationship was not found in the population of people with eye disease. CONCLUSIONS The results add to previous research that object perception and attentional deficits are associated with CVH in dementia, but that risk factors for CVH in eye disease are inconsistent, suggesting that dynamic rather than static impairments in attentional processes may be key in this population.

Frontoparietal cortical networks for directing attention and the eye to visual locations: Identical, independent, or overlapping neural systems?

Functional anatomical and single-unit recording studies indicate that a set of neural signals in parietal and frontal cortex mediates the covert allocation of attention to visual locations, as originally proposed by psychological studies. This frontoparietal network is the source of a location bias that interacts with extrastriate regions of the ventral visual system during object analysis to enhance visual processing. The frontoparietal network is not exclusively related to visual attention, but may coincide or overlap with regions involved in oculomotor processing. The relationship between attention and eye movement processes is discussed at the psychological, functional anatomical, and cellular level of analysis.

Evidence for divided automatic attention

A long-standing debate in the literature is whether attention can form two or more independent spatial foci in addition to the well-known unique spatial focus. There is evidence that voluntary visual attention divides in space. The possibility that this also occurs for automatic visual attention was investigated here. Thirty-six female volunteers were tested. In each trial, a prime stimulus was presented in the left or right visual hemifield. This stimulus was characterized by the blinking of a superior, middle or inferior ring, the blinking of all these rings, or the blinking of the superior and inferior rings. A target stimulus to which the volunteer should respond with the same side hand or a target stimulus to which she should not respond was presented 100 ms later in a primed location, a location between two primed locations or a location in the contralateral hemifield. Reaction time to the positive target stimulus in a primed location was consistently shorter than reaction time in the horizontally corresponding contralateral location. This attentional effect was significantly smaller or absent when the positive target stimulus appeared in the middle location after the double prime stimulus. These results suggest that automatic visual attention can focus on two separate locations simultaneously, to some extent sparing the region in between.

Further evidence for a deficit in switching attention in schizophrenia

In this study, sustained, selective, divided, and switching attention, and reloading of working memory were investigated in schizophrenia by using a newly developed Visual Attention Battery (VAB). Twenty-four outpatients with schizophrenia and 24 control participants were studied using the VAB. Performance on VAB components was correlated with performance of standard tests. Patients with schizophrenia were significantly impaired on VAB tasks that required switching of attention and reloading of working memory but had normal performance on tasks involving sustained attention or attention to multiple stimulus features. Switching attention and reloading of working memory were highly correlated with Trails (B - A) score for patients. The decline in performance on the switching-attention task in patients with schizophrenia met criteria for a differential deficit in switching attention. Future research should examine the neurophysiological basis of the switching deficit and its sensitivity and specificity to schizophrenia.

Local-global processing in early-onset schizophrenia: Evidence for an impairment in shifting the spatial scale of attention

In this study we report the results of two experiments on visual attention conducted with patients with early-onset schizophrenia. These experiments investigated the effect of irrelevant spatial-scale information upon the processing of relevant spatial-scale information, and the ability to shift the spatial scale of attention, across consecutive trials, between different levels of the hierarchical stimulus. Twelve patients with early-onset schizophrenia and matched controls performed local-global tasks under: (1) directed attention conditions with a consistency manipulation and (2) divided-attention conditions. In the directed-attention paradigm, the early-onset patients exhibited the normal patterns of global advantage and interference, and were not unduly affected by the consistency manipulation. Under divided-attention conditions, however, the early-onset patients exhibited a local-processing deficit. The source of this local processing deficit lay in the prolonged reaction time to local targets, when these had been preceded by a global target, but not when preceded by a local target. These findings suggest an impaired ability to shift the spatial scale of attention from a global to a local spatial scale in early-onset schizophrenia. (C) 2003 Elsevier Science (USA). All rights reserved.

Influence of silence and attention on tinnitus perception

OBJECTIVE: The purpose of this study was to study the effect of attention and sustained silence on the emergence of auditory phantom perception in normal-hearing adults. STUDY DESIGN: Cross-sectional survey. SUBJECTS AND METHODS: While sitting in a sound booth, 66 volunteers (age range. 18-65; mean age, 37.3) performed 3 experiments of 5 minutes each, consecutively and randomly presented. Two deviated attention from auditory system (Hanoi and visual attention experiments). and 1 drove attention to the auditory system (auditory attention). After each experiment, participants were asked about their auditory and visual perception. No sound or light change was given at any moment. RESULTS: Of the participants, 19.7% experienced tinnitus during Hanoi, 45.5% during visual attention, and 68.2% during auditory attention experiment. with no significant differences for studied variables. CONCLUSION: Tinnitus-like perceptions may occur in a non-clinical population in a silent environment. Concomitant auditory attention plays an important role on the emergence of tinnitus. (C) 2008 American Academy of Otolaryngology-Head and Neck Surgery Foundation. All rights reserved.

Postural adjustment as a sign of attention in 7-month-old infants

Adjustments during postural control have been recognized in the process of the integration of movement and cognition. The objective of the present work was to describe postural changes and to verify if there is a correlation between postural adjustment and attention span in 7-month-old infants during 1 min of viewing an animated puppet. Method: Twenty-nine healthy infants (14 males) born from 31 to 39 weeks (median 36) were placed in a prone position and filmed watching a puppet during I min. The analysis of the images allowed us to catalogue the changes in position, the frequency of these changes, and the attention span. The following items were quantified: total number of infant positions, positions with weight transfer, changes in support, axis, decubitus, trunk and cervical movements, timing and pauses in visual attention. Results: Twenty-one infants stayed in the prone position during most of the recording, and eight chose sitting position before starting the session. Two groups were studied according to the main position throughout the filming, one in prone and the other in sitting positions, although they could rolling or crawling. For prone group the attention span was positively correlated with the number of positions with weight transfer (r = 0.53, p = 0.04), negatively correlated with trunk movements (r = -0.63, p = 0.01), and not correlated with birth or current weight. This work suggests that changes in the trunk movements and weight transfer are different traits related to the attention in 7-month-old infants. (C) 2008 Elsevier B.V.. All rights reserved.

Emergence of joint attention: Relationships between gaze following, social referencing, imitation, and naming in infancy

The authors investigated the extent to which the joint-attention behaviors of gaze following, social referencing, and object-directed imitation were related to each other and to infants vocabulary development in a sample of 60 infants between the ages of 8 and 14 months. Joint-attention skills and vocabulary development were assessed in a laboratory setting. Split-half reliability analyses on the joint-attention measures indicated that the tasks reliably assessed infants' capabilities. In the main analysis, no significant correlations were found among the joint-attention behaviors except for a significant relationship between gaze following and the number of names in infants' productive vocabularies. The overall pattern of results did not replicate results of previous studies (e.g., M. Carpenter, K. Nagell, & M. Tomasello, 1998) that found relationships between various emerging joint-attention behaviors.

Perceção visual na avaliação diagnóstica em mamografia: uma revisão sistemática

Introdução – Na avaliação diagnóstica em mamografia, o desempenho do radiologista pode estar sujeito a erros de diagnóstico. Objetivo – Descrever a importância da perceção visual na análise da mamografia, identificando os principais fatores que contribuem para a perceção visual do radiologista e que condicionam a acuidade diagnóstica. Metodologia – Estudo descritivo baseado numa revisão sistemática de literatura através da PubMed e da Science Direct. Foram incluídos 42 artigos que respeitavam, pelo menos, um dos critérios de inclusão no estudo. Para a seleção das referências foi utilizada a metodologia PRISMA, constituída por 4 fases: identificação, seleção preliminar, elegibilidade e estudos incluídos. Resultados – Na avaliação diagnóstica em mamografia, a perceção visual está intimamente relacionada com: 1) diferentes parâmetros visuais e da motilidade ocular (acuidade visual, sensibilidade ao contraste e à luminância e movimentos oculares); 2) com condições de visualização de uma imagem (iluminância da sala e luminância do monitor); e 3) fadiga ocular provocada pela observação diária consecutiva de imagens. Conclusões – A perceção visual pode ser influenciada por 3 categorias de erros observados: erros de pesquisa (lesões não são fixadas pela fóvea), erros de reconhecimento (lesões fixadas, mas não durante o tempo suficiente) e erros de decisão (lesões fixadas, mas não identificadas como suspeitas). Os estudos analisados sobre perceção visual, atenção visual e estratégia visual, bem como os estudos sobre condições de visualização não caracterizam a função visual dos observadores. Para uma avaliação correta da perceção visual em mamografia deverão ser efetuados estudos que correlacionem a função visual com a qualidade diagnóstica. ABSTRACT - Introduction – Diagnostic evaluation in mammography could be influenced by the radiologist performance that could be under diagnostic errors. Aims – To describe the importance of radiologist visual perception in mammographic diagnostic evaluation and to identify the main factors that contribute to diagnostic accuracy. Methods – In this systematic review 42 references were included based on inclusion criteria (PubMed and Science Direct). PRISMA method was used to select the references following 4 steps: identification, screening, eligibility and included references. Results – Visual perception in mammography diagnostic evaluation is related with: 1) visual parameters and ocular motility (visual acuity, contrast sensitivity and luminance and ocular movements); 2) image visualization environment (room iluminance and monitor luminance); and 3) eyestrain caused by image daily consecutive observation. Conclusions – Visual perception can be influenced by three errors categories: search errors (lesions are never looked at with high-resolution foveal vision), recognition errors (lesions are looked at, but not long enough to detect or recognize) and decision errors (lesions are looked at for long periods of time but are still missed). The reviewed studies concerning visual perception, visual attention, visual strategies and image visualization environment do not describe observer’s visual function. An accurate evaluation of visual perception in mammography must include visual function analysis.

Insuficiência de convergência e atenção visual: estudo exploratório em estudantes do ensino superior

RESUMO: Introdução – A insuficiência de convergência (IC) pode desencadear alterações da atenção visual. Pretende-se investigar se existem alterações na atenção visual em estudantes do ensino superior com IC. Metodologia – Estudo quantitativo, comparativo e correlacional. Participaram 44 estudantes com idades compreendidas entre os 18 e os 24 anos. Formaram-se dois grupos, um com Visão Binocular Normal (VBN) e outro com IC. O grupo com IC incluiu os indivíduos que apresentaram alterações no ponto próximo de convergência (PPC) e/ou na convergência para perto (C’). Para avaliar a atenção visual utilizou-se o teste de cancelamento de sinos. Resultados – O grupo com VBN foi composto por 32 indivíduos (23 do género feminino) e o grupo com IC por 12 indivíduos (11 do género feminino). No teste de atenção visual verificou-se que o número médio de sinos identificados foi de 34,6 para o grupo com VBN e de 34,3 no grupo com IC. O tempo médio de realização do teste foi de 167,9s e de 198,3s para os grupos de VBN e IC, respetivamente. Observou-se uma correlação moderada positiva entre o PPC e o tempo médio de realização do teste (r≈0,63) e uma correlação fraca positiva entre o número médio de sinos identificados e a C’ (r≈0,16). Por outro lado, a correlação entre o PPC e o número médio de sinos identificados (r≈-0,48) foi fraca negativa e entre a C’ e o tempo médio (r≈-0,05) foi ínfima negativa. Discussão/Conclusões – O grupo com VBN apresenta um número médio de sinos identificados superior ao grupo com IC. Verifica-se ainda que o grupo com IC demorou mais tempo na realização do teste, comparativamente com o grupo com VBN. Estes resultados apontam para uma possível relação entre a IC e a diminuição da atenção visual.