Automatic visual detection of human behavior: a review from 2000 to 2014

Due to advances in information technology (e.g., digital video cameras, ubiquitous sensors), the automatic detection of human behaviors from video is a very recent research topic. In this paper, we perform a systematic and recent literature review on this topic, from 2000 to 2014, covering a selection of 193 papers that were searched from six major scientific publishers. The selected papers were classified into three main subjects: detection techniques, datasets and applications. The detection techniques were divided into four categories (initialization, tracking, pose estimation and recognition). The list of datasets includes eight examples (e.g., Hollywood action). Finally, several application areas were identified, including human detection, abnormal activity detection, action recognition, player modeling and pedestrian detection. Our analysis provides a road map to guide future research for designing automatic visual human behavior detection systems.

Controlo de qualidade e inspeção visual por imagem: definição de uma aplicação para registo de alterações e avaliação de desempenho

Dissertação de mestrado em Engenharia e Gestão da Qualidade

Pinterest: um estudo de eye tracking

Dissertação de mestrado em Média Interativos

Detection of road accident accumulation zones with a visual analytics approach

Nowadays, road accidents are a major public health problem, which increase is forecasted if road safety is not treated properly, dying about 1.2 million people every year around the globe. In 2012, Portugal recorded 573 fatalities in road accidents, on site, revealing the largest decreasing of the European Union for 2011, along with Denmark. Beyond the impact caused by fatalities, it was calculated that the economic and social costs of road accidents weighted about 1.17% of the Portuguese gross domestic product in 2010. Visual Analytics allows the combination of data analysis techniques with interactive visualizations, which facilitates the process of knowledge discovery in sets of large and complex data, while the Geovisual Analytics facilitates the exploration of space-time data through maps with different variables and parameters that are under analysis. In Portugal, the identification of road accident accumulation zones, in this work named black spots, has been restricted to annual fixed windows. In this work, it is presented a dynamic approach based on Visual Analytics techniques that is able to identify the displacement of black spots on sliding windows of 12 months. Moreover, with the use of different parameterizations in the formula usually used to detect black spots, it is possible to identify zones that are almost becoming black spots. Through the proposed visualizations, the study and identification of countermeasures to this social and economic problem can gain new grounds and thus the decision- making process is supported and improved.

Measuring end-to-end delay in real-time auralisation systems

One of the major challenges in the development of an immersive system is handling the delay between the tracking of the user’s head position and the updated projection of a 3D image or auralised sound, also called end-to-end delay. Excessive end-to-end delay can result in the general decrement of the “feeling of presence”, the occurrence of motion sickness and poor performance in perception-action tasks. These latencies must be known in order to provide insights on the technological (hardware/software optimization) or psychophysical (recalibration sessions) strategies to deal with them. Our goal was to develop a new measurement method of end-to-end delay that is both precise and easily replicated. We used a Head and Torso simulator (HATS) as an auditory signal sensor, a fast response photo-sensor to detect a visual stimulus response from a Motion Capture System, and a voltage input trigger as real-time event. The HATS was mounted in a turntable which allowed us to precisely change the 3D sound relative to the head position. When the virtual sound source was at 90º azimuth, the correspondent HRTF would set all the intensity values to zero, at the same time a trigger would register the real-time event of turning the HATS 90º azimuth. Furthermore, with the HATS turned 90º to the left, the motion capture marker visualization would fell exactly in the photo-sensor receptor. This method allowed us to precisely measure the delay from tracking to displaying. Moreover, our results show that the method of tracking, its tracking frequency, and the rendering of the sound reflections are the main predictors of end-to-end delay.

Attachment style impacts behavior and early oculomotor response to positive, but not negative, pictures

The present study investigated whether oculomotor behavior is influenced by attachment styles. The Relationship Scales Questionnaire was used to assess attachment styles of forty-eight voluntary university students and to classify them into attachment groups (secure, preoccupied, fearful, and dismissing). Eye-tracking was recorded while participants engaged in a 3-seconds free visual exploration of stimuli presenting either a positive or a negative picture together with a neutral picture, all depicting social interactions. The task consisted in identifying whether the two pictures depicted the same emotion. Results showed that the processing of negative pictures was impermeable to attachment style, while the processing of positive pictures was significantly influenced by individual differences in insecure attachment. The groups highly avoidant regarding to attachment (dismissing and fearful) showed reduced accuracy, suggesting a higher threshold for recognizing positive emotions compared to the secure group. The groups with higher attachment anxiety (preoccupied and fearful) showed differences in automatic capture of attention, in particular an increased delay preceding the first fixation to a picture of positive emotional valence. Despite lenient statistical thresholds induced by the limited sample size of some groups (p < 0.05 uncorrected for multiple comparisons), the current findings suggest that the processing of positive emotions is affected by attachment styles. These results are discussed within a broader evolutionary framework.

Light-distortion analysis as a possible indicator of visual quality after refractive lens exchange with diffractive multifocal intraocular lenses

METHODS: Refractive lens exchange was performed with implantation of an AT Lisa 839M (trifocal) or 909MP (bifocal toric) IOL, the latter if corneal astigmatism was more than 0.75 diopter (D). The postoperative visual and refractive outcomes were evaluated. A prototype light-distortion analyzer was used to quantify the postoperative light-distortion indices. A control group of eyes in which a Tecnis ZCB00 1-piece monofocal IOL was implanted had the same examinations. RESULTS: A trifocal or bifocal toric IOL was implanted in 66 eyes. The control IOL was implanted in 18 eyes. All 3 groups obtained a significant improvement in uncorrected distance visual acuity (UDVA) (P < .001) and corrected distance visual acuity (CDVA) (P Z .001). The mean uncorrected near visual acuity (UNVA) was 0.123 logMAR with the trifocal IOL and 0.130 logMAR with the bifocal toric IOL. The residual refractive cylinder was less than 1.00 D in 86.7% of cases with the toric IOL. The mean light-distortion index was significantly higher in the multifocal IOL groups than in the monofocal group (P < .001), although no correlation was found between the light-distortion index and CDVA. CONCLUSIONS: The multifocal IOLs provided excellent UDVA and functional UNVA despite increased light-distortion indices. The light-distortion analyzer reliably quantified a subjective component of vision distinct from visual acuity; it may become a useful adjunct in the evaluation of visual quality obtained with multifocal IOLs.

Cognitive rehabilitation in a visual variant of Alzheimer's disease

Alzheimer's disease (AD) is commonly associated with marked memory deficits; however, nonamnestic variants have been consistently described as well. Posterior cortical atrophy (PCA) is a progressive degenerative condition in which posterior regions of the brain are predominantly affected, therefore resulting in a pattern of distinctive and marked visuospatial symptoms, such as apraxia, alexia, and spatial neglect. Despite the growing number of studies on cognitive and neural bases of the visual variant of AD, intervention studies remain relatively sparse. Current pharmacological treatments offer modest efficacy. Also, there is a scarcity of complementary nonpharmacological interventions with only two previous studies of PCA. Here we describe a highly educated 57-year-old patient diagnosed with a visual variant of AD who participated in a cognitive intervention program (comprising reality orientation, cognitive stimulation, and cognitive training exercises). Neuropsychological assessment was performed across moments (baseline, postintervention, follow-up) and consisted mainly of verbal and visual memory. Baseline neuropsychological assessment showed deficits in perceptive and visual-constructive abilities, learning and memory, and temporal orientation. After neuropsychological rehabilitation, we observed small improvements in the patient's cognitive functioning, namely in verbal memory, attention, and psychomotor abilities. This study shows evidence of small beneficial effects of cognitive intervention in PCA and is the first report of this approach with a highly educated patient in a moderate stage of the disease. Controlled studies are needed to assess the potential efficacy of cognition-focused approaches in these patients, and, if relevant, to grant their availability as a complementary therapy to pharmacological treatment and visual aids.

Visual search for normal color and dichromatic observers using a unique distracter color

It is well known that color coding facilitates search and iden- tification in real-life tasks. The aim of this work was to compare reac- tion times for normal color and dichromatic observers in a visual search experiment. A unique distracter color was used to avoid abnormal color vision vulnerability to background complexity. Reaction times for nor- mal color observers and dichromats were estimated for 2◦ central vision at 48 directions around a white point in CIE L∗a∗b∗ color space for systematic examination on the mechanisms of dichromatic color percep- tion. The results show that mean search times for dichromats were twice larger compared to the normal color observers and for all directions. The difference between the copunctual confusion lines and the confusion direction measure experimentally was 5.5◦ for protanopes and 7.5◦ for deuteranopes.

Avaliação de vigas de madeira de Castanho tendo por base a classificação visual e ensaios não destrutivos

Dissertação de mestrado Internacional em Sustentabilidade do Ambiente Construído

Repeated assessment and practice effects of the written symbol digit modalities test using a short inter-test interval

The Symbol Digit Modalities Test (SDMT) is a widely used instrument to assess information processing speed, attention, visual scanning, and tracking. Considering that repeated evaluations are a common need in neuropsychological assessment routines, we explored test–retest reliability and practice effects of two alternate SDMT forms with a short inter-assessment interval. A total of 123 university students completed the written SDMT version in two different time points separated by a 150-min interval. Half of the participants accomplished the same form in both occasions, while the other half filled different forms. Overall, reasonable test–retest reliabilities were found (r = .70), and the subjects that completed the same form revealed significant practice effects (p < .001, dz = 1.61), which were almost non-existent in those filling different forms. These forms were found to be moderately reliable and to elicit a similar performance across participants, suggesting their utility in repeated cognitive assessments when brief inter-assessment intervals are required.

Promoção da motivação e da autonomia com recurso às tecnologias de informação e comunicação em alunos normovisuais e em alunos com deficiência visual

Relatório de estágio de mestrado em Ensino de Informática

A comunicação online: a página Web como o BIO Empresarial: estratégias de comunicação visual e web design

Dissertação de mestrado em Ciências da Comunicação (área de especialização em Audiovisuais e Multimédia)

Mother's anxiety and depression during the third pregnancy trimester and neonate's mother versus stranger's face/voice visual preference

Background: Neonates show visual preference for their mother's face/voice and shift their attention from their mother to a stranger's face/voice after habituation. Aim: To assess neonate's mother versus stranger's face/voice visual preference, namely mother's anxiety and depression during the third pregnancy trimester and neonate's: 1) visual preference for the mother versus the stranger's face/voice (pretest visual preference), 2) habituation to the mother's face/voice and 3) visual preference for the stranger versus the mother's face/voice (posttest visual preference). Method: Mothers (N=100) filled out the Edinburgh Postnatal Depression Scale (EPDS) and the State Anxiety Inventory (STAI) both at the third pregnancy trimester and childbirth, and the “preference and habituation to the mother's face/voice versus stranger” paradigm was administered to their newborn 1 to 5 days after childbirth. Results: Neonates of anxious/depressed mothers during the third pregnancy trimester contrarily to neonates of non-anxious/non-depressed mothers did not look 1) longer at their mother's than at the stranger's face/voice at the pretest visual preference (showing no visual preference for the mother), nor 2) longer at the stranger's face/voice in the posttest than in the pretest visual preference (not improving their attention to the stranger's after habituation). Conclusion: Infants exposed to mother's anxiety/depression at the third gestational trimester exhibit less perceptual/social competencies at birth.

A Real-Time intelligent system for tracking patient condition

Hospitals have multiple data sources, such as embedded systems, monitors and sensors. The number of data available is increasing and the information are used not only to care the patient but also to assist the decision processes. The introduction of intelligent environments in health care institutions has been adopted due their ability to provide useful information for health professionals, either in helping to identify prognosis or also to understand patient condition. Behind of this concept arises this Intelligent System to track patient condition (e.g. critic events) in health care. This system has the great advantage of being adaptable to the environment and user needs. The system is focused in identifying critic events from data streaming (e.g. vital signs and ventilation) which is particularly valuable for understanding the patient’s condition. This work aims to demonstrate the process of creating an intelligent system capable of operating in a real environment using streaming data provided by ventilators and vital signs monitors. Its development is important to the physician because becomes possible crossing multiple variables in real-time by analyzing if a value is critic or not and if their variation has or not clinical importance.