Robust Stereo Visual Odometry through a Probabilistic Combination of Points and Line Segments

Most approaches to stereo visual odometry reconstruct the motion based on the tracking of point features along a sequence of images. However, in low-textured scenes it is often difficult to encounter a large set of point features, or it may happen that they are not well distributed over the image, so that the behavior of these algorithms deteriorates. This paper proposes a probabilistic approach to stereo visual odometry based on the combination of both point and line segment that works robustly in a wide variety of scenarios. The camera motion is recovered through non-linear minimization of the projection errors of both point and line segment features. In order to effectively combine both types of features, their associated errors are weighted according to their covariance matrices, computed from the propagation of Gaussian distribution errors in the sensor measurements. The method, of course, is computationally more expensive that using only one type of feature, but still can run in real-time on a standard computer and provides interesting advantages, including a straightforward integration into any probabilistic framework commonly employed in mobile robotics.

O museu virtual Google Art Project : um estudo de caso em contexto de ensino-aprendizagem da educação visual

A educação na arte e pela arte confere a todos os seus intervenientes a estimulação da sua criatividade e da sua consciência cultural, proporcionando meios para se exprimirem e participarem ativamente no mundo que nos rodeia. A integração das tecnologias de informação e comunicação no processo de ensino-aprendizagem veio alargar o papel que a arte pode desempenhar neste processo, promovendo novas formas de aprender, de ensinar e de pensar. Assim, a utilização de ambientes virtuais em contexto educativo tem revelado um enorme potencial, sobretudo ao nível da comunicação e da interação entre alunos e obras de arte. Neste sentido, considerou-se importante desenvolver um estudo de caso em contexto de sala de aula da Educação Visual, promovendo uma aprendizagem baseada na articulação entre a observação, interpretação e análise da obra de arte e o museu virtual. Assim o principal objetivo deste estudo foi avaliar as potencialidades do Google Art Project, enquanto objeto de aprendizagem, na promoção da aprendizagem na área da literacia em artes. Para além disso, procurámos ainda avaliar se a utilização de ferramentas multimédia como o referido Google Art Project e o Quadro Interativo, constituem fatores de motivação na aprendizagem da disciplina de Educação Visual. Do ponto de vista metodológico desenvolvemos uma estratégia baseada na investigação-ação. Procurámos, por um lado, descobrir e compreender o significado de uma realidade vivida por um grupo de alunos e, por outro lado, refletir sobre a prática educativa com o intuito de a melhorar e transformar. Este estudo envolveu cinco turmas do sexto ano do ensino público. Para a recolha de dados utilizámos técnicas baseadas na conversação e na observação, no questionário e nas notas de campo. Os resultados deste estudo revelam que as ferramentas tecnológicas utilizadas podem efetivamente contribuir para a promoção da aprendizagem dos alunos na área da Educação Visual, mais concretamente ao nível do domínio da literacia artística, da representação e da interpretação visual.

Cognitive and Visual Speech Contributions to Speech Perception in Challenging Listening Conditions

Speech perception routinely takes place in noisy or degraded listening environments, leading to ambiguity in the identity of the speech token. Here, I present one review paper and two experimental papers that highlight cognitive and visual speech contributions to the listening process, particularly in challenging listening environments. First, I survey the literature linking audiometric age-related hearing loss and cognitive decline and review the four proposed causal mechanisms underlying this link. I argue that future research in this area requires greater consideration of the functional overlap between hearing and cognition. I also present an alternative framework for understanding causal relationships between age-related declines in hearing and cognition, with emphasis on the interconnected nature of hearing and cognition and likely contributions from multiple causal mechanisms. I also provide a number of testable hypotheses to examine how impairments in one domain may affect the other. In my first experimental study, I examine the direct contribution of working memory (through a cognitive training manipulation) on speech in noise comprehension in older adults. My results challenge the efficacy of cognitive training more generally, and also provide support for the contribution of sentence context in reducing working memory load. My findings also challenge the ubiquitous use of the Reading Span test as a pure test of working memory. In a second experimental (fMRI) study, I examine the role of attention in audiovisual speech integration, particularly when the acoustic signal is degraded. I demonstrate that attentional processes support audiovisual speech integration in the middle and superior temporal gyri, as well as the fusiform gyrus. My results also suggest that the superior temporal sulcus is sensitive to intelligibility enhancement, regardless of how this benefit is obtained (i.e., whether it is obtained through visual speech information or speech clarity). In addition, I also demonstrate that both the cingulo-opercular network and motor speech areas are recruited in difficult listening conditions. Taken together, these findings augment our understanding of cognitive contributions to the listening process and demonstrate that memory, working memory, and executive control networks may flexibly be recruited in order to meet listening demands in challenging environments.

A importância da adaptação da linguagem do visual merchandising para o varejo de baixa renda

A evolução do varejo no Brasil, também atribuída ao crescimento econômico das últimas décadas, foi marcada pelo surgimento de novos formatos e estratégias comerciais e por um surpreendente processo de transformação social. Observa-se que a referida transformação social foi seguida pelo aumento do poder aquisitivo das diferentes classes sociais que compõem o cenário econômico. O crescimento econômico, proporcionado pela instituição de políticas econômicas e de inclusão social, fez despontar um nicho de mercado, que até o momento apresentava-se com acesso restrito ao consumo, formado pela classe social de baixa renda. O surgimento de um novo cenário mercadológico constituído por indivíduos pertencentes à classe social de baixa renda e a concorrência saturada dos mercados consolidados despertaram o interesse de muitas empresas em incrementar suas atividades investindo no emergente mercado de consumo. Para consolidar suas atuações em um mercado pouco conhecido, algumas empresas perceberam a necessidade de compatibilizar sua estratégias comerciais e de marketing ao novo perfil e comportamento dos respectivos consumidores. Entretanto, ainda é possível observar que muitas das referidas estratégias são desenvolvidas a partir de mitos acerca das motivações e comportamentos de consumo da classe social de baixa renda e, desta forma, não correspondente ao estilo de vida e formação cultural do referido público alvo. O presente estudo pretende contribuir para o aperfeiçoamento do varejo de baixa renda e, desta forma, apresentar a importância de planejar ações comerciais e de convencimento de consumo coordenadas com estratégias de marketing, notadamente do visual merchandising, adaptadas ao referido público alvo. Para alcançar a proposta deste estudo fez-se necessária a compreensão do estilo de vida do respectivo público alvo através do desenvolvimento de métodos de pesquisa investigativos, para uma análise detalhada e assertiva das respectivas motivações de consumo.

Audio-Visual Information Processing across different age groups

People possess different sensory modalities to detect, interpret, and efficiently act upon various events in a complex and dynamic environment (Fetsch, DeAngelis, & Angelaki, 2013). Much empirical work has been done to understand the interplay of modalities (e.g. audio-visual interactions, see Calvert, Spence, & Stein, 2004). On the one hand, integration of multimodal input as a functional principle of the brain enables the versatile and coherent perception of the environment (Lewkowicz & Ghazanfar, 2009). On the other hand, sensory integration does not necessarily mean that input from modalities is always weighted equally (Ernst, 2008). Rather, when two or more modalities are stimulated concurrently, one often finds one modality dominating over another. Study 1 and 2 of the dissertation addressed the developmental trajectory of sensory dominance. In both studies, 6-year-olds, 9-year-olds, and adults were tested in order to examine sensory (audio-visual) dominance across different age groups. In Study 3, sensory dominance was put into an applied context by examining verbal and visual overshadowing effects among 4- to 6-year olds performing a face recognition task. The results of Study 1 and Study 2 support default auditory dominance in young children as proposed by Napolitano and Sloutsky (2004) that persists up to 6 years of age. For 9-year-olds, results on privileged modality processing were inconsistent. Whereas visual dominance was revealed in Study 1, privileged auditory processing was revealed in Study 2. Among adults, a visual dominance was observed in Study 1, which has also been demonstrated in preceding studies (see Spence, Parise, & Chen, 2012). No sensory dominance was revealed in Study 2 for adults. Potential explanations are discussed. Study 3 referred to verbal and visual overshadowing effects in 4- to 6-year-olds. The aim was to examine whether verbalization (i.e., verbally describing a previously seen face), or visualization (i.e., drawing the seen face) might affect later face recognition. No effect of visualization on recognition accuracy was revealed. As opposed to a verbal overshadowing effect, a verbal facilitation effect occurred. Moreover, verbal intelligence was a significant predictor for recognition accuracy in the verbalization group but not in the control group. This suggests that strengthening verbal intelligence in children can pay off in non-verbal domains as well, which might have educational implications.

Mind the gaps: cognitive-inspired AI for high-level visual sensemaking. Towards abstract concept image classification

The abundance of visual data and the push for robust AI are driving the need for automated visual sensemaking. Computer Vision (CV) faces growing demand for models that can discern not only what images "represent," but also what they "evoke." This is a demand for tools mimicking human perception at a high semantic level, categorizing images based on concepts like freedom, danger, or safety. However, automating this process is challenging due to entropy, scarcity, subjectivity, and ethical considerations. These challenges not only impact performance but also underscore the critical need for interoperability. This dissertation focuses on abstract concept-based (AC) image classification, guided by three technical principles: situated grounding, performance enhancement, and interpretability. We introduce ART-stract, a novel dataset of cultural images annotated with ACs, serving as the foundation for a series of experiments across four key domains: assessing the effectiveness of the end-to-end DL paradigm, exploring cognitive-inspired semantic intermediaries, incorporating cultural and commonsense aspects, and neuro-symbolic integration of sensory-perceptual data with cognitive-based knowledge. Our results demonstrate that integrating CV approaches with semantic technologies yields methods that surpass the current state of the art in AC image classification, outperforming the end-to-end deep vision paradigm. The results emphasize the role semantic technologies can play in developing both effective and interpretable systems, through the capturing, situating, and reasoning over knowledge related to visual data. Furthermore, this dissertation explores the complex interplay between technical and socio-technical factors. By merging technical expertise with an understanding of human and societal aspects, we advocate for responsible labeling and training practices in visual media. These insights and techniques not only advance efforts in CV and explainable artificial intelligence but also propel us toward an era of AI development that harmonizes technical prowess with deep awareness of its human and societal implications.

Advancing Bag-of-visual-words Representations For Lesion Classification In Retinal Images.

Diabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be useful for clinical application. The bag-of-visual-words (BoVW) algorithm employs a maximum-margin classifier in a flexible framework that is able to detect the most common DR-related lesions such as microaneurysms, cotton-wool spots and hard exudates. BoVW allows to bypass the need for pre- and post-processing of the retinographic images, as well as the need of specific ad hoc techniques for identification of each type of lesion. An extensive evaluation of the BoVW model, using three large retinograph datasets (DR1, DR2 and Messidor) with different resolution and collected by different healthcare personnel, was performed. The results demonstrate that the BoVW classification approach can identify different lesions within an image without having to utilize different algorithms for each lesion reducing processing time and providing a more flexible diagnostic system. Our BoVW scheme is based on sparse low-level feature detection with a Speeded-Up Robust Features (SURF) local descriptor, and mid-level features based on semi-soft coding with max pooling. The best BoVW representation for retinal image classification was an area under the receiver operating characteristic curve (AUC-ROC) of 97.8% (exudates) and 93.5% (red lesions), applying a cross-dataset validation protocol. To assess the accuracy for detecting cases that require referral within one year, the sparse extraction technique associated with semi-soft coding and max pooling obtained an AUC of 94.2 ± 2.0%, outperforming current methods. Those results indicate that, for retinal image classification tasks in clinical practice, BoVW is equal and, in some instances, surpasses results obtained using dense detection (widely believed to be the best choice in many vision problems) for the low-level descriptors.

Visual Navigation In The Neotropical Ant Odontomachus Hastatus (formicidae, Ponerinae), A Predominantly Nocturnal, Canopy-dwelling Predator Of The Atlantic Rainforest.

The arboreal ant Odontomachus hastatus nests among roots of epiphytic bromeliads in the sandy forest at Cardoso Island (Brazil). Crepuscular and nocturnal foragers travel up to 8m to search for arthropod prey in the canopy, where silhouettes of leaves and branches potentially provide directional information. We investigated the relevance of visual cues (canopy, horizon patterns) during navigation in O. hastatus. Laboratory experiments using a captive ant colony and a round foraging arena revealed that an artificial canopy pattern above the ants and horizon visual marks are effective orientation cues for homing O. hastatus. On the other hand, foragers that were only given a tridimensional landmark (cylinder) or chemical marks were unable to home correctly. Navigation by visual cues in O. hastatus is in accordance with other diurnal arboreal ants. Nocturnal luminosity (moon, stars) is apparently sufficient to produce contrasting silhouettes from the canopy and surrounding vegetation, thus providing orientation cues. Contrary to the plain floor of the round arena, chemical cues may be important for marking bifurcated arboreal routes. This experimental demonstration of the use of visual cues by a predominantly nocturnal arboreal ant provides important information for comparative studies on the evolution of spatial orientation behavior in ants. This article is part of a Special Issue entitled: Neotropical Behaviour.

[strategies For Integration Of Health Care Practices And Sanitary Surveillance In The Context Of The Implementation Of Rede Cegonha - A Brazilian Mother And Infant Health Care Network].

Mother and infant mortality has been the scope of analysis throughout the history of public health in Brazil and various strategies to tackle the issue have been proposed to date. The Ministry of Health has been working on this and the Rede Cegonha strategy is the most recent policy in this context. Given the principle of comprehensive health care and the structure of the Unified Health System in care networks, it is necessary to ensure the integration of health care practices, among which are the sanitary surveillance actions (SSA). Considering that the integration of health care practices and SSA can contribute to reduce mother and infant mortality rates, this article is a result of qualitative research that analyzed the integration of these actions in four cities in the State of São Paulo/Brazil: Campinas, Indaiatuba, Jaguariúna and Santa Bárbara D'Oeste. The research was conducted through interviews with SSA and maternal health managers, and the data were evaluated using thematic analysis. The results converge with other studies, identifying the isolation of health care practices and SSA. The insertion of SSA in collectively-managed areas appears to be a potential strategy for health planning and implementation of actions in the context under scrutiny.

Applications Of Visual Evoked Potentials And Fourier-domain Optical Coherence Tomography In Parkinson's Disease: A Controlled Study.

The goal of this cross-sectional observational study was to quantify the pattern-shift visual evoked potentials (VEP) and the thickness as well as the volume of retinal layers using optical coherence tomography (OCT) across a cohort of Parkinson's disease (PD) patients and age-matched controls. Forty-three PD patients and 38 controls were enrolled. All participants underwent a detailed neurological and ophthalmologic evaluation. Idiopathic PD cases were included. Cases with glaucoma or increased intra-ocular pressure were excluded. Patients were assessed by VEP and high-resolution Fourier-domain OCT, which quantified the inner and outer thicknesses of the retinal layers. VEP latencies and the thicknesses of the retinal layers were the main outcome measures. The mean age, with standard deviation (SD), of the PD patients and controls were 63.1 (7.5) and 62.4 (7.2) years, respectively. The patients were predominantly in the initial Hoehn-Yahr (HY) disease stages (34.8% in stage 1 or 1.5, and 55.8 % in stage 2). The VEP latencies and the thicknesses as well as the volumes of the retinal inner and outer layers of the groups were similar. A negative correlation between the retinal thickness and the age was noted in both groups. The thickness of the retinal nerve fibre layer (RNFL) was 102.7 μm in PD patients vs. 104.2 μm in controls. The thicknesses of retinal layers, VEP, and RNFL of PD patients were similar to those of the controls. Despite the use of a representative cohort of PD patients and high-resolution OCT in this study, further studies are required to establish the validity of using OCT and VEP measurements as the anatomic and functional biomarkers for the evaluation of retinal and visual pathways in PD patients.

Motivating Medical Students To Learn Basic Science Concepts Using Chronic Myeloid Leukemia As An Integration Theme.

To report on the use of chronic myeloid leukemia as a theme of basic clinical integration for first year medical students to motivate and enable in-depth understanding of the basic sciences of the future physician. During the past thirteen years we have reviewed and updated the curriculum of the medical school of the Universidade Estadual de Campinas. The main objective of the new curriculum is to teach the students how to learn to learn. Since then, a case of chronic myeloid leukemia has been introduced to first year medical students and discussed in horizontal integration with all themes taught during a molecular and cell biology course. Cell structure and components, protein, chromosomes, gene organization, proliferation, cell cycle, apoptosis, signaling and so on are all themes approached during this course. At the end of every topic approached, the students prepare in advance the corresponding topic of clinical cases chosen randomly during the class, which are then presented by them. During the final class, a paper regarding mutations in the abl gene that cause resistance to tyrosine kinase inhibitors is discussed. After each class, three tests are solved in an interactive evaluation. The course has been successful since its beginning, 13 years ago. Great motivation of those who participated in the course was observed. There were less than 20% absences in the classes. At least three (and as many as nine) students every year were interested in starting research training in the field of hematology. At the end of each class, an interactive evaluation was performed and more than 70% of the answers were correct in each evaluation. Moreover, for the final evaluation, the students summarized, in a written report, the molecular and therapeutic basis of chronic myeloid leukemia, with scores ranging from 0 to 10. Considering all 13 years, a median of 78% of the class scored above 5 (min 74%-max 85%), and a median of 67% scored above 7. Chronic myeloid leukemia is an excellent example of a disease that can be used for clinical basic integration as this disorder involves well known protein, cytogenetic and cell function abnormalities, has well-defined diagnostic strategies and a target oriented therapy.

Physical Activity Interventions For Children And Youth With Visual Impairments.

The authors conducted a systematic literature review on physical activity interventions for children and youth with visual impairment (VI). Five databases were searched to identify studies involving the population of interest and physical activity practices. After evaluating 2,495 records, the authors found 18 original full-text studies published in English they considered eligible. They identified 8 structured exercise-training studies that yielded overall positive effect on physical-fitness and motor-skill outcomes. Five leisure-time-physical-activity and 5 instructional-strategy interventions were also found with promising proposals to engage and instruct children and youth with VI to lead an active lifestyle. However, the current research on physical activity interventions for children and youth with VI is still limited by an absence of high-quality research designs, low sample sizes, use of nonvalidated outcome measures, and lack of generalizability, which need to be addressed in future studies.

Método para avaliação da conduta visual de lactentes

The purpose of this study is to introduce a method to evaluate visual functions in infants in the first three months of life. An adaptation of the Guide for the Assessment of Visual Ability in Infants (Gagliardo, 1997) was used. The instrument was a ring with string. It was implemented a pilot study with 33 infants, selected according to the following criteria: neonates well enough to go home within two days of birth; 1 to 3 months of chronological age; monthly evaluation with no absence; subjects living in Campinas/SP metropolitan area. In the first month we observed: visual fixation (93,9%); eye contact (90,9%); horizontal tracking (72,7%); inspects surroundings (97,0%). In the third month, we observed: inspects own hands (42,4%) and increased movements of arms (36,4%). This method allowed the evaluation of visual functions in infants, according to the chronological age. Alterations in this function will facilitate immediate referral to medical services for diagnoses.

Visual demonstration of the ionic strength effect in the classroom: the Debye-Hückel limiting law

The effects of ionic strength on ions in aqueous solutions are quite relevant, especially for biochemical systems, in which proteins and amino acids are involved. The teaching of this topic and more specifically, the Debye-Hückel limiting law, is central in chemistry undergraduate courses. In this work, we present a description of an experimental procedure based on the color change of aqueous solutions of bromocresol green (BCG), driven by addition of electrolyte. The contribution of charge product (z+|z-|) to the Debye-Hückel limiting law is demonstrated when the effects of NaCl and Na2SO4 on the color of BCG solutions are compared.

Estudo da circulação retrobulbar e do campo visual após dose única oral de citrato de sildenafil (Viagra®)

Purpose: To analyze the effects of 100 mg of sildenafil citrate (Viagra®) on the retrobulbar circulation and visual field. Methods: A double masked, placebo controlled study was conducted in 10 males with a mean age of 27.7 + 5.68 years. The right eye of each volunteer underwent orbital color Doppler imaging and automated perimetry (Humphrey, program 30-2, Full-Threshold Strategy) at 3 occasions: baseline, 1 hour after placebo and 1 hour after 100 mg of sildenafil. The foveal threshold and the mean deviation (MD) were analyzed by automated perimetry on the three occasions. Color Doppler imaging allowed the measurement of the peak systolic velocity (PSV), end diastolic velocity (EDV) and Pourcelot index (PI) in the central retinal artery and ophthalmic artery. Results: The foveal threshold and the mean deviation did not show a significant change following the administration of sildenafil. The ophthalmic artery peak systolic velocity and end diastolic velocity significantly increased after the administration of sildenafil (p<0.001). The hemodynamic parameters in the central retinal artery and the ophthalmic artery PI did not significantly change. Conclusions: Sildefanil citrate increased the blood flow velocities in the ophthalmic artery in normal subjects, with no significant changes in the foveal threshold and mean deviation in the automated perimetry.