Seleção de features guiada por atenção visual em imagens com fóvea

Visual attention is a very important task in autonomous robotics, but, because of its complexity, the processing time required is significant. We propose an architecture for feature selection using foveated images that is guided by visual attention tasks and that reduces the processing time required to perform these tasks. Our system can be applied in bottom-up or top-down visual attention. The foveated model determines which scales are to be used on the feature extraction algorithm. The system is able to discard features that are not extremely necessary for the tasks, thus, reducing the processing time. If the fovea is correctly placed, then it is possible to reduce the processing time without compromising the quality of the tasks outputs. The distance of the fovea from the object is also analyzed. If the visual system loses the tracking in top-down attention, basic strategies of fovea placement can be applied. Experiments have shown that it is possible to reduce up to 60% the processing time with this approach. To validate the method, we tested it with the feature algorithm known as Speeded Up Robust Features (SURF), one of the most efficient approaches for feature extraction. With the proposed architecture, we can accomplish real time requirements of robotics vision, mainly to be applied in autonomous robotics

Centros subcorticais dos sistemas visual primário e óptico acessório no mocó (kerodon rupestris): caracterização pela projeção retiniana e citoarquitetura.

The primary and accessory optic systems comprise two set of retinorecipient neural clusters. In this study, these visual related centers in the rock cavy were evaluated by using the retinal innervations pattern and Nissl staining cytoarchigtecture. After unilateral intraocular injection of cholera toxin B subunit and immunohistochemical reaction of coronal and sagittal sections from the diencephalon and midbrain region of rock cavy. Three subcortical centres of primary visual system were identified, superior colliculus, lateral geniculate complex and pretectal complex. The lateral geniculate complex is formed by a series of nuclei receiving direct visual information from the retina, dorsal lateral geniculate nucleus, intergeniculate leaflet and ventral lateral geniculate nucleus. The pretectal complex is formed by series of pretectal nuclei, medial pretectal nucleus, olivary pretectal nucleus, posterior pretectal nucleus, nucleus of the optic tract and anterior pretectal nucleus. In the accessory optic system, retinal terminals were observed in the dorsal terminal, lateral terminal and medial terminal nuclei as well as in the interstitial nucleus of the superior fasciculus, posterior fibres. All retinorecipient nuclei received bilateral input, with a contralateral predominance. This is the first study of this nature in the rock cavy and the results are compared with the data obtained for other species. The investigation represents a contribution to the knowledge regarding the organization of visual optic systems in relation to the biology of species.

Encoding mechanisms based on fast oscillations in the retina of the cat and their dependencies on anesthesia

Processing in the visual system starts in the retina. Its complex network of cells with different properties enables for parallel encoding and transmission of visual information to the lateral geniculate nucleus (LGN) and to the cortex. In the retina, it has been shown that responses are often accompanied by fast synchronous oscillations (30 - 90 Hz) in a stimulus-dependent manner. Studies in the frog, rabbit, cat and monkey, have shown strong oscillatory responses to large stimuli which probably encode global stimulus properties, such as size and continuity (Neuenschwander and Singer, 1996; Ishikane et al., 2005). Moreover, simultaneous recordings from different levels in the visual system have demonstrated that the oscillatory patterning of retinal ganglion cell responses are transmitted to the cortex via the LGN (Castelo-Branco et al., 1998). Overall these results suggest that feedforward synchronous oscillations contribute to visual encoding. In the present study on the LGN of the anesthetized cat, we further investigate the role of retinal oscillations in visual processing by applying complex stimuli, such as natural visual scenes, light spots of varying size and contrast, and flickering checkerboards. This is a necessary step for understanding encoding mechanisms in more naturalistic conditions, as currently most data on retinal oscillations have been limited to simple, flashed and stationary stimuli. Correlation analysis of spiking responses confirmed previous results showing that oscillatory responses in the retina (observed here from the LGN responses) largely depend on the size and stationarity of the stimulus. For natural scenes (gray-level and binary movies) oscillations appeared only for brief moments probably when receptive fields were dominated by large continuous, flat-contrast surfaces. Moreover, oscillatory responses to a circle stimulus could be broken with an annular mask indicating that synchronization arises from relatively local interactions among populations of activated cells in the retina. A surprising finding in this study was that retinal oscillations are highly dependent on halothane anesthesia levels. In the absence of halothane, oscillatory activity vanished independent of the characteristics of the stimuli. The same results were obtained for isoflurane, which has similar pharmacological properties. These new and unexpected findings question whether feedfoward oscillations in the early visual system are simply due to an imbalance between excitation and inhibition in the retinal networks generated by the halogenated anesthetics. Further studies in awake behaving animals are necessary to extend these conclusions

Aspectos anatômicos do olho e neuroquímicos da retina do mocó (Kerodon rupestris)

The visual system is an important link between the animal and the environment, com profound influences on the habits and lifestyle in various habitats. Adaptive mechanismsto the temporal niche are present in the visual system of many vertebrates, involving changins in ocular dimensios and design, retinal cell distribution and organization of neurochemical circuits related to the retinal resolution or sensitivity. The sensory system of the eye is represented by the retina, whose organization is responsible by receipty, initial analysis, and transmission of the information to the brain. The knowledge of the position of the eyes in the head and the distribution of retinal cells allow to identify adaptive aspects of each species to its visual field, which is characteristic to the ecological niche it occupies. In this research, we study eye anatomical characteristics and retina neurochemical features of the rock cavy (Kerodon rupestris), a tipical Brazilian rodent from the suborder Hystricomorpha, family Caviidae. The rock cavy has lateral eyes well constitute bony orbit and well differentiated extrinsic muscle. The study of the descriptive and morphometric anatomy of the showed mean values of axial diameter 10.7±0,5mm and equatorial diameter 11.6±0.7mm. The pupil is slit shaped and the lens has mean axial diameter 5.4±0.03 mm, corresponding to ~45% of the axial diameter of the eye. The posterior nodal distance and the retinal magnification factor were estimated at 6.74 mm e 118 μm/grau, respectively. Flat mounts were processed for Nissl stain, and the topographic distribution of ganglion cells showed a moderate visual band, just below the optic disc, with higher density in the ventral retina. Retinal vertical sections and flat mounts were processed for immunohistochemistry to visualize tyrosine hydroxilase (TH) and thus two types of TH+ cells were detected. Type 1 cells had strong TH-immunoreactivity, the body cell varied from 120.047 to 269.373 μm2 stratifying in the sublamina 1 of the IPL. Type 2 cells were weakly TH-imunoreactive, had cell body located mostly in the IPL, varying from 54.848 to 177.142 μm2, constituting ~10% of the TH+ cells. Both cell types exhibited similar topographic distribution with higher density found in a horizontal band along of the naso-temporal axis in the dorsal retina. The total population of dopaminergic cells was 2,156±469,4 cells, occupying an average area of 198,164 μm2. The presence of cones and rods was detected by immunohistochemistry in vertical sections and flat mounts. S cones density is around 10 times smaller than L cones, with different degree of spatial organization. Other retinal neuronal populations of the rock cavy were also detected in vertical sections with specific markers. Comparative analysis of the anatomical characteristics of the rock cavy eye 12 suggest that it was designed to acquire higher sensitivity to light, at expense of image sharpness, compatible with a vision at mesopic conditions. Additionally, the distribution of the 2 subtypes of dopaminergic cells in a naso-temporal band in the dorsal retina seems suitable to a gain in sensitivity, coherent with an animal with predominantly crepuscular activity pattern

A Zona Incerta no sagüi (Callithrix jacchus): Análise Citoarquitetônica, Neuroquímica e Projeção Retiniana

The retinal projections in mammals usually reach, classically, three major functional systems: the primary visual system, the accessory optic system, and the circadian timing system. But the retinal projections also reach areas classically considered non-visual, one of which groups the neurons of the zona incerta (ZI), target this study. The primary visual system includes thalamic lateral geniculate complex is formed by the dorsal lateral geniculate nucleus, intergeniculate leaflet and the ventral lateral geniculate nucleus and other Components. The accessory optic system is composed of the small nuclei: nuclei terminal dorsal, lateral, medial and the interstitial nucleus of the superior posterior fasciculus. These nuclei are involved in visuo-motor activities. The circadian timing system is comprised of the suprachiasmatic nucleus of the hypothalamus, that act as master circadian pacemaker, entraining pathways and efferents pathways to the efectors, and the intergeniculate leaflet, that seems to act as a modulator of the pacemaker. The retinal projections too reach classically considered non-visual areas, including the zona incerta. This region is localized in the ventral thalamus and has been implicated in various functional properties including nociceptive and somatosensory processing, motor response, sociosexual behaviour, feeding and drinking, in symptoms of neurodegenerative diseases, arousal and attention. It also displays connection with several areas of central nervous system. The aim of this study was characterize the retinal projection in the zona incerta of Callithrix jacchus (sagüi), a primate of the New World through the anterograde axonal transport of the cholera toxin subunit b and analyze the citoarchicteture using Nissl and NeuN, and neurochemical substances such as serotonin, GABA, VIP, VP, GFAP and binding-calcium proteins. The zona incerta showed a different division of the literature in citoarquitetura, both by means of Nissl as neurochemical by NeuN, with a subdivision ventrolateral and dorsomedial. The neurochemical to the other substances corroborate with this subdivision. The GFAP was almost completely negative for the zona incerta, result non evidenced in previous studies yet. The 16 retinal projection in sagüi, unlike other primates and rodents, reached the caudal portion only. This work helps to make further studies are conducted based on this subdivision and the localization of the neurochemical substances associated with possible behaviors that the zona incerta is involved

Sistema de supervisão aérea baseado em navegação visual para detecção de anomalias em instalações de petróleo e gás

This work deals with the development of a prototype of a helicopter quadrotor for monitoring applications in oil facilities. Anomaly detection problems can be resolved through monitoringmissions performed by a suitably instrumented quadrotor, i.e. infrared thermosensors should be embedded. The proposed monitoring system aims to reduce accidents as well as to make possible the use of non-destructive techniques for detection and location of leaks caused by corrosion. To this end, the implementation of a prototype, its stabilization and a navigation strategy have been proposed. The control strategy is based on dividing the problem into two control hierarchical levels: the lower level stabilizes the angles and the altitude of the vehicle at the desired values, while the higher one provide appropriate references signals to the lower level in order the quadrotor performs the desired movements. The navigation strategy for helicopter quadrotor is made using information provided by a acquisition image system (monocular camera) embedded onto the helicopter. Considering that the low-level control has been solved, the proposed vision-based navigation technique treats the problem as high level control strategies, such as, relative position control, trajectory generation and trajectory tracking. For the position control we use a control technique for visual servoing based on image features. The trajectory generation is done in a offline step, which is a visual trajectory composed of a sequence of images. For the trajectory tracking problem is proposed a control strategy by continuous servovision, thus enabling a navigation strategy without metric maps. Simulation and experimental results are presented to validate the proposal

Recomendações para um sistema de sinalização tátil a partir de abordagens ergonômicas e da percepção do deficiente visual para o Campus Parnamirim do IFRN

This study reports recommendations for a tactile and graphic wayfinding system aiming to offer more orientability and mobility for visually impaired people (blindness and low vision) at Instituto Federal de Educação, Ciência e Tecnologia do Rio Grande do Norte (IFRN), Parnamirim Campus. It was necessary to focus on visual impaired people and approach concepts like orientation and accessibility at the built environment. In order to provide the comprehension of a complex social phenomenon and preserve the meaningful characteristics of the events, this research has developed a single case study in which elements of Post Occupation Evaluation have been used. Its purpose was to allow not only a technical analysis, but also the user perception about the space in use. The chosen tool to collect the user’s opinions and considerations was the Walk Together Method. The collected and analyzed information has demonstrated that, although Parnamirim Campus has implemented some interventions in relation to the spatial accessibility, they are still not enough to create an environment which arranges safety and autonomy for the visual impaired people and the other ones who attend there. This study suggests that it happened because the engineering interventions at the Campus have been based on Brazilian technical standards NBR 9050:2004, which is proper for the physical impaired people, but it does not offer enough information to respond to all the specific needs demanded by all the classifications of visual impairment.

Recomendações para um sistema de sinalização tátil a partir de abordagens ergonômicas e da percepção do deficiente visual para o Campus Parnamirim do IFRN

This study reports recommendations for a tactile and graphic wayfinding system aiming to offer more orientability and mobility for visually impaired people (blindness and low vision) at Instituto Federal de Educação, Ciência e Tecnologia do Rio Grande do Norte (IFRN), Parnamirim Campus. It was necessary to focus on visual impaired people and approach concepts like orientation and accessibility at the built environment. In order to provide the comprehension of a complex social phenomenon and preserve the meaningful characteristics of the events, this research has developed a single case study in which elements of Post Occupation Evaluation have been used. Its purpose was to allow not only a technical analysis, but also the user perception about the space in use. The chosen tool to collect the user’s opinions and considerations was the Walk Together Method. The collected and analyzed information has demonstrated that, although Parnamirim Campus has implemented some interventions in relation to the spatial accessibility, they are still not enough to create an environment which arranges safety and autonomy for the visual impaired people and the other ones who attend there. This study suggests that it happened because the engineering interventions at the Campus have been based on Brazilian technical standards NBR 9050:2004, which is proper for the physical impaired people, but it does not offer enough information to respond to all the specific needs demanded by all the classifications of visual impairment.

Pessoas com deficiência visual e o acesso à informação

Expõe considerações a respeito dos portadores de necessidades especiais, das pessoas com deficiência, um enfoque parcial sobre as doenças degenerativas da visão, e uma atenção especial para as pessoas com deficiência visual, objeto de estudo da pesquisa desenvolvida. Estabelece um resgate da evolução dos métodos que possibilitaram a essas pessoas registrar e decodificar informações na forma escrita até o surgimento do Sistema Braille. Destaca ainda os suportes e as formas de registro da informação no mencionado sistema, e aponta nominalmente os novos recursos decorrentes do advento das novas tecnologias.

A informática como uma ferramenta de apoio a inclusão do deficiente visual

An inclusive environment has its foundations in the belief that all people are entitled to participate, to live as normal a life as possible, without discrimination, especially in education. This is to ensure equal opportunities. For individuals with special needs, the use of computers and digital materials is not an alternative, but one of the only forms of access to information. For the visually impaired, they start from the beginning to enter the university, through the selection processes, not always accessible. For those who can, other difficulties arise, undermining the initial enthusiasm and generating a large rate of dropouts. In most cases, these students will depend on the goodwill of colleagues and volunteers for the reading of texts in the basic literature of the disciplines studied. The high cost of technology assisted allied to a lack of resources and knowledge of curricular adaptations, prevents many teachers help these students in an appropriate manner. This thesis seeks to contribute to the inclusion of the visually impaired student pointing alternatives that can help in caring education. The research was conducted specifically for the doctorate during the period 2001 to 2006, the cities of Natal, Salvador and Curitiba, and is based mainly on the methodology of action research. The objective was the construction of Virtual Teaching Support Center , structured in a Web portal that can serve as a resource to help support teachers, staff and other users concerned with the process of inclusion of people with needs special education, with the goal of assimilation of educational opportunities, with the support of resources and methods. The inclusion is for everyone because we are all different

Navegação cooperativa de um robô humanóide e um robô com rodas usando informação visual

This work presents a cooperative navigation systemof a humanoid robot and a wheeled robot using visual information, aiming to navigate the non-instrumented humanoid robot using information obtained from the instrumented wheeled robot. Despite the humanoid not having sensors to its navigation, it can be remotely controlled by infra-red signals. Thus, the wheeled robot can control the humanoid positioning itself behind him and, through visual information, find it and navigate it. The location of the wheeled robot is obtained merging information from odometers and from landmarks detection, using the Extended Kalman Filter. The marks are visually detected, and their features are extracted by image processing. Parameters obtained by image processing are directly used in the Extended Kalman Filter. Thus, while the wheeled robot locates and navigates the humanoid, it also simultaneously calculates its own location and maps the environment (SLAM). The navigation is done through heuristic algorithms based on errors between the actual and desired pose for each robot. The main contribution of this work was the implementation of a cooperative navigation system for two robots based on visual information, which can be extended to other robotic applications, as the ability to control robots without interfering on its hardware, or attaching communication devices

Odometria visual baseada em técnicas de structure from motion

Visual Odometry is the process that estimates camera position and orientation based solely on images and in features (projections of visual landmarks present in the scene) extraced from them. With the increasing advance of Computer Vision algorithms and computer processing power, the subarea known as Structure from Motion (SFM) started to supply mathematical tools composing localization systems for robotics and Augmented Reality applications, in contrast with its initial purpose of being used in inherently offline solutions aiming 3D reconstruction and image based modelling. In that way, this work proposes a pipeline to obtain relative position featuring a previously calibrated camera as positional sensor and based entirely on models and algorithms from SFM. Techniques usually applied in camera localization systems such as Kalman filters and particle filters are not used, making unnecessary additional information like probabilistic models for camera state transition. Experiments assessing both 3D reconstruction quality and camera position estimated by the system were performed, in which image sequences captured in reallistic scenarios were processed and compared to localization data gathered from a mobile robotic platform

Desenvolvimento de esquema de controle com realimentação visual para um robô manipulador

This work proposes a kinematic control scheme, using visual feedback for a robot arm with five degrees of freedom. Using computational vision techniques, a method was developed to determine the cartesian 3d position and orientation of the robot arm (pose) using a robot image obtained through a camera. A colored triangular label is disposed on the robot manipulator tool and efficient heuristic rules are used to obtain the vertexes of that label in the image. The tool pose is obtained from those vertexes through numerical methods. A color calibration scheme based in the K-means algorithm was implemented to guarantee the robustness of the vision system in the presence of light variations. The extrinsic camera parameters are computed from the image of four coplanar points whose cartesian 3d coordinates, related to a fixed frame, are known. Two distinct poses of the tool, initial and final, obtained from image, are interpolated to generate a desired trajectory in cartesian space. The error signal in the proposed control scheme consists in the difference between the desired tool pose and the actual tool pose. Gains are applied at the error signal and the signal resulting is mapped in joint incrementals using the pseudoinverse of the manipulator jacobian matrix. These incrementals are applied to the manipulator joints moving the tool to the desired pose

Controle de Manipulador Redundante Utilizando Realimentação Visual

In conventional robot manipulator control, the desired path is specified in cartesian space and converted to joint space through inverse kinematics mapping. The joint references generated by this mapping are utilized for dynamic control in joint space. Thus, the end-effector position is, in fact, controlled indirectly, in open-loop, and the accuracy of grip position control directly depends on the accuracy of the available kinematic model. In this report, a new scheme for redundant manipulator kinematic control, based on visual servoing is proposed. In the proposed system, a robot image acquired through a CCD camera is processed in order to compute the position and orientation of each link of the robot arm. The robot task is specified as a temporal sequence of reference images of the robot arm. Thus, both the measured pose and the reference pose are specified in the same image space, and its difference is utilized to generate a cartesian space error for kinematic control purposes. The proposed control scheme was applied in a four degree-of-freedom planar redundant robot arm, experimental results are shown

Sistema de teleoftalmologia para auxílio ao pré-diagnóstico de disfunções oculomotoras

The vision is one of the five senses of the human body and, in children is responsible for up to 80% of the perception of world around. Studies show that 50% of children with multiple disabilities have some visual impairment, and 4% of all children are diagnosed with strabismus. The strabismus is an eye disability associated with handling capacity of the eye, defined as any deviation from perfect ocular alignment. Besides of aesthetic aspect, the child may report blurred or double vision . Ophthalmological cases not diagnosed correctly are reasons for many school abandonments. The Ministry of Education of Brazil points to the visually impaired as a challenge to the educators of children, particularly in literacy process. The traditional eye examination for diagnosis of strabismus can be accomplished by inducing the eye movements through the doctor s instructions to the patient. This procedure can be played through the computer aided analysis of images captured on video. This paper presents a proposal for distributed system to assist health professionals in remote diagnosis of visual impairment associated with motor abilities of the eye, such as strabismus. It is hoped through this proposal to contribute improving the rates of school learning for children, allowing better diagnosis and, consequently, the student accompaniment