Advancing Bag-of-visual-words Representations For Lesion Classification In Retinal Images.

Diabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be useful for clinical application. The bag-of-visual-words (BoVW) algorithm employs a maximum-margin classifier in a flexible framework that is able to detect the most common DR-related lesions such as microaneurysms, cotton-wool spots and hard exudates. BoVW allows to bypass the need for pre- and post-processing of the retinographic images, as well as the need of specific ad hoc techniques for identification of each type of lesion. An extensive evaluation of the BoVW model, using three large retinograph datasets (DR1, DR2 and Messidor) with different resolution and collected by different healthcare personnel, was performed. The results demonstrate that the BoVW classification approach can identify different lesions within an image without having to utilize different algorithms for each lesion reducing processing time and providing a more flexible diagnostic system. Our BoVW scheme is based on sparse low-level feature detection with a Speeded-Up Robust Features (SURF) local descriptor, and mid-level features based on semi-soft coding with max pooling. The best BoVW representation for retinal image classification was an area under the receiver operating characteristic curve (AUC-ROC) of 97.8% (exudates) and 93.5% (red lesions), applying a cross-dataset validation protocol. To assess the accuracy for detecting cases that require referral within one year, the sparse extraction technique associated with semi-soft coding and max pooling obtained an AUC of 94.2 ± 2.0%, outperforming current methods. Those results indicate that, for retinal image classification tasks in clinical practice, BoVW is equal and, in some instances, surpasses results obtained using dense detection (widely believed to be the best choice in many vision problems) for the low-level descriptors.

Neuronal Ceroid-lipofuscinosis with prominent chorea and without visual manifestations: a case report

A case of neuronal ceroid-lipofuscinosis (NCL) is reported in a 11-year-old girl, whose main symptoms were progressive dementia since the age of 4 years and choreic movements since age 10. Seizures, myoclonus and visual deterioration were absent and optic fundi were normal. A cerebral biopsy disclosed two basic types of stored substance in the cytoplasm of neurons: a) severely balloned nerve cells in cortical layers HI and V contained a non-autofluorescent material, which stained with PAS and Sudan Black B in frozen, but not in paraffin sections; ultrastructurally, these neurons showed abundant corpuscles similar to the membranous cytoplasmic bodies of Tay-Sachs disease and, in smaller amounts, also zebra bodies; b) slightly distended or non-distended neurons in all layers contained lipopigment granules, which were autofluorescent, PAS-positive and sudanophil in both frozen and paraffin sections; their ultrastructure was closely comparable to that of lipofuscin. Similar bodies were found in the swollen segments of axons and in a few astrocytes and endothelial cells. The histochemical and ultrastructural demonstration of large amounts of lipopigments allows a presumptive classification of the case as NCL. However, the presence of involuntary movements, the absence of visual disturbances and the unusual ultrastructural features place the patient into a small heterogeneous group within the NCL. A better classification of such unique instances of the disease must await elucidation of the basic enzymatic defects.

An exploration of varieties of visual attention: ERP findings

A set of five tasks was designed to examine dynamic aspects of visual attention: selective attention to color, selective attention to pattern, dividing and switching attention between color and pattern, and selective attention to pattern with changing target. These varieties of visual attention were examined using the same set of stimuli under different instruction sets; thus differences between tasks cannot be attributed to differences in the perceptual features of the stimuli. ERP data are presented for each of these tasks. A within-task analysis of different stimulus types varying in similarity to the attended target feature revealed that an early frontal selection positivity (FSP) was evident in selective attention tasks, regardless of whether color was the attended feature. The scalp distribution of a later posterior selection negativity (SN) was affected by whether the attended feature was color or pattern. The SN was largely unaffected by dividing attention across color and pattern. A large widespread positivity was evident in most conditions, consisting of at least three subcomponents which were differentially affected by the attention conditions. These findings are discussed in relation to prior research and the time course of visual attention processes in the brain. (C) 1999 Elsevier Science B.V. All rights reserved.

Implication of the visual system in the regulation of activity cycles in the absence of solar light: 2-[I-125]iodomelatonin binding sites and melatonin receptor gene expression in the brains of demersal deep-sea gadiform fish

Relative eye size, gross brain morphology and central localization of 2-[I-125]iodomelatonin binding sites and melatonin receptor gene expression were compared in six gadiform fish living at different depths in the north-east Atlantic Ocean: Phycis blennoides (capture depth range 265-1260 m), Nezumia aequalis (445-1512 m), Coryphaenoides rupestris (706-1932 m), Trachyrincus murrayi (1010-1884 m), Coryphaenoides guentheri (1030 m) and Coryphaenoides (Nematonurus) armatus (2172-4787 m). Amongst these, the eye size range was 0.15-0.35 of head length with a value of 0.19 for C.(N.) armatus, the deepest species. Brain morphology reflected behavioural differences with well-developed olfactory regions in P.blennoides, T.murrayi and C. (N.) armatus and evidence of olfactory deficit in N. aequalis, C. rupestris and C. guentheri. All species had a clearly defined optic tectum with 2-[I-125] iodomelatonin binding and melatonin receptor gene expression localized to specific brain regions in a similar pattern to that found in shallow-water fish. Melatonin receptors were found throughout the visual structures of the brains of all species. Despite living beyond the depth of penetration of solar light these fish have retained central features associated with the coupling of cycles of growth, behaviour and reproduction to the diel light-dark cycle. How this functions in the deep sea remains enigmatic.

Dendritic branching patterns of pyramidal cells in the visual cortex of the new world marmoset monkey, with comparative notes on the old world macaque monkey

The basal dendritic arbors of 442 supragranular pyramidal cells in visual cortex of the marmoset monkey were compared by fractal analyses. As detailed in a previous study,(1) individual cells were injected with Lucifer Yellow and processed for a DAB reaction product. The basal dendritic arbors were drawn, in the tangential plane, and the fractal dimension (D) determined by the dilation method. The fractal dimensions were compared between cells in ten cortical areas containing cells involved in visual processing, including the primary visual area (Vi), the second visual area (V2), the dorsoanterior area (DA), the dorsomedial area (DM), the dorsolateral. area (DL), the middle temporal area (MT), the posterior parietal area (PP), the fundus of the superior temporal area (FST) and the caudal and rostral subdivisions of inferotemporal cortex (ITc and ITr, respectively). Of 45 pairwise interareal comparisons of the fractal dimension of neurones, 20 were significantly different. Moreover, comparison of data according to previously published visual processing pathways revealed a trend for cells with greater fractal dimensions in higher cortical areas. Comparison of the present results with those in homologous cortical areas in the macaque monkey(2) revealed some similarities between the two species. The similarity in the trends of D values of cells in both species may reflect developmental features which, result in different functional attributes.

Pyramidal neurones in macaque visual cortex: Interareal phenotypic variation of dendritic branching patterns

The basal dendritic arbors of over 500-layer III pyramidal neurones of the macaque cortex were compared by fractal analyses, which provides a measure of the space filling (or branching pattern) of dendritic arbors. Fractal values (D) of individual cells were compared between the cytochrome oxidase (CO)-rich blobs and CO-poor interblobs, of middle and upper layer III, and between sublaminae, in the primary visual area (Vi). These data were compared with those in the CO compartments in the second visual area (V2), and seven other extrastriate cortical areas. (V4, MT, LIP, 7a, TEO, TE and STP). There were significant differences in the fractal dimensions, and therefore the dendritic branching patterns, of cells in striate and extrastriate areas. Of the 55 possible pairwise comparisons of fractal dimension of neurones in different cortical areas (or CO compartments), 39 proved to be significantly different. The markedly different morphologies of pyramidal cells in the different cortical areas may be one of the features that determine the functional signatures of these cells by influencing the number of inputs received by, and propagation of potentials through, their dendritic arbors.

Sistema de percepção visual para veículos autónomos aéreos

Esta dissertação aborda o problema de detecção e desvio de obstáculos "SAA- Sense And Avoid" em movimento para veículos aéreos. Em particular apresenta contribuições tendo em vista a obtenção de soluções para permitir a utilização de aeronaves não tripuladas em espaço aéreo não segregado e para aplicações civis. Estas contribuições caracterizam-se por: uma análise do problema de SAA em \UAV's - Unmmaned Aerial Vehicles\ civis; a definição do conceito e metodologia para o projecto deste tipo de sistemas; uma proposta de \ben- chmarking\ para o sistema SAA caracterizando um conjunto de "datasets\ adequados para a validação de métodos de detecção; respectiva validação experimental do processo e obtenção de "datasets"; a análise do estado da arte para a detecção de \Dim point features\ ; o projecto de uma arquitectura para uma solução de SAA incorporando a integração de compensação de \ego motion" e respectiva validação para um "dataset" recolhido. Tendo em vista a análise comparativa de diferentes métodos bem como a validação de soluções foi proposta a recolha de um conjunto de \datasets" de informação sensorial e de navegação. Para os mesmos foram definidos um conjunto de experiências e cenários experimentais. Foi projectado e implementado um setup experimental para a recolha dos \datasets" e realizadas experiências de recolha recorrendo a aeronaves tripuladas. O setup desenvolvido incorpora um sistema inercial de alta precisão, duas câmaras digitais sincronizadas (possibilitando análise de informa formação stereo) e um receptor GPS. As aeronaves alvo transportam um receptor GPS com logger incorporado permitindo a correlação espacial dos resultados de detecção. Com este sistema foram recolhidos dados referentes a cenários de aproximação com diferentes trajectórias e condições ambientais bem como incorporando movimento do dispositivo detector. O método proposto foi validado para os datasets recolhidos tendo-se verificado, numa análise preliminar, a detecção do obstáculo (avião ultraleve) em todas as frames para uma distância inferior a 3 km com taxas de sucesso na ordem dos 95% para distâncias entre os 3 e os 4 km. Os resultados apresentados permitem validar a arquitectura proposta para a solução do problema de SAA em veículos aéreos autónomos e abrem perspectivas muito promissoras para desenvolvimento futuro com forte impacto técnico-científico bem como sócio-economico. A incorporação de informa formação de \ego motion" permite fornecer um forte incremento em termos de desempenho.

An Evaluation of Local Feature Combiners for Robot Visual Localization

In the last decade, local image features have been widely used in robot visual localization. To assess image similarity, a strategy exploiting these features compares raw descriptors extracted from the current image to those in the models of places. This paper addresses the ensuing step in this process, where a combining function must be used to aggregate results and assign each place a score. Casting the problem in the multiple classifier systems framework, we compare several candidate combiners with respect to their performance in the visual localization task. A deeper insight into the potential of the sum and product combiners is provided by testing two extensions of these algebraic rules: threshold and weighted modifications. In addition, a voting method, previously used in robot visual localization, is assessed. All combiners are tested on a visual localization task, carried out on a public dataset. It is experimentally demonstrated that the sum rule extensions globally achieve the best performance. The voting method, whilst competitive to the algebraic rules in their standard form, is shown to be outperformed by both their modified versions.

Robot visual localization through local feature fusion: an evaluation of multiple classifiers combination approaches

In the last decade, local image features have been widely used in robot visual localization. In order to assess image similarity, a strategy exploiting these features compares raw descriptors extracted from the current image with those in the models of places. This paper addresses the ensuing step in this process, where a combining function must be used to aggregate results and assign each place a score. Casting the problem in the multiple classifier systems framework, in this paper we compare several candidate combiners with respect to their performance in the visual localization task. For this evaluation, we selected the most popular methods in the class of non-trained combiners, namely the sum rule and product rule. A deeper insight into the potential of these combiners is provided through a discriminativity analysis involving the algebraic rules and two extensions of these methods: the threshold, as well as the weighted modifications. In addition, a voting method, previously used in robot visual localization, is assessed. Furthermore, we address the process of constructing a model of the environment by describing how the model granularity impacts upon performance. All combiners are tested on a visual localization task, carried out on a public dataset. It is experimentally demonstrated that the sum rule extensions globally achieve the best performance, confirming the general agreement on the robustness of this rule in other classification problems. The voting method, whilst competitive with the product rule in its standard form, is shown to be outperformed by its modified versions.

Combining sparse and dense methods in 6D Visual Odometry

13th International Conference on Autonomous Robot Systems (Robotica), 2013, Lisboa

Controlo de qualidade e inspeção visual por imagem: definição de uma aplicação para registo de alterações e avaliação de desempenho

Dissertação de mestrado em Engenharia e Gestão da Qualidade

Visual stimulus-dependent changes in interhemispheric EEG coherence in humans.

We analyzed the coherence of electroencephalographic (EEG) signals recorded symmetrically from the two hemispheres, while subjects (n = 9) were viewing visual stimuli. Considering the many common features of the callosal connectivity in mammals, we expected that, as in our animal studies, interhemispheric coherence (ICoh) would increase only with bilateral iso-oriented gratings located close to the vertical meridian of the visual field, or extending across it. Indeed, a single grating that extended across the vertical meridian significantly increased the EEG ICoh in normal adult subjects. These ICoh responses were obtained from occipital and parietal derivations and were restricted to the gamma frequency band. They were detectable with different EEG references and were robust across and within subjects. Other unilateral and bilateral stimuli, including identical gratings that were effective in anesthetized animals, did not affect ICoh in humans. This fact suggests the existence of regulatory influences, possibly of a top-down kind, on the pattern of callosal activation in conscious human subjects. In addition to establishing the validity of EEG coherence analysis for assaying cortico-cortical connectivity, this study extends to the human brain the finding that visual stimuli cause interhemispheric synchronization, particularly in frequencies of the gamma band. It also indicates that the synchronization is carried out by cortico-cortical connection and suggests similarities in the organization of visual callosal connections in animals and in man.

Visual search in spatial neglect studied with a preview paradigm.

Impaired visual search is a hallmark of spatial neglect. When searching for an unique feature (e.g., color) neglect patients often show only slight visual field asymmetries. In contrast, when the target is defined by a combination of features (e.g., color and form) they exhibit a severe deficit of contralesional search. This finding suggests a selective impairment of the serial deployment of spatial attention. Here, we examined this deficit with a preview paradigm. Neglect patients searched for a target defined by the conjunction of shape and color, presented together with varying numbers of distracters. The presentation time was varied such that on some trials participants previewed the target together with same-shape/different-color distracters, for 300 or 600 ms prior to the appearance of additional different-shape/same-color distracters. On the remaining trials the target and all distracters were shown simultaneously. Healthy participants exhibited a serial search strategy only when all items were presented simultaneously, whereas in both preview conditions a pop-out effect was observed. Neglect patients showed a similar pattern when the target was presented in the right hemifield. In contrast, when searching for a target in the left hemifield they showed serial search in the no-preview condition, as well as with a preview of 300 ms, and partly even at 600 ms. A control experiment suggested that the failure to fully benefit from item preview was probably independent of accurate perception of time. Our results, when viewed in the context of existing literature, lead us to conclude that the visual search deficit in neglect reflects two additive factors: a biased representation of attentional priority in favor of ipsilesional information and exaggerated capture of attention by ipsilesional abrupt onsets.

Corneal Opacities in Trisomy 8 Mosaic Syndrome : Clinical, Histologic and Genetic Features

Purpose: To describe the clinical, histologic and genetic findings of corneal opacities in the trisomy 8 mosaic syndrome. Methods: 3 children aged 8 years (Patients A), 6 years (Patients B) and 1 month (Patients C) respectively, were referred with corneal opacities for ophthalmologic evaluation. The 2 older patients had been previously diagnosed with trisomy 8 mosaicism, while the third was diagnosed after the ocular examination. Automated lamellar keratoplasty (ALTK) was performed on the most amblyopic eye. Histopathologic analysis with immunohistochemical markers and cytogenetic studies by FISH using haploid probes for chromosome 8 and chromosome 16 (control) were performed on the excised corneal lesion. Results: All patients presented vascularized corneal opacities involving the superficial stroma, and amblyopia with a bilateral involvement in two of them (Patients A and B). Post-operative follow-up (range 6-20 months) was satisfactory, with the graft remaining clear and improved visual acuity, allowing iso-acuity and stereoscopy in the one month old child (Patients C). The clinically observed corneal opacities corresponded histopathologically to the replacement of the normal anterior corneal stroma by a choristomatous loose richly vascularized connective tissue containing mucopolysacharides. Bowman's membrane was absent. There were no adnexal structures. The overlaying epithelium expressed keratin 3 in all three cases. Keratin 19 was found in the suprabasal epithelial cells in one case but was absent in the other cases. There were no expression of keratin 7 and 1 as well as MUC5AC in the epithelial cells. FISH analysis from 100 interphase cells of the affected tissue and normal conjontival probe revealed normal diploid cells. Conclusions: In this series, the corneal opacities associated with trisomy 8 mosaic syndrome share a common clinical, histopathological and genetic features. ALTK should be considered at diagnosis to prevent amblyopia in these children.