Object detection and recognition in complex scenes

Dissertação de Mestrado, Engenharia Informática, Faculdade de Ciências e Tecnologia, Universidade do Algarve, 2014

The effect of sample and sample matrix on DNA processing: Mechanisms for the detection and management of inhibition in forensic samples

The presence of inhibitory substances in biological forensic samples has, and continues to affect the quality of the data generated following DNA typing processes. Although the chemistries used during the procedures have been enhanced to mitigate the effects of these deleterious compounds, some challenges remain. Inhibitors can be components of the samples, the substrate where samples were deposited or chemical(s) associated to the DNA purification step. Therefore, a thorough understanding of the extraction processes and their ability to handle the various types of inhibitory substances can help define the best analytical processing for any given sample. A series of experiments were conducted to establish the inhibition tolerance of quantification and amplification kits using common inhibitory substances in order to determine if current laboratory practices are optimal for identifying potential problems associated with inhibition. DART mass spectrometry was used to determine the amount of inhibitor carryover after sample purification, its correlation to the initial inhibitor input in the sample and the overall effect in the results. Finally, a novel alternative at gathering investigative leads from samples that would otherwise be ineffective for DNA typing due to the large amounts of inhibitory substances and/or environmental degradation was tested. This included generating data associated with microbial peak signatures to identify locations of clandestine human graves. Results demonstrate that the current methods for assessing inhibition are not necessarily accurate, as samples that appear inhibited in the quantification process can yield full DNA profiles, while those that do not indicate inhibition may suffer from lowered amplification efficiency or PCR artifacts. The extraction methods tested were able to remove >90% of the inhibitors from all samples with the exception of phenol, which was present in variable amounts whenever the organic extraction approach was utilized. Although the results attained suggested that most inhibitors produce minimal effect on downstream applications, analysts should practice caution when selecting the best extraction method for particular samples, as casework DNA samples are often present in small quantities and can contain an overwhelming amount of inhibitory substances.^

Fast Detection and Chemical Characterization of Gunshot Residues by CMV-GC-MS and LIBS

Gunshot residue (GSR) is the term used to describe the particles originating from different parts of the firearm and ammunition during the discharge. A fast and practical field tool to detect the presence of GSR can assist law enforcement in the accurate identification of subjects. A novel field sampling device is presented for the first time for the fast detection and quantitation of volatile organic compounds (VOCs). The capillary microextraction of volatiles (CMV) is a headspace sampling technique that provides fast results (< 2 min. sampling time) and is reported as a versatile and high-efficiency sampling tool. The CMV device can be coupled to a Gas Chromatography-Mass Spectrometry (GC-MS) instrument by installation of a thermal separation probe in the injection port of the GC. An analytical method using the CMV device was developed for the detection of 17 compounds commonly found in polluted environments. The acceptability of the CMV as a field sampling method for the detection of VOCs is demonstrated by following the criteria established by the Environmental Protection Agency (EPA) compendium method TO-17. The CMV device was used, for the first time, for the detection of VOCs on swabs from the hands of shooters, and non-shooters and spent cartridges from different types of ammunition (i.e., pistol, rifle, and shotgun). The proposed method consists in the headspace extraction of VOCs in smokeless powders present in the propellant of ammunition. The sensitivity of this method was demonstrated with method detection limits (MDLs) 4-26 ng for diphenylamine (DPA), nitroglycerine (NG), 2,4-dinitrotoluene (2,4-DNT), and ethyl centralite (EC). In addition, a fast method was developed for the detection of the inorganic components (i.e., Ba, Pb, and Sb) characteristic of GSR presence by Laser Induced Breakdown Spectroscopy (LIBS). Advantages of LIBS include fast analysis (~ 12 seconds per sample) and good sensitivity, with expected MDLs in the range of 0.1-20 ng for target elements. Statistical analysis of the results using both techniques was performed to determine any correlation between the variables analyzed. This work demonstrates that the information collected from the analysis of organic components has the potential to improve the detection of GSR.

First molecular detection and characterization of herpesvirus and poxvirus in a Pacific walrus (Odobenus rosmarus divergens)

BACKGROUND Herpesvirus and poxvirus can infect a wide range of species: herpesvirus genetic material has been detected and amplified in five species of the superfamily Pinnipedia; poxvirus genetic material, in eight species of Pinnipedia. To date, however, genetic material of these viruses has not been detected in walrus (Odobenus rosmarus), another marine mammal of the Pinnipedia clade, even though anti-herpesvirus antibodies have been detected in these animals. CASE PRESENTATION In February 2013, a 9-year-old healthy captive female Pacific walrus died unexpectedly at L'Oceanografic (Valencia, Spain). Herpesvirus was detected in pharyngeal tonsil tissue by PCR. Phylogenetic analysis revealed that the virus belongs to the subfamily Gammaherpesvirinae. Poxvirus was also detected by PCR in skin, pre-scapular and tracheobronchial lymph nodes and tonsils. Gross lesions were not detected in any tissue, but histopathological analyses of pharyngeal tonsils and lymph nodes revealed remarkable lymphoid depletion and lymphocytolysis. Similar histopathological lesions have been previously described in bovine calves infected with an alphaherpesvirus, and in northern elephant seals infected with a gammaherpesvirus that is closely related to the herpesvirus found in this case. Intracytoplasmic eosinophilic inclusion bodies, consistent with poxviral infection, were also observed in the epithelium of the tonsilar mucosa. CONCLUSION To our knowledge, this is the first molecular identification of herpesvirus and poxvirus in a walrus. Neither virus was likely to have contributed directly to the death of our animal.

Detection and assessment of electrocution in endangered raptors by infrared thermography

BACKGROUND Most European birds of prey find themselves in a poor state of conservation, with electrocution as one of the most frequent causes of unnatural death. Since early detection of electrocution is difficult, treatment is usually implemented late, which reduces its effectiveness. By considering that electrocution reduces tissue temperature, it may be detectable by thermography, which would allow a more rapid identification. Three individuals from three endangered raptor species [Spanish imperial eagle (Aquila adalberti), Lammergeier (Gypaetus barbatus) and Osprey (Pandion haliaetus)] were studied thermographically from the time they were admitted to a rehabilitation centre to the time their clinical cases were resolved. CASES PRESENTATION The three raptors presented lesions lacking thermal bilateral symmetry and were consistent with electrocution of feet, wings and eyes, visible by thermography before than clinically; lesions were well-defined and showed a lower temperature than the surrounding tissue. Some lesions evolved thermally and clinically until the appearance of normal tissue recovered, while others evolved and became necrotic. A histopathological analysis of a damaged finger amputated off a Lammergeier, and the necropsy and histopathology examination of an osprey, confirmed the electrocution diagnosis. CONCLUSIONS These results suggest that thermography is effective and useful for the objective and early detection and monitoring of electrocuted birds, and that it may prove especially useful for examining live animals that require no amputation or cannot be subjected to invasive histopathology.

Analytic and heuristic processes in the detection and resolution of conflict

Previous research with the ratio-bias task found larger response latencies for conflict trials where the heuristic- and analytic-based responses are assumed to be in opposition (e.g., choosing between 1/10 and 9/100 ratios of success) when compared to no-conflict trials where both processes converge on the same response (e.g., choosing between 1/10 and 11/100). This pattern is consistent with parallel dualprocess models, which assume that there is effective, rather than lax, monitoring of the output of heuristic processing. It is, however, unclear why conflict resolution sometimes fails. Ratio-biased choices may increase because of a decline in analytical reasoning (leaving heuristic-based responses unopposed) or to a rise in heuristic processing (making it more difficult for analytic processes to override the heuristic preferences). Using the process-dissociation procedure, we found that instructions to respond logically and response speed affected analytic (controlled) processing (C), leaving heuristic processing (H) unchanged, whereas the intuitive preference for large nominators (as assessed by responses to equal ratio trials) affected H but not C. These findings create new challenges to the debate between dual-process and singleprocess accounts, which are discussed.

Detection and Grading of Prostate Cancer in Temporal Enhanced Ultrasound using Convolutional Neural Networks

Prostate cancer is the most common non-dermatological cancer amongst men in the developed world. The current definitive diagnosis is core needle biopsy guided by transrectal ultrasound. However, this method suffers from low sensitivity and specificity in detecting cancer. Recently, a new ultrasound based tissue typing approach has been proposed, known as temporal enhanced ultrasound (TeUS). In this approach, a set of temporal ultrasound frames is collected from a stationary tissue location without any intentional mechanical excitation. The main aim of this thesis is to implement a deep learning-based solution for prostate cancer detection and grading using TeUS data. In the proposed solution, convolutional neural networks are trained to extract high-level features from time domain TeUS data in temporally and spatially adjacent frames in nine in vivo prostatectomy cases. This approach avoids information loss due to feature extraction and also improves cancer detection rate. The output likelihoods of two TeUS arrangements are then combined to form our novel decision support system. This deep learning-based approach results in the area under the receiver operating characteristic curve (AUC) of 0.80 and 0.73 for prostate cancer detection and grading, respectively, in leave-one-patient-out cross-validation. Recently, multi-parametric magnetic resonance imaging (mp-MRI) has been utilized to improve detection rate of aggressive prostate cancer. In this thesis, for the first time, we present the fusion of mp-MRI and TeUS for characterization of prostate cancer to compensates the deficiencies of each image modalities and improve cancer detection rate. The results obtained using TeUS are fused with those attained using consolidated mp-MRI maps from multiple MR modalities and cancer delineations on those by multiple clinicians. The proposed fusion approach yields the AUC of 0.86 in prostate cancer detection. The outcomes of this thesis emphasize the viable potential of TeUS as a tissue typing method. Employing this ultrasound-based intervention, which is non-invasive and inexpensive, can be a valuable and practical addition to enhance the current prostate cancer detection.

Factors affecting southern water vole (Arvicola sapidus) detection and occupancy probabilities in Mediterranean farmland

Failure to detect a species at sites where it is present (i.e. imperfect detection) is known to occur frequently, but this is often disregarded in monitoring programs and metapopulation studies. Here we modelled for the first time the probability of patch occupancy by a threatened small mammal, the southern water vole (Arvicola sapidus, while accounting for the probability of detection given occupancy. Based on replicated presence sign surveys conducted in autumn (November–December 2013) and winter (February–March 2014) in a farmland landscape, we used occupancy detection modelling to test the effects of vegetation, sampling effort, observer experience, and rainfall on detection probability. We then assessed whether occupancy was related to patch size, isolation, vegetation, or presence of water, after correcting for imperfect detection. The mean detection probabilities of water vole signs in autumn (0.71) and winter (0.81) indicated that false absences may be generated in about 20–30% of occupied patches surveyed by a single observer on a single occasion. There was no statistical support for the effects of covariates on detectability. After controlling for imperfect detection, the mean probabilities of occupancy in autumn (0.31) and winter (0.29) were positively related to patch size and presence of water, and negatively so, albeit weakly, to patch isolation. Overall, our study underlined the importance of accounting for imperfect detection in sign surveys of small mammals such as water voles, pointing out the need to use occupancy detection modelling together with replicate surveys for accurately estimating occupancy and the factors affecting it.

Detection and molecular characterization of Grapevine yellow speckle viroid 1 isolates infecting grapevines in Brazil.

Abstract Presently, Hop stunt viroid(HSVd) and Citrus exocortis viroid (CEVd) are the only viroids reported to infect grapevines (Vitis spp.) in Brazil, among the seven viroid species already reported infecting this host in other countries. All grapevine viroid diseases are graft-transmissible and can induce losses especiallywhenassociatedwithviruses.Theaimofthisworkwas to confirm infection by Grapevine yellow speckle viroid 1(GYSVd-1) in grapevine samples exhibiting yellow speckle symptoms in the leaves and in asymptomatic samples sequenced by next generation sequencing (NGS). The occurrence of this viroid in Brazil was further investigated in a second study. Total RNAs and dsRNAs were extracted from five symptomatic plants and 16 asymptomatic samples, respectively. Specific primers were used for RT-PCR and amplified DNA fragments were cloned and sequenced by the Sanger method. Eleven complete nucleotide sequences of GYSVd-1 isolates (366 ?367 nt) were obtained from NGS and from RT-PCR amplicons. Comparisons showed high identities (95.9 ?100 %) among ten isolates and an identity of 87.2 ?90.4 % with a divergent isolate (RM-BR). Phylogenetic analyses placed GYSVd-1 isolates in four clusters (types 1, 2, 3 and 4). All GYSVd-1 infections were confirmed by conventional RT-PCR and RT-qPCR using specific oligonucleo-tides and a labeled probe. This is the first report and molecular characterization of GYSVd-1 infecting grapevines in Brazil, and our survey indicates that this viroid could be widespread in the major grape producing regions of Brazil. Keywords GYSVd-1 . Incidence . Next generation sequencing. Secondary structure. Vine.

Development of machine learning methods for multi-modal biomarkers detection and integration

In medicine, innovation depends on a better knowledge of the human body mechanism, which represents a complex system of multi-scale constituents. Unraveling the complexity underneath diseases proves to be challenging. A deep understanding of the inner workings comes with dealing with many heterogeneous information. Exploring the molecular status and the organization of genes, proteins, metabolites provides insights on what is driving a disease, from aggressiveness to curability. Molecular constituents, however, are only the building blocks of the human body and cannot currently tell the whole story of diseases. This is why nowadays attention is growing towards the contemporary exploitation of multi-scale information. Holistic methods are then drawing interest to address the problem of integrating heterogeneous data. The heterogeneity may derive from the diversity across data types and from the diversity within diseases. Here, four studies conducted data integration using customly designed workflows that implement novel methods and views to tackle the heterogeneous characterization of diseases. The first study devoted to determine shared gene regulatory signatures for onco-hematology and it showed partial co-regulation across blood-related diseases. The second study focused on Acute Myeloid Leukemia and refined the unsupervised integration of genomic alterations, which turned out to better resemble clinical practice. In the third study, network integration for artherosclerosis demonstrated, as a proof of concept, the impact of network intelligibility when it comes to model heterogeneous data, which showed to accelerate the identification of new potential pharmaceutical targets. Lastly, the fourth study introduced a new method to integrate multiple data types in a unique latent heterogeneous-representation that facilitated the selection of important data types to predict the tumour stage of invasive ductal carcinoma. The results of these four studies laid the groundwork to ease the detection of new biomarkers ultimately beneficial to medical practice and to the ever-growing field of Personalized Medicine.

AGV Safety Areas Obstacle Detection and Interaction with Point Cloud Derived Map

This thesis project aims to the development of an algorithm for the obstacle detection and the interaction between the safety areas of an Automated Guided Vehicles (AGV) and a Point Cloud derived map inside the context of a CAD software. The first part of the project focuses on the implementation of an algorithm for the clipping of general polygons, with which has been possible to: construct the safety areas polygon, derive the sweep of this areas along the navigation path performing a union and detect the intersections with line or polygon representing the obstacles. The second part is about the construction of a map in terms of geometric entities (lines and polygons) starting from a point cloud given by the 3D scan of the environment. The point cloud is processed using: filters, clustering algorithms and concave/convex hull derived algorithms in order to extract line and polygon entities representing obstacles. Finally, the last part aims to use the a priori knowledge of possible obstacle detections on a given segment, to predict the behavior of the AGV and use this prediction to optimize the choice of the vehicle's assigned velocity in that segment, minimizing the travel time.

Deteção e acompanhamento de movimento através de uma câmara de vídeo

A deteção e seguimento de pessoas tem uma grande variedade de aplicações em visão computacional. Embora tenha sido alvo de anos de investigação, continua a ser um tópico em aberto, e ainda hoje, um grande desafio a obtenção de uma abordagem que inclua simultaneamente exibilidade e precisão. O trabalho apresentado nesta dissertação desenvolve um caso de estudo sobre deteção e seguimento automático de faces humanas, em ambiente de sala de reuniões, concretizado num sistema flexível de baixo custo. O sistema proposto é baseado no sistema operativo GNU's Not Unix (GNU) linux, e é dividido em quatro etapas, a aquisição de vídeo, a deteção da face, o tracking e reorientação da posição da câmara. A aquisição consiste na captura de frames de vídeo das três câmaras Internet Protocol (IP) Sony SNC-RZ25P, instaladas na sala, através de uma rede Local Area Network (LAN) também ele já existente. Esta etapa fornece os frames de vídeo para processamento à detecção e tracking. A deteção usa o algoritmo proposto por Viola e Jones, para a identificação de objetos, baseando-se nas suas principais características, que permite efetuar a deteção de qualquer tipo de objeto (neste caso faces humanas) de uma forma genérica e em tempo real. As saídas da deteção, quando é identificado com sucesso uma face, são as coordenadas do posicionamento da face, no frame de vídeo. As coordenadas da face detetada são usadas pelo algoritmo de tracking, para a partir desse ponto seguir a face pelos frames de vídeo subsequentes. A etapa de tracking implementa o algoritmo Continuously Adaptive Mean-SHIFT (Camshift) que baseia o seu funcionamento na pesquisa num mapa de densidade de probabilidade, do seu valor máximo, através de iterações sucessivas. O retorno do algoritmo são as coordenadas da posição e orientação da face. Estas coordenadas permitem orientar o posicionamento da câmara de forma que a face esteja sempre o mais próximo possível do centro do campo de visão da câmara. Os resultados obtidos mostraram que o sistema de tracking proposto é capaz de reconhecer e seguir faces em movimento em sequências de frames de vídeo, mostrando adequabilidade para aplicação de monotorização em tempo real.

People counting system using existing surveillance video camera

The Casa da Música Foundation, responsible for the management of Casa da Música do Porto building, has the need to obtain statistical data related to the number of building’s visitors. This information is a valuable tool for the elaboration of periodical reports concerning the success of this cultural institution. For this reason it was necessary to develop a system capable of returning the number of visitors for a requested period of time. This represents a complex task due to the building’s unique architectural design, characterized by very large doors and halls, and the sudden large number of people that pass through them in moments preceding and proceeding the different activities occurring in the building. To achieve the technical solution for this challenge, several image processing methods, for people detection with still cameras, were first studied. The next step was the development of a real time algorithm, using OpenCV libraries and computer vision concepts,to count individuals with the desired accuracy. This algorithm includes the scientific and technical knowledge acquired in the study of the previous methods. The themes developed in this thesis comprise the fields of background maintenance, shadow and highlight detection, and blob detection and tracking. A graphical interface was also built, to help on the development, test and tunning of the proposed system, as a complement to the work. Furthermore, tests to the system were also performed, to certify the proposed techniques against a set of limited circumstances. The results obtained revealed that the algorithm was successfully applied to count the number of people in complex environments with reliable accuracy.

Vision-based localization of an underwater robot in a structured environment

This paper presents a vision-based localization approach for an underwater robot in a structured environment. The system is based on a coded pattern placed on the bottom of a water tank and an onboard down looking camera. Main features are, absolute and map-based localization, landmark detection and tracking, and real-time computation (12.5 Hz). The proposed system provides three-dimensional position and orientation of the vehicle along with its velocity. Accuracy of the drift-free estimates is very high, allowing them to be used as feedback measures of a velocity-based low-level controller. The paper details the localization algorithm, by showing some graphical results, and the accuracy of the system