First-principle data-driven models for assessment of motor disorders in Parkinson’s disease

Parkinson’s disease (PD) is an increasing neurological disorder in an aging society. The motor and non-motor symptoms of PD advance with the disease progression and occur in varying frequency and duration. In order to affirm the full extent of a patient’s condition, repeated assessments are necessary to adjust medical prescription. In clinical studies, symptoms are assessed using the unified Parkinson’s disease rating scale (UPDRS). On one hand, the subjective rating using UPDRS relies on clinical expertise. On the other hand, it requires the physical presence of patients in clinics which implies high logistical costs. Another limitation of clinical assessment is that the observation in hospital may not accurately represent a patient’s situation at home. For such reasons, the practical frequency of tracking PD symptoms may under-represent the true time scale of PD fluctuations and may result in an overall inaccurate assessment. Current technologies for at-home PD treatment are based on data-driven approaches for which the interpretation and reproduction of results are problematic.  The overall objective of this thesis is to develop and evaluate unobtrusive computer methods for enabling remote monitoring of patients with PD. It investigates first-principle data-driven model based novel signal and image processing techniques for extraction of clinically useful information from audio recordings of speech (in texts read aloud) and video recordings of gait and finger-tapping motor examinations. The aim is to map between PD symptoms severities estimated using novel computer methods and the clinical ratings based on UPDRS part-III (motor examination). A web-based test battery system consisting of self-assessment of symptoms and motor function tests was previously constructed for a touch screen mobile device. A comprehensive speech framework has been developed for this device to analyze text-dependent running speech by: (1) extracting novel signal features that are able to represent PD deficits in each individual component of the speech system, (2) mapping between clinical ratings and feature estimates of speech symptom severity, and (3) classifying between UPDRS part-III severity levels using speech features and statistical machine learning tools. A novel speech processing method called cepstral separation difference showed stronger ability to classify between speech symptom severities as compared to existing features of PD speech. In the case of finger tapping, the recorded videos of rapid finger tapping examination were processed using a novel computer-vision (CV) algorithm that extracts symptom information from video-based tapping signals using motion analysis of the index-finger which incorporates a face detection module for signal calibration. This algorithm was able to discriminate between UPDRS part III severity levels of finger tapping with high classification rates. Further analysis was performed on novel CV based gait features constructed using a standard human model to discriminate between a healthy gait and a Parkinsonian gait. The findings of this study suggest that the symptom severity levels in PD can be discriminated with high accuracies by involving a combination of first-principle (features) and data-driven (classification) approaches. The processing of audio and video recordings on one hand allows remote monitoring of speech, gait and finger-tapping examinations by the clinical staff. On the other hand, the first-principles approach eases the understanding of symptom estimates for clinicians. We have demonstrated that the selected features of speech, gait and finger tapping were able to discriminate between symptom severity levels, as well as, between healthy controls and PD patients with high classification rates. The findings support suitability of these methods to be used as decision support tools in the context of PD assessment.

Posicionamento e movimentação de um robô humanóide utilizando imagens de uma câmera móvel externa

This work proposes a method to localize a simple humanoid robot, without embedded sensors, using images taken from an extern camera and image processing techniques. Once the robot is localized relative to the camera, supposing we know the position of the camera relative to the world, we can compute the position of the robot relative to the world. To make the camera move in the work space, we will use another mobile robot with wheels, which has a precise locating system, and will place the camera on it. Once the humanoid is localized in the work space, we can take the necessary actions to move it. Simultaneously, we will move the camera robot, so it will take good images of the humanoid. The mainly contributions of this work are: the idea of using another mobile robot to aid the navigation of a humanoid robot without and advanced embedded electronics; chosing of the intrinsic and extrinsic calibration methods appropriated to the task, especially in the real time part; and the collaborative algorithm of simultaneous navigation of the robots

Acelerando algoritmos de baixo nível em visão robótica com hardware reconfigurável

A challenge that remains in the robotics field is how to make a robot to react in real time to visual stimulus. Traditional computer vision algorithms used to overcome this problem are still very expensive taking too long when using common computer processors. Very simple algorithms like image filtering or even mathematical morphology operations may take too long. Researchers have implemented image processing algorithms in high parallelism hardware devices in order to cut down the time spent in the algorithms processing, with good results. By using hardware implemented image processing techniques and a platform oriented system that uses the Nios II Processor we propose an approach that uses the hardware processing and event based programming to simplify the vision based systems while at the same time accelerating some parts of the used algorithms

Boundary identification criteria and geometry analysis of Al 7050 stretch zone from elevation profiles

This article describes the development of a method for analysis of the shape of the stretch zone surface based on parallax measurement theory and using digital image processing techniques. Accurate criteria for the definition of the boundaries of the stretch zone are established from profiles of fracture surfaces obtained from crack tip opening displacement tests on Al-7050 alloy samples. The elevation profiles behavior analysis is based on stretch zone width and height parameters. It is concluded that the geometry of the stretch zone profiles under plane strain conditions can be described by a semi-parabolic relationship. (C) Elsevier B.V., 1999. All rights reserved.

Sistema não-Intrusivo para Estimação da Direção do olhar utilizando redes neurais artificiais

The fundamental senses of the human body are: vision, hearing, touch, taste and smell. These senses are the functions that provide our relationship with the environment. The vision serves as a sensory receptor responsible for obtaining information from the outside world that will be sent to the brain. The gaze reflects its attention, intention and interest. Therefore, the estimation of gaze direction, using computer tools, provides a promising alternative to improve the capacity of human-computer interaction, mainly with respect to those people who suffer from motor deficiencies. Thus, the objective of this work is to present a non-intrusive system that basically uses a personal computer and a low cost webcam, combined with the use of digital image processing techniques, Wavelets transforms and pattern recognition, such as artificial neural network models, resulting in a complete system that performs since the image acquisition (including face detection and eye tracking) to the estimation of gaze direction. The obtained results show the feasibility of the proposed system, as well as several feature advantages.

Monitoramento geoambiental do estuário do Rio Paraíba do Norte - PB por meio da cartografia temática digital e de produtos de sensoriamento remoto

The North Paraíba River Estuary, located in the eastern portion of the Paraíba State, Northeast Brazil, on coordinates 34º50 00 -34º57 30 S and 6º55 00 -7º7 30 W, constitutes a fluvio-marine plain formed by the North Paraíba River and its tributaries Sanhauá, Paroeira, Mandacaru, Tiriri, Tambiá, Ribeira and Guia. This estuary comprises an area of about 260 km2. Increasing human demands on the estuary area and inadequate environment managing have generated conflicts. The present work main purpose is to evaluate the geodynamic evolution of the North Paraíba River Estuary in the period from 1969 to 2001, using digital image processing techniques, thematic digital cartography and multitemporal data integration, combined to geological-geophysical field surveys. The SUDENE cartographic database, converted to digital format were, used to obtain occupation and topographic maps from 1969 and to generate a Digital Elevation Model (DEM). Digital Landsat 7 ETM+ and Spot HRVIR-PAN satellite images interpretation allowed the environmental characterization of the estuary. The most important digital processing results were achieved color composites RGB 5-4-3, 5-3-1, 5-2-NDWI and band ratio 7/4-5/3-4/2, 5/7-3/1-5/4). In addition the fusion image technique RGBI was used by the inclusion of the Spot HRVRI and Landsat 7 ETM+ panchromatic band on I layer with RGB triplets 5-4-3, 5-3-1 and 5/7-3/1-5/4. The DEM and digital images integration allowed the identification of seven geomorphological units: coastal tableland, flowing tray, tide plain, fluvial terrace, submerged dune, beach plain and beach). Both Side Scan Sonar and Echosound were used to analyse underwater surface and bedforms of the estuarine channel, sand predominance (fine to very fine) and 2D dune features 5 m wide and 0.5 m height. This investigation characterized the estuary as an environment dominated by regimen of average flow. The channel depth varies between 1 m and 11 m, being this last quota reached in the area of Porto de Cabedelo. The chanel estuary is relatively shallow, with erosion evidences mainly on its superior portion, attested by sand banks exposed during the low tide. Multitemporal digital maps from 1969 and 2001 integration were obtained through geoprocessing techniques, resulting the geodynamic evolution of the estuary based on landuse, DEM geomorphology and bathymetric maps

Avaliação quantitativa das dimensões óculo-palpebrais em portadores de cavidade anoftálmica em uso de prótese ocular externa

OBJETIVOS: Avaliar o posicionamento palpebral em portadores de cavidade anoftálmica com e sem prótese ocular externa, utilizando o processamento de imagem digital. MÉTODOS: Dezoito pacientes foram avaliados qualitativa e quantitativamente na Faculdade de Medicina de Botucatu - Universidade Estadual Paulista - UNESP, com e sem a prótese externa. Usando imagens obtidas por filmadora e processadas usando o programa Scion Image, mediu-se a altura do sulco palpebral superior, a altura da fenda palpebral e os ângulos palpebrais dos cantos interno e externo. RESULTADOS: Pseudo-estrabismo e sulco palpebral superior profundo foram as alterações mais freqüentes ao exame externo. Houve diferença significativa em todas as variáveis estudadas, com diminuição da altura do sulco palpebral superior, aumento da área da fenda palpebral e aumento dos ângulos palpebrais interno e externo quando o paciente estava usando a prótese externa. CONCLUSÃO: Todos os pacientes avaliados apresentaram algum tipo de anormalidade órbito-palpebral, o que reflete a dificuldade em se proporcionar ao portador de cavidade anoftálmica um aspecto idêntico ao que existe na órbita normal. O processamento de imagens digitais permitiu avaliação objetiva das dimensões óculo-palpebrais, o que poderá contribuir nas avaliações seqüenciais dos portadores de cavidade anoftálmica.

Analysis of tectonic-controlled fluvial morphology and sedimentary processes of the western Amazon Basin: an approach using satellite images and digital elevation model

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Spontaneous eye blink analysis in the normal individual

Purpose: Spontaneous eye blink activity in the primary eye position and its relationship to age and gender were assessed using digital image processing techniques to quantify blink opening and closing time. Methods: One hundred-and-eighty healthy volunteers (90 males and 90 females), divided into the age groups 0-3, 4-12, 13-20, 21-40, 41-60 and ≥60 years old, were evaluated prospectively. They were videotaped digitally in a standard setting and the images were transferred to a personal computer (Macintosh 400) and processed with the iMovie software. Blink opening and closing time were measured at 30 frames/second. The data were then subjected to statistical analysis. Results: The closing time was significantly longer than the opening time for all ages and both genders. Elderly individuals (≥41 years old) and women had significantly longer closing times. Conclusion: Image processing techniques made possible the observation of differences in spontaneous eye blink opening and closing time in relation to age and gender. Copyright © 2005 Taylor & Francis LLC.

Segmentação morfológica aplicada à cartografia

Pós-graduação em Ciências Cartográficas - FCT

Técnicas de paralelização em GPGPU aplicadas em algoritmo para remoção de ruído multiplicativo

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Medidas de deslocamento e vibrações através de imagens de câmeras digitais

Pós-graduação em Engenharia Mecânica - FEIS

Processamento de fotomicrografias por meio da transformada wavelet starlet

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Análise de formas planas em imagens digitais

Given the widespread use of computers, the visual pattern recognition task has been automated in order to address the huge amount of available digital images. Many applications use image processing techniques as well as feature extraction and visual pattern recognition algorithms in order to identify people, to make the disease diagnosis process easier, to classify objects, etc. based on digital images. Among the features that can be extracted and analyzed from images is the shape of objects or regions. In some cases, shape is the unique feature that can be extracted with a relatively high accuracy from the image. In this work we present some of most important shape analysis methods and compare their performance when applied on three well-known shape image databases. Finally, we propose the development of a new shape descriptor based on the Hough Transform.

Imaging and modeling of pore scale processes in porous media using X-ray computed tomography and lattice Boltzmann solver

In der Erdöl– und Gasindustrie sind bildgebende Verfahren und Simulationen auf der Porenskala im Begriff Routineanwendungen zu werden. Ihr weiteres Potential lässt sich im Umweltbereich anwenden, wie z.B. für den Transport und Verbleib von Schadstoffen im Untergrund, die Speicherung von Kohlendioxid und dem natürlichen Abbau von Schadstoffen in Böden. Mit der Röntgen-Computertomografie (XCT) steht ein zerstörungsfreies 3D bildgebendes Verfahren zur Verfügung, das auch häufig für die Untersuchung der internen Struktur geologischer Proben herangezogen wird. Das erste Ziel dieser Dissertation war die Implementierung einer Bildverarbeitungstechnik, die die Strahlenaufhärtung der Röntgen-Computertomografie beseitigt und den Segmentierungsprozess dessen Daten vereinfacht. Das zweite Ziel dieser Arbeit untersuchte die kombinierten Effekte von Porenraumcharakteristika, Porentortuosität, sowie die Strömungssimulation und Transportmodellierung in Porenräumen mit der Gitter-Boltzmann-Methode. In einer zylindrischen geologischen Probe war die Position jeder Phase auf Grundlage der Beobachtung durch das Vorhandensein der Strahlenaufhärtung in den rekonstruierten Bildern, das eine radiale Funktion vom Probenrand zum Zentrum darstellt, extrahierbar und die unterschiedlichen Phasen ließen sich automatisch segmentieren. Weiterhin wurden Strahlungsaufhärtungeffekte von beliebig geformten Objekten durch einen Oberflächenanpassungsalgorithmus korrigiert. Die Methode der „least square support vector machine” (LSSVM) ist durch einen modularen Aufbau charakterisiert und ist sehr gut für die Erkennung und Klassifizierung von Mustern geeignet. Aus diesem Grund wurde die Methode der LSSVM als pixelbasierte Klassifikationsmethode implementiert. Dieser Algorithmus ist in der Lage komplexe geologische Proben korrekt zu klassifizieren, benötigt für den Fall aber längere Rechenzeiten, so dass mehrdimensionale Trainingsdatensätze verwendet werden müssen. Die Dynamik von den unmischbaren Phasen Luft und Wasser wird durch eine Kombination von Porenmorphologie und Gitter Boltzmann Methode für Drainage und Imbibition Prozessen in 3D Datensätzen von Böden, die durch synchrotron-basierte XCT gewonnen wurden, untersucht. Obwohl die Porenmorphologie eine einfache Methode ist Kugeln in den verfügbaren Porenraum einzupassen, kann sie dennoch die komplexe kapillare Hysterese als eine Funktion der Wassersättigung erklären. Eine Hysterese ist für den Kapillardruck und die hydraulische Leitfähigkeit beobachtet worden, welche durch die hauptsächlich verbundenen Porennetzwerke und der verfügbaren Porenraumgrößenverteilung verursacht sind. Die hydraulische Konduktivität ist eine Funktion des Wassersättigungslevels und wird mit einer makroskopischen Berechnung empirischer Modelle verglichen. Die Daten stimmen vor allem für hohe Wassersättigungen gut überein. Um die Gegenwart von Krankheitserregern im Grundwasser und Abwässern vorhersagen zu können, wurde in einem Bodenaggregat der Einfluss von Korngröße, Porengeometrie und Fluidflussgeschwindigkeit z.B. mit dem Mikroorganismus Escherichia coli studiert. Die asymmetrischen und langschweifigen Durchbruchskurven, besonders bei höheren Wassersättigungen, wurden durch dispersiven Transport aufgrund des verbundenen Porennetzwerks und durch die Heterogenität des Strömungsfeldes verursacht. Es wurde beobachtet, dass die biokolloidale Verweilzeit eine Funktion des Druckgradienten als auch der Kolloidgröße ist. Unsere Modellierungsergebnisse stimmen sehr gut mit den bereits veröffentlichten Daten überein.