Hand gesture recognition for human computer interaction : a comparative study of different image features

Hand gesture recognition for human computer interaction, being a natural way of human computer interaction, is an area of active research in computer vision and machine learning. This is an area with many different possible applications, giving users a simpler and more natural way to communicate with robots/systems interfaces, without the need for extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them to convey information or for device control. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. In this study we try to identify hand features that, isolated, respond better in various situations in human-computer interaction. The extracted features are used to train a set of classifiers with the help of RapidMiner in order to find the best learner. A dataset with our own gesture vocabulary consisted of 10 gestures, recorded from 20 users was created for later processing. Experimental results show that the radial signature and the centroid distance are the features that when used separately obtain better results, with an accuracy of 91% and 90,1% respectively obtained with a Neural Network classifier. These to methods have also the advantage of being simple in terms of computational complexity, which make them good candidates for real-time hand gesture recognition.

Quantitative image analysis as a tool for Yarrowia lipolytica dimorphic growth evaluation in different culture media

Yarrowia lipolytica, a yeast strain with a huge biotechnological potential, capable to produce metabolites such as γ-decalactone, citric acid, intracellular lipids and enzymes, possesses the ability to change its morphology in response to environmental conditions. In the present study, a quantitative image analysis (QIA) procedure was developed for the identification and quantification of Y. lipolytica W29 and MTLY40-2P strains dimorphic growth, cultivated in batch cultures on hydrophilic (glucose and N-acetylglucosamine (GlcNAc) and hydrophobic (olive oil and castor oil) media. The morphological characterization of yeast cells by QIA techniques revealed that hydrophobic carbon sources, namely castor oil, should be preferred for both strains growth in the yeast single cell morphotype. On the other hand, hydrophilic sugars, namely glucose and GlcNAc caused a dimorphic transition growth towards the hyphae morphotype. Experiments for γ-decalactone production with MTLY40-2P strain in two distinct morphotypes (yeast single cells and hyphae cells) were also performed. The obtained results showed the adequacy of the proposed morphology monitoring tool in relation to each morphotype on the aroma production ability. The present work allowed establishing that QIA techniques can be a valuable tool for the identification of the best culture conditions for industrial processes implementation.

Measuring end-to-end delay in real-time auralisation systems

One of the major challenges in the development of an immersive system is handling the delay between the tracking of the user’s head position and the updated projection of a 3D image or auralised sound, also called end-to-end delay. Excessive end-to-end delay can result in the general decrement of the “feeling of presence”, the occurrence of motion sickness and poor performance in perception-action tasks. These latencies must be known in order to provide insights on the technological (hardware/software optimization) or psychophysical (recalibration sessions) strategies to deal with them. Our goal was to develop a new measurement method of end-to-end delay that is both precise and easily replicated. We used a Head and Torso simulator (HATS) as an auditory signal sensor, a fast response photo-sensor to detect a visual stimulus response from a Motion Capture System, and a voltage input trigger as real-time event. The HATS was mounted in a turntable which allowed us to precisely change the 3D sound relative to the head position. When the virtual sound source was at 90º azimuth, the correspondent HRTF would set all the intensity values to zero, at the same time a trigger would register the real-time event of turning the HATS 90º azimuth. Furthermore, with the HATS turned 90º to the left, the motion capture marker visualization would fell exactly in the photo-sensor receptor. This method allowed us to precisely measure the delay from tracking to displaying. Moreover, our results show that the method of tracking, its tracking frequency, and the rendering of the sound reflections are the main predictors of end-to-end delay.

Ag-TiNx electrodes deposited on piezoelectric poly(vinylidene fluoride) for biomedical sensor applications

Electroactive polymers are one of the most interesting class of polymers used as smart materials in various applications, such as the development of sensors and actuators for biomedical applications in areas such as smart prosthesis, implantable biosensors and biomechanical signal monitoring, among others. For acquiring or applying the electrical signal from/to the piezoelectric material, suitable electrodes can be produced from Ti based coatings with tailored multifunctional properties, conductivity and antibacterial characteristics, through Ag inclusions. This work reports on Ag-TiNx electrodes, deposited by d. c. and pulsed magnetron sputtering at room temperature on poly(vinylidene fluoride), PVDF, the all-round best piezoelectric polymer.. Composition of the electrodes was assessed by microanalysis X-ray system (EDS - energy dispersive spectrometer). The XRD results revealed that the deposition conditions preserve the polymer structure and suggested the presence of crystalline fcc-TiN phase and fcc-Ag phase in samples with N2 flow above 3 sccm. According to the results obtained from SEM analysis, the coatings are homogeneous and Ag clusters were found for samples with nitrogen flow above 3 sccm. With increasing nitrogen flow, the sheet resistivity tend to be lower than the samples without nitrogen, leading also to a decrease of the piezoelectric response. It is concluded that the deposition conditions do significantly affect the piezoelectric polymer, which maintain its characteristics for sensor/actuator applications.

A hybrid MAC Scheme to improve the transmission performance in body sensor networks

Wireless body sensor networks (WBSNs) constitute a key technology for closing the loop between patients and healthcare providers, as WBSNs provide sensing ability, as well as mobility and portability, essential characteristics for wide acceptance of wireless healthcare technology. However, one important and difficult aspect of WBSNs is to provide data transmissions with quality of service, among other factors due to the antennas being small size and placed close to the body. Such transmissions cannot be fully provided without the assumption of a MAC protocol that solves the problems of the medium sharing. A vast number of MAC protocols conceived for wireless networks are based on random or scheduled schemes. This paper studies firstly the suitability of two MAC protocols, one using CSMA and the other TDMA, to transmit directly to the base station the signals collected continuously from multiple sensor nodes placed on the human body. Tests in a real scenario show that the beaconed TDMA MAC protocol presents an average packet loss ratio lower than CSMA. However, the average packet loss ratio is above 1.0 %. To improve this performance, which is of vital importance in areas such as e-health and ambient assisted living, a hybrid TDMA/CSMA scheme is proposed and tested in a real scenario with two WBSNs and four sensor nodes per WBSN. An average packet loss ratio lower than 0.2 % was obtained with the hybrid scheme. To achieve this significant improvement, the hybrid scheme uses a lightweight algorithm to control dynamically the start of the superframes. Scalability and traffic rate variation tests show that this strategy allows approximately ten WBSNs operating simultaneously without significant performance degradation.

Sistema de visão robótico baseado no sensor kinect para orientação no espaço e contorno de obstáculos

Dissertação de mestrado em Engenharia Eletrónica Industrial e Computadores (área de especialização em Robótica)

Implementação de um sistema MPPT em circuito integrado CMOS

Dissertação de mestrado integrado em Engenharia Eletrónica Industrial e Computadores

Optimization of magnetoelectric composites based on electroactive polymers for energy harvesting and sensor application

Tese de Doutoramento em Engenharia de Materiais.

Development of a novel aptamer-based multi-sensor device for the detection of osteopontin

Doctoral Dissertation for PhD degree in Chemical and Biological Engineering