Hand gesture recognition for human computer interaction : a comparative study of different image features

Hand gesture recognition for human computer interaction, being a natural way of human computer interaction, is an area of active research in computer vision and machine learning. This is an area with many different possible applications, giving users a simpler and more natural way to communicate with robots/systems interfaces, without the need for extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them to convey information or for device control. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. In this study we try to identify hand features that, isolated, respond better in various situations in human-computer interaction. The extracted features are used to train a set of classifiers with the help of RapidMiner in order to find the best learner. A dataset with our own gesture vocabulary consisted of 10 gestures, recorded from 20 users was created for later processing. Experimental results show that the radial signature and the centroid distance are the features that when used separately obtain better results, with an accuracy of 91% and 90,1% respectively obtained with a Neural Network classifier. These to methods have also the advantage of being simple in terms of computational complexity, which make them good candidates for real-time hand gesture recognition.

Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

Enrollment time as a requirement for biometric hand recognition systems

Biometric systems are increasingly being used as a means for authentication to provide system security in modern technologies. The performance of a biometric system depends on the accuracy, the processing speed, the template size, and the time necessary for enrollment. While much research has focused on the first three factors, enrollment time has not received as much attention. In this work, we present the findings of our research focused upon studying user’s behavior when enrolling in a biometric system. Specifically, we collected information about the user’s availability for enrollment in respect to the hand recognition systems (e.g., hand geometry, palm geometry or any other requiring positioning the hand on an optical scanner). A sample of 19 participants, chosen randomly apart their age, gender, profession and nationality, were used as test subjects in an experiment to study the patience of users enrolling in a biometric hand recognition system.

Nonlinear optimization for human-like synchronous movements of a dual arm-hand robotic system

In previous work we have presented a model capable of generating human-like movements for a dual arm-hand robot involved in human-robot cooperative tasks. However, the focus was on the generation of reach-to-grasp and reach-to-regrasp bimanual movements and no synchrony in timing was taken into account. In this paper we extend the previous model in order to accomplish bimanual manipulation tasks by synchronously moving both arms and hands of an anthropomorphic robotic system. Specifically, the new extended model has been designed for two different tasks with different degrees of difficulty. Numerical results were obtained by the implementation of the IPOPT solver embedded in our MATLAB simulator.

Hand gesture recognition system based in computer vision and machine learning: Applications on human-machine interaction

Tese de Doutoramento em Engenharia de Eletrónica e de Computadores

Tradução e adaptação transcultural do Michigan Hand Outcomes Questionnaire

INTRODUÇÃO: Atualmente há um aumento crescente no número de diagnósticos de artrite reumatoide, seja graças à evolução dos métodos diagnósticos ou a intensas pesquisas realizadas na área de reumatologia, porém há uma lacuna quanto a instrumentos de medidas para acompanhamento no campo físico e psíquico da evolução dessa doença, que pode causar limitações físicas graves com o seu avanço, além do comprometimento de diversos aspectos da qualidade de vida. OBJETIVO: Este estudo tem como objetivo desenvolver a versão em português brasileiro do Michigan Hand Outcomes Questionnaire, um instrumento de avaliação e monitoramento do estado de saúde em pacientes com transtornos e doenças que incapacitam as atividades cotidianas realizadas pelas suas mãos. MÉTODOS: Foram realizadas duas traduções e retrotraduções por avaliadores independentes e cegos quanto ao instrumento original, seguidas de composição de uma versão sintética, testada experimentalmente em um grupo de sujeitos da população geral e também pacientes com diagnóstico de artrite. RESULTADOS: São apresentadas todas as fases do processo. A participação de tradutores especialistas em saúde mental, reumatologia e ortopedia favoreceu a adequação dos termos utilizados ao construto mensurado. A aplicação experimental evidenciou a correta compreensão de todos os itens, quanto ao seu significado, por todos os respondentes. CONCLUSÃO: Elaborada a versão em português brasileiro da Michigan Hand Outcomes Questionnaire.

Hand gesture spotting and recognition using HMMs and CRFs in color image sequences

Magdeburg, Univ., Fak. für Elektrotechnik und Informationstechnik, Diss., 2010

Static and dynamic interpretations of hand specific body language cues for HCI

Otto-von-Guericke-Universität Magdeburg, Fakultät für Elektrotechnik und Informationstechnik, Univ., Dissertation, 2015

Non-assisted versus neuro-navigated and XperCT-guided external ventricular catheter placement: a comparative cadaver study.

BACKGROUND AND PURPOSE: Accurate placement of an external ventricular drain (EVD) for the treatment of hydrocephalus is of paramount importance for its functionality and in order to minimize morbidity and complications. The aim of this study was to compare two different drain insertion assistance tools with the traditional free-hand anatomical landmark method, and to measure efficacy, safety and precision. METHODS: Ten cadaver heads were prepared by opening large bone windows centered on Kocher's points on both sides. Nineteen physicians, divided in two groups (trainees and board certified neurosurgeons) performed EVD insertions. The target for the ventricular drain tip was the ipsilateral foramen of Monro. Each participant inserted the external ventricular catheter in three different ways: 1) free-hand by anatomical landmarks, 2) neuronavigation-assisted (NN), and 3) XperCT-guided (XCT). The number of ventricular hits and dangerous trajectories; time to proceed; radiation exposure of patients and physicians; distance of the catheter tip to target and size of deviations projected in the orthogonal plans were measured and compared. RESULTS: Insertion using XCT increased the probability of ventricular puncture from 69.2 to 90.2 % (p = 0.02). Non-assisted placements were significantly less precise (catheter tip to target distance 14.3 ± 7.4 mm versus 9.6 ± 7.2 mm, p = 0.0003). The insertion time to proceed increased from 3.04 ± 2.06 min. to 7.3 ± 3.6 min. (p < 0.001). The X-ray exposure for XCT was 32.23 mSv, but could be reduced to 13.9 mSv if patients were initially imaged in the hybrid-operating suite. No supplementary radiation exposure is needed for NN if patients are imaged according to a navigation protocol initially. CONCLUSION: This ex vivo study demonstrates a significantly improved accuracy and safety using either NN or XCT-assisted methods. Therefore, efforts should be undertaken to implement these new technologies into daily clinical practice. However, the accuracy versus urgency of an EVD placement has to be balanced, as the image-guided insertion technique will implicate a longer preparation time due to a specific image acquisition and trajectory planning.

Hand exposure in diagnostic nuclear medicine with 18F- and 99mTc-labelled radiopharmaceuticals - Results of the ORAMED project

Workers performing preparation and administration of radiopharmaceuticals in NM departments are likely to receive high local skin doses to the hands which may even surpass the dose limit of 500 mSv whenever radiation protection standards are insufficient. A large measurement campaign was organised within the framework of the ORAMED project to determine the dose distribution across the hands received during preparation and administration of 18F- and 99mTc-labelled radiopharmaceuticals. The final data, collected over almost 3 years, include 641 measurements from 96 workers in 30 NM departments from 6 European countries. Results have provided levels of reference doses for the considered standard NM diagnostic procedures (mean maximum normalised skin dose of 230 μSv/GBq, 430 μSv/GBq, 930 μSv/GBq and 1200 μSv/GBq for the administration of 99mTc, preparation of 99mTc, administration of 18F and preparation of 18F, respectively). Finger dose was analysed as a function of the potential parameters of influence showing that shielding is the most efficient means of radiation protection to reduce skin dose. An appropriate method for routine monitoring of the extremities is also proposed: the base of the index finger of the non-dominant hand is a suitable position to place the ring dosemeter, with its sensitive part oriented towards the palm side; its reading may be multiplied by a factor of 6 to estimate the maximum local skin dose. Finally, results were compared to earlier published data, which correspond mostly to individual works with a reduced number of workers and measurements.

Effects of unilateral motor cortex lesion on ipsilesional hand's reach and grasp performance in monkeys: relationship with recovery in the contralesional hand.

Manual dexterity, a prerogative of primates, is under the control of the corticospinal (CS) tract. Because 90-95% of CS axons decussate, it is assumed that this control is exerted essentially on the contralateral hand. Consistently, unilateral lesion of the hand representation in the motor cortex is followed by a complete loss of dexterity of the contralesional hand. During the months following lesion, spontaneous recovery of manual dexterity takes place to a highly variable extent across subjects, although largely incomplete. In the present study, we tested the hypothesis that after a significant postlesion period, manual performance in the ipsilesional hand is correlated with the extent of functional recovery in the contralesional hand. To this aim, ten adult macaque monkeys were subjected to permanent unilateral motor cortex lesion. Monkeys' manual performance was assessed for each hand during several months postlesion, using our standard behavioral test (modified Brinkman board task) that provides a quantitative measure of reach and grasp ability. The ipsilesional hand's performance was found to be significantly enhanced over the long term (100-300 days postlesion) in six of ten monkeys, with the six exhibiting the best, though incomplete, recovery of the contralesional hand. There was a statistically significant correlation (r = 0.932; P < 0.001) between performance in the ipsilesional hand after significant postlesion period and the extent of recovery of the contralesional hand. This observation is interpreted in terms of different possible mechanisms of recovery, dependent on the recruitment of motor areas in the lesioned and/or intact hemispheres.