Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

Development of an intelligent bio-based packaging system

[Extrat] Currently there is a growing interest in the development of eco-efficient bio-based packaging, being active, smart and intelligent packaging the most highlighted among various innovations. Intelligent packaging has the ability to detect and mark, in real time, changes that might occur within the package/in the food product. Their main purpose is to help the consumer decide whether to buy a certain food product, ensuring that when it is bought it has not suffered significant changes influencing its quality and safety. (...)

Using balanced scorecards to evaluate the data warehouse system utility

Dissertação de mestrado em Systems Engineering

Hand gesture recognition system based in computer vision and machine learning: Applications on human-machine interaction

Tese de Doutoramento em Engenharia de Eletrónica e de Computadores

A novel hanging spherical drop system for the generation of cellular spheroids and high throughput combinatorial drug screening

We propose a novel hanging spherical drop system for anchoring arrays of droplets of cell suspension based on the use of biomimetic superhydrophobic flat substrates, with controlled positional adhesion and minimum contact with a solid substrate. By facing down the platform, it was possible to generate independent spheroid bodies in a high throughput manner, in order to mimic in vivo tumour models on the lab-on-chip scale. To validate this system for drug screening purposes, the toxicity of the anti-cancer drug doxorubicin in cell spheroids was tested and compared to cells in 2D culture. The advantages presented by this platform, such as feasibility of the system and the ability to control the size uniformity of the spheroid, emphasize its potential to be used as a new low cost toolbox for high-throughput drug screening and in cell or tissue engineering.

A clinical recommendation system to maternity care

Nowadays in healthcare, the Clinical Decision Support Systems are used in order to help health professionals to take an evidence-based decision. An example is the Clinical Recommendation Systems. In this sense, it was developed and implemented in Centro Hospitalar do Porto a pre-triage system in order to group the patients on two levels (urgent or outpatient). However, although this system is calibrated and specific to the urgency of obstetrics and gynaecology, it does not meet all clinical requirements by the general department of the Portuguese HealthCare (Direção Geral de Saúde). The main requirement is the need of having priority triage system characterized by five levels. Thus some studies have been conducted with the aim of presenting a methodology able to evolve the pre-triage system on a Clinical Recommendation System with five levels. After some tests (using data mining and simulation techniques), it has been validated the possibility of transformation the pre-triage system in a Clinical Recommendation System in the obstetric context. This paper presents an overview of the Clinical Recommendation System for obstetric triage, the model developed and the main results achieved.