Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

Generic system for human-computer gesture interaction

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for humancomputer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of vision-based interaction systems can be the same for all applications and thus facilitate the implementation. In order to test the proposed solutions, three prototypes were implemented. For hand posture recognition, a SVM model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications.

Dynamic group formation in mobile computer supported collaborative learning environment

Forming suitable learning groups is one of the factors that determine the efficiency of collaborative learning activities. However, only a few studies were carried out to address this problem in the mobile learning environments. In this paper, we propose a new approach for an automatic, customized, and dynamic group formation in Mobile Computer Supported Collaborative Learning (MCSCL) contexts. The proposed solution is based on the combination of three types of grouping criteria: learner’s personal characteristics, learner’s behaviours, and context information. The instructors can freely select the type, the number, and the weight of grouping criteria, together with other settings such as the number, the size, and the type of learning groups (homogeneous or heterogeneous). Apart from a grouping mechanism, the proposed approach represents a flexible tool to control each learner, and to manage the learning processes from the beginning to the end of collaborative learning activities. In order to evaluate the quality of the implemented group formation algorithm, we compare its Average Intra-cluster Distance (AID) with the one of a random group formation method. The results show a higher effectiveness of the proposed algorithm in forming homogenous and heterogeneous groups compared to the random method.

Aplicação do Building Information Modeling na gestão de projetos de construção

Dissertação de mestrado em Construção e Reabilitação Sustentáveis

Modeling microbes: New methods for integrated metabolic and regulatory network reconstruction

PhD Thesis in Bioengineering

A relational algebra approach to ETL modeling

The MAP-i Doctoral Programme in Informatics, of the Universities of Minho, Aveiro and Porto

High strain rate constitutive modeling forhistorical structures subjected to blast loading

Doctoral Thesis Civil Engineering

Fused deposition modeling with polypropylene

This paper addresses the potential of polypropylene (PP) as a candidate for fused deposition modeling (FDM)-based 3D printing technique. The entire filament production chain is evaluated, starting with the PP pellets, filament production by extrusion and test samples printing. This strategy enables a true comparison between parts printed with parts manufactured by compression molding, using the same grade of raw material. Printed samples were mechanically characterized and the influence of filament orientation, layer thickness, infill degree and material was assessed. Regarding the latter, two grades of PP were evaluated: a glass-fiber reinforced and a neat, non-reinforced, one. The results showed the potential of the FDM to compete with conventional techniques, especially for the production of small series of parts/components; also, it was showed that this technique allows the production of parts with adequate mechanical performance and, therefore, does not need to be restricted to the production of mockups and prototypes.

[Editorial] Current challenges in modeling cellular metabolism

The authors would like to thank the financial support from the NovoNordiskFoundation.

Modeling separator membranes physical characteristics for optimized lithium ion battery performance

The effect of varying separator membrane physical parameters such as degree of porosity, tortuosity and thickness, on battery delivered capacity was studied in order to optimize performance of lithium-ion batteries. This was achieved by a theoretical mathematical model relating the Bruggeman coefficient with the degree of porosity and tortuosity. The inclusion of the separator membrane in the simulation model of the battery system does not affect the delivered capacity of the battery. The ionic conductivity of the separator and consequently the delivered capacity values obtained at different discharge rates depends on the value of the Bruggeman coefficient, which is related with the degree of porosity and tortuosity of the membrane. Independently of scan rate, the optimal value of the degree of porosity is above 50% and the separator thickness should range between 1 μm at 32 μm for improved battery performance.

Population Dynamics Modeling of Arapaima gigas

Pirarucu (Arapaima gigas) has been of the most important natural fishing resources of the Amazon region. Due to its economic importance, and the necessity to preserve the species hand, field research concerning the habits and behavior of the pirarucu has been increasing for the last 20 years. The aim of this paper is to present a mathematical model for the pirarucu population dynamics considering the species peculiarities, particularly the male parental care over the offspring. The solution of the dynamical systems indicates three possible equilibrium points for the population. The first corresponds to extinction; the third corresponds to a stable population close to the environmental carrying capacity. The second corresponds to an unstable equilibrium located between extinction and full use of the carrying capacity. It is shown that lack of males’ parental care closes the gap between the point corresponding to the unstable equilibrium and the point of stable non-trivial equilibrium. If guarding failure reaches a critical point the two points coincide and the population tends irreversibly to extinction. If some event tends to destabilize the population equilibrium, as for instance inadequate parental care, the model responds in such a way as to restore the trajectory towards the stable equilibrium point avoiding the route to extinction. The parameters introduced to solve the system of equations are partially derived from limited but reliable field data collected at the Mamirauá Sustainable Development Reserve (MSDR) in the Brazilian Amazonian Region.

Numerical modeling and assessment of the thermal environment in an industrial premise of automotive components

Dissertação de mestrado em Engenharia Industrial

An interactive web-based tool for breast reduction surgery simulation

In this work, we present a 3D web-based interactive tool for numerical modeling and simulation approach to breast reduction surgery simulation, to assist surgeons in planning all aspects related to breast reduction surgery before the actual procedure takes place, thereby avoiding unnecessary risks. In particular, it allows the modeling of the initial breast geometry, the definition of all aspects related to the surgery and the visualization of the post-surgery breast shape in a realistic environment.

Influence of the hip joint modeling approaches on the kinematics of human gait

The influence of the hip joint formulation on the kinematic response of the model of human gait is investigated throughout this work. To accomplish this goal, the fundamental issues of the modeling process of a planar hip joint under the framework of multibody systems are revisited. In particular, the formulations for the ideal, dry, and lubricated revolute joints are described and utilized for the interaction of femur head inside acetabulum or the hip bone. In this process, the main kinematic and dynamic aspects of hip joints are analyzed. In a simple manner, the forces that are generated during human gait, for both dry and lubricated hip joint models, are computed in terms of the system’s state variables and subsequently introduced into the dynamics equations of motion of the multibody system as external generalized forces. Moreover, a human multibody model is considered, which incorporates the different approaches for the hip articulation, namely ideal joint, dry, and lubricated models. Finally, several computational simulations based on different approaches are performed, and the main results presented and compared to identify differences among the methodologies and procedures adopted in this work. The input conditions to the models correspond to the experimental data capture from an adult male during normal gait. In general, the obtained results in terms of positions do not differ significantly when the different hip joint models are considered. In sharp contrast, the velocity and acceleration plotted vary significantly. The effect of the hip joint modeling approach is clearly measurable and visible in terms of peaks and oscillations of the velocities and accelerations. In general, with the dry hip model, intra-joint force peaks can be observed, which can be associated with the multiple impacts between the femur head and the cup. In turn, when the lubricant is present, the system’s response tends to be smoother due to the damping effects of the synovial fluid.