Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

Generic system for human-computer gesture interaction

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for humancomputer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of vision-based interaction systems can be the same for all applications and thus facilitate the implementation. In order to test the proposed solutions, three prototypes were implemented. For hand posture recognition, a SVM model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications.

Dynamic group formation in mobile computer supported collaborative learning environment

Forming suitable learning groups is one of the factors that determine the efficiency of collaborative learning activities. However, only a few studies were carried out to address this problem in the mobile learning environments. In this paper, we propose a new approach for an automatic, customized, and dynamic group formation in Mobile Computer Supported Collaborative Learning (MCSCL) contexts. The proposed solution is based on the combination of three types of grouping criteria: learner’s personal characteristics, learner’s behaviours, and context information. The instructors can freely select the type, the number, and the weight of grouping criteria, together with other settings such as the number, the size, and the type of learning groups (homogeneous or heterogeneous). Apart from a grouping mechanism, the proposed approach represents a flexible tool to control each learner, and to manage the learning processes from the beginning to the end of collaborative learning activities. In order to evaluate the quality of the implemented group formation algorithm, we compare its Average Intra-cluster Distance (AID) with the one of a random group formation method. The results show a higher effectiveness of the proposed algorithm in forming homogenous and heterogeneous groups compared to the random method.

Companies' OHS internal structures: Types and theoretical foundations

An organization manages to regulate, standardize and optimize its operations in a way that places health and safety first by considering Health, Safety, Environment and Ergonomics (HSEE). In order to provide a theoretical foundation for Companies’ Occupational Health and Safety Internal Structures (COHSIS) allowing the focus on safety, COHSIS and its fundamentals were reviewed and described based on a brief literature review, which have included both papers published in journals, as well as works made available by selected organizations with mature safety culture. Three COHSIS were defined for description of its fundamentals, enabling improve the usability of its terminologies and provide the mentioned theoretical foundation.

Ergonomic evaluation of office workplaces with Rapid Office Strain Assessment (ROSA)

The regular use of the computer in the office contributed to the appearance of many risk factors related with work-related musculoskeletal disorders (WRMSD) such as maintaining static sitting postures for long time and awkward postures of the head, neck and upper limbs, leading to increased muscle activity in the cervical spine and shoulders. The objective of this study was to evaluate the presence of risk factors for WRMSD in an office using the Rapid Assessment Office Strain method (ROSA). Based on the results of this ergonomic evaluation, an occupational gym program was designed and implemented. Thirty-eight workplaces were evaluated using the observation of the tasks and pictures records in order to characterize those tasks in more detail. The ROSA tool was applied by an observer, who selected the appropriate score based on the worker's posture as well as the time spent in each posture. Scores were recorded for the sections of the method, specifically Chair, Monitor and Mouse and Keyboard and Telephone. The scores were recorded in a sheet developed for the method. The mean ROSA final score was 3.61 ± 0.64, for Chair section was 3.45 ± 0.55, to Monitor and Telephone section was 3.11 ± 0.61, and to Mouse and Keyboard section was 2.11 ± 0.31. The results led to understand that the analyzed tasks represent situations of risk of discomfort and, according to the methods guidelines, further research and modifications of the workplace may be necessary. It should be emphasized that these scores may not be related to the poor available equipment but with the need to optimize their use by the workers. It was noticed also that the interaction of workers with the tasks and the adopted sitting posture at the computer throughout the day have effects at a muscular level, essentially for the cervical area and shoulders. ROSA tool is an useful and easy method to assess several risk factors associated with WRMSD, also allowing the design of specific occupational gym programs.

Shear strengthening of reinforced concrete beams with SHCC-FRP panels

Tese de Doutoramento em Engenharia Civil

Da prova: na atuação policial e no âmbito da infração tributária

Relatório de atividade profissional de mestrado em Direito Judiciário

Impact performance prediction of injection-molded talc-filled polypropylene through thermomechanical environment assessment

Due to the fact that different injection molding conditions tailor the mechanical response of the thermoplastic material, such effect must be considered earlier in the product development process. The existing approaches implemented in different commercial software solutions are very limited in their capabilities to estimate the influence of processing conditions on the mechanical properties. Thus, the accuracy of predictive simulations could be improved. In this study, we demonstrate how to establish straightforward processing-impact property relationships of talc-filled injection-molded polypropylene disc-shaped parts by assessing the thermomechanical environment (TME). To investigate the relationship between impact properties and the key operative variables (flow rate, melt and mold temperature, and holding pressure), the design of experiments approach was applied to systematically vary the TME of molded samples. The TME is characterized on computer flow simulation outputsanddefined bytwo thermomechanical indices (TMI): the cooling index (CI; associated to the core features) and the thermo-stress index (TSI; related to the skin features). The TMI methodology coupled to an integrated simulation program has been developed as a tool to predict the impact response. The dynamic impact properties (peak force, peak energy, and puncture energy) were evaluated using instrumented falling weight impact tests and were all found to be similarly affected by the imposed TME. The most important molding parameters affecting the impact properties were found to be the processing temperatures (melt andmold). CI revealed greater importance for the impact response than TSI. The developed integrative tool provided truthful predictions for the envisaged impact properties.

Hand gesture recognition system based in computer vision and machine learning: Applications on human-machine interaction

Tese de Doutoramento em Engenharia de Eletrónica e de Computadores

BiYacc: Roll your parser and reflective printer into one

In: A. Cunha, E. Kindler (eds.): Proceedings of the Fourth International Workshop on Bidirectional Transformations (Bx 2015), L’Aquila, Italy, July 24, 2015, published at http://ceur-ws.org

A study of risk-aware program transformation

In the trend towards tolerating hardware unreliability, accuracy is exchanged for cost savings. Running on less reliable machines, functionally correct code becomes risky and one needs to know how risk propagates so as to mitigate it. Risk estimation, however, seems to live outside the average programmer’s technical competence and core practice. In this paper we propose that program design by source-to-source transformation be risk-aware in the sense of making probabilistic faults visible and supporting equational reasoning on the probabilistic behaviour of programs caused by faults. This reasoning is carried out in a linear algebra extension to the standard, `a la Bird-Moor algebra of programming. This paper studies, in particular, the propagation of faults across standard program transformation techniques known as tupling and fusion, enabling the fault of the whole to be expressed in terms of the faults of its parts.

From software extensions to product lines of dataflow programs

Abstract Dataflow programs are widely used. Each program is a directed graph where nodes are computations and edges indicate the flow of data. In prior work, we reverse-engineered legacy dataflow programs by deriving their optimized implementations from a simple specification graph using graph transformations called refinements and optimizations. In MDE-speak, our derivations were PIM-to-PSM mappings. In this paper, we show how extensions complement refinements, optimizations, and PIM-to-PSM derivations to make the process of reverse engineering complex legacy dataflow programs tractable. We explain how optional functionality in transformations can be encoded, thereby enabling us to encode product lines of transformations as well as product lines of dataflow programs. We describe the implementation of extensions in the ReFlO tool and present two non-trivial case studies as evidence of our work’s generality

Metaphorisms in programming

This paper introduces the metaphorism pattern of relational specification and addresses how specification following this pattern can be refined into recursive programs. Metaphorisms express input-output relationships which preserve relevant information while at the same time some intended optimization takes place. Text processing, sorting, representation changers, etc., are examples of metaphorisms. The kind of metaphorism refinement proposed in this paper is a strategy known as change of virtual data structure. It gives sufficient conditions for such implementations to be calculated using relation algebra and illustrates the strategy with the derivation of quicksort as example.

Digital literacy, technology and social inclusion: making sense of one-to-one computer programmes around the world

This book was produced in the scope of a research project entitled “Navigating with ‘Magalhães’: Study on the Impact of Digital Media in Schoolchildren”. This study was conducted between May 2010 and May 2013 at the Communication and Society Research Centre, University of Minho, Portugal and it was funded by the Portuguese Foundation for Science and Technology (PTDC/CCI-COM/101381/2008).