Hand gesture recognition system based in computer vision and machine learning : applications on human-machine interaction

Sendo uma forma natural de interação homem-máquina, o reconhecimento de gestos implica uma forte componente de investigação em áreas como a visão por computador e a aprendizagem computacional. O reconhecimento gestual é uma área com aplicações muito diversas, fornecendo aos utilizadores uma forma mais natural e mais simples de comunicar com sistemas baseados em computador, sem a necessidade de utilização de dispositivos extras. Assim, o objectivo principal da investigação na área de reconhecimento de gestos aplicada à interacção homemmáquina é o da criação de sistemas, que possam identificar gestos específicos e usálos para transmitir informações ou para controlar dispositivos. Para isso as interfaces baseados em visão para o reconhecimento de gestos, necessitam de detectar a mão de forma rápida e robusta e de serem capazes de efetuar o reconhecimento de gestos em tempo real. Hoje em dia, os sistemas de reconhecimento de gestos baseados em visão são capazes de trabalhar com soluções específicas, construídos para resolver um determinado problema e configurados para trabalhar de uma forma particular. Este projeto de investigação estudou e implementou soluções, suficientemente genéricas, com o recurso a algoritmos de aprendizagem computacional, permitindo a sua aplicação num conjunto alargado de sistemas de interface homem-máquina, para reconhecimento de gestos em tempo real. A solução proposta, Gesture Learning Module Architecture (GeLMA), permite de forma simples definir um conjunto de comandos que pode ser baseado em gestos estáticos e dinâmicos e que pode ser facilmente integrado e configurado para ser utilizado numa série de aplicações. É um sistema de baixo custo e fácil de treinar e usar, e uma vez que é construído unicamente com bibliotecas de código. As experiências realizadas permitiram mostrar que o sistema atingiu uma precisão de 99,2% em termos de reconhecimento de gestos estáticos e uma precisão média de 93,7% em termos de reconhecimento de gestos dinâmicos. Para validar a solução proposta, foram implementados dois sistemas completos. O primeiro é um sistema em tempo real capaz de ajudar um árbitro a arbitrar um jogo de futebol robótico. A solução proposta combina um sistema de reconhecimento de gestos baseada em visão com a definição de uma linguagem formal, o CommLang Referee, à qual demos a designação de Referee Command Language Interface System (ReCLIS). O sistema identifica os comandos baseados num conjunto de gestos estáticos e dinâmicos executados pelo árbitro, sendo este posteriormente enviado para um interface de computador que transmite a respectiva informação para os robôs. O segundo é um sistema em tempo real capaz de interpretar um subconjunto da Linguagem Gestual Portuguesa. As experiências demonstraram que o sistema foi capaz de reconhecer as vogais em tempo real de forma fiável. Embora a solução implementada apenas tenha sido treinada para reconhecer as cinco vogais, o sistema é facilmente extensível para reconhecer o resto do alfabeto. As experiências também permitiram mostrar que a base dos sistemas de interação baseados em visão pode ser a mesma para todas as aplicações e, deste modo facilitar a sua implementação. A solução proposta tem ainda a vantagem de ser suficientemente genérica e uma base sólida para o desenvolvimento de sistemas baseados em reconhecimento gestual que podem ser facilmente integrados com qualquer aplicação de interface homem-máquina. A linguagem formal de definição da interface pode ser redefinida e o sistema pode ser facilmente configurado e treinado com um conjunto de gestos diferentes de forma a serem integrados na solução final.

Integrating rich learning applications in LMS

Currently, a learning management system (LMS) plays a central role in any e-learning environment. These environments include systems to handle the pedagogic aspects of the teaching–learning process (e.g. specialized tutors, simulation games) and the academic aspects (e.g. academic management systems). Thus, the potential for interoperability is an important, although over looked, aspect of an LMS. In this paper, we make a comparative study of the interoperability level of the most relevant LMS. We start by defining an application and a specification model. For the application model, we create a basic application that acts as a tool provider for LMS integration. The specification model acts as the API that the LMS should implement to communicate with the tool provider. Based on researches, we select the Learning Tools Interoperability (LTI) from IMS. Finally, we compare the LMS interoperability level defined as the effort made to integrate the application on the study LMS.

Accounting education in an action-based learning environment: lessons learned

In the context of the Bologna Declaration a change is taking place in the teaching/learning paradigm. From teaching-centered education, which emphasizes the acquisition and transmission of knowledge, we now speak of learning-centered education, which is more demanding for students. This paradigm promotes a continuum of lifelong learning, where the individual needs to be able to handle knowledge, to select what is appropriate for a particular context, to learn permanently and to understand how to learn in new and rapidly changing situations. One attempt to face these challenges has been the experience of ISCAP regarding the teaching/learning of accounting in the course Managerial Simulation. This paper describes the process of teaching, learning and assessment in an action-based learning environment. After a brief general framework that focuses on education objectives, we report the strengths and limitations of this teaching/learning tool. We conclude with some lessons from the implementation of the project.

Problem-Based Learning e suas implicações: breve revisão teórica

A ESTSP-IPP implementou em 2008-2009 um novo modelo pedagógico, o PBL, em três licenciaturas. Este modelo tem sido considerado capaz de promover a aquisição de conhecimentos mas também o desenvolvimento de competências transversais valorizadas no mercado de trabalho; orienta-se em torno de problemas significativos da realidade profissional, trabalhados segundo a metodologia dos sete passos, destacando-se a aprendizagem através de pesquisa individual e trabalho de grupo; e visa ainda desenvolver processos cognitivos e metacognitivos como levantar hipóteses, comparar, analisar, interpretar e avaliar. Neste artigo, caracterizamos brevemente o modelo e respectivas implicações, justificando o interesse em investigar as repercussões da sua implementação.

Reverse problem-based learning - a case study with a Braille machine

Engineering Education includes not only teaching theoretical fundamental concepts but also its verification during practical lessons in laboratories. The usual strategies to carry out this action are frequently based on Problem Based Learning, starting from a given state and proceeding forward to a target state. The possibility or the effectiveness of this procedure depends on previous states and if the present state was caused or resulted from earlier ones. This often happens in engineering education when the achieved results do not match the desired ones, e.g. when programming code is being developed or when the cause of the wrong behavior of an electronic circuit is being identified. It is thus important to also prepare students to proceed in the reverse way, i.e. given a start state generate the explanation or even the principles that underlie it. Later on, this sort of skills will be important. For instance, to a doctor making a patient?s story or to an engineer discovering the source of a malfunction. This learning methodology presents pedagogical advantages besides the enhanced preparation of students to their future work. The work presented on his document describes an automation project developed by a group of students in an engineering polytechnic school laboratory. The main objective was to improve the performance of a Braille machine. However, in a scenario of Reverse Problem-Based learning, students had first to discover and characterize the entire machine's function before being allowed (and being able) to propose a solution for the existing problem.

A mobile robot platform for open learning based on serious games and remote laboratories

Within the pedagogical community, Serious Games have arisen as a viable alternative to traditional course-based learning materials. Until now, they have been based strictly on software solutions. Meanwhile, research into Remote Laboratories has shown that they are a viable, low-cost solution for experimentation in an engineering context, providing uninterrupted access, low-maintenance requirements, and a heightened sense of reality when compared to simulations. This paper will propose a solution where both approaches are combined to deliver a Remote Laboratory-based Serious Game for use in engineering and school education. The platform for this system is the WebLab-Deusto Framework, already well-tested within the remote laboratory context, and based on open standards. The laboratory allows users to control a mobile robot in a labyrinth environment and take part in an interactive game where they must locate and correctly answer several questions, the subject of which can be adapted to educators' needs. It also integrates the Google Blockly graphical programming language, allowing students to learn basic programming and logic principles without needing to understand complex syntax.

A B-learning strategy for Therapeutics at the Bachelor Level

Background Information:The incorporation of distance learning activities by institutions of higher education is considered an important contribution to create new opportunities for teaching at both, initial and continuing training. In Medicine and Nursing, several papers illustrate the adaptation of technological components and teaching methods are prolific, however, when we look at the Pharmaceutical Education area, the examples are scarce. In that sense this project demonstrates the implementation and assessment of a B-Learning Strategy for Therapeutics using a “case based learning” approach. Setting: Academic Pharmacy Methods:This is an exploratory study involving 2nd year students of the Pharmacy Degree at the School of Allied Health Sciences of Oporto. The study population consists of 61 students, divided in groups of 3-4 elements. The b-learning model was implemented during a time period of 8 weeks. Results:A B-learning environment and digital learning objects were successfully created and implemented. Collaboration and assessment techniques were carefully developed to ensure the active participation and fair assessment of all students. Moodle records show a consistent activity of students during the assignments. E-portfolios were also developed using Wikispaces, which promoted reflective writing and clinical reasoning. Conclusions:Our exploratory study suggests that the “case based learning” method can be successfully combined with the technological components to create and maintain a feasible online learning environment for the teaching of therapeutics.

Ferramenta de estudo para alunos de medicina na especialidade de dermatologia

A vulgarização do uso de dispositivos móveis promoveu a proliferação de aplicações dos mais diversos âmbitos para estes dispositivos não sendo a área clínica uma excepção. Tanto a nível profissional, como a nível de ensino, as tecnologias móveis foram já há muito adoptadas nesta área para as mais diversas finalidades. O trabalho aqui apresentado pretende essencialmente provar a real importância desempenhada pelo mobile learning no contexto da aprendizagem clínica. Mais do que implementar um simples recurso educativo, pretendeu-se conceber um sistema integrado que respondesse a todas as necessidades do aluno quer durante o estudo nas suas diversas fases e locais, como também no próprio serviço hospitalar onde se encontre a desempenhar funções como interno da especialidade. Após uma exaustiva análise das aplicações móveis relevantes da área médica, verificou-se a inexistência de uma ferramenta integradora de vários módulos de aprendizagem com um custo comportável para a maioria dos alunos. Desta forma, idealizou-se uma aplicação capaz de superar esta lacuna que será detalhada ao longo desta tese. Para o desenvolvimento deste trabalho contou-se com a preciosa colaboração dos possíveis utilizadores finais desta ferramenta uma vez que a escolha dos módulos a integrar foi essencialmente baseada nas suas opiniões. Ainda no âmbito desta tese, encontra-se a avaliação do protótipo por parte dos alunos. Esta avaliação pretende validar a efectiva importância de uma ferramenta desta natureza para um aluno de medicina assim como o impacto que o protótipo teve na sua opinião acerca do conceito de mobile learning na aprendizagem clínica. Com vista a uma futura implementação de um recurso educativo deste âmbito, foram também recolhidos os pontos negativos e positivos mais relevantes para o aluno. Em suma, este trabalho valida a importância do papel que as aplicações de aprendizagem para dispositivos móveis podem desempenhar para um aluno de medicina tanto nos seus locais de estudo, como no serviço onde se possa encontrar.

The European Project Semester at ISEP: Learning to Learn Engineering

The European Project Semester at ISEP (EPS@ISEP) is a one semester project-based learning programme addressed to engineering students from diverse scientific backgrounds and nationalities. The students, organized in multicultural teams, are challenged to solve real world multidisciplinary problems, accounting for 30 ECTU. The EPS package, although focused on project development (20 ECTU), includes a series of complementary seminars aimed at fostering soft, project-related and engineering transversal skills (10 ECTU). This paper presents the study plan, resources, operation and results of the EPS@ISEP that was created in 2011 to apply the best engineering education practices and promote the internationalization of ISEP. The results show that the EPS@ISEP students acquire during one semester the scientific, technical and soft competences necessary to propose, design and implement a solution for a multidisciplinary problem.

An intelligent clustering scheme for distributed intrusion detection in vehicular cloud computing

In recent years, vehicular cloud computing (VCC) has emerged as a new technology which is being used in wide range of applications in the area of multimedia-based healthcare applications. In VCC, vehicles act as the intelligent machines which can be used to collect and transfer the healthcare data to the local, or global sites for storage, and computation purposes, as vehicles are having comparatively limited storage and computation power for handling the multimedia files. However, due to the dynamic changes in topology, and lack of centralized monitoring points, this information can be altered, or misused. These security breaches can result in disastrous consequences such as-loss of life or financial frauds. Therefore, to address these issues, a learning automata-assisted distributive intrusion detection system is designed based on clustering. Although there exist a number of applications where the proposed scheme can be applied but, we have taken multimedia-based healthcare application for illustration of the proposed scheme. In the proposed scheme, learning automata (LA) are assumed to be stationed on the vehicles which take clustering decisions intelligently and select one of the members of the group as a cluster-head. The cluster-heads then assist in efficient storage and dissemination of information through a cloud-based infrastructure. To secure the proposed scheme from malicious activities, standard cryptographic technique is used in which the auotmaton learns from the environment and takes adaptive decisions for identification of any malicious activity in the network. A reward and penalty is given by the stochastic environment where an automaton performs its actions so that it updates its action probability vector after getting the reinforcement signal from the environment. The proposed scheme was evaluated using extensive simulations on ns-2 with SUMO. The results obtained indicate that the proposed scheme yields an improvement of 10 % in detection rate of malicious nodes when compared with the existing schemes.

Learning Sustainability with EPS@ISEP – Development of a Water Disinfection System

Proceedings of the 8th International Symposium on Project Approaches in Engineering Education (PAEE), Guimarães, 2016

ePortfolios in translators’ training and assessment

Translator’s training and assessment has used more and more tools and innovative strategies over the years. The goals and results to achieve haven’t changed much, however: translation quality. In order to accomplish it, the translator and all the tasks and processes he develops appear as crucial, being pre-translation and post-translation processes equally important as the translation itself, namely as far as autonomy, reflexive and critical skills are concerned. Finally, the need and relevance of collaborative tasks and networks amongst virtual translation communities, led us to the decision of implementing ePortfolios as a tool to develop the requested skills and extend the use of Internet in translation. In this paper we describe a case-study of a pilot experiment on the using of e-portfolios as a translation training tool and discuss their role in the definition of a clear set of objectives and phases for the completion of each task, by helping students in the management of the projects deadlines, improving their knowledge on the construction and management of translation resources and deepening their awareness about the concepts related to the development of eportfolios.

Lidar com o sofrimento em Fisioterapia: a experiência formativa na ESTSP-IPP

A comunicação e a relação terapêutica são reconhecidamente domínios de competência dos profissionais de saúde cujas funções impliquem o contacto com doentes (Corney, 2000; Grilo & Pedro, 2005; Pio Abreu, 1998). Além do seu papel determinante na adesão terapêutica, a qualidade da comunicação e da relação terapêutica estabelecida tem particular impacto no sofrimento da pessoa, tomado como constructo multidimensional (McIntyre, 2004). Tradicionalmente descurados na formação académica, estes temas tendem actualmente a ganhar expressão nos currículos, para o que contribuíram, no espaço europeu, as recomendações para a adequação a Bolonha (Lopes, 2004). Neste trabalho, descrevemos a metodologia de formação adoptada para estes domínios na licenciatura em Fisioterapia da ESTSP-IPP, a funcionar segundo o modelo pedagógico designado Problem-Based Learning (Walsh, 2005; Macedo, 2009). Além dos conhecimentos disseminados ao longo de toda a estrutura curricular, temas como a comunicação (Watzlawick, Bavelas & Jackson, 1967/1993), a escuta activa (Gordon & Edwards, 1997), a relação terapêutica (Rogers, 1957/1992, 1980, 1985), as competências e microcompetências/técnicas de atendimento e de observação (Ivey, 1983; Ivey & Downing, 1990; Ivey, Gluckstern & Ivey, 2006) ou as comunicações difíceis (Faulkner, Maguire & Regnard, 1994; Maguire, 2000) são alvo de formação mais intensiva ao longo de cerca de 16 semanas consecutivas do 1º ciclo de estudos, com recurso a diferentes tipologias de aula visando desenvolver, além dos conhecimentos, atitudes e habilidades nestes domínios.

Methodology for in-game certification in serious games

Serious games are starting to attain a higher role as tools for learning in various contexts, but in particular in areas such as education and training. Due to its characteristics, such as rules, behavior simulation and feedback to the player's actions, serious games provide a favorable learning environment where errors can occur without real life penalty and students get instant feedback from challenges. These challenges are in accordance with the intended objectives and will self-adapt and repeat according to the student’s difficulty level. Through motivating and engaging environments, which serve as base for problem solving and simulation of different situations and contexts, serious games have a great potential to aid players developing professional skills. But, how do we certify the acquired knowledge and skills? With this work we intend to propose a methodology to establish a relationship between the game mechanics of serious games and an array of competences for certification, evaluating the applicability of various aspects in the design and development of games such as the user interfaces and the gameplay, obtaining learning outcomes within the game itself. Through the definition of game mechanics combined with the necessary pedagogical elements, the game will ensure the certification. This paper will present a matrix of generic skills, based on the European Framework of Qualifications, and the definition of the game mechanics necessary for certification on tour guide training context. The certification matrix has as reference axes: skills, knowledge and competencies, which describe what the students should learn, understand and be able to do after they complete the learning process. The guides-interpreters welcome and accompany tourists on trips and visits to places of tourist interest and cultural heritage such as museums, palaces and national monuments, where they provide various information. Tour guide certification requirements include skills and specific knowledge about foreign languages and in the areas of History, Ethnology, Politics, Religion, Geography and Art of the territory where it is inserted. These skills are communication, interpersonal relationships, motivation, organization and management. This certification process aims to validate the skills to plan and conduct guided tours on the territory, demonstrate knowledge appropriate to the context and finally match a good group leader. After defining which competences are to be certified, the next step is to delineate the expected learning outcomes, as well as identify the game mechanics associated with it. The game mechanics, as methods invoked by agents for interaction with the game world, in combination with game elements/objects allows multiple paths through which to explore the game environment and its educational process. Mechanics as achievements, appointments, progression, reward schedules or status, describe how game can be designed to affect players in unprecedented ways. In order for the game to be able to certify tour guides, the design of the training game will incorporate a set of theoretical and practical tasks to acquire skills and knowledge of various transversal themes. For this end, patterns of skills and abilities in acquiring different knowledge will be identified.

TimeMesh – a serious game for european citizenship

Serious games are games where the entertainment aspect is not the most relevant motivation or objective. TimeMesh is an online, multi-language, multiplayer, collaborative and social game platform for sharing and acquiring knowledge of the history of European regions. As such it is a serious game with educational characteristics. This article evaluates the use of TimeMesh with students of 13 and 14 years-old. It shows that this game is already a significant learning tool about European citizenship.