Hand gesture recognition system based in computer vision and machine learning : applications on human-machine interaction

Sendo uma forma natural de interação homem-máquina, o reconhecimento de gestos implica uma forte componente de investigação em áreas como a visão por computador e a aprendizagem computacional. O reconhecimento gestual é uma área com aplicações muito diversas, fornecendo aos utilizadores uma forma mais natural e mais simples de comunicar com sistemas baseados em computador, sem a necessidade de utilização de dispositivos extras. Assim, o objectivo principal da investigação na área de reconhecimento de gestos aplicada à interacção homemmáquina é o da criação de sistemas, que possam identificar gestos específicos e usálos para transmitir informações ou para controlar dispositivos. Para isso as interfaces baseados em visão para o reconhecimento de gestos, necessitam de detectar a mão de forma rápida e robusta e de serem capazes de efetuar o reconhecimento de gestos em tempo real. Hoje em dia, os sistemas de reconhecimento de gestos baseados em visão são capazes de trabalhar com soluções específicas, construídos para resolver um determinado problema e configurados para trabalhar de uma forma particular. Este projeto de investigação estudou e implementou soluções, suficientemente genéricas, com o recurso a algoritmos de aprendizagem computacional, permitindo a sua aplicação num conjunto alargado de sistemas de interface homem-máquina, para reconhecimento de gestos em tempo real. A solução proposta, Gesture Learning Module Architecture (GeLMA), permite de forma simples definir um conjunto de comandos que pode ser baseado em gestos estáticos e dinâmicos e que pode ser facilmente integrado e configurado para ser utilizado numa série de aplicações. É um sistema de baixo custo e fácil de treinar e usar, e uma vez que é construído unicamente com bibliotecas de código. As experiências realizadas permitiram mostrar que o sistema atingiu uma precisão de 99,2% em termos de reconhecimento de gestos estáticos e uma precisão média de 93,7% em termos de reconhecimento de gestos dinâmicos. Para validar a solução proposta, foram implementados dois sistemas completos. O primeiro é um sistema em tempo real capaz de ajudar um árbitro a arbitrar um jogo de futebol robótico. A solução proposta combina um sistema de reconhecimento de gestos baseada em visão com a definição de uma linguagem formal, o CommLang Referee, à qual demos a designação de Referee Command Language Interface System (ReCLIS). O sistema identifica os comandos baseados num conjunto de gestos estáticos e dinâmicos executados pelo árbitro, sendo este posteriormente enviado para um interface de computador que transmite a respectiva informação para os robôs. O segundo é um sistema em tempo real capaz de interpretar um subconjunto da Linguagem Gestual Portuguesa. As experiências demonstraram que o sistema foi capaz de reconhecer as vogais em tempo real de forma fiável. Embora a solução implementada apenas tenha sido treinada para reconhecer as cinco vogais, o sistema é facilmente extensível para reconhecer o resto do alfabeto. As experiências também permitiram mostrar que a base dos sistemas de interação baseados em visão pode ser a mesma para todas as aplicações e, deste modo facilitar a sua implementação. A solução proposta tem ainda a vantagem de ser suficientemente genérica e uma base sólida para o desenvolvimento de sistemas baseados em reconhecimento gestual que podem ser facilmente integrados com qualquer aplicação de interface homem-máquina. A linguagem formal de definição da interface pode ser redefinida e o sistema pode ser facilmente configurado e treinado com um conjunto de gestos diferentes de forma a serem integrados na solução final.

Protein folding, metal ions and conformational states: the case of a di-cluster ferredoxin

Dissertation presented to obtain the PhD degree in Biochemistry at the Instituto de Tecnologia Química e Biológica, Universidade Nova de Lisboa

Fractional Dynamics of Computer Virus Propagation

We propose a fractional model for computer virus propagation. The model includes the interaction between computers and removable devices. We simulate numerically the model for distinct values of the order of the fractional derivative and for two sets of initial conditions adopted in the literature. We conclude that fractional order systems reveal richer dynamics than the classical integer order counterpart. Therefore, fractional dynamics leads to time responses with super-fast transients and super-slow evolutions towards the steady-state, effects not easily captured by the integer order models.

Dynamic cluster scheduling for cluster-tree WSNs

While Cluster-Tree network topologies look promising for WSN applications with timeliness and energy-efficiency requirements, we are yet to witness its adoption in commercial and academic solutions. One of the arguments that hinder the use of these topologies concerns the lack of flexibility in adapting to changes in the network, such as in traffic flows. This paper presents a solution to enable these networks with the ability to self-adapt their clusters’ duty-cycle and scheduling, to provide increased quality of service to multiple traffic flows. Importantly, our approach enables a network to change its cluster scheduling without requiring long inaccessibility times or the re-association of the nodes. We show how to apply our methodology to the case of IEEE 802.15.4/ZigBee cluster-tree WSNs without significant changes to the protocol. Finally, we analyze and demonstrate the validity of our methodology through a comprehensive simulation and experimental validation using commercially available technology on a Structural Health Monitoring application scenario.

Phytoplankton analysis of portuguese reservoirs: a cluster analysis with R

In this work, cluster analysis is applied to a real dataset of biological features of several Portuguese reservoirs. All the statistical analysis is done using R statistical software. Several metrics and methods were explored, as well as the combination of Euclidean metric and the hierarchical Ward method. Although it did not present the best combination in terms of internal and stability validation, it was still a good solution and presented good results in terms of interpretation of the problem at hand.

Cluster Turismo Sustentável em Áreas Protegidas: o caso do Alente

Local Tourist Systems (LTS) can be analyzed according to an investigation structure that derives from industrial economics on industrial districts, local productive systems or learning regions. LTS concept is a useful analytical tool that can seize the resorts diversity and organization. Resorts can be conceived both as clusters or industrial districts, either with a perfect agreement between productive sphere and local community or a mere industrial juxtaposition without any economic or social connection. On the other hand tourist clusters analysis has cross referred almost exclusively to socio-economic criteria. Environmental issues were almost disregarded. Approaches swing from the “greening” of products and practices to initiatives focused on an integrated approach, linking environment and tourist development. This paper tries to discuss how to favor – inside a tourist destination - the creation of clusters grounded on sustainable tourism. The case studies (the 5 Alentejo Natural Reserves: Estuário do Sado; Lagoas de Santo André e da Sancha; Vale do Guadiana; Sudoeste Alentejano e Costa Vicentina; Serra de S. Mamede) are analyzed under the light of how microstructures groups can allow a territorial sustainable tourist development. The issues of “resources and competences” and “governance” ar

Electrophoretic protein patterns and numerical analysis of Candida albicans from the oral cavities of healthy children

The aim of this research was to evaluate the protein polymorphism degree among seventy-five C. albicans strains from healthy children oral cavities of five socioeconomic categories from eight schools (private and public) in Piracicaba city, São Paulo State, in order to identify C. albicans subspecies and their similarities in infantile population groups and to establish their possible dissemination route. Cell cultures were grown in YEPD medium, collected by centrifugation, and washed with cold saline solution. The whole-cell proteins were extracted by cell disruption, using glass beads and submitted to SDS-PAGE technique. After electrophoresis, the protein bands were stained with Coomassie-blue and analyzed by statistics package NTSYS-pc version 1.70 software. Similarity matrix and dendrogram were generated by using the Dice similarity coefficient and UPGMA algorithm, respectively, which made it possible to evaluate the similarity or intra-specific polymorphism degrees, based on whole-cell protein fingerprinting of C. albicans oral isolates. A total of 13 major phenons (clusters) were analyzed, according to their homogeneous (socioeconomic category and/or same school) and heterogeneous (distinct socioeconomic categories and/or schools) characteristics. Regarding to the social epidemiological aspect, the cluster composition showed higher similarities (0.788 < S D < 1.0) among C. albicans strains isolated from healthy children independent of their socioeconomic bases (high, medium, or low). Isolates of high similarity were not found in oral cavities from healthy children of social stratum A and D, B and D, or C and E. This may be explained by an absence of a dissemination route among these children. Geographically, some healthy children among identical and different schools (private and public) also are carriers of similar strains but such similarity was not found among other isolates from children from certain schools. These data may reflect a restricted dissemination route of these microorganisms in some groups of healthy scholars, which may be dependent of either socioeconomic categories or geographic site of each child. In contrast to the higher similarity, the lower similarity or higher polymorphism degree (0.499 < S D < 0.788) of protein profiles was shown in 23 (30.6%) C. albicans oral isolates. Considering the social epidemiological aspect, 42.1%, 41.7%, 26.6%, 23.5%, and 16.7% were isolates from children concerning to socioeconomic categories A, D, C, B, and E, respectively, and geographically, 63.6%, 50%, 33.3%, 33.3%, 30%, 25%, and 14.3% were isolates from children from schools LAE (Liceu Colégio Albert Einstein), MA (E.E.P.S.G. "Prof. Elias de Melo Ayres"), CS (E.E.P.G. "Prof. Carlos Sodero"), AV (Alphaville), HF (E.E.P.S.G. "Honorato Faustino), FMC (E.E.P.G. "Prof. Francisco Mariano da Costa"), and MEP (E.E.P.S.G. "Prof. Manasses Ephraim Pereira), respectively. Such results suggest a higher protein polymorphism degree among some strains isolated from healthy children independent of their socioeconomic strata or geographic sites. Complementary studies, involving healthy students and their families, teachers, servants, hygiene and nutritional habits must be done in order to establish the sources of such colonization patterns in population groups of healthy children. The whole-cell protein profile obtained by SDS-PAGE associated with computer-assisted numerical analysis may provide additional criteria for the taxonomic and epidemiological studies of C. albicans.

Fractional Dynamics of Computer Virus Propagation

We propose a fractional model for computer virus propagation. The model includes the interaction between computers and removable devices. We simulate numerically the model for distinct values of the order of the fractional derivative and for two sets of initial conditions adopted in the literature. We conclude that fractional order systems reveal richer dynamics than the classical integer order counterpart. Therefore, fractional dynamics leads to time responses with super-fast transients and super-slow evolutions towards the steady-state, effects not easily captured by the integer order models.

Ensemble: an innovative approach to practice computer programming

Currently, the teaching-learning process in domains, such as computer programming, is characterized by an extensive curricula and a high enrolment of students. This poses a great workload for faculty and teaching assistants responsible for the creation, delivery, and assessment of student exercises. The main goal of this chapter is to foster practice-based learning in complex domains. This objective is attained with an e-learning framework—called Ensemble—as a conceptual tool to organize and facilitate technical interoperability among services. The Ensemble framework is used on a specific domain: computer programming. Content issues are tacked with a standard format to describe programming exercises as learning objects. Communication is achieved with the extension of existing specifications for the interoperation with several systems typically found in an e-learning environment. In order to evaluate the acceptability of the proposed solution, an Ensemble instance was validated on a classroom experiment with encouraging results.

Design a computer programming learning environment for Massive Open Online Courses

Teaching and learning computer programming is as challenging as difficult. Assessing the work of students and providing individualised feedback to all is time-consuming and error prone for teachers and frequently involves a time delay. The existent tools and specifications prove to be insufficient in complex evaluation domains where there is a greater need to practice. At the same time Massive Open Online Courses (MOOC) are appearing revealing a new way of learning, more dynamic and more accessible. However this new paradigm raises serious questions regarding the monitoring of student progress and its timely feedback. This paper provides a conceptual design model for a computer programming learning environment. This environment uses the portal interface design model gathering information from a network of services such as repositories and program evaluators. The design model includes also the integration with learning management systems, a central piece in the MOOC realm, endowing the model with characteristics such as scalability, collaboration and interoperability. This model is not limited to the domain of computer programming and can be adapted to any complex area that requires systematic evaluation with immediate feedback.

A sustentabilidade territorial de um cluster do mar em Portugal

Tese apresentada para cumprimento dos requisitos necessários à obtenção do grau de Doutor em Geografia e Planeamento Territorial, Especialidade Território e Desenvolvimento

Computer-supported cooperative work:alguns temas de investigação

Os primeiros trabalhos sobre Computer-Supported Cooperative Work surgiram na segunda metade da década de 80, estabelecendo-se um campo de investigação interdisciplinar com enfoque no papel do computador e das tecnologias da comunicação no apoio do trabalho em grupo (Ishii et al., 1994). Ao abordar esta área de investigação torna-se claro que é necessário ter em conta a diversidade dos grupos e das tarefas que estes devem de utilizar, entre outros factores importantes. As implicações desta diversidade são discutidas ao nível concepção de interfaces de groupware, em que um maior envolvimento dos utilizadores nas fases iniciais parece ser necessário, e ao nível dos Sistemas de Apoio à Decisão em Grupo.

Bridging present and future of brain-computer interfaces: an assessment of impacts

Based on the report for the “Project III” unit of the PhD programme on Technology Assessment under the supervision of Prof. António B. Moniz. This report was discussed also at the 2nd Winter School on Technology Assessment held at Universidade Nova de Lisboa, Caparica Campus, Portugal on December 2011.