Ontology-based representation and generation of workflows for micro-task human-machine computation

Doctoral Program in Computer Science

The human eye as human-machine interface

Eye tracking as an interface to operate a computer is under research for a while and new systems are still being developed nowadays that provide some encouragement to those bound to illnesses that incapacitates them to use any other form of interaction with a computer. Although using computer vision processing and a camera, these systems are usually based on head mount technology being considered a contact type system. This paper describes the implementation of a human-computer interface based on a fully non-contact eye tracking vision system in order to allow people with tetraplegia to interface with a computer. As an assistive technology, a graphical user interface with special features was developed including a virtual keyboard to allow user communication, fast access to pre-stored phrases and multimedia and even internet browsing. This system was developed with the focus on low cost, user friendly functionality and user independency and autonomy.

Vision-based hand Wheel-chair control

Several studies have shown that people with disabilities benefit substantially from access to a means of independent mobility and assistive technology. Researchers are using technology originally developed for mobile robots to create easier to use wheelchairs. With this kind of technology people with disabilities can gain a degree of independence in performing daily life activities. In this work a computer vision system is presented, able to drive a wheelchair with a minimum number of finger commands. The user hand is detected and segmented with the use of a kinect camera, and fingertips are extracted from depth information, and used as wheelchair commands.

Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

Vision-based portuguese sign language recognition system

Vision-based hand gesture recognition is an area of active current research in computer vision and machine learning. Being a natural way of human interaction, it is an area where many researchers are working on, with the goal of making human computer interaction (HCI) easier and natural, without the need for any extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them, for example, to convey information. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. Hand gestures are a powerful human communication modality with lots of potential applications and in this context we have sign language recognition, the communication method of deaf people. Sign lan- guages are not standard and universal and the grammars differ from country to coun- try. In this paper, a real-time system able to interpret the Portuguese Sign Language is presented and described. Experiments showed that the system was able to reliably recognize the vowels in real-time, with an accuracy of 99.4% with one dataset of fea- tures and an accuracy of 99.6% with a second dataset of features. Although the im- plemented solution was only trained to recognize the vowels, it is easily extended to recognize the rest of the alphabet, being a solid foundation for the development of any vision-based sign language recognition user interface system.

Dynamic group formation in mobile computer supported collaborative learning environment

Forming suitable learning groups is one of the factors that determine the efficiency of collaborative learning activities. However, only a few studies were carried out to address this problem in the mobile learning environments. In this paper, we propose a new approach for an automatic, customized, and dynamic group formation in Mobile Computer Supported Collaborative Learning (MCSCL) contexts. The proposed solution is based on the combination of three types of grouping criteria: learner’s personal characteristics, learner’s behaviours, and context information. The instructors can freely select the type, the number, and the weight of grouping criteria, together with other settings such as the number, the size, and the type of learning groups (homogeneous or heterogeneous). Apart from a grouping mechanism, the proposed approach represents a flexible tool to control each learner, and to manage the learning processes from the beginning to the end of collaborative learning activities. In order to evaluate the quality of the implemented group formation algorithm, we compare its Average Intra-cluster Distance (AID) with the one of a random group formation method. The results show a higher effectiveness of the proposed algorithm in forming homogenous and heterogeneous groups compared to the random method.

Cost-effective and lightweight mobile units for MixAR: A comparative trial among different setups

Cultural heritage has arousing the interest of the general public (e.g. tourists), resulting in the increasing number of visitations to archaeological sites. However, many buildings and monuments are severely damaged or completely destroyed, which doesn’t allow to get a full experience of “travelling in time”. Over the years, several Augmented Reality (AR) approaches were proposed to overcome these issues by providing three-dimensional visualization of reconstructed ancient structures in situ. However, most of these systems were made available through heavy and expensive technological bundles. Alternatively, MixAR intends to be a lightweight and cost-effective Mixed Reality system which aims to provide the visualization of virtual ancient buildings reconstructions in situ, properly superimposed and aligned with real-world ruins. This paper proposes and compares different AR mobile units setups to be used in the MixAR system, with low-cost and lightweight requirements in mind, providing different levels of immersion. It was propounded four different mobile units, based on: a laptop computer, a single-board computer (SBC), a tablet and a smartphone, which underwent a set of tests to evaluate their performances. The results show that mobile units based on laptop computer and SBC reached a good overall performance while mobile units based on tablet and smartphone did not meet such a satisfactory result even though they are acceptable for the intended use.

MixAR mobile prototype: visualizing virtually reconstructed ancient structures in situ

Archeology and related areas have a special interest on cultural heritage sites since they provide valuable information about past civilizations. However, the ancient buildings present in these sites are commonly found in an advanced state of degradation which difficult the professional/expert analysis. Virtual reconstructions of such buildings aim to provide a digital insight of how these historical places could have been in ancient times. Moreover, the visualization of such models has been explored by some Augmented Reality (AR) systems capable of providing support to experts. Their compelling and appealing environments have also been applied to promote the social and cultural participation of general public. The existing AR solutions regarding this thematic rarely explore the potential of realism, due to the following lacks: the exploration of mixed environments is usually only supported for indoors or outdoors, not both in the same system; the adaptation of the illumination conditions to the reconstructed structures is rarely addressed causing a decrease of credibility. MixAR [1] is a system concerned with those challenges, aiming to provide the visualization of virtual buildings augmented upon real ruins, allowing soft transitions among its interiors and exteriors and using relighting techniques for a faithful interior illumination, while the user freely moves in a given cultural heritage site, carrying a mobile unit. Regarding the focus of this paper, we intend to report the current state of MixAR mobile unit prototype, which allows visualizing virtual buildings – properly aligned with real-world structures – based on user's location, during outdoor navigation. In order to evaluate the prototype performance, a set of tests were made using virtual models with different complexities.

Identifying finger postures when interacting with the touch screen of mobile devices

This study presents the results of preliminary test on the interaction between fingertip and touch screen. The objective of this study is to identify the fingertip posture when interacting with touch screen devices. Ten participants, 7 males and 3 females, participated in this study. The participants were asked to touch targets on the mobile devices screen by tapping them sequentially and connecting them. The participants performed the tasks in a sitting posture. A tablet with 10 inches screen and a mobile phone with 4 inches screen were used in the study. The results showed that all participants dominantly used their thumb to interact with the mobile phone in single and two hands postures. The common thumb posture adopted by the participants is the combination of the 60° pitch and 0° roll angles. While for interaction with tablet in various postures observed in the study, the participants commonly used their index fingers in the combination of 60° pitch and 0° roll angles. This study also observed the participant with long finger nails touched targets on the mobile devices screen by using her index or middle fingers very low pitch.

Improving quality of medical service with mobile health software

An increasing number of m-Health applications are being developed benefiting health service delivery. In this paper, a new methodology based on the principle of calm computing applied to diagnostic and therapeutic procedure reporting is proposed. A mobile application was designed for the physicians of one of the Portuguese major hospitals, which takes advantage of a multi-agent interoperability platform, the Agency for the Integration, Diffusion and Archive (AIDA). This application allows the visualization of inpatients and outpatients medical reports in a quicker and safer manner, in addition to offer a remote access to information. This project shows the advantages in the use of mobile software in a medical environment but the first step is always to build or use an interoperability platform, flexible, adaptable and pervasive. The platform offers a comprehensive set of services that restricts the development of mobile software almost exclusively to the mobile user interface design. The technology was tested and assessed in a real context by intensivists.

Moda ética: a consciencialização através da comunicação

Dissertação de mestrado em Design e Comunicação de Moda

Designing next generation car washing machines with rotary brushes

Tese de Doutoramento - Leaders for Technical Industries (LTI) - MIT Portugal

Development of computational tools for the integrated analysis of DNA microarray data with applications in cancer research

The MAP-i Doctoral Program of the Universities of Minho, Aveiro and Porto

Metallic glass/PVDF magnetoelectric energy harvester working up to the radiofrequency range

Companies and researchers involved in developing miniaturized electronic devices face the basic problem of the needed batteries size, finite life of time and environmental pollution caused by their final deposition. The current trends to overcome this situation point towards Energy Harvesting technology. These harvesters (or scavengers) store the energy from sources present in the ambient (as wind, solar, electromagnetic, etc) and are costless for us. Piezoelectric devices are the ones that show a higher power density, and materials as ceramic PZT or polymeric PVDF have already demonstrated their ability to act as such energy harvester elements. Combinations between piezoelectric and electromagnetic mechanism have been also extensively investigated. Nevertheless, the power generated by these combinations is limited under the application of small magnetic fields, reducing the performance of the energy harvester [1]. In the last years the appearance of magnetoelectric (ME) devices, in which the piezoelectric deformation is driven by the magnetostrictive element, enables to extract the energy of very small electromagnetic signals through the generated magnetoelectric voltage at the piezoelectric element. However, very little work has been done testing PVDF polymer as piezoelectric constituent of the ME energy harvester device, and only to be proposed as a possibility of application [2]. Among the advantages of using piezopolymers for vibrational energy harvesting we can remember that they are ductile, resilient to shock, deformable and lightweight. In this work we demonstrate the feasibility of using magnetostrictive Fe-rich magnetic amorphous alloys/piezoelectric PVDF sandwich-type laminated ME devices as energy harvesters. A very simple experimental set-up will show how these laminates can extract energy, in amounts of μW, from an external AC field.