Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

The human eye as human-machine interface

Eye tracking as an interface to operate a computer is under research for a while and new systems are still being developed nowadays that provide some encouragement to those bound to illnesses that incapacitates them to use any other form of interaction with a computer. Although using computer vision processing and a camera, these systems are usually based on head mount technology being considered a contact type system. This paper describes the implementation of a human-computer interface based on a fully non-contact eye tracking vision system in order to allow people with tetraplegia to interface with a computer. As an assistive technology, a graphical user interface with special features was developed including a virtual keyboard to allow user communication, fast access to pre-stored phrases and multimedia and even internet browsing. This system was developed with the focus on low cost, user friendly functionality and user independency and autonomy.

Conflito e trauma: XVI Colóquio de Outono

It has been the main concern of CEHUM, as a Research Centre within the Humanities which operates in an inter and transdisciplinary structure to listen attentively to the “noise of the world” and attempt a global interpretation of the signs of the times issuing from the world around us, as vibrant echoes of many social and cultural pressing issues. Every year each new Colóquio de Outono attempts to give evidence of that concern through the topic chosen for debate, ample enough and challenging enough to trigger a lively multidisciplinary dialogue amongst the diff erent research groups that compose this centre, the participants and our invited guest speakers. Throughout the three days of this 16th Colóquio de Outono we had the privilege to debate the propositions of a vast number of national and international specialists in the manifold fi elds of inquiry here represented, engaging keynote speakers, project advisors, members of research teams and external researchers attached to the various research projects currently running in CEHUM, in the fi elds of literature, linguistics, philosophy, ethics, visual arts, cultural studies, music and performance. Each specifi c fi eld of studies was however never seen isolated, but always embodied in a geo-cultural context and within the scope of a wide variety of critical debates and current theories of knowledge, as a signal of our understanding of the Humanities as a rich and plural territory which engages us all, scholars, researchers, students.

Generic system for human-computer gesture interaction

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for humancomputer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of vision-based interaction systems can be the same for all applications and thus facilitate the implementation. In order to test the proposed solutions, three prototypes were implemented. For hand posture recognition, a SVM model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications.

Form tutors in the joint teaching of music: perspectives and experiences

In the Portuguese school system, form tutors (FTs) are an intermediate education management structure. The form tutor is responsible for a position of coordination and orientation with a «threefold function»: a relationship with students, relationship with the student’s family and relationship with other class teachers. The joint teaching of music is a part of the educational system in basic education. It is optional and provides musical and instrumental training to students who are interested in taking it. In order to achieve this, there is a system, subject to protocols, between general education schools and schools specializing in teaching music. There is also the position of FT in specialized schools and it also includes a «threefold function». However, these FTs have the additional role of representing music teachers at the class council, which is held at the general education school. Thus, in these cases, both FTs have a fourth joint area, between the music school and the general education school, which makes the relationship between them even more complex. This paper is based on the analysis of empirical data obtained from the testimonies of FTs regarding their representations and experiences in leadership and the coordination of teachers among schools in which there is a joint teaching system. The aim of collecting narratives is to look into some of the main challenges and confrontations related to leadership issues, which we assume to be the focus of those who have the role of form tutor in that specific context.

The music of language: an ERP investigation of the effects of musical training on emotional prosody processing

Recent studies have demonstrated the positive effects of musical training on the perception of vocally expressed emotion. This study investigated the effects of musical training on event-related potential (ERP) correlates of emotional prosody processing. Fourteen musicians and fourteen control subjects listened to 228 sentences with neutral semantic content, differing in prosody (one third with neutral, one third with happy and one third with angry intonation), with intelligible semantic content (semantic content condition--SCC) and unintelligible semantic content (pure prosody condition--PPC). Reduced P50 amplitude was found in musicians. A difference between SCC and PPC conditions was found in P50 and N100 amplitude in non-musicians only, and in P200 amplitude in musicians only. Furthermore, musicians were more accurate in recognizing angry prosody in PPC sentences. These findings suggest that auditory expertise characterizing extensive musical training may impact different stages of vocal emotional processing.

Performance assessment of electrically small antennas for implantable microsystems with wireless power and communications

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)

Optical properties of zirconium oxynitride films: the effect of composition, electronic and crystalline structures

tThis work is devoted to the investigation of zirconium oxynitride (ZrOxNy) films with varied opticalresponses prompted by the variations in their compositional and structural properties. The films wereprepared by dc reactive magnetron sputtering of Zr, using Ar and a reactive gas mixture of N2+ O2(17:3).The colour of the films changed from metallic-like, very bright yellow-pale and golden yellow, for low gasflows to red-brownish for intermediate gas flows. Associated to this colour change there was a significantdecrease of brightness. With further increase of the reactive gas flow, the colour of the samples changedfrom red-brownish to dark blue or even to interference colourations. The variations in composition dis-closed the existence of four different zones, which were found to be closely related with the variationsin the crystalline structure. XRD analysis revealed the change from a B1 NaCl face-centred cubic zirco-nium nitride-type phase for films prepared with low reactive gas flows, towards a poorly crystallizedover-stoichiometric nitride phase, which may be similar to that of Zr3N4with some probable oxygeninclusions within nitrogen positions, for films prepared with intermediate reactive gas flows. For highreactive gas flows, the films developed an oxynitride-type phase, similar to that of -Zr2ON2with someoxygen atoms occupying some of the nitrogen positions, evolving to a ZrO2monoclinic type structurewithin the zone where films were prepared with relatively high reactive gas flows. The analysis carriedout by reflected electron energy loss spectroscopy (REELS) revealed a continuous depopulation of thed-band and an opening of an energy gap between the valence band (2p) and the Fermi level close to 5 eV.The ZrN-based coatings (zone I and II) presented intrinsic colourations, with a decrease in brightness anda colour change from bright yellow to golden yellow, red brownish and dark blue. Associated to thesechanges, there was also a shift of the reflectivity minimum to lower energies, with the increase of thenon-metallic content. The samples lying in the two last zones (zone III, oxynitride and zone IV, oxide films)revealed a typical semi-transparent-optical behaviour showing interference-like colourations only dueto the complete depopulation of the d band at the Fermi level. The samples lying in these zones presentedalso an increase of the optical bandgap from 2 to 3.6 eV.