Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

Vision-based portuguese sign language recognition system

Vision-based hand gesture recognition is an area of active current research in computer vision and machine learning. Being a natural way of human interaction, it is an area where many researchers are working on, with the goal of making human computer interaction (HCI) easier and natural, without the need for any extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them, for example, to convey information. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. Hand gestures are a powerful human communication modality with lots of potential applications and in this context we have sign language recognition, the communication method of deaf people. Sign lan- guages are not standard and universal and the grammars differ from country to coun- try. In this paper, a real-time system able to interpret the Portuguese Sign Language is presented and described. Experiments showed that the system was able to reliably recognize the vowels in real-time, with an accuracy of 99.4% with one dataset of fea- tures and an accuracy of 99.6% with a second dataset of features. Although the im- plemented solution was only trained to recognize the vowels, it is easily extended to recognize the rest of the alphabet, being a solid foundation for the development of any vision-based sign language recognition user interface system.

A domain-specific language for ETL patterns specification in Data Warehousing Systems

During the last few years many research efforts have been done to improve the design of ETL (Extract-Transform-Load) systems. ETL systems are considered very time-consuming, error-prone and complex involving several participants from different knowledge domains. ETL processes are one of the most important components of a data warehousing system that are strongly influenced by the complexity of business requirements, their changing and evolution. These aspects influence not only the structure of a data warehouse but also the structures of the data sources involved with. To minimize the negative impact of such variables, we propose the use of ETL patterns to build specific ETL packages. In this paper, we formalize this approach using BPMN (Business Process Modelling Language) for modelling more conceptual ETL workflows, mapping them to real execution primitives through the use of a domain-specific language that allows for the generation of specific instances that can be executed in an ETL commercial tool.

Using a domain-specific language to enrich ETL schemas

Today it is easy to find a lot of tools to define data migration schemas among different types of information systems. Data migration processes use to be implemented on a very diverse range of applications, ranging from conventional operational systems to data warehousing platforms. The implementation of a data migration process often involves a serious planning, considering the development of conceptual migration schemas at early stages. Such schemas help architects and engineers to plan and discuss the most adequate way to migrate data between two different systems. In this paper we present and discuss a way for enriching data migration conceptual schemas in BPMN using a domain-specific language, demonstrating how to convert such enriched schemas to a first correspondent physical representation (a skeleton) in a conventional ETL implementation tool like Kettle.

Cross-language influences on new second language vocabulary acquisition: the effect of learning method

Dissertação de mestrado integrado em Psicologia

Variation of the physicochemical and morphological characteristics of solvent casted poly(vinylidene fluoride) along its binary phase diagram with dimethylformamide

Poly(vinylidene fluoride), PVDF, films and membranes were prepared by solvent casting from dimethylformamide, DMF, by systematically varying polymer/solvent ratio and solvent evaporation temperature. The effect of the processing conditions on the morphology, degree of porosity, mechanical and thermal properties and crystalline phase of the polymer were evaluated. The obtained microstructure is explained by the Flory-Huggins theory. For the binary system, the porous membrane formation is attributed to a spinodal decomposition of the liquid-liquid phase separation. The morphological features were simulated through the correlation between the Gibbs total free energy and the Flory-Huggins theory. This correlation allowed the calculation of the PVDF/DMF phase diagram and the evolution of the microstructure in different regions of the phase diagram. Varying preparation conditions allow tailoring polymer 2 microstructure while maintaining a high degree of crystallinity and a large β crystalline phase content. Further, the membranes show adequate mechanical properties for applications in filtration or battery separator membranes.

Digital manipulatives as scaffolds for preschoolers’ language development

The study reported here aims at contributing to a deeper understanding of the educational possibilities offered by digital manipulatives in preschool contexts. It presents a study carried with a digital manipulative to enhance the development of lexical knowledge and language awareness, which are relevant language abilities for formal literacy learning. The study took place in a Portuguese preschool, with a class of 20 five-year-olds in collaboration with the teacher. The digital manipulative supported the construction of multiple fictional worlds, motivating children's verbal interactions, and the playing of words and sound games, thus contextualizing the learning of an extensive collection of vocabulary and language awareness abilities. The degree of engagement and involvement that the manipulative provided in supporting children’s imaginative play as well as the imitation, in their own play, of the playful pedagogical interventions that the teacher had designed, shows the importance of well- designed materials that support a child-centered learning model. As such, it sustains a discussion on the potential of digital manipulatives to enhance fundamental language development in the preschool years. Further, the study highlights the importance of multidisciplinary teams in the creation of innovative pedagogical materials.

Mosaic maternal ancestry in the Great Lakes region of East Africa

The Great Lakes lie within a region of East Africa with very high human genetic diversity, home of many ethno-linguistic groups usually assumed to be the product of a small number of major dispersals. However, our knowledge of these dispersals relies primarily on the inferences of historical, linguistics and oral traditions, with attempts to match up the archaeological evidence where possible. This is an obvious area to which archaeogenetics can contribute, yet Uganda, at the heart of these developments, has not been studied for mitochondrial DNA (mtDNA) variation. Here, we compare mtDNA lineages at this putative genetic crossroads across 409 representatives of the major language groups: Bantu speakers and Eastern and Western Nilotic speakers. We show that Uganda harbours one of the highest mtDNA diversities within and between linguistic groups, with the various groups significantly differentiated from each other. Despite an inferred linguistic origin in South Sudan, the data from the two Nilotic-speaking groups point to a much more complex history, involving not only possible dispersals from Sudan and the Horn but also large-scale assimilation of autochthonous lineages within East Africa and even Uganda itself. The Eastern Nilotic group also carries signals characteristic of West-Central Africa, primarily due to Bantu influence, whereas a much stronger signal in the Western Nilotic group suggests direct West-Central African ancestry. Bantu speakers share lineages with both Nilotic groups, and also harbour East African lineages not found in Western Nilotic speakers, likely due to assimilating indigenous populations since arriving in the region ~3000 years ago.

The music of language: an ERP investigation of the effects of musical training on emotional prosody processing

Recent studies have demonstrated the positive effects of musical training on the perception of vocally expressed emotion. This study investigated the effects of musical training on event-related potential (ERP) correlates of emotional prosody processing. Fourteen musicians and fourteen control subjects listened to 228 sentences with neutral semantic content, differing in prosody (one third with neutral, one third with happy and one third with angry intonation), with intelligible semantic content (semantic content condition--SCC) and unintelligible semantic content (pure prosody condition--PPC). Reduced P50 amplitude was found in musicians. A difference between SCC and PPC conditions was found in P50 and N100 amplitude in non-musicians only, and in P200 amplitude in musicians only. Furthermore, musicians were more accurate in recognizing angry prosody in PPC sentences. These findings suggest that auditory expertise characterizing extensive musical training may impact different stages of vocal emotional processing.

Composition and structure variation for magnetron sputtered tantalum oxynitride thin films, as function of deposition parameters

Tantalum oxynitride thin films were produced by magnetron sputtering. The films were deposited usinga pure Ta target and a working atmosphere with a constant N2/O2ratio. The choice of this constant ratiolimits the study concerning the influence of each reactive gas, but allows a deeper understanding of theaspects related to the affinity of Ta to the non-metallic elements and it is economically advantageous.This work begins by analysing the data obtained directly from the film deposition stage, followed bythe analysis of the morphology, composition and structure. For a better understanding regarding theinfluence of the deposition parameters, the analyses are presented by using the following criterion: thefilms were divided into two sets, one of them produced with grounded substrate holder and the otherwith a polarization of −50 V. Each one of these sets was produced with different partial pressure of thereactive gases P(N2+ O2). All the films exhibited a O/N ratio higher than the N/O ratio in the depositionchamber atmosphere. In the case of the films produced with grounded substrate holder, a strong increaseof the O content is observed, associated to the strong decrease of the N content, when P(N2+ O2) is higherthan 0.13 Pa. The higher Ta affinity for O strongly influences the structural evolution of the films. Grazingincidence X-ray diffraction showed that the lower partial pressure films were crystalline, while X-rayreflectivity studies found out that the density of the films depended on the deposition conditions: thehigher the gas pressure, the lower the density. Firstly, a dominant -Ta structure is observed, for lowP(N2+ O2); secondly a fcc-Ta(N,O) structure, for intermediate P(N2+ O2); thirdly, the films are amorphousfor the highest partial pressures. The comparison of the characteristics of both sets of produced TaNxOyfilms are explained, with detail, in the text.

Modelling and verifying smell-free architectures with the Archery language

Architectural (bad) smells are design decisions found in software architectures that degrade the ability of systems to evolve. This paper presents an approach to verify that a software architecture is smellfree using the Archery architectural description language. The language provides a core for modelling software architectures and an extension for specifying constraints. The approach consists in precisely specifying architectural smells as constraints, and then verifying that software architectures do not satisfy any of them. The constraint language is based on a propositional modal logic with recursion that includes: a converse operator for relations among architectural concepts, graded modalities for describing the cardinality in such relations, and nominals referencing architectural elements. Four architectural smells illustrate the approach.