Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

Vision-based portuguese sign language recognition system

Vision-based hand gesture recognition is an area of active current research in computer vision and machine learning. Being a natural way of human interaction, it is an area where many researchers are working on, with the goal of making human computer interaction (HCI) easier and natural, without the need for any extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them, for example, to convey information. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. Hand gestures are a powerful human communication modality with lots of potential applications and in this context we have sign language recognition, the communication method of deaf people. Sign lan- guages are not standard and universal and the grammars differ from country to coun- try. In this paper, a real-time system able to interpret the Portuguese Sign Language is presented and described. Experiments showed that the system was able to reliably recognize the vowels in real-time, with an accuracy of 99.4% with one dataset of fea- tures and an accuracy of 99.6% with a second dataset of features. Although the im- plemented solution was only trained to recognize the vowels, it is easily extended to recognize the rest of the alphabet, being a solid foundation for the development of any vision-based sign language recognition user interface system.

A domain-specific language for ETL patterns specification in Data Warehousing Systems

During the last few years many research efforts have been done to improve the design of ETL (Extract-Transform-Load) systems. ETL systems are considered very time-consuming, error-prone and complex involving several participants from different knowledge domains. ETL processes are one of the most important components of a data warehousing system that are strongly influenced by the complexity of business requirements, their changing and evolution. These aspects influence not only the structure of a data warehouse but also the structures of the data sources involved with. To minimize the negative impact of such variables, we propose the use of ETL patterns to build specific ETL packages. In this paper, we formalize this approach using BPMN (Business Process Modelling Language) for modelling more conceptual ETL workflows, mapping them to real execution primitives through the use of a domain-specific language that allows for the generation of specific instances that can be executed in an ETL commercial tool.

Using a domain-specific language to enrich ETL schemas

Today it is easy to find a lot of tools to define data migration schemas among different types of information systems. Data migration processes use to be implemented on a very diverse range of applications, ranging from conventional operational systems to data warehousing platforms. The implementation of a data migration process often involves a serious planning, considering the development of conceptual migration schemas at early stages. Such schemas help architects and engineers to plan and discuss the most adequate way to migrate data between two different systems. In this paper we present and discuss a way for enriching data migration conceptual schemas in BPMN using a domain-specific language, demonstrating how to convert such enriched schemas to a first correspondent physical representation (a skeleton) in a conventional ETL implementation tool like Kettle.

Implementation and comparison of different switching techniques for shunt active power filters

This paper presents a comparison between three switching techniques that can be used in three-phase four-wire Shunt Active Power Filters (SAPFs). The implemented switching techniques are: Periodic-Sampling (PS), Triangular Carrier Pulse-Width Modulation (TC-PWM) and Space Vector PWM (SVPWM). The comparison between them is made in terms of the compensated currents THD%, implementation complexity, necessary CPU time and SAPF efficiency. To perform this comparison are presented and analyzed several experimental results, obtained with a 20 kVA Shunt Active Power Filter prototype, specially developed for this purpose. The control system of the developed SAPF is based in the p-q Theory with a grid synchronization algorithm p-PLL.

Cross-language influences on new second language vocabulary acquisition: the effect of learning method

Dissertação de mestrado integrado em Psicologia

Surface plasmon resonance-coupled photoluminescence and resistive switching behavior of pulsed laser-deposited Ag:SiC nanocermet thin films

In this study, Ag:SiC nanocermets were prepared via rapid thermal annealing (RTA) of pulsed laser-deposited SiC/Ag/SiC trilayers grown on Si substrate. Atomic force microscope images show that silver nanoparticles (Ag NPs) are formed after RTA, and the size of NPs increases with increasing Ag deposition time (t Ag). Sharp dip observed in the reflectance spectra confirmed the existence of Ag surface plasmons (SPs). The infrared transmission spectra showed an intense and broad absorption band around 780–800 cm−1 that can be assigned to Si-C stretching vibration mode. Influence of t Ag on the spectral characteristics of SP-enhanced photoluminescence (PL) and electrical properties of silicon carbide (SiC) films has been investigated. The maximum PL enhancement by 5.5 times for Ag:SiC nanocermets is achieved when t Ag ≈ 50 s. This enhancement is due to the strong resonant coupling between SiC and the SP oscillations of the Ag NPs. Presence of Ag NPs in SiC also induces a forming-free resistive switching with switching ratio of 2 × 10−2. The analysis of I–V curves demonstrates that the trap-controlled space-charge-limited conduction with filamentary model is the governing mechanism for the resistive switching in nanocerment thin films.

Effect of annealing temperature on photoluminescence and resistive switching characteristics of ZnO/Al2O3 multilayer nanostructures

This work demonstrates the role of defects generated during rapid thermal annealing of pulsed laser deposited ZnO/Al2O3 multilayer nanostructures in presence of vacuum at different temperatures (Ta) (500–900 C) on their electrical conductance and optical characteristics. Photoluminescence (PL) emissions show the stronger green emission at Ta 600 C and violet–blue emission at TaP800 C, and are attributed to oxygen vacancies and zinc related defects (zinc vacancies and interstitials) respectively. Current–voltage (I–V) characteristics of nanostructures with rich oxygen vacancies and zinc related defects display the electroforming free resistive switching (RS) characteristics. Nanostructures with rich oxygen vacancies exhibit conventional and stable RS behavior with high and low resistance states (HRS/LRS) ratio 104 during the retention test. Besides, the dominant conduction mechanism of HRS and LRS is explained by trap-controlled-space-charge limited conduction mechanism, where the oxygen vacancies act as traps. On the other hand, nanostructures with rich zinc related defects show a diode-like RS behavior. The rectifying ratio is found to be sensitive on the zinc interstitials concentration. It is assumed that the rectifying behavior is due to the electrically formed interface layer ZnAl2O4 at the Zn defects rich ZnO crystals – Al2O3 x interface and the switching behavior is attributed to the electron trapping/de-trapping process at zinc vacancies.

Light-controlled resistive switching in laser-assisted annealed Ba0.8Sr0.2TiO3 thin films

In this work, Ba0.8Sr0.2TiO3 (BST)/ITO structures were grown on glass substrate and laser assisted annealing (LAA) was performed to promote the crystallization of BST. Atomic force microscopy and X-ray diffraction studies confirm the crack free and polycrystalline perovskite phase of BST. White light controlled resistive switching (RS) effect in Au/BST/ITO device is investigated. The device displays the electroforming-free bipolar RS characteristics and are explained by the modulationof the width and height of barrier at the BST/ITO interface via ferroelectric polarization. Moreover, the RS effect is signifi- cantly improved under white light illumination compared to that in the dark. The enhanced RS and photovoltaic effects are explained by considering depolarization field and charge distribution at the interface. The devices exhibit stable retention characteristics with low currents (mA), which make them attractive for non volatile memory devices.

Enhanced resistive switching and multilevel behavior in bilayered HfAlO/HfAlOx structures for non-volatile memory applications

In this work, hafnium aluminum oxide (HfAlO) thin films were deposited by ion beam sputtering deposition technique on Si substrate. The presence of oxygen vacancies in the HfAlOx layer deposited in oxygen deficient environment is evidenced from the photoluminescence spectra. Furthermore, HfAlO(oxygen rich)/HfAlOx(oxygen poor) bilayer structures exhibit multilevel resistive switching (RS), and the switching ratio becomes more prominent with increasing the HfAlO layer thickness. The bilayer structure with HfAlO/HfAlOx thickness of 30/40 nm displays the enhanced multilevel resistive switching characteristics, where the high resistance state/ intermediate resistance state (IRS) and IRS/low resistance state resistance ratios are 102 and 5 105 , respectively. The switching mechanisms in the bilayer structures were investigated by the temperature dependence of the three resistance states. This study revealed that the multilevel RS is attributed to the coupling of ionic conduction and the metallic conduction, being the first associated to the formation and rupture of conductive filaments related to oxygen vacancies and the second with the formation of a metallic filament. Moreover, the bilayer structures exhibit good endurance and stability in time.

Digital manipulatives as scaffolds for preschoolers’ language development

The study reported here aims at contributing to a deeper understanding of the educational possibilities offered by digital manipulatives in preschool contexts. It presents a study carried with a digital manipulative to enhance the development of lexical knowledge and language awareness, which are relevant language abilities for formal literacy learning. The study took place in a Portuguese preschool, with a class of 20 five-year-olds in collaboration with the teacher. The digital manipulative supported the construction of multiple fictional worlds, motivating children's verbal interactions, and the playing of words and sound games, thus contextualizing the learning of an extensive collection of vocabulary and language awareness abilities. The degree of engagement and involvement that the manipulative provided in supporting children’s imaginative play as well as the imitation, in their own play, of the playful pedagogical interventions that the teacher had designed, shows the importance of well- designed materials that support a child-centered learning model. As such, it sustains a discussion on the potential of digital manipulatives to enhance fundamental language development in the preschool years. Further, the study highlights the importance of multidisciplinary teams in the creation of innovative pedagogical materials.

The music of language: an ERP investigation of the effects of musical training on emotional prosody processing

Recent studies have demonstrated the positive effects of musical training on the perception of vocally expressed emotion. This study investigated the effects of musical training on event-related potential (ERP) correlates of emotional prosody processing. Fourteen musicians and fourteen control subjects listened to 228 sentences with neutral semantic content, differing in prosody (one third with neutral, one third with happy and one third with angry intonation), with intelligible semantic content (semantic content condition--SCC) and unintelligible semantic content (pure prosody condition--PPC). Reduced P50 amplitude was found in musicians. A difference between SCC and PPC conditions was found in P50 and N100 amplitude in non-musicians only, and in P200 amplitude in musicians only. Furthermore, musicians were more accurate in recognizing angry prosody in PPC sentences. These findings suggest that auditory expertise characterizing extensive musical training may impact different stages of vocal emotional processing.

Modelling and verifying smell-free architectures with the Archery language

Architectural (bad) smells are design decisions found in software architectures that degrade the ability of systems to evolve. This paper presents an approach to verify that a software architecture is smellfree using the Archery architectural description language. The language provides a core for modelling software architectures and an extension for specifying constraints. The approach consists in precisely specifying architectural smells as constraints, and then verifying that software architectures do not satisfy any of them. The constraint language is based on a propositional modal logic with recursion that includes: a converse operator for relations among architectural concepts, graded modalities for describing the cardinality in such relations, and nominals referencing architectural elements. Four architectural smells illustrate the approach.