Vision-based portuguese sign language recognition system

Vision-based hand gesture recognition is an area of active current research in computer vision and machine learning. Being a natural way of human interaction, it is an area where many researchers are working on, with the goal of making human computer interaction (HCI) easier and natural, without the need for any extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them, for example, to convey information. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. Hand gestures are a powerful human communication modality with lots of potential applications and in this context we have sign language recognition, the communication method of deaf people. Sign lan- guages are not standard and universal and the grammars differ from country to coun- try. In this paper, a real-time system able to interpret the Portuguese Sign Language is presented and described. Experiments showed that the system was able to reliably recognize the vowels in real-time, with an accuracy of 99.4% with one dataset of fea- tures and an accuracy of 99.6% with a second dataset of features. Although the im- plemented solution was only trained to recognize the vowels, it is easily extended to recognize the rest of the alphabet, being a solid foundation for the development of any vision-based sign language recognition user interface system.

Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

Hand gesture recognition system based in computer vision and machine learning: Applications on human-machine interaction

Tese de Doutoramento em Engenharia de Eletrónica e de Computadores

Um olhar sobre a surdez: uma história de vida

Dissertação de mestrado em Educação Especial (área de especialização em Intervenção Precoce)

Análise e identificação dos termos matemáticos utilizados no 1º e 2º ciclo do ensino básico e sua correspondência na língua gestual portuguesa

Dissertação de mestrado em Educação Especial (área de especialização em Dificuldades de Aprendizagem Específicas)

Descodificação do De re aedificatoria de Alberti: gramáticas de forma para a análise e geração de edifícios sagrados

Teses de Doutoramento em Arquitectura.

Tradução: língua e comunicação no contexto diplomático

Relatório de estágio de mestrado em Tradução e Comunicação Multilingue

Cross-language influences on new second language vocabulary acquisition: the effect of learning method

Dissertação de mestrado integrado em Psicologia

Exposição à escrita e rendimento académico na língua portuguesa: um estudo com alunos do 5.º e 7.º ano

Dissertação de mestrado integrado em Psicologia

Estudo acústico de /a/ acentuado na fala bracarense: potenciais aplicações

Dissertação de mestrado em Ciências da Linguagem

Digital manipulatives as scaffolds for preschoolers’ language development

The study reported here aims at contributing to a deeper understanding of the educational possibilities offered by digital manipulatives in preschool contexts. It presents a study carried with a digital manipulative to enhance the development of lexical knowledge and language awareness, which are relevant language abilities for formal literacy learning. The study took place in a Portuguese preschool, with a class of 20 five-year-olds in collaboration with the teacher. The digital manipulative supported the construction of multiple fictional worlds, motivating children's verbal interactions, and the playing of words and sound games, thus contextualizing the learning of an extensive collection of vocabulary and language awareness abilities. The degree of engagement and involvement that the manipulative provided in supporting children’s imaginative play as well as the imitation, in their own play, of the playful pedagogical interventions that the teacher had designed, shows the importance of well- designed materials that support a child-centered learning model. As such, it sustains a discussion on the potential of digital manipulatives to enhance fundamental language development in the preschool years. Further, the study highlights the importance of multidisciplinary teams in the creation of innovative pedagogical materials.

Comparing heritage speakers and late L2-learners of European Portuguese: verb movement, VP ellipsis and adverb placement

This study compares the performance of Portuguese-German heritage children and adult L2 speakers of European Portuguese whose L1 is German with respect to two aspects of grammar, adverb placement and VP-ellipsis, which depend on a core syntactic property of the language, verb movement. The results show that both groups have acquired V-to-I and adverb placement, showing no influence of a V2 grammar. Performance in the VP-ellipsis task is more complex: heritage children produce VP-ellipsis at the level of controls, as opposed to L2 speakers; however, both L2 and heritage speakers show that crosslinguistic influence may produce a preference for pronoun substitution over VP-ellipsis in a task asking for redundancy resolution. Nevertheless, given that overall results show that heritage children perform at the level of L1 children, we take our results to support approaches to heritage bilingualism which suggest the development of an intact grammar in childhood.