Generic system for human-computer gesture interaction: applications on sign language recognition and robotic soccer refereeing

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for human-computer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of visionbased interaction systems could be the same for all applications and thus facilitate the implementation. For hand posture recognition, a SVM (Support Vector Machine) model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM (Hidden Markov Model) model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications. To validate the proposed framework two applications were implemented. The first one is a real-time system able to interpret the Portuguese Sign Language. The second one is an online system able to help a robotic soccer game referee judge a game in real time.

Generic system for human-computer gesture interaction

Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work proposes a generic system architecture based in computer vision and machine learning, able to be used with any interface for humancomputer interaction. The proposed solution is mainly composed of three modules: a pre-processing and hand segmentation module, a static gesture interface module and a dynamic gesture interface module. The experiments showed that the core of vision-based interaction systems can be the same for all applications and thus facilitate the implementation. In order to test the proposed solutions, three prototypes were implemented. For hand posture recognition, a SVM model was trained and used, able to achieve a final accuracy of 99.4%. For dynamic gestures, an HMM model was trained for each gesture that the system could recognize with a final average accuracy of 93.7%. The proposed solution as the advantage of being generic enough with the trained models able to work in real-time, allowing its application in a wide range of human-machine applications.

Dynamic group formation in mobile computer supported collaborative learning environment

Forming suitable learning groups is one of the factors that determine the efficiency of collaborative learning activities. However, only a few studies were carried out to address this problem in the mobile learning environments. In this paper, we propose a new approach for an automatic, customized, and dynamic group formation in Mobile Computer Supported Collaborative Learning (MCSCL) contexts. The proposed solution is based on the combination of three types of grouping criteria: learner’s personal characteristics, learner’s behaviours, and context information. The instructors can freely select the type, the number, and the weight of grouping criteria, together with other settings such as the number, the size, and the type of learning groups (homogeneous or heterogeneous). Apart from a grouping mechanism, the proposed approach represents a flexible tool to control each learner, and to manage the learning processes from the beginning to the end of collaborative learning activities. In order to evaluate the quality of the implemented group formation algorithm, we compare its Average Intra-cluster Distance (AID) with the one of a random group formation method. The results show a higher effectiveness of the proposed algorithm in forming homogenous and heterogeneous groups compared to the random method.

Studying conformally flat spacetimes with an elastic stress energy tensor using 1+3 formalism

Conformally flat spacetimes with an elastic stress energy tensor having diagonal trace-free anisotropic pressure are investigated using 1+3 formalism. The 1+3 Bianchi and Jacobi identities and Einstein field equations are written for a particular case with a conformal factor dependent on only one spatial coordinate. Solutions with non null anisotropic pressure are obtained.

Hand gesture recognition system based in computer vision and machine learning: Applications on human-machine interaction

Tese de Doutoramento em Engenharia de Eletrónica e de Computadores

Digital literacy, technology and social inclusion: making sense of one-to-one computer programmes around the world

This book was produced in the scope of a research project entitled “Navigating with ‘Magalhães’: Study on the Impact of Digital Media in Schoolchildren”. This study was conducted between May 2010 and May 2013 at the Communication and Society Research Centre, University of Minho, Portugal and it was funded by the Portuguese Foundation for Science and Technology (PTDC/CCI-COM/101381/2008).

Foreword [to Digital literacy, technology and social inclusion: making sense of one-to-one computer programmes around the world]

(Excerto) In times past, learning to read, write and do arithmetic was to get on course to earn the “writ of emancipation” in society. These skills are still essential today, but are not enough to live in society. Reading and critically understanding the world we live in, with all its complexity, difficulties and challenges, require not only other skills (learning to search for and validate information, reading with new codes and grammar, etc) but, to a certain extent, also metaskills, matrixes and mechanisms that are transversal to the different and new literacies, are necessary. They are needed not just to interpret but equally to communicate and participate in the little worlds that make up our everyday activities as well as, in a broader sense, in the world of the polis, which today is a global world.

Introduction [to Digital literacy, technology and social inclusion: making sense of one-to-one computer programmes around the world]

This book was produced in the scope of a research project entitled “Navigating with ‘Magalhães’: Study on the Impact of Digital Media in Schoolchildren”. This study was conducted between May 2010 and May 2013 at the Communication and Society Research Centre, University of Minho, Portugal and it was funded by the Portuguese Foundation for Science and Technology (PTDC/CCI-COM/101381/2008). As we shall explain in more detail later in this book, the main objective of that research project was to analyse the impact of the Portuguese government programme named ´e-escolinha´ launched in 2008 within the Technological Plan for Education. This Plan responds to the principles of the Lisbon Strategy signed in 2000 and rereleased in the Spring European Council of 2005.

A 3D computer assisted Orthopedic Surgery Planning approach based on planar radiography

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Informática Médica)

Diagnóstico pela ecocardiografia transesofágica e evolução de 35 pacientes portadores de flail mitral valve

OBJETIVO: Descrever os achados ao ecocardiograma transesofágico e evolução clínica de portadores de flail mitral valve. MÉTODOS: No período de janeiro/93 a março/97, 1675 pacientes foram submetidos, em nossa instituição, a ecocardiograma transesofágico, sendo que em 35 casos foi feito o diagnóstico de flail mitral valve e, posteriormente, obtida sua evolução clínica. RESULTADOS: A idade dos pacientes variou 12 a 87 anos (média 65±15) e 27 (77%) eram do sexo masculino. O folheto posterior foi o mais acometido (25 pacientes, 71%). O mecanismo do flail foi ruptura de cordoalha tendínea em todos os casos, exceto um, que apresentava importante alongamento e redundância de cordoalha. A etiologia foi prolapso e/ou degeneração mixomatosa em 15 pacientes, degenerativa em 9, isquêmica em 5, reumática em 4 e endocardite em 3. Regurgitação mitral de grau importante ocorreu em 25 (71%) pacientes e moderada em 10 (29%). O tempo médio de acompanhamento foi de 375±395 dias (1 a 1380). Foram submetidos a tratamento clínico 19 pacientes e a tratamento cirúrgico 16, sendo que em todos foi confirmado o diagnóstico transesofágico. O número total de óbitos (hospitalar e pós-hospitalar) foi alto (34%), tanto em pacientes submetidos a tratamento clínico quanto cirúrgico. Entre os sobreviventes, 17 estão em classe funcional (CF) I e 6 em CF II da NYHA. CONCLUSÃO: O diagnóstico de flail mitral valve ao ecocardiograma transesofágico é acurado, permitindo a definição de sua etiologia e mecanismo. A alta mortalidade à época do diagnóstico, provavelmente, se relaciona à gravidade da doença subjacente. Embora os pacientes não operados estejam evoluindo bem, a baixa CF observada nestes pacientes pode ser atribuída ao curto período de seguimento.

Mitral valve disease with rheumatic appearance in the presence of left ventricular endomyocardial fibrosis

This is a report of a nine-year-old boy with both mitral stenosis and regurgitation and extensive endomyocardial fibrosis of the left ventricle. Focus is given to the singularity of the fibrotic process, with an emphasis on the etiopathogenic aspects.

Myxoma of the mitral valve

Only rarely do myxomas originate from the mitral valve. This is the report of a 49-year-old woman presenting with congestive heart failure. The diagnosis of an intracardiac tumor involving the anterior cuspid of the mitral valve was made by transesophageal echocardiography. The patient underwent surgery for tumor resection and plasty of the valve was made with reconstruction and preservation of the valve. The diagnosis of myxoma was confirmed by histology. This is the 23rd case of myxoma of the mitral valve reported in the literature.

Aortic valve assessment. Anatomical study of 100 healthy human hearts

PURPOSE: To assess anatomical characteristics of the aortic valve, so that they may be useful in diagnostic situations and surgical treatment. METHODS: The study analyzed 100 healthy fixed human hearts; 84% of them obtained from males, 61% of them from Caucasian individuals. The ages of the individuals ranged from 9 to 86 years (mean 30±15.5 years). The characteristics assessed related to age, sex, and race were the following: number and height of the cusps, size of the lunulae, internal and external intercommissural distance, position of the coronary ostium in relation to the aortic valve, position of the ventricular septum in relation to the aortic valve, thickness of the cusps. RESULTS: All hearts assessed had a tricuspidal aortic valve. In regard to the height of the cusps and size of the lunula, the left coronary cusp was larger, followed by the right coronary cusp and the noncoronary cusp. The internal and external intercommissural distances had mean values of 24.6±5.7mm and 19.7±7mm, respectively. In regard to the position of the coronary ostia, in one heart two ostia emerged from the left coronary sinus, and in another, the ostium was supracommissural. The mean diameter of the aorta was 21.8±3.6mm, and there were no significant sexual or racial differences, but the diameter increased progressively with the increase in age. The thickness of the cusps did not show any significant difference in the 3 points assessed. CONCLUSION: The aortic valve annulus did not show a perfect circumference, with some variations in the measurements of the annulus, in the cusps and in the relation with the ventricular septum.

Mitral valve repair. Quadrangular resection of the posterior leaflet in patients with myxomatous degeneration

OBJECTIVE - To analyze the immediate and late results of mitral valve repair with quadrangular resection of the posterior leaflet without the use of a prosthetic ring annuloplasty. METHODS - Using this technique, 118 patients with mitral valve prolapse who underwent mitral repair from January '84 through December '96 were studied. Age ranged from 30 to 86 (mean = 59.1±11.8) years and 62.7% were males. An associated surgery was performed in 22% of the patients, and coronary artery bypass graft was the most frequently performed surgery (15 patients - 12.7%). In 20 (16.9%) patients other associated techniques of mitral valve repair were used and shortening of elongated chordae tendineae was the most frequent one (6 patients). RESULTS - Immediate mortality was 0.9% (one patient). Long-term rates for thromboembolism, endocarditis, re-operation and death in the late postoperative period were 0.4%, 0.4%, 1.7% and 2.2% patients/year, respectively. The actuarial curve of survival was 83.8±8.6% over 12 years; survival free from re-operation was 91.8±4.3%, free from endocarditis was 99.2±0.8% and free from thromboembolism was 99.2±0.8%. In the late postoperative period, 93.8% of the patients were in functional class 1 (NYHA), with a complete follow-up in 89.7% of the patients. CONCLUSION - Patients with mitral valve prolapse who undergo mitral valve repair using this technique have a satisfactory prognosis over 12 years.

Immediate and long term evolution of valve replacement in children less than 12 years old

OBJECTIVE: The aim of this work was the follow-up and evaluation of valve replacement in children under 12 years of age. METHODS: Forty-four children less than 12 years old were underwent valve replacement at INCOR-HCFMUSP between January 1986 and December 1992. Forty (91%) were rheumatic, 39 (88.7%) were in functional classes II or IV, 19 (43.2%) were operated upon on an emergency basis, and 6 (13.6%) had atrial fibrillation. Biological prostheses (BP) were employed in 26 patients (59.1%), and mechanical prostheses (MP) in 18 (40.9%). Mitral valves were replaced in 30 (68.7%), aortic valves in 8 (18.2%), a tricuspid valve in 1 (2.3%), and double (aortic and mitral) valves in 5 (11.4) of the patients. RESULTS: Hospital mortality was of 4.5% (2 cases). The mean follow-up period was 5.8 years. Re-operations occurred in 63.3% of the patients with BP and in 12.5% of those with MP (p=0.002). Infectious endocarditis was present in 26.3% of the BP, but in none of the cases of MP (p=0.049). Thrombosis occurred in 2 (12.5%) and hemorrhage in one (6.5%) of the patients with a MP. Delayed mortality occurred in 5 (11.9%) of the patients over a mean period of 2.6 years; four had had BP and one had a MP (NS). Actuarial survival and re-operation-free curves after 10 years were respectively, 82.5±7.7 (SD)% and 20.6±15.9%. CONCLUSION: Patients with MP required fewer re-operation, had less infectious endocarditis and lower late mortality rates compared with patients with bioprostheses. The former, therefore, appear to be the best valve replacement for pediatric patients.