Hand gesture recognition for human computer interaction : a comparative study of different image features

Hand gesture recognition for human computer interaction, being a natural way of human computer interaction, is an area of active research in computer vision and machine learning. This is an area with many different possible applications, giving users a simpler and more natural way to communicate with robots/systems interfaces, without the need for extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them to convey information or for device control. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. In this study we try to identify hand features that, isolated, respond better in various situations in human-computer interaction. The extracted features are used to train a set of classifiers with the help of RapidMiner in order to find the best learner. A dataset with our own gesture vocabulary consisted of 10 gestures, recorded from 20 users was created for later processing. Experimental results show that the radial signature and the centroid distance are the features that when used separately obtain better results, with an accuracy of 91% and 90,1% respectively obtained with a Neural Network classifier. These to methods have also the advantage of being simple in terms of computational complexity, which make them good candidates for real-time hand gesture recognition.

Hand gesture recognition system based in computer vision and machine learning

"Lecture notes in computational vision and biomechanics series, ISSN 2212-9391, vol. 19"

Vision-based portuguese sign language recognition system

Vision-based hand gesture recognition is an area of active current research in computer vision and machine learning. Being a natural way of human interaction, it is an area where many researchers are working on, with the goal of making human computer interaction (HCI) easier and natural, without the need for any extra devices. So, the primary goal of gesture recognition research is to create systems, which can identify specific human gestures and use them, for example, to convey information. For that, vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition in real time. Hand gestures are a powerful human communication modality with lots of potential applications and in this context we have sign language recognition, the communication method of deaf people. Sign lan- guages are not standard and universal and the grammars differ from country to coun- try. In this paper, a real-time system able to interpret the Portuguese Sign Language is presented and described. Experiments showed that the system was able to reliably recognize the vowels in real-time, with an accuracy of 99.4% with one dataset of fea- tures and an accuracy of 99.6% with a second dataset of features. Although the im- plemented solution was only trained to recognize the vowels, it is easily extended to recognize the rest of the alphabet, being a solid foundation for the development of any vision-based sign language recognition user interface system.

Hand gesture recognition system based in computer vision and machine learning: Applications on human-machine interaction

Tese de Doutoramento em Engenharia de Eletrónica e de Computadores

Plasmodium falciparum merozoite surface protein 2: epitope mapping and biological activity analysis of specific antibodies

Background: Plasmodium falciparum(P. falciparum) merozoite surfaceprotein 2 (MSP-2) is one of bloodstage proteins that are associated withprotection from malaria. MSP-2 consistsof a highly polymorphic centralrepeat region flanked by a dimorphicregion that defines the two allelicfamilies, 3D7 and FC27; N- and Cterminalregions are conserved domains.Long synthetic peptides (LSP)representing the two allelic familiesof MSP-2 and constant regions arerecognized by sera from donors livingin endemic areas; and specific antibodies(Abs) are associated with protectionand active in antibody dependentcellular inhibition (ADCI) in vitro.However, the fine specificity ofAb response to the two allelic familiesof MSP-2 is unknown. Methods: Peptidesrepresenting dimorphic regionof 3D7 and FC27 families and theirC-terminal (common fragment to thetwo families) termed 3D7-D (88 aa),FC27-D (48 aa) and C (40 aa) respectivelywere synthesized. Overlapping20 mer peptides covering dimorphicand constant regions of two familieswere also synthesized for epitopemapping. Human sera were obtainedfrom donors living in malaria endemicareas. SpecificDand CregionsAbs were purified from single or poolhuman sera. Sera from mice were obtainedafter immunization with thetwo families LSP mixture in three differentadjuvants: alhydrogel (Alum),Glucopyranosyl Lipid Adjuvant-Stableoil-in-water Emulsion (GLA-SE)and Virosome. For ADCI, P. falciparum(strain 3D7) parasite wasmaintained in culture at 0.5% parasitemiaand 4% hematocrit in air tightbox at love oxygen (2%) and 37 ºC.Results: We identified several epitopesfrom the dimorphic and constantregions of both families of MSP-2, inmice and humans (adults and children).In human, most recognizedepitopes were the same in differentendemic regions for each domain ofthe two families of MSP-2. In mice,the differential recognition of epitopewas depending on the strain of mouseand interestingly on the adjuvantused. GLA-SE and alum as adjuvantswere more often associated with therecognition of multiple epitopes thanvirosomes. Epitope-specific Abs recognizednative merozoites of P.falciparum and were active in ADCIto block development of parasite.Conclusion: The delineation of a limitednumber of epitopes could be exploitedto develop MSP-2 vaccinesactive on both allelic families ofMSP-2.

Heterogeneous T-cell response to MAGE-A10(254-262): high avidity-specific cytolytic T lymphocytes show superior antitumor activity.

MAGE-encoded antigens, which are expressed by tumors of many histological types but not in normal tissues, are suitable candidates for vaccine-based immunotherapy of cancers. Thus far, however, T-cell responses to MAGE antigens have been detected only occasionally in cancer patients. In contrast, by using HLA/peptide fluorescent tetramers, we have observed recently that CD8(+) T cells specific for peptide MAGE-A10(254-262) can be detected frequently in peptide-stimulated peripheral blood mononuclear cells from HLA-A2-expressing melanoma patients and healthy donors. On the basis of these results, antitumoral vaccination trials using peptide MAGE-A10(254-262) have been implemented recently. In the present study, we have characterized MAGE-A10(254-262)-specific CD8(+) T cells in polyclonal cultures and at the clonal level. The results indicate that the repertoire of MAGE-A10(254-262)-specific CD8(+) T cells is diverse both in terms of clonal composition, efficiency of peptide recognition, and tumor-specific lytic activity. Importantly, only CD8(+) T cells able to recognize the antigenic peptide with high efficiency are able to lyse MAGE-A10-expressing tumor cells. Under defined experimental conditions, the tetramer staining intensity exhibited by MAGE-A10(254-262)-specific CD8(+) T cells correlates with efficiency of peptide recognition so that "high" and "low" avidity cells can be separated by FACS. Altogether, the data reported here provide evidence for functional diversity of MAGE-A10(254-262)-specific T cells and will be instrumental for the monitoring of peptide MAGE-A10(254-262)-based clinical trials.

Tissue-specific segregation of CD1d-dependent and CD1d-independent NK T cells.

NKT cells, defined as T cells expressing the NK cell marker NK1.1, are involved in tumor rejection and regulation of autoimmunity via the production of cytokines. We show in this study that two types of NKT cells can be defined on the basis of their reactivity to the monomorphic MHC class I-like molecule CD1d. One type of NKT cell is positively selected by CD1d and expresses a biased TCR repertoire together with a phenotype found on activated T cells. A second type of NKT cell, in contrast, develops in the absence of CD1d, and expresses a diverse TCR repertoire and a phenotype found on naive T cells and NK cells. Importantly, the two types of NKT cells segregate in distinct tissues. Whereas thymus and liver contain primarily CD1d-dependent NKT cells, spleen and bone marrow are enriched in CD1d-independent NKT cells. Collectively, our data suggest that recognition of tissue-specific ligands by the TCR controls localization and activation of NKT cells.

Trypanosoma cruzi recognition by macrophages and muscle cells: perspectives after a 15-year study

Macrophages and muscle cells are the main targets for invasion of Trypanosoma cruzi. Ultrastructural studies of this phenomenon in vitro showed that invasion occurs by endocytosis, with attachment and internalization being mediated by different components capable of recognizing epi-or trypomastigotes (TRY). A parasitophorus vacuole was formed in both cell types, thereafter fusing with lysosomes. Then, the mechanism of T. cruzi invasion of host cells (HC) is essentially similar (during a primary infection in the abscence of a specific immune response), regardless of wether the target cell is a professional or a non-professional phagocytic cell. Using sugars, lectins, glycosidases, proteinases and proteinase inhibitors, we observed that the relative balance between exposed sialic acid and galactose/N-acetyl galactosamine (GAL) residues on the TRY surface, determines the parasite's capacity to invade HC, and that lectin-mediated phagocytosis with GAL specificity is important for internalization of T. cruzi into macrophages. On the other hand, GAL on the surface to heart muscle cells participate on TRY adhesion. TRY need to process proteolytically both the HC and their own surface, to expose the necessary ligands and receptors that allow binding to, and internalization in the host cell. The diverse range of molecular mechanisms which the parasite could use to invade the host cell may correspond to differences in the available "receptors"on the surface of each specific cell type. Acute phase components, with lectin or proteinase inhibitory activities (a-macroglobulins), may also be involved in T. cruzi-host cell interaction.

Pyochelin enantiomers and their outer-membrane siderophore transporters in fluorescent pseudomonads: structural bases for unique enantiospecific recognition.

Pyochelin (Pch) and enantiopyochelin (EPch) are enantiomeric siderophores, with three chiral centers, produced under iron limitation conditions by Pseudomonas aeruginosa and Pseudomonas fluorescens , respectively. After iron chelation in the extracellular medium, Pch-Fe and EPch-Fe are recognized and transported by their specific outer-membrane transporters: FptA in P. aeruginosa and FetA in P. fluorescens . Structural analysis of FetA-EPch-Fe and FptA-Pch-Fe, combined with mutagenesis and docking studies revealed the structural basis of the stereospecific recognition of these enantiomers by their respective transporters. Whereas FetA and FptA have a low sequence identity but high structural homology, the Pch and EPch binding pockets do not share any structural homology, but display similar physicochemical properties. The stereospecific recognition of both enantiomers by their corresponding transporters is imposed by the configuration of the siderophore's C4'' and C2'' chiral centers. This recognition involves specific hydrogen bonds between the Arg91 guanidinium group and EPch-Fe for FetA and between the Leu117-Leu116 main chain and Pch-Fe for FptA. FetA and FptA are the first membrane receptors to be structurally described with opposite binding enantioselectivities for their ligands, giving insights into the structural basis of their enantiospecificity.

Natural killer cell mediated missing-self recognition can protect mice from primary chronic myeloid leukemia in vivo.

Background: Natural Killer (NK) cells are thought to protect from residual leukemic cells in patients receiving stem cell transplantation. However, multiple retrospective analyses of patient data have yielded conflicting conclusions regarding a putative role of NK cells and the essential NK cell recognition events mediating a protective effect against leukemia. Further, a NK cell mediated protective effect against primary leukemia in vivo has not been shown directly.Methodology/Principal Findings: Here we addressed whether NK cells have the potential to control chronic myeloid leukemia (CML) arising based on the transplantation of BCR-ABL1 oncogene expressing primary bone marrow precursor cells into lethally irradiated recipient mice. These analyses identified missing-self recognition as the only NK cell-mediated recognition strategy, which is able to significantly protect from the development of CML disease in vivo.Conclusion: Our data provide a proof of principle that NK cells can control primary leukemic cells in vivo. Since the presence of NK cells reduced the abundance of leukemia propagating cancer stem cells, the data raise the possibility that NK cell recognition has the potential to cure CML, which may be difficult using small molecule BCR-ABL1 inhibitors. Finally, our findings validate approaches to treat leukemia using antibody-based blockade of self-specific inhibitory MHC class I receptors.

Laser scanning-based recognition of rotational movements on a deep seated gravitational instability: The Cinque Torri case (North-Eastern Italian Alps)

The Cinque Torri group (Cortina d'Ampezzo, Italy) is an articulated system of unstable carbonatic rock monoliths located in a very important tourism area and therefore characterized by a significant risk. The instability phenomena involved represent an example of lateral spreading developed over a larger deep seated gravitational slope deformation (DSGSD) area. After the recent fall of a monolith of more than 10 000 m3, a scientific study was initiated to monitor the more unstable sectors and to characterize the past movements as a fundamental tool for predicting future movements and hazard assessment. To achieve greater insight on the ongoing lateral spreading process, a method for a quantitative analysis of rotational movements associated with the lateral spreading has been developed, applied and validated. The method is based on: i) detailed geometrical characterization of the area by means of laser scanner techniques; ii) recognition of the discontinuity sets and definition of a reference frame for each set, iii) correlation between the obtained reference frames related to a specific sector and a stable external reference frame, and iv) determination of the 3D rotations in terms of Euler angles to describe the present settlement of the Cinque Torri system with respect to the surrounding stable areas. In this way, significant information on the processes involved in the fragmentation and spreading of a former dolomitic plateau into different rock cliffs has been gained. The method is suitable to be applied to similar case studies.

Naturally acquired MAGE-A10- and SSX-2-specific CD8+ T cell responses in patients with hepatocellular carcinoma.

Immunotherapy is being proposed to treat patients with hepatocellular carcinoma (HCC). However, more detailed knowledge on tumor Ag expression and specific immune cells is required for the preparation of highly targeted vaccines. HCC express a variety of tumor-specific Ags, raising the question whether CTL specific for such Ags exist in HCC patients. Indeed, a recent study revealed CTLs specific for two cancer-testis (CT) Ags (MAGE-A1 and MAGE-A3) in tumor infiltrating lymphocytes of HCC patients. Here we assessed the presence of T cells specific for additional CT Ags: MAGE-A10, SSX-2, NY-ESO-1, and LAGE-1, which are naturally immunogenic as demonstrated in HLA-A2(+) melanoma patients. In two of six HLA-A2(+) HCC patients, we found that MAGE-A10- and/or SSX-2-specific CD8(+) T cells naturally responded to the disease, because they were enriched in tumor lesions but not in nontumoral liver. Isolated T cells specifically and strongly killed tumor cells in vitro, providing evidence that these CTL were selected in vivo for high avidity Ag recognition. Therefore, besides melanoma, HCC is the second solid human tumor with clear evidence for in vivo tumor recognition by T cells, providing the rational for specific immunotherapy, based on immunization with CT Ags such as MAGE-A10 and SSX-2.

Human scFv antibody fragments specific for the epithelial tumour marker MUC-1, selected by phage display on living cells.

New anti-cancer agents are being developed that specifically recognise tumour cells. Recognition is dependent upon the enhanced expression of antigenic determinants on the surface of tumour cells. The tumour exposure and the extracellular accessibility of the mucin MUC-1 make this marker a suitable target for tumour diagnosis and therapy. We isolated and characterised six human scFv antibody fragments that bound to the MUC-1 core protein, by selecting a large naive human phage display library directly on a MUC-1-expressing breast carcinoma cell line. Their binding characteristics have been studied by ELISA, FACS and indirect immunofluorescence. The human scFv antibody fragments were specific for the tandem repeat region of MUC-1 and their binding is inhibited by soluble antigen. Four human scFv antibody fragments (M2, M3, M8, M12) recognised the hydrophilic PDTRP region of the MUC-1 core protein, which is thought to be an immunodominant region. The human scFv antibody fragments were stable in human serum at 37 degrees C and retained their binding specificity. For imaging or targeting to tumours over-expressing MUC-1, it might be feasible to use these human scFv, or multivalent derivatives, as vehicles to deliver anti-cancer agents.

An exploratory study on facial emotion recognition capacity in beginning Alzheimer's disease.

Objective: It was the aim of this study to investigate facial emotion recognition (FER) in the elderly with cognitive impairment. Method: Twelve patients with Alzheimer's disease (AD) and 12 healthy control subjects were asked to name dynamic or static pictures of basic facial emotions using the Multimodal Emotion Recognition Test and to assess the degree of their difficulty in the recognition task, while their electrodermal conductance was registered as an unconscious processing measure. Results: AD patients had lower objective recognition performances for disgust and fear, but only disgust was accompanied by decreased subjective FER in AD patients. The electrodermal response was similar in all groups. No significant effect of dynamic versus static emotion presentation on FER was found. Conclusion: Selective impairment in recognizing facial expressions of disgust and fear may indicate a nonlinear decline in FER capacity with increasing cognitive impairment and result from progressive though specific damage to neural structures engaged in emotional processing and facial emotion identification. Although our results suggest unchanged unconscious FER processing with increasing cognitive impairment, further investigations on unconscious FER and self-awareness of FER capacity in neurodegenerative disorders are required.

Inhibition of antigen-induced T-cell clone proliferation by antigen-specific antibodies.

Attempts to inhibit the recognition of soluble antigens by T lymphocytes using antibodies specific for the antigen in question have been uniformally unsuccessful, in contrast to the observed specific inhibition of antibody generation by B cells. One exception is the unique situation whereby anti-hapten antisera inhibit the T-cell proliferative responses observed when hapten-specific T lymphocytes or clones are cultured with hapten-derivatized cells or proteins. The inability to inhibit T-cell functions by antigen-specific antibodies has been interpreted in several ways: (1) T cells possess a different repertoire from B cells; (2) the antibodies tested recognize epitopes present on the native antigen, whereas T cells recognize non-native (processed) structures; (3) the antigenic determinant(s) recognized by T cells on the surface of antigen presenting cells are either not accessible to antibodies, or are present in low amounts. The development of antigen-specific T-cell clones and monoclonal antibodies both specific for the same antigenic determinants now allows this question to be investigated definitively. Here, we report for the first time the specific inhibition of antigen-induced T-cell clone proliferation by a monoclonal antibody directed against the relevant soluble protein antigen.