Recognition of Facial Expressions with Autoencoders and Convolutional-Nets

Les humains communiquent via différents types de canaux: les mots, la voix, les gestes du corps, des émotions, etc. Pour cette raison, un ordinateur doit percevoir ces divers canaux de communication pour pouvoir interagir intelligemment avec les humains, par exemple en faisant usage de microphones et de webcams. Dans cette thèse, nous nous intéressons à déterminer les émotions humaines à partir d’images ou de vidéo de visages afin d’ensuite utiliser ces informations dans différents domaines d’applications. Ce mémoire débute par une brève introduction à l'apprentissage machine en s’attardant aux modèles et algorithmes que nous avons utilisés tels que les perceptrons multicouches, réseaux de neurones à convolution et autoencodeurs. Elle présente ensuite les résultats de l'application de ces modèles sur plusieurs ensembles de données d'expressions et émotions faciales. Nous nous concentrons sur l'étude des différents types d’autoencodeurs (autoencodeur débruitant, autoencodeur contractant, etc) afin de révéler certaines de leurs limitations, comme la possibilité d'obtenir de la coadaptation entre les filtres ou encore d’obtenir une courbe spectrale trop lisse, et étudions de nouvelles idées pour répondre à ces problèmes. Nous proposons également une nouvelle approche pour surmonter une limite des autoencodeurs traditionnellement entrainés de façon purement non-supervisée, c'est-à-dire sans utiliser aucune connaissance de la tâche que nous voulons finalement résoudre (comme la prévision des étiquettes de classe) en développant un nouveau critère d'apprentissage semi-supervisé qui exploite un faible nombre de données étiquetées en combinaison avec une grande quantité de données non-étiquetées afin d'apprendre une représentation adaptée à la tâche de classification, et d'obtenir une meilleure performance de classification. Finalement, nous décrivons le fonctionnement général de notre système de détection d'émotions et proposons de nouvelles idées pouvant mener à de futurs travaux.

Recognition of static and dynamic facial expressions: Influences of sex, type and intensity of emotion

Ecological validity of static and intense facial expressions in emotional recognition has been questioned. Recent studies have recommended the use of facial stimuli more compatible to the natural conditions of social interaction, which involves motion and variations in emotional intensity. In this study, we compared the recognition of static and dynamic facial expressions of happiness, fear, anger and sadness, presented in four emotional intensities (25 %, 50 %, 75 % and 100 %). Twenty volunteers (9 women and 11 men), aged between 19 and 31 years, took part in the study. The experiment consisted of two sessions in which participants had to identify the emotion of static (photographs) and dynamic (videos) displays of facial expressions on the computer screen. The mean accuracy was submitted to an Anova for repeated measures of model: 2 sexes x [2 conditions x 4 expressions x 4 intensities]. We observed an advantage for the recognition of dynamic expressions of happiness and fear compared to the static stimuli (p < .05). Analysis of interactions showed that expressions with intensity of 25 % were better recognized in the dynamic condition (p < .05). The addition of motion contributes to improve recognition especially in male participants (p < .05). We concluded that the effect of the motion varies as a function of the type of emotion, intensity of the expression and sex of the participant. These results support the hypothesis that dynamic stimuli have more ecological validity and are more appropriate to the research with emotions.

Gender differences among undergraduates in the recognition of emotional facial expressions

The perceptive accuracy of university students was compared between men and women, from sciences and humanities courses, to recognize emotional facial expressions. emotional expressions have had increased interest in several areas involved with human interaction, reflecting the importance of perceptive skills in human expression of emotions for the effectiveness of communication. Two tests were taken: one was a quick exposure (0.5 s) of 12 faces with an emotional expression, followed by a neutral face. subjects had to tell if happiness, sadness, anger, fear, disgust or surprise was flashed, and each emotion was shown twice, at random. on the second test 15 faces with the combination of two emotional expressions were shown without a time limit, and the subject had to name one of the emotions of the previous list. in this study, women perceived sad expressions better while men realized more happy faces. there was no significant difference in other emotions detection like anger, fear, surprise, disgust. Students of humanities and sciences areas of both sexes, when compared, had similar capacities to perceive emotional expressions

Forecasting human entrances at a commercial store using facial recognition data

Dissertação de mestrado integrado em Engenharia e Gestão de Sistemas de Informação

Apoptosis y expresión de receptores de reconocimiento de patrones en Polimorfonucleares Neutrófilos de individuos con infección VIH/SIDA. Apoptosis and recognition patterns receptors expression in Polymorphonuclear Neutrophils of individuals with HIV/AIDS infection.

El Virus de la Inmunodeficiencia Humana tipo 1 (VIH-1) afecta principalmente a la respuesta inmune específica causando una pérdida progresiva de los linfocitos T CD4+. Sin embargo, este virus también afecta a células del sistema inmune innato, tales como los Polimorfonucleares Neutrófilos (PMN). Existen evidencias de alteraciones funcionales de los PMN durante la progresión de la infección por VIH y una de las explicaciones de estos defectos, la atribuye a una muerte celular programada o apoptosis constitutiva incrementada. El compromiso de la apoptosis de los PMN en la infección por VIH no está totalmente dilucidado, por ello, los objetivos de este proyecto son investigar el efecto de la infección por VIH sobre la apoptosis de PMN, analizar la expresión de moléculas y receptores de patrones de reconocimiento en estas células y evaluar el impacto de la terapia antirretroviral sobre la apoptosis y expresión de moléculas y receptores en PMN. Se incluirán individuos en distintos estadios clínicos e inmunológicos de la infección con o sin tratamiento antirretroviral y se determinarán parámetros hematológicos, inmunológicos y virológicos a fin de correlacionar el nivel de apoptosis y expresión de moléculas y receptores con el nivel de linfocitos T CD4+ y carga viral. La importancia de los PMN en el control de la infección por el VIH es actualmente un área de mucho interés, ya pueden ejercer un efecto anti-VIH directo, y al mismo tiempo, ser blancos de la infección viral. Los mecanismos que conducen a la muerte acelerada de los PMN no han sido totalmente dilucidados, por ello, su estudio permitirá entender las bases bioquímicas de los cambios morfológicos y determinar los mecanismos que definen su iniciación y regulación. En el presente proyecto, el estudio de la apoptosis de PMN de pacientes con infección VIH/SIDA posibilitará caracterizar la sobrevida de éstas células y su relación con el estado inmunológico, virológico y la terapia antirretroviral. Además, el estudio de los receptores reconocedores de patrones moleculares asociados a patógenos permitirá aclarar algunos aspectos de la activación de la respuesta inmune innata y su conexión con la inmunidad adaptativa. Comprender aspectos claves de la cascada de la apoptosis de PMN y de la expresión de receptores reconocedores de patrones moleculares en la infección VIH/SIDA podría en un futuro aportar posibles blancos terapéuticos para restaurar la función de estas células durante esta infección.

Visual recognition systems in a car passenger compartment with the focus on facial driver identification

Magdeburg, Univ., Fak. für Informatik, Diss., 2014

Cre recombinase-mediated inactivation of H-2Dd transgene expression: evidence for partial missing self-recognition by Ly49A NK cells.

We have established H-2D(d)-transgenic (Tg) mice, in which H-2D(d) expression can be extinguished by Cre recombinase-mediated deletion of an essential portion of the transgene (Tg). NK cells adapted to the expression of the H-2D(d) Tg in H-2(b) mice and acquired reactivity to cells lacking H-2D(d), both in vivo and in vitro. H-2D(d)-Tg mice crossed to mice harboring an Mx-Cre Tg resulted in mosaic H-2D(d) expression. That abrogated NK cell reactivity to cells lacking D(d). In D(d) single Tg mice it is the Ly49A+ NK cell subset that reacts to cells lacking D(d), because the inhibitory Ly49A receptor is no longer engaged by its D(d) ligand. In contrast, Ly49A+ NK cells from D(d) x MxCre double Tg mice were unable to react to D(d)-negative cells. These Ly49A+ NK cells retained reactivity to target cells that were completely devoid of MHC class I molecules, suggesting that they were not anergic. Variegated D(d) expression thus impacts specifically missing D(d) but not globally missing class I reactivity by Ly49A+ NK cells. We propose that the absence of D(d) from some host cells results in the acquisition of only partial missing self-reactivity.

RNA polymerase I promoter and splice acceptor site recognition affect gene expression in non-pathogenic Leishmania species

Leishmania (Sauroleishmania) tarentolae has biotechnological potential for use as live vaccine against visceral leishmaniasis and as a system for the over expression of eukaryotic proteins that possess accurate post-translational modifications. For both purposes, new systems for protein expression in this non-pathogenic protozoan are necessary. The ribosomal RNA promoter proved to be a stronger transcription driver since its use yielded increased levels of recombinant protein in organisms of both genera Trypanosoma or Leishmania. We have evaluated heterologous expression systems using vectors with two different polypyrimidine tracts in the splice acceptor site by measuring a reporter gene transcribed from L. tarentolae RNA polymerase I promoter. Our data indicate that the efficiency of chloramphenicol acetyl transferase expression changed drastically with homologous or heterologous sequences, depending on the polypyrimidine tract used in the construct and differences in size and/or distance from the AG dinucleotide. In relation to the promoter sequence the reporter expression was higher in heterologous lizard-infecting species than in the homologous L. tarentolae or in the mammalian-infecting L. (Leishmania) amazonensis.

Expression of non-TLR pattern recognition receptors in the spleen of BALB/c mice infected with Plasmodium yoelii and Plasmodium chabaudi chabaudi AS

The spleen plays a crucial role in the development of immunity to malaria, but the role of pattern recognition receptors (PRRs) in splenic effector cells during malaria infection is poorly understood. In the present study, we analysed the expression of selected PRRs in splenic effector cells from BALB/c mice infected with the lethal and non-lethal Plasmodium yoelii strains 17XL and 17X, respectively, and the non-lethal Plasmodium chabaudi chabaudi AS strain. The results of these experiments showed fewer significant changes in the expression of PRRs in AS-infected mice than in 17X and 17XL-infected mice. Mannose receptor C type 2 (MRC2) expression increased with parasitemia, whereas Toll-like receptors and sialoadhesin (Sn) decreased in mice infected with P. chabaudi AS. In contrast, MRC type 1 (MRC1), MRC2 and EGF-like module containing mucin-like hormone receptor-like sequence 1 (F4/80) expression decreased with parasitemia in mice infected with 17X, whereas MRC1 an MRC2 increased and F4/80 decreased in mice infected with 17XL. Furthermore, macrophage receptor with collagenous structure and CD68 declined rapidly after initial parasitemia. SIGNR1 and Sn expression demonstrated minor variations in the spleens of mice infected with either strain. Notably, macrophage scavenger receptor (Msr1) and dendritic cell-associated C-type lectin 2 expression increased at both the transcript and protein levels in 17XL-infected mice with 50% parasitemia. Furthermore, the increased lethality of 17X infection in Msr1 -/- mice demonstrated a protective role for Msr1. Our results suggest a dual role for these receptors in parasite clearance and protection in 17X infection and lethality in 17XL infection.

Expression of cysteine proteinase type I and II of Leishmania infantum and their recognition by sera during canine and human visceral leishmaniasis.

In this study, the mature domains of type I (CPB) and type II (CPA) cysteine proteinases (CPs) of Leishmania infantum were expressed and their immunogenic properties defined using sera from active and recovered cases of human visceral leishmaniasis and sera from infected dogs. Immunoblotting and ELISA analysis indicated that a freeze/thaw extract of parasite antigens showed similar and intensive recognition in both active cases of human and dog sera but lower recognition in recovered human individuals. The total IgG of actively infected human sera was higher than in recovered cases when rCPs were used as antigen. In contrast to dog sera, both active and recovered human cases have higher recognition toward rCPB than rCPA. Furthermore, the asymptomatic dogs in contrast to the symptomatic cases exhibited specific lymphocyte proliferation to both crude antigens and rCPs.

Evidence for the expression of native Mycobacterium tuberculosis phospholipase C: recognition by immune sera and detection of promoter activity

The genome of Mycobacterium tuberculosis H37Rv contains three contiguous genes (plc-a, plc-b and plc-c) which are similar to the Pseudomonas aeruginosa phospholipase C (PLC) genes. Expression of mycobacterial PLC-a and PLC-b in E. coli and M. smegmatis has been reported, whereas expression of the native proteins in M. tuberculosis H37Rv has not been demonstrated. The objective of the present study was to demonstrate that native PLC-a is expressed in M. tuberculosis H37Rv. Sera from mice immunized with recombinant PLC-a expressed in E. coli were used in immunoblots to evaluate PLC-a expression. The immune serum recognized a 49-kDa protein in immunoblots against M. tuberculosis extracts. No bands were visible in M. tuberculosis culture supernatants or extracts from M. avium, M. bovis and M. smegmatis. A 550-bp DNA fragment upstream of plc-a was cloned in the pJEM12 vector and the existence of a functional promoter was evaluated by detection of ß-galactosidase activity. ß-Galactosidase activity was detected in M. smegmatis transformed with recombinant pJEM12 grown in vitro and inside macrophages. The putative promoter was active both in vitro and in vivo, suggesting that expression is constitutive. In conclusion, expression of non-secreted native PLC-a was demonstrated in M. tuberculosis.

The role of the amygdala in facial emotional expression during a discrimination task. 'El papel de la am??gdala en una tarea de discriminaci??n de expresiones emocionales'

Resumen tomado de la publicaci??n. Resumen tambi??n en ingl??s

Weightless neural nets for face recognition: a comparison

This paper considers the application of weightless neural networks (WNNs) to the problem of face recognition and compares the results with those provided using a more complicated multiple neural network approach. WNNs have significant advantages over the more common forms of neural networks, in particular in term of speed of operation and learning. A major difficulty when applying neural networks to face recognition problems is the high degree of variability in expression, pose and facial details: the generalisation properties of a WNN can be crucial. In the light of this problem a software simulator of a WNN has been built and the results of some initial tests are presented and compared with other techniques

Gene and protein expression of oestrogen-beta and progesterone receptors in facial melasma and adjacent healthy skin in women

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)