Something to smile about: The interrelationship between attractiveness and emotional expression

Previous studies have suggested a link between the processing of the emotional expression of a face and how attractive it appears. In two experiments we investigated the interrelationship between attractiveness and happiness. In Experiment 1 we presented morphed faces varying in attractiveness and happiness and asked participants to choose the more attractive of two simultaneously presented faces. In the second experiment we used the same stimuli as in Experiment 1 and asked participants to choose the happier face. The results of Experiment 1 revealed that the evaluation of attractiveness is strongly influenced by the intensity of a smile expressed on a face: A happy facial expression could even compensate for relative unattractiveness. Conversely, the findings of Experiment 2 showed that facial attractiveness also influences the evaluation of happiness: It was easier to choose the happier of two faces if the happier face was also more attractive. We discuss the interrelationship of happiness and attractiveness with regard to evolutionary relevance of positive affective status and rewarding effects.

Facial Feedback Affects Perceived Intensity but Not Quality of Emotional Expressions

Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.

Estudo de associação entre déficits de reconhecimento de emoções em faces, flexibilidade mental e adequação social, em pacientes com transtorno bipolar do tipo I eutímicos, comparados com controles normais

Introdução: O objetivo do estudo foi investigar se há associação entre déficits na capacidade de reconhecimento de emoções faciais e déficits na flexibilidade mental e na adequação social em pacientes com Transtorno Bipolar do tipo I eutímicos quando comparados a sujeitos controles sem transtorno mental. Métodos: 65 pacientes com Transtorno Bipolar do tipo I eutímicos e 95 controles sem transtorno mental, foram avaliados no reconhecimento de emoções faciais, na flexibilidade mental e na adequação social através de avaliações clínicas e neuropsicológicas. Os sintomas afetivos foram avaliados através da Escala de Depressão de Hamilton e da Escala de Mania de Young, o reconhecimento de emoções faciais através da Facial Expressions of Emotion: Stimuli and Tests, a flexibilidade mental avaliada através do Wisconsin Card Sorting Test e a adequação social através da Escala de Auto- Avaliação de Adequação Social. Resultados: Pacientes com Transtorno Bipolar do tipo I eutímicos apresentam uma associação de maior intensidade comparativamente aos controles entre o reconhecimento de emoções faciais e a flexibilidade mental, indicando que quanto mais preservada a flexibilidade mental, melhor será a habilidade para reconhecer emoções faciais Neste grupo às correlações de todas as emoções são positivas com o total de acertos e as categorias e são negativas com as respostas perseverativas, total de erros, erros perseverativos e erros não perseverativos. Não houve uma correlação entre o reconhecimento de emoções faciais e a adequação social, apesar dos pacientes com Transtorno Bipolar do tipo I eutímicos apresentar uma pior adequação social, sinalizando que a pior adequação social não parece ser devida a uma dificuldade em reconhecer e interpretar adequadamente as expressões faciais. Os pacientes com Transtorno Bipolar do tipo I eutímicos não apresentam diferenças significativas no reconhecimento de emoções faciais em relação aos controles, entretanto no subteste surpresa (p=0,080) as diferenças estão no limite da significância estatística, indicando que portadores de transtorno bipolar do tipo I eutímicos tendem a apresentar um pior desempenho no reconhecimento da emoção surpresa em relação aos controles. Conclusão: Nossos resultados reforçam a hipótese de que existe uma associação entre o reconhecimento de emoções faciais e a preservação do funcionamento executivo, mais precisamente a flexibilidade mental, indicando que quanto maior a flexibilidade mental, melhor será a habilidade para reconhecer emoções faciais e melhorar o desempenho funcional do paciente. Pacientes bipolares do tipo I eutímicos apresentam uma pior adequação social quando comparados aos controles, o que pode ser uma consequência do Transtorno Bipolar que ratifica a necessidade de uma intervenção terapêutica rápida e eficaz nestes pacientes

Louis Kuhne's Facial diagnosis ...

Later ed. has title: The science of facial expression.

Investigation of neural correlates of faces and emotional expressions using magnetoencephalography

The recognition of faces and of facial expressions in an important evolutionary skill, and an integral part of social communication. It has been argued that the processing of faces is distinct from the processing of non-face stimuli and functional neuroimaging investigations have even found evidence of a distinction between the perception of faces and of emotional expressions. Structural and temporal correlates of face perception and facial affect have only been separately identified. Investigation neural dynamics of face perception per se as well as facial affect would allow the mapping of these in space, time and frequency specific domains. Participants were asked to perform face categorisation and emotional discrimination tasks and Magnetoencephalography (MEG) was used to measure the neurophysiology of face and facial emotion processing. SAM analysis techniques enable the investigation of spectral changes within specific time-windows and frequency bands, thus allowing the identification of stimulus specific regions of cortical power changes. Furthermore, MEG’s excellent temporal resolution allows for the detection of subtle changes associated with the processing of face and non-face stimuli and different emotional expressions. The data presented reveal that face perception is associated with spectral power changes within a distributed cortical network comprising occipito-temporal as well as parietal and frontal areas. For the perception of facial affect, spectral power changes were also observed within frontal and limbic areas including the parahippocampal gyrus and the amygdala. Analyses of temporal correlates also reveal a distinction between the processing of faces and facial affect. Face perception per se occurred at earlier latencies whereas the discrimination of facial expression occurred within a longer time-window. In addition, the processing of faces and facial affect was differentially associated with changes in cortical oscillatory power for alpha, beta and gamma frequencies. The perception of faces and facial affect is associated with distinct changes in cortical oscillatory activity that can be mapped to specific neural structures, specific time-windows and latencies as well as specific frequency bands. Therefore, the work presented in this thesis provides further insight into the sequential processing of faces and facial affect.

Genetic modulation of the response bias towards facial displays of anger and happiness

Background: Investigating genetic modulation of emotion processing may contribute to the understanding of heritable mechanisms of emotional disorders. The aim of the present study was to test the effects of catechol- O-methyltransferase (COMT) val158met and serotonin-transporter-linked promoter region (5-HTTLPR) polymorphisms on facial emotion processing in healthy individuals. Methods: Two hundred and seventy five (167 female) participants were asked to complete a computerized facial affect recognition task, which involved four experimental conditions, each containing one type of emotional face (fearful, angry, sad or happy) intermixed with neutral faces. Participants were asked to indicate whether the face displayed an emotion or was neutral. The COMT-val158met and 5-HTTLPR polymorphisms were genotyped. Results: Met homozygotes (COMT) showed a stronger bias to perceive neutral faces as expressions of anger, compared with val homozygotes. However, the S-homozygotes (5-HTTLPR) showed a reduced bias to perceive neutral faces as expressions of happiness, compared to L-homozygotes. No interaction between 5-HTTLPR and COMT was found. Conclusions: These results add to the knowledge of individual differences in social cognition that are modulated via serotonergic and dopaminergic systems. This potentially could contribute to the understanding of the mechanisms of susceptibility to emotional disorders. © 2013 Elsevier Masson SAS.

Thermal imaging as a biometrics approach to facial signature authentication

This dissertation develops an image processing framework with unique feature extraction and similarity measurements for human face recognition in the thermal mid-wave infrared portion of the electromagnetic spectrum. The goals of this research is to design specialized algorithms that would extract facial vasculature information, create a thermal facial signature and identify the individual. The objective is to use such findings in support of a biometrics system for human identification with a high degree of accuracy and a high degree of reliability. This last assertion is due to the minimal to no risk for potential alteration of the intrinsic physiological characteristics seen through thermal infrared imaging. The proposed thermal facial signature recognition is fully integrated and consolidates the main and critical steps of feature extraction, registration, matching through similarity measures, and validation through testing our algorithm on a database, referred to as C-X1, provided by the Computer Vision Research Laboratory at the University of Notre Dame. Feature extraction was accomplished by first registering the infrared images to a reference image using the functional MRI of the Brain’s (FMRIB’s) Linear Image Registration Tool (FLIRT) modified to suit thermal infrared images. This was followed by segmentation of the facial region using an advanced localized contouring algorithm applied on anisotropically diffused thermal images. Thermal feature extraction from facial images was attained by performing morphological operations such as opening and top-hat segmentation to yield thermal signatures for each subject. Four thermal images taken over a period of six months were used to generate thermal signatures and a thermal template for each subject, the thermal template contains only the most prevalent and consistent features. Finally a similarity measure technique was used to match signatures to templates and the Principal Component Analysis (PCA) was used to validate the results of the matching process. Thirteen subjects were used for testing the developed technique on an in-house thermal imaging system. The matching using an Euclidean-based similarity measure showed 88% accuracy in the case of skeletonized signatures and templates, we obtained 90% accuracy for anisotropically diffused signatures and templates. We also employed the Manhattan-based similarity measure and obtained an accuracy of 90.39% for skeletonized and diffused templates and signatures. It was found that an average 18.9% improvement in the similarity measure was obtained when using diffused templates. The Euclidean- and Manhattan-based similarity measure was also applied to skeletonized signatures and templates of 25 subjects in the C-X1 database. The highly accurate results obtained in the matching process along with the generalized design process clearly demonstrate the ability of the thermal infrared system to be used on other thermal imaging based systems and related databases. A novel user-initialization registration of thermal facial images has been successfully implemented. Furthermore, the novel approach at developing a thermal signature template using four images taken at various times ensured that unforeseen changes in the vasculature did not affect the biometric matching process as it relied on consistent thermal features.

La retroalimentación facial y su efecto en la evaluación de publicidad de humor

La hipótesis de retroalimentación facial planteada por Tomkins en 1962 sustenta que la activación de algunos músculos faciales envía información sensorial al cerebro y se induce entonces una experiencia emocional en el sujeto. Partiendo de dicha teoría y de investigaciones que la sustentan, el presente estudio se propuso confirmar el efecto de la emoción inducida a través de la retroalimentación facial sobre la evaluación de cinco tipos de humor en publicidad. Para ello se realizó un experimento con 60 hombres y 60 mujeres, que fueron asignados aleatoriamente a una de dos condiciones: estimulación de sonrisa –músculos hacia arriba- o inhibición de sonrisa –músculos hacía abajo-, mientras evaluaban 16 imágenes de publicidad de humor. A partir del análisis de los resultados se encontraron diferencias significativas entre las condiciones; en línea con la hipótesis formulada, los participantes expuestos a la condición estimulación de sonrisa –músculos hacía arriba- evaluaron más positivamente los comerciales. También se encontraron diferencias significativas en función del sexo y los tipos de humor evaluados. El estudio ofrece evidencia empírica de la teoría propuesta hace más de medio siglo y su efecto en el ámbito de la publicidad actual.

Integrating an Emotion Recognition Model for the Flobi System

This thesis investigates if emotional states of users interacting with a virtual robot can be recognized reliably and if specific interaction strategy can change the users’ emotional state and affect users’ risk decision. For this investigation, the OpenFace [1] emotion recognition model was intended to be integrated into the Flobi [2] system, to allow the agent to be aware of the current emotional state of the user and to react appropriately. There was an open source ROS [3] bridge available online to integrate OpenFace to the Flobi simulation but it was not consistent with some other projects in Flobi distribution. Then due to technical reasons DeepFace was selected. In a human-agent interaction, the system is compared to a system without using emotion recognition. Evaluation could happen at different levels: evaluation of emotion recognition model, evaluation of the interaction strategy, and evaluation of effect of interaction on user decision. The results showed that the happy emotion induction was 58% and fear emotion induction 77% successful. Risk decision results show that: in happy induction after interaction 16.6% of participants switched to a lower risk decision and 75% of them did not change their decision and the remaining switched to a higher risk decision. In fear inducted participants 33.3% decreased risk 66.6 % did not change their decision The emotion recognition accuracy was and had bias to. The sensitivity and specificity is calculated for each emotion class. The emotion recognition model classifies happy emotions as neutral in most of the time.

Studies of Cognition and Emotion in Organisations: Attribution, Affective Events, Emotional Intelligence and Perception of Emotion

This article details the author’s attempts to improve understanding of organisational behaviour through investigation of the cognitive and affective processes that underlie attitudes and behaviour. To this end, the paper describes the author’s earlier work on the attribution theory of leadership and, more recently, in three areas of emotion research: affective events theory, emotional intelligence, and the effect of supervisors’ facial expression on employees’ perceptions of leader-member exchange quality. The paper summarises the author’s research on these topics, shows how they have contributed to furthering our understanding of organisational behaviour, suggests where research in these areas are going, and draws some conclusions for management practice.

Elevated striatal and decreased dorsolateral prefrontal cortical activity in response to emotional stimuli in euthymic bipolar disorder: no associations with psychotropic medication load

To examine abnormal patterns of frontal cortical-subcortical activity in response to emotional stimuli in euthymic individuals with bipolar disorder type I in order to identify trait-like, pathophysiologic mechanisms of the disorder. We examined potential confounding effects of total psychotropic medication load and illness variables upon neural abnormalities. We analyzed neural activity in 19 euthymic bipolar and 24 healthy individuals to mild and intense happy, fearful and neutral faces. Relative to healthy individuals, bipolar subjects had significantly increased left striatal activity in response to mild happy faces (p < 0.05, corrected), decreased right dorsolateral prefrontal cortical (DLPFC) activity in response to neutral, mild and intense happy faces, and decreased left DLPFC activity in response to neutral, mild and intense fearful faces (p < 0.05, corrected). Bipolar and healthy individuals did not differ in amygdala activity in response to either emotion. In bipolar individuals, there was no significant association between medication load and abnormal activity in these regions, but a negative relationship between age of illness onset and amygdala activity in response to mild fearful faces (p = 0.007). Relative to those without comorbidities, bipolar individuals with comorbidities showed a trend increase in left striatal activity in response to mild happy faces. Abnormally increased striatal activity in response to potentially rewarding stimuli and decreased DLPFC activity in response to other emotionally salient stimuli may underlie mood instabilities in euthymic bipolar individuals, and are more apparent in those with comorbid diagnoses. No relationship between medication load and abnormal neural activity in bipolar individuals suggests that our findings may reflect pathophysiologic mechanisms of the illness rather than medication confounds. Future studies should examine whether this pattern of abnormal neural activity could distinguish bipolar from unipolar depression.

Use of Music and Voice Stimulus on Patients With Disorders of Consciousness

The objectives of this study were to check music and voice message influence on vital signs and facial expressions of patients with disorders of consciousness and to connect the existence of patient`s responses with the Glasgow Coma Scale or with the Ramsay Sedation Scale. The method was a single-blinded randomized controlled clinical trial with 30 patients, from two intensive care units, being divided into two groups (control and experimental). Their relatives recorded a voice message and chose a song according to the patient`s preference. The patients were submitted to three sessions for three consecutive days. Significant statistical alterations of the vital signs were noted during the message playback (oxygen saturation-Day 1 and Day 3; respiratory frequency-Day 3) and with facial expression, on Day 1, during both music and message. The conclusion was that the voice message was a stronger stimulus than the music.

Effects of sex hormonal levels and phases of the menstrual cycle in the processing of emotional faces

Several neuropsychiatry disorders have shown a sexual dimorphism in their incidence, symptom profile and therapeutic response. A better understanding of the impact of sex hormones in emotional processing sexual dimorphism could bring tight to this important clinical finding. Some studies have provided evidence of sex differences in the identification of emotional faces, however, results are inconsistent and such inconsistency could be related to the lack of experimental control of the sex hormone status of participants. More recently, a few studies evaluated the modulation of facial emotion recognition by the phase of the menstrual cycle and sex hormones, however, none of them directly compared these results with a group of men. We evaluated the accuracy of facial emotion recognition in 40 healthy volunteers. Eleven women were assigned to early follicular group, nine women to the ovulatory group and 10 women to luteal group, depending on the phase of menstrual cycle, and a group of 10 men were also evaluated. Estrogen, progesterone and testosterone levels were assessed. The performance of the groups in the identification of emotional faces varied depending on the emotion. Early follicular group were more accurate to perceive angry faces than all other groups. Sadness was more accurately recognized by early follicular group than by luteal group and regarding the recognition of fearful faces a trend to a better performance and a significantly higher accuracy was observed, respectively, in the early follicular group and in the ovulatory group, in comparison to men. In women, estrogen negatively correlated to the accuracy in perception of angry mate faces. Our results indicate sex hormones to be implicated in a sexual dimorphism in facial emotion recognition, and highlight the importance of estrogen specifically in the recognition of negative emotions such as sadness, anger and fear. (C) 2009 Elsevier Ltd. All rights reserved.

Morphological Study of Myoneural Interaction between the Levator Labii Superioris Muscle and its Motor Nerve in Rats

The progress of science in search of new techniques of the nerve regeneration and the functional repair in reinnervated muscle has been the target of many researchers around the world. Consequently, nerves and muscles in different body segments asked for more enlightenment of their morphology, their interrelation with other anatomic structures and their peculiarities. One of the most significant areas that need deeper studies is the region of the head and neck, since they are often affected by important pathologies. In order to offer the researcher`s community a morphological myoneural interaction model, this study elected the levator labii superioris muscle and its motor nerve, the buccal branch of the facial nerve (VII pair) not only for its special characteristics, but also its value on the facial expression. The rat was chosen for this investigation for being easy to obtain, to keep, to manipulate and to compare this experiment with many others studies previously published. The techniques used were Mesoscopic (dissection), histoenzymologic and morphometric ones. In the results the muscle proved to have a predominance of fast twich fibers (FG and FOG) and superficial location, with a proximal bone and a distal cutaneous insertion. Its motor nerve, the buccal branch of the facial nerve (VII pair), breaks through the muscle belly into its deep face, and comprised a heterogeneous group of myelinic nerve fibers disposed in a regular form in all fascicle. Near the motor point, the nerve showed to be composed of two fascicles with different sizes. Due to the small nerve dimensions, the nerve fibers have a smaller diameter if compared to the motor nerve of pectineus muscle of the cat. Further studies with neural tracers have already had a start in order to provide more information about the distribution and the architecture of these fibers.

Palco: a multisensor realtime 3D cartoon production system

This paper presents Palco, a prototype system specifically designed for the production of 3D cartoon animations. The system addresses the specific problems of producing cartoon animations, where the main obj ective is not to reproduce realistic movements, but rather animate cartoon characters with predefined and characteristic body movements and facial expressions. The techniques employed in Palco are simple and easy to use, not requiring any invasive or complicated motion capture system, as both body motion and facial expression of actors are captured simultaneously, using an infrared motion detection sensor, a regular camera and a pair of electronically instrumented gloves. The animation process is completely actor-driven, with the actor controlling the character movements, gestures, facial expression and voice, all in realtime. The actor controlled cartoonification of the captured facial and body motion is a key functionality of Palco, and one that makes it specifically suited for the production of cartoon animations.