Assessment of social cognition in schizophrenia through the “Reading the Mind in the Eyes” test. Implications for rehabilitation

Introduction: Schizophrenia is a serious and chronic mental illness that has effect on cognitive and social functioning of a person who suffers it. Recent research points out that social cognition subprocesses, such as Theory of Mind, social perception or emotional processing, have to do with some problems that patients show in their social adjustment. Aim: Assessing ability of recognizing mental states from facial expressions in schizophrenia patients compared to a control group. Subjects and methods: 17 stable schizophrenia patients who are aware of the illness and 17 healthy people, with the same age and sociocultural level, took the “Reading the Mind in the Eyes” Test Revised Version of Baron- Cohen. Results: Compared with the control group, subjects with schizophrenia showed much lower scores. Conclusions: It is confirmed that schizophrenia patients have impairments to understand facial expressions, especially from the eyes. That is typical of this illness, so it is necessary to do interventions at that point. Furthermore, inability to recognize emotions, as a domain of social cognition, contributes to deficit in functional outcome in schizophrenia. Finally, some treatment programs are put forward.

Psychophysics of emotion: the QUEST for emotional attention

To investigate the mechanisms involved in automatic processing of facial expressions, we used the QUEST procedure to measure the display durations needed to make a gender decision on emotional faces portraying fearful, happy, or neutral facial expressions. In line with predictions of appraisal theories of emotion, our results showed greater processing priority of emotional stimuli regardless of their valence. Whereas all experimental conditions led to an averaged threshold of about 50 ms, fearful and happy facial expressions led to significantly less variability in the responses than neutral faces. Results suggest that attention may have been automatically drawn by the emotion portrayed by face targets, yielding more informative perceptions and less variable responses. The temporal resolution of the perceptual system (expressed by the thresholds) and the processing priority of the stimuli (expressed by the variability in the responses) may influence subjective and objective measures of awareness, respectively.

NK1 receptor antagonism and the neural processing of emotional information in healthy volunteers

The neuropeptide substance P and its receptor NK1 have been implicated in emotion, anxiety and stress in preclinical studies. However, the role of NK1 receptors in human brain function is less clear and there have been inconsistent reports of the value of NK1 receptor antagonists in the treatment of clinical depression. The present study therefore aimed to investigate effects of NK1 antagonism on the neural processing of emotional information in healthy volunteers. Twenty-four participants were randomized to receive a single dose of aprepitant (125 mg) or placebo. Approximately 4 h later, neural responses during facial expression processing and an emotional counting Stroop word task were assessed using fMRI. Mood and subjective experience were also measured using self-report scales. As expected a single dose of aprepitant did not affect mood and subjective state in the healthy volunteers. However, NK1 antagonism increased responses specifically during the presentation of happy facial expressions in both the rostral anterior cingulate and the right amygdala. In the emotional counting Stroop task the aprepitant group had increased activation in both the medial orbitofrontal cortex and the precuneus cortex to positive vs. neutral words. These results suggest consistent effects of NK1 antagonism on neural responses to positive affective information in two different paradigms. Such findings confirm animal studies which support a role for NK1 receptors in emotion. Such an approach may be useful in understanding the effects of novel drug treatments prior to full-scale clinical trials.

On the 'special' status of emotional faces... Comment on Yang, Hong, and Blake (2010)

A wealth of literature suggests that emotional faces are given special status as visual objects: Cognitive models suggest that emotional stimuli, particularly threat-relevant facial expressions such as fear and anger, are prioritized in visual processing and may be identified by a subcortical “quick and dirty” pathway in the absence of awareness (Tamietto & de Gelder, 2010). Both neuroimaging studies (Williams, Morris, McGlone, Abbott, & Mattingley, 2004) and backward masking studies (Whalen, Rauch, Etcoff, McInerney, & Lee, 1998) have supported the notion of emotion processing without awareness. Recently, our own group (Adams, Gray, Garner, & Graf, 2010) showed adaptation to emotional faces that were rendered invisible using a variant of binocular rivalry: continual flash suppression (CFS, Tsuchiya & Koch, 2005). Here we (i) respond to Yang, Hong, and Blake's (2010) criticisms of our adaptation paper and (ii) provide a unified account of adaptation to facial expression, identity, and gender, under conditions of unawareness

The influence of emotional contagion on products evaluation

Emotional Contagion is the mechanism that includes mimicking and the automatic synchronization of facial expressions, vocalizations, postures, and movements with another person and, consequently, convergence of emotions between the sender and receiver. Researches of this mechanism conducted usually in the fields of Psychology and Marketing tends to investigate face-to-face interactions. However, the question remains to what extent, if any, emotional contagion may occur with facial expressions in photos, since many purchase situations are brought on by catalogues or websites. This thesis has the goal to verify this gap and, in addition, verify whether emotional contagion is more common in females than in males as stated in previous studies. Emotions have been studied because it is intuitively apparent that emotions affect the dynamics of the interaction between a salesperson and customers (Verbeke, 1997); in other words, emotions may significantly affect consumer behavior. Therefore, this thesis also verified whether the facial expressions that transmit emotions could be associated to product evaluations. To investigate these questions, an experiment was done with 171 participants, which were exposed to either smiling (positive emotion) or neutral advertising. The differences between the individual advertisements were limited to the facial expressions of figures in the advertisements (either smiling or neutral/without smiling). One specialist and two students analyzed videotaped records of the participants’ responses, and found that participants who saw the positive stimulus mimicked the picture (smiling back) confirming the Emotional Contagion in Photos (the first hypothesis). The second hypothesis was to analyze if there is difference based in gender. The results demonstrated that there is not a significant difference between genders; female and male equally suffer Emotional Contagion. The third hypothesis was related to whether the positive emotions vs. neutral emotions acquired from the positive facial expression in the photo are associated to a positive evaluation of the product also displayed in the photo. Evidences show that the ad with a positive expression could change more positively the attitude, the sympathy, the reliability, and the intention of purpose of the participant compared to those who were exposed to the neutral condition. Therefore, the analysis concludes that the facial expressions displayed in photos produce emotional contagion and may interfere on the evaluation product. A discussion of the theoretical and practical implications and limitations for these findings are presented.

Aplicação de sistemas imunológicos artificiais para biometria facial: Reconhecimento de identidade baseado nas características de padrões binários

Pós-graduação em Engenharia Elétrica - FEIS

The language of others mirrored in thy face: The role of political affiliation in automatic facial effects of language

People tend to automatically mimic facial expressions of others. If clear evidence exists on the effect of non-verbal behavior (emotion faces) on automatic facial mimicry, little is known about the role of verbal behavior (emotion language) in triggering such effects. Whereas it is well-established that political affiliation modulates facial mimicry, no evidence exists on whether this modulation passes also through verbal means. This research addressed the role of verbal behavior in triggering automatic facial effects depending on whether verbal stimuli are attributed to leaders of different political parties. Study 1 investigated the role of interpersonal verbs, referring to positive and negative emotion expressions and encoding them at different levels of abstraction, in triggering corresponding facial muscle activation in a reader. Study 2 examined the role of verbs expressing positive and negative emotional behaviors of political leaders in modulating automatic facial effects depending on the matched or mismatched political affiliation of participants and politicians of left-and right-wing. Study 3 examined whether verbs expressing happiness displays of ingroup politicians induce a more sincere smile (Duchenne) pattern among readers of same political affiliation relative to happiness expressions of outgroup politicians. Results showed that verbs encoding facial actions at different levels of abstraction elicited differential facial muscle activity (Study 1). Furthermore, political affiliation significantly modulated facial activation triggered by emotion verbs as participants showed more congruent and enhanced facial activity towards ingroup politicians’ smiles and frowns compared to those of outgroup politicians (Study 2). Participants facially responded with a more sincere smile pattern towards verbs expressing smiles of ingroup compared to outgroup politicians (Study 3). Altogether, results showed that the role of political affiliation in modulating automatic facial effects passes also through verbal channels and is revealed at a fine-grained level by inducing quantitative and qualitative differences in automatic facial reactions of readers.

Impact Study of Nonverbal Facial Cues on Spontaneous Chatting with Virtual Humans

Non-verbal communication (NVC) is considered to represent more than 90 percent of everyday communication. In virtual world, this important aspect of interaction between virtual humans (VH) is strongly neglected. This paper presents a user-test study to demonstrate the impact of automatically generated graphics-based NVC expression on the dialog quality: first, we wanted to compare impassive and emotion facial expression simulation for impact on the chatting. Second, we wanted to see whether people like chatting within a 3D graphical environment. Our model only proposes facial expressions and head movements induced from spontaneous chatting between VHs. Only subtle facial expressions are being used as nonverbal cues - i.e. related to the emotional model. Motion capture animations related to hand gestures, such as cleaning glasses, were randomly used to make the virtual human lively. After briefly introducing the technical architecture of the 3D-chatting system, we focus on two aspects of chatting through VHs. First, what is the influence of facial expressions that are induced from text dialog? For this purpose, we exploited an emotion engine extracting an emotional content from a text and depicting it into a virtual character developed previously [GAS11]. Second, as our goal was not addressing automatic generation of text, we compared the impact of nonverbal cues in conversation with a chatbot or with a human operator with a wizard of oz approach. Among main results, the within group study -involving 40 subjects- suggests that subtle facial expressions impact significantly not only on the quality of experience but also on dialog understanding.

Cortical control of facial expression.

The present topical review deals with the motor control of facial expressions in humans. Facial expressions are a central part of human communication. Emotional face expressions have a crucial role in human non-verbal behavior, allowing a rapid transfer of information between individuals. Facial expressions can be both voluntarily or emotionally controlled. Recent studies in non-human primates and humans revealed that the motor control of facial expressions has a distributed neural representation. At least 5 cortical regions on the medial and lateral aspects of each hemisphere are involved: the primary motor cortex, the ventral lateral premotor cortex, the supplementary motor area on the medial wall, and, finally, the rostral and caudal cingulate cortex. The results of studies in humans and non-human primates suggest that the innervation of the face is bilaterally controlled for the upper part, and mainly contralaterally controlled for the lower part. Furthermore, the primary motor cortex, the ventral lateral premotor cortex, and the supplementary motor area are essential for the voluntary control of facial expressions. In contrast, the cingulate cortical areas are important for emotional expression, since they receive input from different structures of the limbic system. This article is protected by copyright. All rights reserved.

Self-esteem moderates affective reactions to briefly presented emotional faces

According to the sociometer hypothesis individuals with low self-esteem experience increased negative affect in response to negative social stimuli, even when these stimuli are not perceived consciously. Using an affective priming paradigm, the present study examined whether trait self-esteem would moderate mood following briefly presented facial expressions. Results from 43 undergraduates revealed that, after controlling for baseline mood, anxiety and depression, the degree of negative affect experienced by the participants following exposure to expressions of anger and disgust varied as a function of their self-esteem. Implications for individuals with low-self esteem and our understanding of the link between self-esteem and negative affect are discussed.

Facial affect processing inbipolar disorder:a magnetoencephalography study

Background: Identifying biological markers to aid diagnosis of bipolar disorder (BD) is critically important. To be considered a possible biological marker, neural patterns in BD should be discriminant from those in healthy individuals (HI). We examined patterns of neuromagnetic responses revealed by magnetoencephalography (MEG) during implicit emotion-processing using emotional (happy, fearful, sad) and neutral facial expressions, in sixteen BD and sixteen age- and gender-matched healthy individuals. Methods: Neuromagnetic data were recorded using a 306-channel whole-head MEG ELEKTA Neuromag System, and preprocessed using Signal Space Separation as implemented in MaxFilter (ELEKTA). Custom Matlab programs removed EOG and ECG signals from filtered MEG data, and computed means of epoched data (0-250ms, 250-500ms, 500-750ms). A generalized linear model with three factors (individual, emotion intensity and time) compared BD and HI. A principal component analysis of normalized mean channel data in selected brain regions identified principal components that explained 95% of data variation. These components were used in a quadratic support vector machine (SVM) pattern classifier. SVM classifier performance was assessed using the leave-one-out approach. Results: BD and HI showed significantly different patterns of activation for 0-250ms within both left occipital and temporal regions, specifically for neutral facial expressions. PCA analysis revealed significant differences between BD and HI for mild fearful, happy, and sad facial expressions within 250-500ms. SVM quadratic classifier showed greatest accuracy (84%) and sensitivity (92%) for neutral faces, in left occipital regions within 500-750ms. Conclusions: MEG responses may be used in the search for disease specific neural markers.

La retroalimentación facial y su efecto en la evaluación de publicidad de humor

La hipótesis de retroalimentación facial planteada por Tomkins en 1962 sustenta que la activación de algunos músculos faciales envía información sensorial al cerebro y se induce entonces una experiencia emocional en el sujeto. Partiendo de dicha teoría y de investigaciones que la sustentan, el presente estudio se propuso confirmar el efecto de la emoción inducida a través de la retroalimentación facial sobre la evaluación de cinco tipos de humor en publicidad. Para ello se realizó un experimento con 60 hombres y 60 mujeres, que fueron asignados aleatoriamente a una de dos condiciones: estimulación de sonrisa –músculos hacia arriba- o inhibición de sonrisa –músculos hacía abajo-, mientras evaluaban 16 imágenes de publicidad de humor. A partir del análisis de los resultados se encontraron diferencias significativas entre las condiciones; en línea con la hipótesis formulada, los participantes expuestos a la condición estimulación de sonrisa –músculos hacía arriba- evaluaron más positivamente los comerciales. También se encontraron diferencias significativas en función del sexo y los tipos de humor evaluados. El estudio ofrece evidencia empírica de la teoría propuesta hace más de medio siglo y su efecto en el ámbito de la publicidad actual.

Social competence and emotional comprehension: How are they related in children?

The developmental progression of emotional competence in childhood provides a robust evidence for its relation to social competence and important adjustment outcomes. This study aimed to analyze how this association is established in middle childhood. For this purpose, we tested 182 Portuguese children aged between 8 and 11 years, of 3rd and 4th grades, in public schools. Firstly, for assessing social competence we used an instrument directed to children using critical social situations within the relationships with peers in the school context - Socially in Action-Peers (SAp) (Rocha, Candeias & Lopes da Silva, 2012); children were assessed by three sources: themselves, their peers and their teacher. Secondly, we assessed children’s emotional understanding, individually, with the Test of Emotion Comprehension (Pons & Harris, 2002; Pons, Harris & Rosnay, 2004). Relations between social competence levels (in a composite score and using self, peers and teachers’ scores) and emotional comprehension components (comprehension of the recognition of emotions, based on facial expressions; external emotional causes; contribute of desire to emotion; emotions based on belief; memory influence under emotional state evaluation; possibility of emotional regulation; possibility of hiding an emotional state; having mixed emotions; contribution of morality to emotion experience) were investigated by means of two SSA (Similarity Structure Analysis) - a Multidimensional Scaling procedure and the external variable as points technique. In the first structural analysis (SSA) we will consider self, peers and teachers’ scores on Social Competence as content variables and TEC as external variable; in the second SSA we will consider TEC components as content variables and Social Competence in their different levels as external variable. The implications of these MDS procedures in order to better understand how social competence and emotional comprehension are related in children is discussed, as well as the repercussions of these findings for social competence and emotional understanding assessment and intervention in childhood is examined.

Seeing emotions in others: Improving cognitive and neuronal mechanisms of facial expression processing

In the conceptual framework of affective neuroscience, this thesis intends to advance the understanding of the plasticity mechanisms of other’s emotional facial expression representations. Chapter 1 outlines a description of the neurophysiological bases of Hebbian plasticity, reviews influential studies that adopted paired associative stimulation procedures, and introduces new lines of research where the impact of cortico-cortical paired associative stimulation protocols on higher order cognitive functions is investigated. The experiments in Chapter 2 aimed to test the modulatory influence of a perceptual-motor training, based on the execution of emotional expressions, on the subsequent emotion intensity judgements of others’ high (i.e., full visible) and low-intensity (i.e., masked) emotional expressions. As a result of the training-induced learning, participants showed a significant congruence effect, as indicated by relatively higher expression intensity ratings for the same emotion as the one that was previously trained. Interestingly, although judged as overall less emotionally intense, surgical facemasks did not prevent the emotion-specific effects of the training to occur, suggesting that covering the lower part of other’s face do not interact with the training-induced congruence effect. In Chapter 3 it was implemented a transcranial magnetic stimulation study targeting neural pathways involving re-entrant input from higher order brain regions into lower levels of the visual processing hierarchy. We focused on cortical visual networks within the temporo-occipital stream underpinning the processing of emotional faces and susceptible to plastic adaptations. Importantly, we tested the plasticity-induced effects in a state dependent manner, by administering ccPAS while presenting different facial expressions yet afferent to a specific emotion. Results indicated that the discrimination accuracy of emotion-specific expressions is enhanced following the ccPAS treatment, suggesting that a multi-coil TMS intervention might represent a suitable tool to drive brain remodeling at a neural network level, and consequently influence a specific behavior.

Abnormal Amygdala-Prefrontal Effective Connectivity to Happy Faces Differentiates Bipolar from Major Depression

Background: Bipolar disorder is frequently misdiagnosed as major depressive disorder, delaying appropriate treatment and worsening outcome for many bipolar individuals. Emotion dysregulation is a core feature of bipolar disorder. Measures of dysfunction in neural systems supporting emotion regulation might therefore help discriminate bipolar from major depressive disorder. Methods: Thirty-one depressed individuals-15 bipolar depressed (BD) and 16 major depressed (MDD), DSM-IV diagnostic criteria, ages 18-55 years, matched for age, age of illness onset, illness duration, and depression severity-and 16 age- and gender-matched healthy control subjects performed two event-related paradigms: labeling the emotional intensity of happy and sad faces, respectively. We employed dynamic causal modeling to examine significant among-group alterations in effective connectivity (EC) between right- and left-sided neural regions supporting emotion regulation: amygdala and orbitomedial prefrontal cortex (OMPFC). Results: During classification of happy faces, we found profound and asymmetrical differences in EC between the OMPFC and amygdala. Left-sided differences involved top-down connections and discriminated between depressed and control subjects. Furthermore, greater medication load was associated with an amelioration of this abnormal top-down EC. Conversely, on the right side the abnormality was in bottom-up EC that was specific to bipolar disorder. These effects replicated when we considered only female subjects. Conclusions: Abnormal, left-sided, top-down OMPFC-amygdala and right-sided, bottom-up, amygdala-OMPFC EC during happy labeling distinguish BD and MDD, suggesting different pathophysiological mechanisms associated with the two types of depression.