Emotion recognition of static and dynamic faces in autism spectrum disorder

There is substantial evidence for facial emotion recognition (FER) deficits in autism spectrum disorder (ASD). The extent of this impairment, however, remains unclear, and there is some suggestion that clinical groups might benefit from the use of dynamic rather than static images. High-functioning individuals with ASD (n = 36) and typically developing controls (n = 36) completed a computerised FER task involving static and dynamic expressions of the six basic emotions. The ASD group showed poorer overall performance in identifying anger and disgust and were disadvantaged by dynamic (relative to static) stimuli when presented with sad expressions. Among both groups, however, dynamic stimuli appeared to improve recognition of anger. This research provides further evidence of specific impairment in the recognition of negative emotions in ASD, but argues against any broad advantages associated with the use of dynamic displays.

Brain networks subserving the evaluation of static and dynamic facial expressions

Because moving depictions of face emotion have greater ecological validity than their static counterparts, it has been suggested that still photographs may not engage ‘authentic’ mechanisms used to recognize facial expressions in everyday life. To date, however, no neuroimaging studies have adequately addressed the question of whether the processing of static and dynamic expressions rely upon different brain substrates. To address this, we performed an functional magnetic resonance imaging (fMRI) experiment wherein participants made emotional expression discrimination and Sex discrimination judgements to static and moving face images. Compared to Sex discrimination, Emotion discrimination was associated with widespread increased activation in regions of occipito-temporal, parietal and frontal cortex. These regions were activated both by moving and by static emotional stimuli, indicating a general role in the interpretation of emotion. However, portions of the inferior frontal gyri and supplementary/pre-supplementary motor area showed task by motion interaction. These regions were most active during emotion judgements to static faces. Our results demonstrate a common neural substrate for recognizing static and moving facial expressions, but suggest a role for the inferior frontal gyrus in supporting simulation processes that are invoked more strongly to disambiguate static emotional cues.

Negotiating futility, managing emotions : nursing the transition to palliative care

Nurses play a pivotal role in caring for patients during the transition from life-prolonging care to palliative care. This is an area of nursing prone to emotional difficulty, interpersonal complexity, and interprofessional conflict. It is situated within complex social dynamics, including those related to establishing and accepting futility and reconciling the desire to maintain hope. Here, drawing on interviews with 20 Australian nurses, we unpack their accounts of nursing the transition to palliative care, focusing on the purpose of nursing at the point of transition; accounts of communication and strategies for representing palliative care; emotional engagement and burden; and key interprofessional challenges. We argue that in caring for patients approaching the end of life, nurses occupy precarious interpersonal and interprofessional spaces that involve a negotiated order around sentimental work, providing them with both capital (privileged access) and burden (emotional suffering) within their day-to-day work.

Recognising emotional expressions of complaining customers : A cross-cultural study

Purpose This study aims to test service providers’ ability to recognise non-verbal emotions in complaining customers of same and different cultures. Design/methodology/approach In a laboratory study, using a between-subjects experimental design (n = 153), we tested the accuracy of service providers’ perceptions of the emotional expressions of anger, fear, shame and happiness of customers from varying cultural backgrounds. After viewing video vignettes of customers complaining (with the audio removed), participants (in the role of service providers) assessed the emotional state of the customers portrayed in the video. Findings Service providers in culturally mismatched dyads were prone to misreading anger, happiness and shame expressed by dissatisfied customers. Happiness was misread in the displayed emotions of both dyads. Anger was recognisable in the Anglo customers but not Confucian Asian, while Anglo service providers misread both shame and happiness in Confucian Asian customers. Research limitations/implications The study was conducted in the laboratory and was based solely on participant’s perceptions of actors’ non-verbal facial expressions in a single encounter. Practical implications Given the level of ethnic differences in developed nations, a culturally sensitive workplace is needed to foster effective functioning of service employee teams. Ability to understand cultural display rules and to recognise and interpret emotions is an important skill for people working in direct contact with customers. Originality/value This research addresses the lack of empirical evidence for the recognition of customer emotions by service providers and the impact of cross-cultural differences.

Facial emotion and identity processing development in 5- to 15-year-old children

Most developmental studies of emotional face processing to date have focused on infants and very young children. Additionally, studies that examine emotional face processing in older children do not distinguish development in emotion and identity face processing from more generic age-related cognitive improvement. In this study, we developed a paradigm that measures processing of facial expression in comparison to facial identity and complex visual stimuli. The three matching tasks were developed (i.e., facial emotion matching, facial identity matching, and butterfly wing matching) to include stimuli of similar level of discriminability and to be equated for task difficulty in earlier samples of young adults. Ninety-two children aged 5–15 years and a new group of 24 young adults completed these three matching tasks. Young children were highly adept at the butterfly wing task relative to their performance on both face-related tasks. More importantly, in older children, development of facial emotion discrimination ability lagged behind that of facial identity discrimination.

Symptom correlates of static and dynamic facial affect processing in schizophrenia : evidence of a double dissociation?

Schizophrenia patients have been shown to be compromised in their ability to recognize facial emotion. This deficit has been shown to be related to negative symptoms severity. However, to date, most studies have used static rather than dynamic depictions of faces. Nineteen patients with schizophrenia were compared with seventeen controls on 2 tasks; the first involving the discrimination of facial identity, emotion, and butterfly wings; the second testing emotion recognition using both static and dynamic stimuli. In the first task, the patients performed more poorly than controls for emotion discrimination only, confirming a specific deficit in facial emotion recognition. In the second task, patients performed more poorly in both static and dynamic facial emotion processing. An interesting pattern of associations suggestive of a possible double dissociation emerged in relation to correlations with symptom ratings: high negative symptom ratings were associated with poorer recognition of static displays of emotion, whereas high positive symptom ratings were associated with poorer recognition of dynamic displays of emotion. However, while the strength of associations between negative symptom ratings and accuracy during static and dynamic facial emotion processing was significantly different, those between positive symptom ratings and task performance were not. The results confirm a facial emotion-processing deficit in schizophrenia using more ecologically valid dynamic expressions of emotion. The pattern of findings may reflect differential patterns of cortical dysfunction associated with negative and positive symptoms of schizophrenia in the context of differential neural mechanisms for the processing of static and dynamic displays of facial emotion.

Facial identity and facial expression matching in 5 - 12-year-old children and adults

Facial identity and facial expression matching tasks were completed by 5–12-year-old children and adults using stimuli extracted from the same set of normalized faces. Configural and feature processing were examined using speed and accuracy of responding and facial feature selection, respectively. Facial identity matching was slower than face expression matching for all age groups. Large age effects were found on both speed and accuracy of responding and feature use in both identity and expression matching tasks. Eye region preference was found on the facial identity task and mouth region preference on the facial expression task. Use of mouth region information for facial expression matching increased with age, whereas use of eye region information for facial identity matching peaked early. The feature use information suggests that the specific use of primary facial features to arrive at identity and emotion matching judgments matures across middle childhood.

Mirror neuron activation is associated with facial emotion processing

Theoretical accounts suggest that mirror neurons play a crucial role in social cognition. The current study used transcranial-magnetic stimulation (TMS) to investigate the association between mirror neuron activation and facialemotion processing, a fundamental aspect of social cognition, among healthy adults (n = 20). Facial emotion processing of static (but not dynamic) images correlated significantly with an enhanced motor response, proposed to reflect mirror neuron activation. These correlations did not appear to reflect general facial processing or pattern recognition, and provide support to current theoretical accounts linking the mirror neuron system to aspects of social cognition. We discuss the mechanism by which mirror neurons might facilitate facial emotion recognition.

Children's emotions and multimodal appraisal of places : walking with the camera

This sensory ethnography explores the affordances and constraints of multimodal design to represent emotions and appraisal associated with experiencing local places. Digital video production, walking with the camera, and the use of a think-aloud protocol to reflect on the videos, provided an opportunity for the primary school children to represent their emotions and appraisal of places multimodally. Applying a typology from Martin and White's (2005) framework for the Language of Evaluation, children's multimodal emotional responses to places in this study tended toward happiness, security, and satisfaction. The findings demonstrate an explicit connection between children's emotions in response to local places through video, while highlighting the potential for teachers to use digital filmmaking to allow children to reflect actively on their placed experiences and represent their emotional reactions to places through multiple modes.

Happiness online : supporting the emotions of emergent teachers in a virtual community

Extending Lash and Urry's (1994) notion of new "imagined communities" through information and communication structures, I ask the question: Are emergent teachers happy when they interact in online learning environments? This question is timely in the context of the ubiquity of online media and its pervasiveness in teachers' everyday work and lives. The research is important nationally and internationally, because the current research is contradictory. On the one hand, feelings of isolation and frustration have been cited as common emotions experienced in many online environments (Su, Bonk, Magjuka, Liu, & Lee, 2005). Yet others report that online communities encourage a sense of belonging and support (Mills, 2011). Emotions are inherently social, are central to learning and online interaction (Shen, Wang, & Shen, 2009). The presentations reports the use of e-motion blogs to explore emotional states of emergent primary teachers in an online learning context as they transition into their first field experience in schools. The original research was conducted with a graduate class of 64 secondary science pre-service teachers in Science Education Curriculum Studies in a large Australian university, including males and females from a variety of cultural backgrounds, aged 17-55 years. Online activities involved the participants watching a series of streamed live lectures within a course of 8 weeks duration, providing a varied set of learning experiences, such as viewing live teaching demonstrations. Each week, participants provided feedback on learning by writing and posting an e-motion diary or web log about their emotional response. The blogs answered the question: What emotions you experience during this learning experience? The descriptive data set included 284 online posts, with students contributing multiple entries. The Language of Appraisal framework, following Martin and White (2005), was used to cluster the discrete emotions within six affect groups. The findings demonstrated that the pre-service teachers' emotional responses tended towards happiness and satisfaction within the typology of affect groups - un/happiness, in/security, and dis/satisfaction. Fewer participants reported that online learning mode triggered negative feelings of frustration, and when this occurred, it often pertained expectations of themselves in the forthcoming field experience in schools or as future teachers. The findings primarily contribute new understanding about emotional states in online communities, and recommendations are provided for supporting the happiness and satisfaction of emergent teachers as they interact in online communities. It demonstrates that online environments can play an important role in fulfilling teachers' need for social interaction and inclusion.

Functional MRI of facial emotion recognition deficits in schizophrenia and their electrophysiological correlates

Empirical evidence suggests impaired facial emotion recognition in schizophrenia. However, the nature of this deficit is the subject of ongoing research. The current study tested the hypothesis that a generalized deficit at an early stage of face-specific processing (i.e. putatively subserved by the fusiform gyrus) accounts for impaired facial emotion recognition in schizophrenia as opposed to the Negative Emotion-specific Deficit Model, which suggests impaired facial information processing at subsequent stages. Event-related potentials (ERPs) were recorded from 11 schizophrenia patients and 15 matched controls while performing a gender discrimination and a facial emotion recognition task. Significant reduction of the face-specific vertex positive potential (VPP) at a peak latency of 165 ms was confirmed in schizophrenia subjects whereas their early visual processing, as indexed by P1, was found to be intact. Attenuated VPP was found to correlate with subsequent P3 amplitude reduction and to predict accuracy when performing a facial emotion discrimination task. A subset of ten schizophrenia patients and ten matched healthy control subjects also performed similar tasks in the magnetic resonance imaging scanner. Patients showed reduced blood oxygenation level-dependent (BOLD) activation in the fusiform, inferior frontal, middle temporal and middle occipital gyrus as well as in the amygdala. Correlation analyses revealed that VPP and the subsequent P3a ERP components predict fusiform gyrus BOLD activation. These results suggest that problems in facial affect recognition in schizophrenia may represent flow-on effects of a generalized deficit in early visual processing.

FaceXpress : an integrated software suite for facial emotion stimulus manipulation and facial measurement

The characterisation of facial expression through landmark-based analysis methods such as FACEM (Pilowsky & Katsikitis, 1994) has a variety of uses in psychiatric and psychological research. In these systems, important structural relationships are extracted from images of facial expressions by the analysis of a pre-defined set of feature points. These relationship measures may then be used, for instance, to assess the degree of variability and similarity between different facial expressions of emotion. FaceXpress is a multimedia software suite that provides a generalised workbench for landmark-based facial emotion analysis and stimulus manipulation. It is a flexible tool that is designed to be specialised at runtime by the user. While FaceXpress has been used to implement the FACEM process, it can also be configured to support any other similar, arbitrary system for quantifying human facial emotion. FaceXpress also implements an integrated set of image processing tools and specialised tools for facial expression stimulus production including facial morphing routines and the generation of expression-representative line drawings from photographs.

Emotional expressions preferentially elicit implicit evaluations of faces also varying in race or age

Both facial cues of group membership (race, age, and sex) and emotional expressions can elicit implicit evaluations to guide subsequent social behavior. There is, however, little research addressing whether group membership cues or emotional expressions are more influential in the formation of implicit evaluations of faces when both cues are simultaneously present. The current study aimed to determine this. Emotional expressions but not race or age cues elicited implicit evaluations in a series of affective priming tasks with emotional Caucasian and African faces (Experiments 1 and 2) and young and old faces (Experiment 3). Spontaneous evaluations of group membership cues of race and age only occurred when those cues were task relevant, suggesting the preferential influence of emotional expressions in the formation of implicit evaluations of others when cues of race or age are not salient. Implications for implicit prejudice, face perception, and person construal are discussed.

Using viewer’s facial expression and heart rate for sports video highlights detection

Viewer interests, evoked by video content, can potentially identify the highlights of the video. This paper explores the use of facial expressions (FE) and heart rate (HR) of viewers captured using camera and non-strapped sensor for identifying interesting video segments. The data from ten subjects with three videos showed that these signals are viewer dependent and not synchronized with the video contents. To address this issue, new algorithms are proposed to effectively combine FE and HR signals for identifying the time when viewer interest is potentially high. The results show that, compared with subjective annotation and match report highlights, ‘non-neutral’ FE and ‘relatively higher and faster’ HR is able to capture 60%-80% of goal, foul, and shot-on-goal soccer video events. FE is found to be more indicative than HR of viewer’s interests, but the fusion of these two modalities outperforms each of them.