Of snakes and flowers: Does preferential detection of pictures of fear-relevant animals in visual search reflect on fear-relevance?

Previous research in visual search indicates that animal fear-relevant deviants, snakes/spiders, are found faster among non fear-relevant backgrounds, flowers/mushrooms, than vice versa. Moreover, deviant absence was indicated faster among snakes/spiders and detection time for flower/mushroom deviants, but not for snake/spider deviants, increased in larger arrays. The current research indicates that the latter 2 results do not reflect on fear-relevance, but are found only with flower/mushroom controls. These findings may reflect on factors such as background homogeneity, deviant homogeneity, or background-deviant similarity. The current research removes contradictions between previous studies that used animal and social fear-relevant stimuli and indicates that apparent search advantages for fear-relevant deviants seem likely to reflect on delayed attentional disengagement from fear-relevance on control trials.

Face recognition robust to head pose from one sample image

Most face recognition systems only work well under quite constrained environments. In particular, the illumination conditions, facial expressions and head pose must be tightly controlled for good recognition performance. In 2004, we proposed a new face recognition algorithm, Adaptive Principal Component Analysis (APCA) [4], which performs well against both lighting variation and expression change. But like other eigenface-derived face recognition algorithms, APCA only performs well with frontal face images. The work presented in this paper is an extension of our previous work to also accommodate variations in head pose. Following the approach of Cootes et al, we develop a face model and a rotation model which can be used to interpret facial features and synthesize realistic frontal face images when given a single novel face image. We use a Viola-Jones based face detector to detect the face in real-time and thus solve the initialization problem for our Active Appearance Model search. Experiments show that our approach can achieve good recognition rates on face images across a wide range of head poses. Indeed recognition rates are improved by up to a factor of 5 compared to standard PCA.

Early gamma-band activity as a function of threat processing in the extrastriate visual cortex

Various neuroimaging investigations have revealed that perception of emotional pictures is associated with greater visual cortex activity than their neutral counterparts. It has further been proposed that threat-related information is rapidly processed, suggesting that the modulation of visual cortex activity should occur at an early stage. Additional studies have demonstrated that oscillatory activity in the gamma band range (40-100 Hz) is associated with threat processing. Magnetoencephalography (MEG) was used to investigate such activity during perception of task-irrelevant, threat-related versus neutral facial expressions. Our results demonstrated a bilateral reduction in gamma band activity for expressions of threat, specifically anger, compared with neutral faces in extrastriate visual cortex (BA 18) within 50-250 ms of stimulus onset. These results suggest that gamma activity in visual cortex may play a role in affective modulation of visual processing, in particular with the perception of threat cues.

Self-esteem moderates affective reactions to briefly presented emotional faces

According to the sociometer hypothesis individuals with low self-esteem experience increased negative affect in response to negative social stimuli, even when these stimuli are not perceived consciously. Using an affective priming paradigm, the present study examined whether trait self-esteem would moderate mood following briefly presented facial expressions. Results from 43 undergraduates revealed that, after controlling for baseline mood, anxiety and depression, the degree of negative affect experienced by the participants following exposure to expressions of anger and disgust varied as a function of their self-esteem. Implications for individuals with low-self esteem and our understanding of the link between self-esteem and negative affect are discussed.

Autonomic response in the perception of disgust and happiness in depersonalization disorder

Patients with depersonalization disorder have shown attenuated responses to emotional unpleasant stimuli, hence supporting the view that depersonalization is characterised by a selective inhibition on the processing of unpleasant emotions. It was the purpose of this study to establish if autonomic responses to facial emotional expressions also show the same blunting effect. The skin conductance responses (SCRs) of 16 patients with chronic DSM-IV depersonalization disorder, 15 normal controls and 15 clinical controls with DSM-IV anxiety disorders were recorded in response to facial expressions of happiness and disgust. Patients with anxiety disorders were found to have greater autonomic responses than patients with depersonalization, in spite of the fact that both groups had similarly high levels of subjective anxiety as measured by anxiety scales. SCR to happy faces did not vary across groups. The findings of this study provide further support to the idea that patients with depersonalization have a selective impairment in the processing of threatening or unpleasant emotional stimuli.

A multimodal investigation of dynamic face perception using functional magnetic resonance imaging and magnetoencephalography

Motion is an important aspect of face perception that has been largely neglected to date. Many of the established findings are based on studies that use static facial images, which do not reflect the unique temporal dynamics available from seeing a moving face. In the present thesis a set of naturalistic dynamic facial emotional expressions was purposely created and used to investigate the neural structures involved in the perception of dynamic facial expressions of emotion, with both functional Magnetic Resonance Imaging (fMRI) and Magnetoencephalography (MEG). Through fMRI and connectivity analysis, a dynamic face perception network was identified, which is demonstrated to extend the distributed neural system for face perception (Haxby et al.,2000). Measures of effective connectivity between these regions revealed that dynamic facial stimuli were associated with specific increases in connectivity between early visual regions, such as inferior occipital gyri and superior temporal sulci, along with coupling between superior temporal sulci and amygdalae, as well as with inferior frontal gyri. MEG and Synthetic Aperture Magnetometry (SAM) were used to examine the spatiotemporal profile of neurophysiological activity within this dynamic face perception network. SAM analysis revealed a number of regions showing differential activation to dynamic versus static faces in the distributed face network, characterised by decreases in cortical oscillatory power in the beta band, which were spatially coincident with those regions that were previously identified with fMRI. These findings support the presence of a distributed network of cortical regions that mediate the perception of dynamic facial expressions, with the fMRI data providing information on the spatial co-ordinates paralleled by the MEG data, which indicate the temporal dynamics within this network. This integrated multimodal approach offers both excellent spatial and temporal resolution, thereby providing an opportunity to explore dynamic brain activity and connectivity during face processing.

Prefrontal cortical and striatal activity to happy and fear faces in bipolar disorder is associated with comorbid substance abuse and eating disorder

Background: The spectrum approach was used to examine contributions of comorbid symptom dimensions of substance abuse and eating disorder to abnormal prefrontal-cortical and subcortical-striatal activity to happy and fear faces previously demonstrated in bipolar disorder (BD). Method: Fourteen remitted BD-type I and sixteen healthy individuals viewed neutral, mild and intense happy and fear faces in two event-related fMRI experiments. All individuals completed Substance-Use and Eating-Disorder Spectrum measures. Region-of-Interest analyses for bilateral prefrontal and subcortical-striatal regions were performed. Results: BD individuals scored significantly higher on these spectrum measures than healthy individuals (p < 0.05), and were distinguished by activity in prefrontal and subcortical-striatal regions. BD relative to healthy individuals showed reduced dorsal prefrontal-cortical activity to all faces. Only BD individuals showed greater subcortical-striatal activity to happy and neutral faces. In BD individuals, negative correlations were shown between substance use severity and right PFC activity to intense happy faces (p < 0.04), and between substance use severity and right caudate nucleus activity to neutral faces (p < 0.03). Positive correlations were shown between eating disorder and right ventral putamen activity to intense happy (p < 0.02) and neutral faces (p < 0.03). Exploratory analyses revealed few significant relationships between illness variables and medication upon neural activity in BD individuals. Limitations: Small sample size of predominantly medicated BD individuals. Conclusion: This study is the first to report relationships between comorbid symptom dimensions of substance abuse and eating disorder and prefrontal-cortical and subcortical-striatal activity to facial expressions in BD. Our findings suggest that these comorbid features may contribute to observed patterns of functional abnormalities in neural systems underlying mood regulation in BD.

Operant and respondent procedures to establish social stimuli as reinforcers in children with autism

According to the DSM-IV- TR (American Psychiatric Association, 2000), one of the core deficits in autism is in the impairment of social interaction. Some have suggested that underlying these deficits is the reality that individuals with autism do not find social stimuli to be as reinforcing as other types of stimuli (Dawson, 2008). An interesting and growing body of literature supports the notion that symptoms in autism may be caused by a general reduction in social motivation (Chevallier et al., 2012). A review of the literature suggests that social orienting and social motivation are low in individuals with autism, and including social motivation as a target for therapeutic intervention should be pursued (Helt et al., 2008). Through our understanding of learning processes, researchers in behavior analysis and related fields have been able to use conditioning procedures to change the function of neutral or ineffective stimuli, including tokens (Ayllon & Azrin, 1968), facial expressions (Gewirtz & Pelaez-Nogueras, 1992) and praise (Dozier et al., 2012). The current study aimed to use operant and respondent procedures to condition social stimuli that were empirically shown to not be reinforcing prior to conditioning. Further, this study aimed to compare the two procedures in their effectiveness to condition social stimuli to function as reinforcers, and in their maintenance of effects over time. Using a multiple-baseline, multi-element design, one social stimulus was conditioned under each procedure to compare the different response rates following conditioning. Finally, the study sought to determine if conditioning social stimuli to function as reinforcers had any effect on the social functioning of young children with autism. Six children diagnosed with autism between the ages of 18 months and 3 years participated. Results show that the respondent procedure (pairing) resulted in more robust and enduring effects than the operant procedure (Sd procedure). Results of a social communication assessment (ESCS, Mundy et al., 2003) before and after conditioning demonstrate gains in all areas of social communication, particularly in the areas of initiating and responding to joint attention.^

Learning Data-Driven Models of Non-Verbal Behaviors for Building Rapport Using an Intelligent Virtual Agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness. Evidence-based patient-centered Brief Motivational Interviewing (BMI) interven- tions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary. Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems. To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].

A framework for investigating the use of face features to identify spontaneous emotions

Emotion-based analysis has raised a lot of interest, particularly in areas such as forensics, medicine, music, psychology, and human-machine interface. Following this trend, the use of facial analysis (either automatic or human-based) is the most common subject to be investigated once this type of data can easily be collected and is well accepted in the literature as a metric for inference of emotional states. Despite this popularity, due to several constraints found in real world scenarios (e.g. lightning, complex backgrounds, facial hair and so on), automatically obtaining affective information from face accurately is a very challenging accomplishment. This work presents a framework which aims to analyse emotional experiences through naturally generated facial expressions. Our main contribution is a new 4-dimensional model to describe emotional experiences in terms of appraisal, facial expressions, mood, and subjective experiences. In addition, we present an experiment using a new protocol proposed to obtain spontaneous emotional reactions. The results have suggested that the initial emotional state described by the participants of the experiment was different from that described after the exposure to the eliciting stimulus, thus showing that the used stimuli were capable of inducing the expected emotional states in most individuals. Moreover, our results pointed out that spontaneous facial reactions to emotions are very different from those in prototypic expressions due to the lack of expressiveness in the latter.

Three-dimensional outcomes of twin-block appliance treatment and the influence of the postured wax bite

Aims 1 To identify the 3D soft tissue volumetric and linear landmark changes following treatment with the Twin-Block Appliance TBA. 2 To estimate the TBA treatment outcome on the soft tissue facial profile volumetric and linear landmark changes from the Postured Wax Bite (PWB). 3 To identify if there is any association between certain soft tissue landmark variables and successful treatment outcome of the TBA as measured by the reduction in overjet. 4 To assess the effects of TBA treatment on facial expressions. Materials and Methods Forty-seven Caucasian subjects with Class II division 1 were recruited. 3D images captured of each subject, pre-treatment (T1), with the PWB (T2) and at the end of treatment (T3). Soft tissue volumetric and linear changes as well as the correlation between facial parameters and successful treatment were calculated. Results The mean soft tissue volumetric change from T1 to T3 was 22.24 ± 16.73 cm³. Soft tissue profile linear changes from T1-T3 for lower facial landmarks were 4-5 mm. From T1-T3, the mean soft tissue volumetric change of the total sample was 60% of the change produced by the PWB (T1 to T2). Correlations were weak for all 3D facial parameters and successful overjet reduction. Facial expression changes were only significant for the lower landmarks. Conclusions 1 TBA treatment, in growing subjects, increased the lower facial soft tissue volume and caused forward movement of the lower soft tissue facial profile landmarks.2 The PWB can be used to estimate the treatment outcome of the TBA on soft tissue profile changes.3 No association was found between soft tissue landmark variables and successful overjet reduction.4 TBA treatment had no effect on the upper facial landmarks for each facial expression but it changed the lower facial expressions significantly except for maximal smile in males.

Utilizing ICT to prevent loneliness and social isolation of the elderly. A literature review

Ageing of the population is a worldwide phenomenon. Numerous ICT-based solutions have been developed for elderly care but mainly connected to the physiological and nursing aspects in services for the elderly. Social work is a profession that should pay attention to the comprehensive wellbeing and social needs of the elderly. Many people experience loneliness and depression in their old age, either as a result of living alone or due to a lack of close family ties and reduced connections with their culture of origin, which results in an inability to participate actively in community activities (Singh & Misra, 2009). Participation in society would enhance the quality of life. With the development of information technology, the use of technology in social work practice has risen dramatically. The aim of this literature review is to map out the state of the art of knowledge about the usage of ICT in elderly care and to figure out research-based knowledge about the usability of ICT for the prevention of loneliness and social isolation of elderly people. The data for the current research comes from the core collection of the Web of Science and the data searching was performed using Boolean? The searching resulted in 216 published English articles. After going through the topics and abstracts, 34 articles were selected for the data analysis that is based on a multi approach framework. The analysis of the research approach is categorized according to some aspects of using ICT by older adults from the adoption of ICT to the impact of usage, and the social services for them. This literature review focused on the function of communication by excluding the applications that mainly relate to physical nursing. The results show that the so-called ‘digital divide’ still exists, but the older adults have the willingness to learn and utilise ICT in daily life, especially for communication. The data shows that the usage of ICT can prevent the loneliness and social isolation of older adults, and they are eager for technical support in using ICT. The results of data analysis on theoretical frames and concepts show that this research field applies different theoretical frames from various scientific fields, while a social work approach is lacking. However, a synergic frame of applied theories will be suggested from the perspective of social work.

Software Components for Serious Game Development

The large upfront investments required for game development pose a severe barrier for the wider uptake of serious games in education and training. Also, there is a lack of well-established methods and tools that support game developers at preserving and enhancing the games’ pedagogical effectiveness. The RAGE project, which is a Horizon 2020 funded research project on serious games, addresses these issues by making available reusable software components that aim to support the pedagogical qualities of serious games. In order to easily deploy and integrate these game components in a multitude of game engines, platforms and programming languages, RAGE has developed and validated a hybrid component-based software architecture that preserves component portability and interoperability. While a first set of software components is being developed, this paper presents selected examples to explain the overall system’s concept and its practical benefits. First, the Emotion Detection component uses the learners’ webcams for capturing their emotional states from facial expressions. Second, the Performance Statistics component is an add-on for learning analytics data processing, which allows instructors to track and inspect learners’ progress without bothering about the required statistics computations. Third, a set of language processing components accommodate the analysis of textual inputs of learners, facilitating comprehension assessment and prediction. Fourth, the Shared Data Storage component provides a technical solution for data storage - e.g. for player data or game world data - across multiple software components. The presented components are exemplary for the anticipated RAGE library, which will include up to forty reusable software components for serious gaming, addressing diverse pedagogical dimensions.

A alexitimia na categorização de emoções em expressões faciais dinâmicas

A alexitimia é o termo usado para caracterizar as pessoas com défices no processamento, na compreensão e na descrição de emoções. Definida também como um traço de personalidade multifatorial, a alexitimia tem uma prevalência de 10% na população em geral e está associada a uma menor qualidade de vida. Apesar de este estudo incidir-se numa população saudável, a alexitimia está frequentemente associada a patologias físicas e perturbações mentais. O objetivo deste estudo consistiu em verificar a influência da alexitimia na categorização das expressões faciais emocionais, numa tarefa de apresentação de faces dinâmicas. 87 participantes com diferentes índices de alexitimia completaram uma tarefa que consistia na apresentação de faces dinâmicas cujo o intuito era categorizar as expressões faciais de raiva, nojo e alegria. A precisão das respostas e os níveis de intensidade emocional foram manipulados. Os resultados indicaram que os indivíduos, no geral, identificaram mais precisamente e com menores níveis de intensidade emocional a expressão de alegria comparativamente com as expressões negativas (raiva e nojo). Verificou-se também diferenças significativas entre a alexitimia e as expressões faciais emocionais relativamente à precisão na categorização. Deste modo, foi possível verificar neste estudo, que indivíduos com altos níveis de alexitimia foram significativamente menos precisos na identificação da expressão facial de raiva comparativamente com indivíduos com baixos níveis de alexitimia.

The interplay between social motivation, social experience, and developmental neural specialization for social perception

From birth, infants preferentially attend to human motion, which allows them to learn to interpret other peoples’ facial expressions and mental states. Evidence from adults shows that selectivity of the amygdala and the posterior superior temporal sulcus (pSTS) to biological motion correlates with social network size. Social motivation—one’s desire to orient to the social world, to seek and find reward in social interaction, and to maintain social relationships—may also contribute to neural specialization for biological motion and to social network characteristics. The current study aimed to determine whether neural selectivity for biological motion relates to social network characteristics, and to gain preliminary evidence as to whether social motivation plays a role in this relation. Findings suggest that neural selectivity for biological motion in the pSTS is positively related to social network size in middle childhood and that this relation is moderated by social motivation.