Building Autonomous Sensitive Artificial Listeners

This paper describes a substantial effort to build a real-time interactive multimodal dialogue system with a focus on emotional and non-verbal interaction capabilities. The work is motivated by the aim to provide technology with competences in perceiving and producing the emotional and non-verbal behaviours required to sustain a conversational dialogue. We present the Sensitive Artificial Listener (SAL) scenario as a setting which seems particularly suited for the study of emotional and non- verbal behaviour, since it requires only very limited verbal understanding on the part of the machine. This scenario allows us to concentrate on non-verbal capabilities without having to address at the same time the challenges of spoken language understanding, task modeling etc. We first report on three prototype versions of the SAL scenario, in which the behaviour of the Sensitive Artificial Listener characters was determined by a human operator. These prototypes served the purpose of verifying the effectiveness of the SAL scenario and allowed us to collect data required for building system components for analysing and synthesising the respective behaviours. We then describe the fully autonomous integrated real-time system we created, which combines incremental analysis of user behaviour, dialogue management, and synthesis of speaker and listener behaviour of a SAL character displayed as a virtual agent. We discuss principles that should underlie the evaluation of SAL-type systems. Since the system is designed for modularity and reuse, and since it is publicly available, the SAL system has potential as a joint research tool in the affective computing research community.

Adapting musicology’s use of affect theories to contemporary theatre-making: directing Martin Crimp’s Attempts on Her Life

Adopting and adapting musicology’s use of affect theories, specifically Jeremy Gilbert’s idea of an ‘affective analysis’ and David Epstein’s idea of ‘shaping affect’, this article looks at Martin Crimp’s Attempts on Her Life from a practitioner’s perspective. It investigates the challenges and benefits of adopting an ‘affective approach’ to directing recent theatre texts which stress the musicality and corporeality of language along with, and at times above, their signifying roles. Rather than locating Aristotelian dramatic climaxes based on narratological or characterological progression, an affective approach seeks to identify moments of affective intensity, which produce a different sort of impact by working on a ‘body-first’ methodology rather than the directly cerebral. That this embodied impact is not ultimately meaningless is one of affect theories most vital assertions. This approach has resonance in terms of how directors, performers and critics/theorists approach work of this type.

Unconscious Vigilance: Worldview Defense without Adaptations for Terror, Coalition or Uncertainty Management

Individuals subtly reminded of death, coalitional challenges, or feelings of uncertainty display exaggerated preferences for affirmations and against criticisms of their cultural in-groups. Terror management, coalitional psychology, and uncertainty management theories postulate this “worldview defense” effectas the output of mechanisms evolved either to allay the fear of death, foster social support, or reduce anxiety by increasing adherence to cultural values. In 4 studies, we report evidence for an alternative perspective. We argue that worldview defense owes to unconscious vigilance, a state of accentuatedreactivity to affective targets (which need not relate to cultural worldviews) that follows detection of subtle alarm cues (which need not pertain to death, coalitional challenges, or uncertainty). In Studies 1 and 2, death-primed participants produced exaggerated ratings of worldview-neutral affective targets. In Studies 3 and 4, subliminal threat manipulations unrelated to death, coalitional challenges, or uncertaintyevoked worldview defense. These results are discussed as they inform evolutionary interpretations of worldview defense and future investigations of the influence of unconscious alarm on judgment.

The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

SEMAINE has created a large audiovisual database as a part of an iterative approach to building Sensitive Artificial Listener (SAL) agents that can engage a person in a sustained, emotionally colored conversation. Data used to build the agents came from interactions between users and an operator simulating a SAL agent, in different configurations: Solid SAL (designed so that operators displayed an appropriate nonverbal behavior) and Semi-automatic SAL (designed so that users' experience approximated interacting with a machine). We then recorded user interactions with the developed system, Automatic SAL, comparing the most communicatively competent version to versions with reduced nonverbal skills. High quality recording was provided by five high-resolution, high-framerate cameras, and four microphones, recorded synchronously. Recordings total 150 participants, for a total of 959 conversations with individual SAL characters, lasting approximately 5 minutes each. Solid SAL recordings are transcribed and extensively annotated: 6-8 raters per clip traced five affective dimensions and 27 associated categories. Other scenarios are labeled on the same pattern, but less fully. Additional information includes FACS annotation on selected extracts, identification of laughs, nods, and shakes, and measures of user engagement with the automatic system. The material is available through a web-accessible database. © 2010-2012 IEEE.

The good our field can hope to do, the harm it should avoid

This paper tries to achieve a balanced view of the ethical issues raised by emotion-oriented technology as it is, rather than as it might be imagined. A high proportion of applications seem ethically neutral. Uses in entertainment and allied areas do no great harm or good. Empowering professions may do either, but regulatory systems already exist. Ethically positive aspirations involve mitigating problems that already exist by supporting humans in emotion-related judgments, by replacing technology that treats people in dehumanized and/or demeaning ways, and by improving access for groups who struggle with existing interfaces. Emotion-oriented computing may also contribute to revaluing human faculties other than pure intellect. Many potential negatives apply to technology as a whole. Concerns specifically related to emotion involve creating a lie, by simulate emotions that the systems do not have, or promoting mechanistic conceptions of emotion. Intermediate issues arise where more general problems could be exacerbated-helping systems to sway human choices or encouraging humans to choose virtual worlds rather than reality. "SIIF" systems (semi-intelligent information filters) are particularly problematic. These use simplified rules to make judgments about people that are complex, and have potentially serious consequences. The picture is one of balances to recognize and negotiate, not uniform good or evil. © 2010-2012 IEEE.

The Belfast Induced Natural Emotion Database

For many years psychological research on facial expression of emotion has relied heavily on a recognition paradigm based on posed static photographs. There is growing evidence that there may be fundamental differences between the expressions depicted in such stimuli and the emotional expressions present in everyday life. Affective computing, with its pragmatic emphasis on realism, needs examples of natural emotion. This paper describes a unique database containing recordings of mild to moderate emotionally coloured responses to a series of laboratory based emotion induction tasks. The recordings are accompanied by information on self-report of emotion and intensity, continuous trace-style ratings of valence and intensity, the sex of the participant, the sex of the experimenter, the active or passive nature of the induction task and it gives researchers the opportunity to compare expressions from people from more than one culture.

Using location-aware technology for learning Geography in a real digital space outside the classroom

The use of new mobile technologies is still in its infancy in many secondary schools and there is limited evidence of the educational and pedagogical benefits on pupils’ learning in the formal school context. This qualitative study focuses on the use of handheld devices to teach a topic in geography to an examination class. Action research combined with pupil observations and focus group interviews are used to capture the pupils’ experiences of using mediascapes. Activity Theory is used as a lens to structure the analysis of the data and to report on the cognitive and affective impact of m-learning on pupils’ academic performance in the topic. Increased attainment and the development of wider skills for lifelong learning were identified in the study. The adaptability of the majority of pupils to the technology resulted in increased levels of willingness to learn in this novel context.

Effects of the Interaction Between Reaction Component of Personal Need for Structure and Role Perceptions on Employee Attitudes in Long-Term Care for Elderly People

This study examined the interaction of reaction component of personal need for structure (reaction to lack of structure, RLS) and role perceptions in predicting job satisfaction, job involvement, affective commitment, and occupational identity among employees working in long-term care for elderly people. High-RLS employees experienced more role conflict, had less job satisfaction, and experienced lower levels of occupational identity than did low-RLS employees. We found individual differences in how problems in roles affected employees' job attitudes. High-RLS employees experienced lower levels of job satisfaction, job involvement, and affective commitment, irrespective of role-conflict levels. Low-RLS employees experienced detrimental job attitudes only if role-conflict levels were high. Our results suggest that high-RLS people benefit less from low levels of experienced role conflicts.

Evaluation of Four Designed Virtual Agent Personalities

Convincing conversational agents require a coherent set of behavioral responses that can be interpreted by a human observer as indicative of a personality. This paper discusses the continued development and subsequent evaluation of virtual agents based on sound psychological principles. We use Eysenck's theoretical basis to explain aspects of the characterization of our agents, and we describe an architecture where personality affects the agent's global behavior quality as well as their back-channel productions. Drawing on psychological research, we evaluate perception of our agents' personalities and credibility by human viewers (N = 187). Our results suggest that we succeeded in validating theoretically grounded indicators of personality in our virtual agents, and that it is feasible to place our characters on Eysenck's scales. A key finding is that the presence of behavioral characteristics reinforces the prescribed personality profiles that are already emerging from the still images. Our long-term goal is to enhance agents' ability to sustain realistic interaction with human users, and we discuss how this preliminary work may be further developed to include more systematic variation of Eysenck's personality scales. © 2012 IEEE.


--------------------------------------------------------------------------------

Reaxys Database Information|

--------------------------------------------------------------------------------

From imagery to intention: A dual route model of imagined contact effects

Imagined intergroup contact (Crisp & R. Turner, 2009) is a new indirect contact strategy for promoting tolerance and more positive intergroup relations. In this chapter, we review existing research on imagined contact and propose two routes-cognitive and affective-through which it can exert a positive influence on contact-related attitudes and intentions. We first review research that has established the beneficial impacts of imagined contact on intergroup attitudes via reduced intergroup anxiety, supporting its efficacy as an intervention where there exists little or no opportunity for direct contact. We then review more recent research showing that imagined contact not only improves attitudes, but can also enhance intentions to engage in future contact. These studies suggest that contact imagery provides a behavioural script that forms the cognitive basis for subsequent judgements about future contact intentions. Collectively, the findings from this research programme support the idea that imagined contact can complement more direct forms of contact-providing a way of initially encouraging an interest in engaging positively with outgroups before introducing face-to-face encounters. We discuss the implications of these findings for future theory and research, and how they can inform prejudice-reduction interventions seeking to capitalise on the beneficial effects of mental imagery.