The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

SEMAINE has created a large audiovisual database as a part of an iterative approach to building Sensitive Artificial Listener (SAL) agents that can engage a person in a sustained, emotionally colored conversation. Data used to build the agents came from interactions between users and an operator simulating a SAL agent, in different configurations: Solid SAL (designed so that operators displayed an appropriate nonverbal behavior) and Semi-automatic SAL (designed so that users' experience approximated interacting with a machine). We then recorded user interactions with the developed system, Automatic SAL, comparing the most communicatively competent version to versions with reduced nonverbal skills. High quality recording was provided by five high-resolution, high-framerate cameras, and four microphones, recorded synchronously. Recordings total 150 participants, for a total of 959 conversations with individual SAL characters, lasting approximately 5 minutes each. Solid SAL recordings are transcribed and extensively annotated: 6-8 raters per clip traced five affective dimensions and 27 associated categories. Other scenarios are labeled on the same pattern, but less fully. Additional information includes FACS annotation on selected extracts, identification of laughs, nods, and shakes, and measures of user engagement with the automatic system. The material is available through a web-accessible database. © 2010-2012 IEEE.

The vertical dimension of social relations and accurate interpersonal perception: A meta-analysis

There is little consensus regarding how verticality (social power, dominance, and status) is related to accurate interpersonal perception. The relation could be either positive or negative, and there could be many causal processes at play. The present article discusses the theoretical possibilities and presents a meta-analysis of this question. In studies using a standard test of interpersonal accuracy, higher socioeconomic status (SES) predicted higher accuracy defined as accurate inference about the meanings of cues; also, higher experimentally manipulated vertical position predicted higher accuracy defined as accurate recall of others’ words. In addition, although personality dominance did not predict accurate inference overall, the type of personality dominance did, such that empathic/responsible dominance had a positive relation and egoistic/aggressive dominance had a negative relation to accuracy. In studies involving live interaction, higher experimentally manipulated vertical position produced lower accuracy defined as accurate inference about cues; however, methodological problems place this result in doubt.