Building autonomous sensitive artificial listeners (Extended abstract)

This paper describes a substantial effort to build a real-time interactive multimodal dialogue system with a focus on emotional and non-verbal interaction capabilities. The work is motivated by the aim to provide technology with competences in perceiving and producing the emotional and non-verbal behaviours required to sustain a conversational dialogue. We present the Sensitive Artificial Listener (SAL) scenario as a setting which seems particularly suited for the study of emotional and non-verbal behaviour, since it requires only very limited verbal understanding on the part of the machine. This scenario allows us to concentrate on non-verbal capabilities without having to address at the same time the challenges of spoken language understanding, task modeling etc. We first summarise three prototype versions of the SAL scenario, in which the behaviour of the Sensitive Artificial Listener characters was determined by a human operator. These prototypes served the purpose of verifying the effectiveness of the SAL scenario and allowed us to collect data required for building system components for analysing and synthesising the respective behaviours. We then describe the fully autonomous integrated real-time system we created, which combines incremental analysis of user behaviour, dialogue management, and synthesis of speaker and listener behaviour of a SAL character displayed as a virtual agent. We discuss principles that should underlie the evaluation of SAL-type systems. Since the system is designed for modularity and reuse, and since it is publicly available, the SAL system has potential as a joint research tool in the affective computing research community.

Turing's menagerie:Talking lions, virtual bats, electric sheep and analogical peacocks: Common ground and common interest are necessary components of engagement

This theoretical paper attempts to define some of the key components and challenges required to create embodied conversational agents that can be genuinely interesting conversational partners. Wittgenstein's argument concerning talking lions emphasizes the importance of having a shared common ground as a basis for conversational interactions. Virtual bats suggests that-for some people at least-it is important that there be a feeling of authenticity concerning a subjectively experiencing entity that can convey what it is like to be that entity. Electric sheep reminds us of the importance of empathy in human conversational interaction and that we should provide a full communicative repertoire of both verbal and non-verbal components if we are to create genuinely engaging interactions. Also we may be making the task more difficult rather than easy if we leave out non-verbal aspects of communication. Finally, analogical peacocks highlights the importance of between minds alignment and establishes a longer term goal of being interesting, creative, and humorous if an embodied conversational agent is to be truly an engaging conversational partner. Some potential directions and solutions to addressing these issues are suggested.

Stories from the Inside:The Prisons Memory Archive

A close textual reading of the online-available recording of ex-prison officer, John Heatherington, who is filmed as he returns to the site of the Maze and Long Kesh Prison, which was the largest prison oeperating during the Troubles in Northern Ireland. Using the empty site as stimulant for his memory, John recalls the tension, violence and dark humour of the period, while also showing exceptional empathy for all those, including prisoners, who passed through the prison system.The interview is taken from the Prisons Memory Archive (www.prisonsmemoryarchive.com) and, as director of the PMA, I have a particular insight to the recording process and John's special contribution to it.

Before the “Comics:” On the Seriality of Graphic Narratives during the Nineteenth Century

While the connection between seriality and comics in the twentieth century has frequently been a subject of study, far less attention has been paid to the role of serialisation in the previous century, when the language of comics gradually developed in the illustrated and satirical press. This article discusses a heterogeneous group of graphic narratives published in various European countries between the 1830s and the 1880s, before a new generation of comic magazines influenced by American newspaper strips transformed this emerging field into the autonomous medium of comics. Serial works flourished during this period and included diverse modes, such as series of “graphic novels,” the use of recurring characters, the serialisation of picture stories in humour periodicals, and the use of graphic narratives as a regular feature in the illustrated news magazines. By providing a panoramic survey of various types of serial texts, the article suggests that the hybrid nature of these graphic narratives and the publishing strategies applied to them can be better understood if considered in relation to the larger context of nineteenth-century print culture, rather than in comparison with the future of the medium.