Sounding alien, touching the future : beyond the sonorous limit in science fiction film

In this paper I examine two particular aspects of sounding science fiction film: first, the ulterior, Othering sounds of the alien, whether it is creature, object, technology or environment; and second, the soundscape that accompanies or underscores the type of space travel that crosses temporal and spatial thresholds. In both instances of sounding science fiction film I suggest that human limits are reached and breached, leading to a deterritorialization of the self and a hearing that touches the future which is a moment of pure becoming. I focus on the womanly sonority of the alien to suggest that patriarchal and heterosexist sound devices can be ultimately corrupted. In the analysis of sounding space travel I suggest that science film can create a series of moments in which one experiences the double sublime. This spectacular rendering of a liquid chaos enables the viewer to experience the logic of sensation beyond bodily integrity. In this paper my over-arching position is one that hears in science fiction film the profound potential of a radical alterity that exists beyond the sonorous limit.

Multi-media and real fiction theatre making

Visual images, in the process of both the imagination and conception of a theatre production, are central to contemporary practice in drama-making. The use of multi-media in theatre is not only a fruitful way to represent the visual component of a particular experience, it but also constitutes a way of speaking the unspoken. Visual language expresses through multi-media and allows broaching taboo subjects, speaking directly to the audience in spite of the indirect form and drawing subtle connections with the live action so as to make meaning. The tension between live action and any form of visual art blurs the lines between imagination and reality. The multi-media theatre is a metaphor for the human mind exposed to social reality. It consists of interruptions, half-finished conversations and ideological aspersions including its primary function of meta-representation.

Mechanisms for multimodality : taking fiction to another dimension

We present methods for automatically constructing representations of fiction books in a range of modalities: audibly, graphically and as 3D virtual environments. The correspondence between the sequential ordering of events against the order of events presented in the text is used to correctly resolve the dynamic interactions for each representation. Synthesised audio created from the fiction text is used to calibrate the base time-line against which the other forms of media are correctly aligned. The audio stream is based on speech synthesis using the text of the book, and is enhanced using distinct voices for the different characters in a book. Sound effects are included automatically. The graphical representation represents the text (as subtitles), identifies active characters and provides visual feedback of the content of the story. Dynamic virtual environments conform to the constraints implied by the story, and are used as a source of further visual content. These representations are all aligned to a common time-line, and combined using sequencing facilities to provide a multimodal version of the original text.

Automating the creation of 3D animation from annotated fiction text

This paper describes a strategy for automatically converting fiction text into 3D animations. It assumes the existence of fiction text annotated with avatar, object, setting, transition and relation annotations, and presents a transformation process that converts annotated text into quantified constraint systems, the solutions to which are used in the population of 3D environments. Constraint solutions are valid over temporal intervals, ensuring that consistent dynamic behaviour is produced. A substantial level of automation is achieved, while providing opportunities for creative manual intervention in animation process. The process is demonstrated using annotated examples drawn from popular fiction text that are converted into animation sequences, confirming that the desired results can be achieved with only high-level human direction.

A naïve, salience-based method for speaker identification in fiction books

This paper presents a salience-based technique for the annotation of directly quoted speech from fiction text. In particular, this paper determines to what extent a naïve (without the use of complex machine learning or knowledge-based techniques) scoring technique can be used for the identification of the speaker of speech quotes. The presented technique makes use of a scoring technique, similar to that commonly found in knowledge-poor anaphora resolution research, as well as a set of hand-coded rules for the final identification of the speaker of each quote in the text. Speaker identification is shown to be achieved using three tasks: the identification of a speech-verb associated with a quote with a recall of 94.41%; the identification of the actor associated with a quote with a recall of 88.22%; and the selection of a speaker with an accuracy of 79.40%.

Constraint-based conversion of fiction text to a time-based graphical representation

This paper presents a method for converting unrestricted fiction text into a time-based graphical form. Key concepts extracted from the text are used to formulate constraints describing the interaction of entities in a scene. The solution of these constraints over their respective time intervals provides the trajectories for these entities in a graphical representation.

Three types of entity are extracted from fiction books to describe the scene, namely Avatars, Areas and Objects. We present a novel method for modeling the temporal aspect of a fiction story using multiple time-line representations after which the information extracted regarding entities and time-lines is used to formulate constraints. A constraint solving technique based on interval arithmetic is used to ensure that the behaviour of the entities satisfies the constraints over multiple universally quantified time intervals. This approach is demonstrated by finding solutions to multiple time-based constraints, and represents a new contribution to the field of Text-to-Scene conversion. An example of the automatically produced graphical output is provided in support of our constraint-based conversion scheme.

Hierarchical rule generalisation for speaker identification in fiction books

This paper presents a hierarchical pattern matching and generalisation technique which is applied to the problem of locating the correct speaker of quoted speech found in fiction books. Patterns from a training set are generalised to create a small number of rules, which can be used to identify items of interest within the text. The pattern matching technique is applied to finding the Speech-Verb, Actor and Speaker of quotes found in ction books. The technique performs well over the training data, resulting in rule-sets many times smaller than the training set, but providing very high accuracy. While the rule-set generalised from one book is less effective when applied to different books than an approach based on hand coded heuristics, performance is comparable when testing on data closely related to the training set.

Identifying annotations for adventure game generation from fiction text

Recent advancements in Text-to-Scene research have lead to the development of systems which automatically extract key concepts from the text of a fiction book and generate computer animated movies depicting the story. Extracting such annotations from raw fiction text is a laborious process and so in this work we evaluate appropriate candidates to serve as the basis for the required annotations for generating interactive virtual worlds.

We validate our choice by generating adventure games: inter-active virtual worlds which create a stylized representation of the environment described in the text, populate it with characters related to the story and define game goals related to the plot of the fiction story. Our prototype produces a fully playable game, making use of an existing open-source game engine.

The process is evaluated using user tests in which participants are asked to measure the accuracy with which the game represents the events, characters and goals described in the story. The response indicates that the chosen annotation set is sufficient to define a game that is a plausibly acceptable representation of the text.

A method for automatically creating 3D animated scenes from annotated fiction text

This paper describes a strategy for automatically converting fiction text into 3D animations. It assumes the existence of fiction text annotated with avatar, object, setting, transition and relation annotations, and presents a transformation process that converts annotated text into quantified constraint systems, the solutions to which are used in the population of 3D environments. Constraint solutions are valid over temporal intervals, ensuring that consistent dynamic behaviour is produced. A substantial level of automation is achieved, while providing opportunities for creative manual intervention in animation process. The process is demonstrated using annotated examples drawn from popular fiction text that are converted into animation sequences, confirming that the desired results can be achieved with only highlevel human direction.

Ten science fiction transitions SFX

Synthesised vocals for science fiction styled projects in mind. 10 different types of transitions that could be used as laser guns, vehicle transitions and whooshes.

Alarm for horror and science fiction SFX

Alarm for horror and science fiction SFX