Playing immersive games on the REVERIE platform

REVERIE (REal and Virtual Engagement in Realistic Immersive Environments) [1] is a multimedia and multimodal framework, which supports the creation of immersive games. The framework supports the creation of games integrating technologies such as 3D spatial audio, detection of the player’s body movement using Kinect and WIMO sensors, NPCs (Non-Playable Characters) with advanced AI capabilities featuring various levels of representation and gameplay into an immersive 3D environment. A demonstration game was developed for REVERIE, which is an adapted version of the popular Simon Says game. In the REVERIE version, a player tries to follow physical instructions issued by two autonomous agents with different degrees of realism. If a player follows a physical instruction correctly, they are awarded one point. If not, they are deducted one point. This paper presents a technical overview of the game technologies integrated in the Simon Says demo and its evaluation by players with variable computer literacy skills. Finally the potential of REVERIE as an immersive framework for gaming is discussed, followed by recommendations for improvements in future versions of the framework.

The Undersea World of the Sound Department: the Construction of Sonic Conventions in Sub-aqua Screen Environments

The availability of new underwater cameras and sub-aqua diving gear in the immediate post-war era opened up exciting possibilities for both narrative and documentary filmmakers. While the visual elements of this new world could now be more easily captured on film, the sound elements of the sub-aqua environment remained more elusive. What did, or should, this undersea world sound like? This article examines the use of sound in the sub-aqua scenes of both fictional and documentary films in the 1950s and asks questions about the methods used in the sonification of these worlds. Comparing the operation of underwater sound and human hearing with the production and post-production strategies used by filmmakers, I seek to identify the emergence of a sound convention and its implications for issues of cinematic realism. Central to this convention is the manipulation of sonic frequencies. The sound strategies adopted also raise questions about the malleability of viewer perspective and sound-image relationship in terms of a realist mode of address. Linked to this is the use of sound to enhance audience experience on an affective level. As well as underpinning cinematic realism, these new sound environments offered fresh experiences to audiences seeking new reasons to visit the cinema in an era of widening forms of entertainment.