BitBox!: A case study interface for teaching real-time adaptive music composition for video games

Real-time adaptive music is now well-established as a popular medium, largely through its use in video game soundtracks. Commercial packages, such as fmod, make freely available the underlying technical methods for use in educational contexts, making adaptive music technologies accessible to students. Writing adaptive music, however, presents a significant learning challenge, not least because it requires a different mode of thought, and tutor and learner may have few mutual points of connection in discovering and understanding the musical drivers, relationships and structures in these works. This article discusses the creation of ‘BitBox!’, a gestural music interface designed to deconstruct and explain the component elements of adaptive composition through interactive play. The interface was displayed at the Dare Protoplay games exposition in Dundee in August 2014. The initial proof-of- concept study proved successful, suggesting possible refinements in design and a broader range of applications.

Pathfinder. Performance at the Sonorities Festival of Contemporary Music 2016

Pathfinder (2016) is an audiovisual performance-game for a solo drummer,exploring the synergies between multiple contemporary creative practices.The work navigates between music composition, improvisation, projection/ light art and game art. At its heart lies a bespoke electro-acoustic instrument,the augmented drum-kit, used not only to provide the sonic content of the work in real-time, but also as a highly expressive game controller that interacts with an instrument-specific game. The musical instrument offers a much wider range of expressive possibilities, control and tactile feedback in comparison to a traditional general-purpose game controller, and as a result it affords a very diverse and nuanced gameplay performance. Live electronics, lights, projections and the drum-kit all make up the performance-game’s universe, within which the performer has to explore, adjust, navigate and complete a journey.

BitBox!

BitBox! is an installation that takes game music from the screen and brings it into the room. Using ultrasonic sensors, the system tracks your position in 3D space and uses your location in real time to create evolving soundscapes, dynamic textures and interactive music tracks. Shake and move to create your own music effect.

An impression of home: player nostalgia and the impulse to explore game worlds

This is the accepted version of the paper following peer review.