Experimental arts practice incorporating motion capture

My practice-led research explores and maps workflows for generating experimental creative work involving inertia based motion capture technology. Motion capture has often been used as a way to bridge animation and dance resulting in abstracted visuals outcomes. In early works this process was largely done by rotoscoping, reference footage and mechanical forms of motion capture. With the evolution of technology, optical and inertial forms of motion capture are now more accessible and able to accurately capture a larger range of complex movements. Made by Motion is a collaboration between digital artist Paul Van Opdenbosch and performer and choreographer Elise May; a series of studies on captured motion data used to generate experimental visual forms that reverberate in space and time. The project investigates the invisible forces generated by and influencing the movement of a dancer. Along with how the forces can be captured and applied to generating visual outcomes that surpass simple data visualisation, projecting the intent of the performer’s movements. The source or ‘seed’ comes from using an Xsens MVN – Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. In my presentation I will be displaying and discussing a selected creative works from the project along with the process and considerations behind the work.

Mirror, mirror : claiming digital places of the mundane mapping culture

This paper offers a discussion on the “mundane” or quotidian aspects of that software which might at first glance seem to be a fine example of the extraordinary. It looks at game worlds in terms of an ancient human desire to articulate place in the world and pursues a design concept which resonates with this practice in order to enable a more mundane exploitation of such spatial representations: the claiming of place.

Claiming places : game mods and graffiti

Many games now on the market come with a Software Development Kit, or SDK, which allow players to construct their own worlds and mod(ify) the original. One or two of these mods have achieved notoriety in the press, cited as evidence of malicious intent on the part of the modders who often exploit their own known lived experience as a basis for new virtual playgrounds. But most player constructed games are a source of delight and pleasure for the builder and for the community of players. Creating a game is the act of creating a world, of making a place.

Too many cooks? Co-creating and co-teaching studio courses in the creative media context : a career-focussed approach

This Case Study relates to the creation and implementation of career‐focussed courses in Creative Media for film, television, animation, broadcast and web contexts. The paper examines the advantages and disadvantages of co‐teaching, and how different professional and academic backgrounds and disciplines can productively inform curriculum design and delivery in the academic/professional context. The authors, as co‐creators and co‐lecturers, have developed a number of courses which represent current working models for intermediate to advanced level academic/professional study, and attract students from across the creative disciplines; including theatre, media, visual arts and music. These courses are structured to develop in students a wide range of aesthetic and technical skills, as well as their ability to apply those skills professionally within and across the creative media industries. Issues regarding the balance between academic rigour, practical hands‐on skill development, assessment, logistics, resources, teamwork and other issues, are examined in the paper.

Digital beings : an opportunity for Australian visual effects

Ongoing innovation in digital animation and visual effects technologies has provided new opportunities for stories to be visually rendered in ways never before possible. Films featuring animation and visual effects continue to perform well at the box office, proving to be highly profitable projects. The Avengers (Whedon, 2012) holds the current record for opening weekend sales, accruing as much as $207,438,708 USD and $623,357,910 USD gross at time of writing. Life of Pi (Lee, 2012) at time of writing has grossed as much as $608,791,063 USD (Box Office Mojo, 2013). With so much creative potential and a demonstrable ability to generate a large amount of revenue, the animation and visual effects industry – otherwise known as the Post, Digital and Visual Effects (PDV) industry – has become significant to the future growth and stability of the Australian film industry as a whole.

QUT Architecture Film Studio (Aus)

Research Statement: An urban film produced by Luke Harrison Mitchell Benham, Sharlene Anderson, Tristan Clark. RIVE NOIR explores the film noir tradition, shot on location in a dark urban space between high-rises and the river, sheltered by a highway. With an original score and striking cinematography, Rive Noir radically transforms the abandoned river’s edge through the production of an amplified reality ordinarily unseen in the Northbank. The work produced under my supervision was selected to appear in the Expanded Architecture Research Group’s International Architecture Film Festival and Panel Discussion in Sydney: The University of Sydney and Carriageworks Performance Space, 06 November 2011. QUT School of Design research submission was selected alongside exhibits by AA School of Architecture, London; The Bartlett School of Architecture, London; University of The Arts, London; Arrhaus School of Architecture, Denmark; Dublin as a Cinematic City, Ireland; Design Lab Screen Studio, Australia; and Sona Cinecity, The University of Melbourne. The exhibit included not only the screening of the film but the design project that derived from and extended the aesthetics of the urban film. The urban proposal and architectural intervention that followed the film was subsequently published in the Brisbane Times, after the urban proposal won first place in The Future of Brisbane architecture competition, which demonstrates the impact of the research project as a whole. EXPANDED ARCHITECTURE 2011 - 6th November Architecture Film Night + Panel Discussion @ Performance Space CarriageWorks was Sydney's first International Architectural Film Festival. With over 40 architectural films by local and international artists, film makers and architects. It was followed by Panel Discussion of esteemed academics and artists working in the field of architectural film.

Exploring sustainability in literature for the Australian curriculum : an annotated guide

The Australian Curriculum: English (AC:E) is being implemented in Queensland and asks teachers and curriculum designers to incorporate the cross curriculum priority of Sustainability. This paper examines some texts suitable for inclusion in classroom study and suggests some companion texts that may be studied alongside them, including online resources by the ABC and those developed online for the Australian Curriculum. We also suggest some formative and summative assessment possibilities for responding to the selected works in this guide. We have endeavoured to investigate literature that enable students to explore and produce text types across the three AC:E categories: persuasive, imaginative and informative. The selected texts cover traditional novels, novellas, Sci-fi and speculative fiction, non-fiction, documentary, feature film and animation. Some of the texts reviewed here also cover the other cross curriculum priorities including texts by Aboriginal and Torres Strait Islander writers and some which also include Asian representations. We have also indicated which of the AC:E the general capabilities are addressed in each text.

Australian animated feature films

Building on and bringing up to date the material presented in the first installment of Directory of World Cinema : Australia and New Zealand, this volume continues the exploration of the cinema produced in Australia and New Zealand since the beginning of the twentieth century. Among the additions to this volume are in-depth treatments of the locations that feature prominently in the countries' cinema. Essays by leading critics and film scholars consider the significance in films of the outback and the beach, which is evoked as a liminal space in Long Weekend and a symbol of death in Heaven's Burning, among other films. Other contributions turn the spotlight on previously unexplored genres and key filmmakers, including Jane Campion, Rolf de Heer, Charles Chauvel, and Gillian Armstrong.

Contours in Motion

My practice-led research explores and maps workflows for generating experimental creative work involving inertia based motion capture technology. Motion capture has often been used as a way to bridge animation and dance resulting in abstracted visuals outcomes. In early works this process was largely done by rotoscoping, reference footage and mechanical forms of motion capture. With the evolution of technology, optical and inertial forms of motion capture are now more accessible and able to accurately capture a larger range of complex movements. The creative work titled “Contours in Motion” was the first in a series of studies on captured motion data used to generating experimental visual forms that reverberate in space and time. With the source or ‘seed’ comes from using an Xsens MVN - Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. The aim of the creative work was to diverge way from a standard practice of using particle system and/or a simple re-targeting of the motion data to drive a 3d character as a means to produce abstracted visual forms. To facilitate this divergence a virtual dynamic object was tether to a selection of data points from a captured performance. The proprieties of the dynamic object were then adjusted to balance the influences from the human movement data with the influence of computer based randomization. The resulting outcome was a visual form that surpassed simple data visualization to project the intent of the performer’s movements into a visual shape itself. The reported outcomes from this investigation have contributed to a larger study on the use of motion capture in the generative arts, furthering the understanding of and generating theories on practice.

Adopting virtual production for animated filmaking

Virtual Production is a rapidly growing approach to filmmaking that utilises 3D software, virtual camera systems and motion capture technology to visually interact with a real-time virtual environment. The use of these technologies has continued to increase, however, little has been done to document the various approaches for incorporating this new film making technique into a production. This practice-led research project outlines the development of virtual production in the entertainment industry and explores possible strategies for adopting aspects of this new film making technique into the production of short animated films. The outcome is an improved understanding of possible strategies that could be utilised to assist producers and directors with the transition into this new film making technique. - See more at: http://dl4.globalstf.org/?wpsc-product=adopting-virtual-production-for-animated-filmaking#sthash.DLzRph4Z.dpuf

Medium and mode : relationships between visual experience and perception in an installation arts practice

Working primarily within the natural landscape, this practice-led research project explored connections between the artist's visual and perceptual experience of a journey or place while simultaneously emphasizing the capacity for digital media to create a perceptual dissonance. By exploring concepts of time, viewpoint, duration of sequences and the manipulation of traditional constructs of stop-frame animation, the practical work created a cognitive awareness of the elements of the journey through optical sensations. The work allowed an opportunity to reflect on the nature of visual experience and its mediation through images. The project recontextualized the selected mediums of still photography, animation and projection within contemporary display modes of multiple screen installations by analysing relationships between the experienced and the perceived. The resulting works added to current discourse on the interstices between still and moving imagery in a digital world.

Managing creativity on the margins : a comparative study of Beijing’s Songzhuang Art District and Hangzhou’s White Horse Lake Creative Eco-City

In the past decade the ‘creative cluster’ has become a driver of urban renewal in China. Many cluster developments attract human capital and investment to post-industrial spaces. This paper looks at two developments which are more post-agricultural than post-industrial: the first is Songzhuang, a large scale contemporary art community situated on the eastern fringe of Beijing, the second is Hangzhou’s White Horse Lake Creative Eco-City, a ‘mixed variety’ cluster model which integrates elements of art, fashion, design and animation. The common factor in both cases is how they came into existence. In both districts urban creative workers moved into a rural environment. Drawing on interviews with planners, officials, and residents we investigate the challenges of sustaining such fringe clusters.

The cooling steam of the Polar Express : historical origins, properties and implications of performance capture

As the first academically rigorous interrogation of the generation of performance within the global frame of the motion capture volume, this research presents a historical contextualisation and develops and tests a set of first principles through an original series of theoretically informed, practical exercises to guide those working in the emergent space of performance capture. It contributes a new understanding of the framing of performance in The Omniscient Frame, and initiates and positions performance capture as a new and distinct interdisciplinary discourse in the fields of theatre, animation, performance studies and film.

Bluebird AR

"What is Bluebird AR? Bluebird AR was the ABC's alternate reality drama set around the leak of Bluebird, a clandestine geoengineering initiative created by eco-billionaire Harrison Wyld. Proposing a fictional scenario set against a backdrop of real world possibilities, Bluebird AR took some of the conventions of the well-established alternate reality game (ARG) genre and pulled them into the relatively new area of online drama, to create a hybrid entertainment form best described as 'participatory drama'. With Bluebird AR's interactive narrative centred on the experimental science of geoengineering, the deliberate manipulation of the Earth's atmosphere to counteract global warming, the events and characters in the Bluebird story were entirely fictional but fused with reality online. Inhabiting a mixture of third party social media spaces and websites created by the ABC, the story incorporated real online articles, scientific journals, media and debate around geoengineering. In an Australian first, ABC Innovation launched Bluebird AR on 27 April 2010, with a 6 week live phase. Audience members were invited to play collectively to help 'unlock the drama' and push forward the emerging narrative, or passively watch the story unfold in real-time across the internet. Bluebird AR subverted ARG conventions with the high quality of its production and assets, and raised the stakes for online drama with its level of audience participation." © 2014 ABC "Introduction One of the most exciting creative challenges of producing Bluebird AR was formulating the broad array of visual styles and treatments required for the project's diverse range of content. Many assets also needed to translate well not only online but across other media, including television and print. With the project's producers keen to create a visually rich narrative with high production values from the outset, inspiration for the production design for various aspects of the Bluebird story began in the earliest pitching phase in September 2008. Particular visual treatments and styles for Bluebird's characters, their web spaces and real world possessions were formulated concurrently with the creation of their profiles. Ideas around how various clues and gameplay spaces might look and feel were also explored at this early stage. Bluebird AR's small but tight creative team produced 7 website designs and brands, motion graphics for title sequences and logo animations, rotoscope animation, 3D compositing and animation, 3D wireframes and schematics, countless Photoshop composites, and a vast array of character assets for the DC (including Kyle's Bluebird Labs security pass and resignation letter, Kruger's American and Russia passports and birth certificate, Harrison's divorce papers, and more)…" © 2014 ABC

Future perfect

"Future Perfect" is a solo artist exhibition featuring a 9 channel video installation, which is comprised of looped computer animation projections. In the first room, the big one, there are nine projections of looped computer animations. Many of these look like representations of gallery spaces containing sculptures, including rotating interpenetrating discs, bouncing coloured coffins, and jostling cardboard cubes (the cubes are blank, then covered in drawings, then covered in photographic imagery). In one video, a man and a woman walk towards one another but never get together. In the second room, an animated video on a flatscreen suggests an origin story. The subtitles tell how, in Russia, my great-grandfather made a joke about Stalin's child bride that cost him his life. That one isn’t a loop; it has a beginning, middle, and end. Lying on the floor, in front of the video, are two slightly crumpled mural prints of photographs of the ocean. There's also a clear Perspex cloud shape on a wall. Viewers will see themselves reflected in it, as if it were a distant hovering mirage. The first room of the exhibition, where objects are set in perpetual motion, is about departure. The second room registers some sense of arrival. The future perfect implies looking back on something that hasn't happened yet; future and past are conflated and the present is somehow deferred. The future perfect combines anticipation and reflection, and it relates to my interest in combining 3-D animation with other mediums like drawing, painting, and shot video. In my work, the virtual and actual coexist in tension, just like experience and expectation in the future perfect.