Inertial motion capture and live performance (with a focus on dance)

3D Motion capture is a fast evolving field and recent inertial technology may expand the artistic possibilities for its use in live performance. Inertial motion capture has three attributes that make it suitable for use with live performance; it is portable, easy to use and can operate in real-time. Using four projects, this paper discusses the suitability of inertial motion capture to live performance with a particular emphasis on dance. Dance is an artistic application of human movement and motion capture is the means to record human movement as digital data. As such, dance is clearly a field in which the use of real-time motion capture is likely to become more common, particularly as projected visual effects including real-time video are already often used in dance performances. Understandably, animation generated in real-time using motion capture is not as extensive or as clean as the highly mediated animation used in movies and games, but the quality is still impressive and the ‘liveness’ of the animation has compensating features that offer new ways of communicating with an audience.

Image synthesis based on a model of human vision

Modern computer graphics systems are able to construct renderings of such high quality that viewers are deceived into regarding the images as coming from a photographic source. Large amounts of computing resources are expended in this rendering process, using complex mathematical models of lighting and shading. However, psychophysical experiments have revealed that viewers only regard certain informative regions within a presented image. Furthermore, it has been shown that these visually important regions contain low-level visual feature differences that attract the attention of the viewer. This thesis will present a new approach to image synthesis that exploits these experimental findings by modulating the spatial quality of image regions by their visual importance. Efficiency gains are therefore reaped, without sacrificing much of the perceived quality of the image. Two tasks must be undertaken to achieve this goal. Firstly, the design of an appropriate region-based model of visual importance, and secondly, the modification of progressive rendering techniques to effect an importance-based rendering approach. A rule-based fuzzy logic model is presented that computes, using spatial feature differences, the relative visual importance of regions in an image. This model improves upon previous work by incorporating threshold effects induced by global feature difference distributions and by using texture concentration measures. A modified approach to progressive ray-tracing is also presented. This new approach uses the visual importance model to guide the progressive refinement of an image. In addition, this concept of visual importance has been incorporated into supersampling, texture mapping and computer animation techniques. Experimental results are presented, illustrating the efficiency gains reaped from using this method of progressive rendering. This visual importance-based rendering approach is expected to have applications in the entertainment industry, where image fidelity may be sacrificed for efficiency purposes, as long as the overall visual impression of the scene is maintained. Different aspects of the approach should find many other applications in image compression, image retrieval, progressive data transmission and active robotic vision.

Unwrapping an ancient Egyptian mummy using x-rays

This article describes a project to unwrap an ancient Egyptian mummy using X-ray computed tomography (CT). About 600 X-ray CT images were obtained through the mummified body of a female named Tjetmutjengebtiu (or Jeni for short), who was a singer in the great temple of Karnak in Egypt during the 22nd dynasty (c. 945-715 BC). The X-ray CT images reveal details of the remains of body organs, wrappings and jewellery. 3D reconstructions of Jeni’s teeth suggest that she was probably only around 20 years old when she died, although the cause of death cannot be ascertained from the CT scans. The CT images were used to build a 3D model of Jeni’s head which enabled an artist to paint a picture of what Jeni may have looked like during life. A PowerPoint presentation and movie clips are provided as supplementary material that may be useful for teaching.

Alternate reality games and education innovation

An Alternate Reality Game (ARG) is a unique experience that blurs the edges between our everyday lives and imagined game worlds. Players are invited to interact with each other and fictional characters using familiar tools such as emails, websites, telephones, and sometimes newspapers, radio and television. ARGs come in all shapes and sizes, tell a variety of different stories and inspire all kinds of interactions between people, their networks and the very streets in which they live. Some ARGs simply immerse you in fictional scenarios and indulge you in quirky challenges. While others reveal hidden histories of a city and teach us about important political causes. But the most exciting thing about ARGs is that they have the potential to inspire participants to imagine their everyday tools and places as resources for their own creative endeavors. Deb Polson will be presenting some of the most inspiring ARGs of recent years and revealing some of the design techniques that were used to create them. Most significantly Deb will discuss ways in which educators can imagine using ARGs as rich teaching tools that inspire collaborative learning and motivate students to engage in all kinds of subject matter.

Making the most of MiLK : harnessing the contemporary culture and interests of natural born cyborg

MiLK is a mobile learning kit that allows students and teachers to author their own place-based learning events using simple web and mobile technologies. We will demonstrate how MiLK has been used by a number of teachers in various contexts to connect students, curriculum and everyday environments. This workshop will introduce participants to the various MiLK tools and processes; including mapping, designing, playing and reviewing events, group journals, discussion forums, student profiles, and class profiles. We will focus on the role of place as a potential resource for curriculum design and delivery. The MiLK Team are looking for enthusiastic mobile technology champions to join us. No previous experience or training in this area is needed. This workshop is designed to be relevant to all KLAs. During this session teachers will have an opportunity to experiment with simple tools to create dynamic resources for their own classrooms.

Location-based games : transforming everyday environments into dynamic learning spaces

Location based games (LBGs) provide an opportunity to look at how new technologies can support a reciprocal relationship between formal classroom learning and learning that can potentially occur in other everyday environments. Fundamentally many games are intensely engaging due to the resulting social interactions and technical challenges they provide to individual and group players. By introducing the use of mobile devices we can transport these characteristics of games into everyday spaces. LBGs are understood as a broad genre incorporating ideas and tools that provide many unique opportunities for us to to reveal, create and even subvert various social, cultural, technical, and scientific interpretations of place, in particular places where learning is sometimes problematic.--------- A team of Queensland game developers have learnt a great deal through designing a range of LBGs such as SCOOT for various user groups and places. While these LBGs were primarily designed as social events, we found that the players recognised and valued the game as an opportunity to learn about their environment, it's history, cultural significance, inhabitants, services etc. Since identifying the strong pedagogical outcomes of LBGs, the team has created a set of authoring tools for people to design and host their own LBGs. A particular version of this is known as MiLK the mobile learning kit for schools.---------- This presentation will include examples of how LBGs have been used to improve the teaching and learning outcomes in various contexts. Participants will be introduced to MiLK and invited to trial it in their own classrooms with students.

SCOOT game event : families as partners in learning

How games can be designed to engage families in learning spaces outside of the classroom. SCOOT Game has been played by families in various science museums and art galleries in Australian capital cities since 2004. Families form groups to collaborate in the game that takes them on an SMS quest through these places engaging them with artworks, historic facts, landmarks, puzzles, street performances etc.

Farm it right : the sustainable farming simulation

Farm It Right is an innovative creative work that simulates sustainable farming techniques using ecological models prepared by academics at Bradford University (School of Life Sciences). This interactive work simulates the farming conditions and options of our ancestors and demonstrates the direct impact their actions had on their environment and on the ’future of their cultures’ (Schmidt 2008). Specifically, the simulation allows users to explore and experiment with the complex relationships between environmental factors and human decision making within the harsh conditions of an early (9th century) Nordic farm. The simulation interface displays both statistical and graphical feedback in response to the users selections regarding animal reproduction rates, shelter provisions, food supplies etc. as well as demonstrating resulting impacts to soil erosion, water supply, animal population sizes etc.---------- 'Farm It Right' is now used at Bradford University (School of Life Sciences) as a dynamic e-Learning resource for incorporating environmental archaeology with sustainable development education, improving the engagement with complex data and the appreciation of human impacts on the environment and the future of their cultures. 'Farm It Right' is also demonstrated as an exemplar case study for interaction design students at Queensland University of Technology.

Studio game-on

The studio-gameon event was supported by the Institute of the Creative Industries and Innovation and the Faculty of IT as part of the State Library of Queensland GAME ON exhibition (ex Barbican, UK) The studio produced a full game in six weeks. It was a curated event, a live web-based exhibition, a performance for the public and the team produced a digital / creative work which is available for download. The studio enabled a team of students to experience the pressures of a real game studio within the space of the precincts but also very much in the public eye. It was a physical hypothesis of the University's mantra - "for the real world" statement: Studio GameOn is an opportunity running alongside the GAME ON exhibition at the State Library of Queensland. The exhibition itself is open to the public from November 17th through to February 15th. The studio runs from January 5th to February 13th 2009. The Studio GameOn challenge? To put together a team of game developers and make a playable game in six weeks! The studio-game on team consists of a group of game developers in training - the team members are all students who are either half-way through or completing a qualification in game design and all its elements - we have designers, artists, programmers and productionteam members. We are also fortunate to have an Industry Board consisting of local Queensland Games professionals: John Passfield (Red Sprite Studios), Adrian Cook (WIldfire Studios) and Duncan Curtis and Marko Grgic (The 3 Blokes). We also invite the public to play with us - there is an ideas box both on-site at the State Library and a number of ways to communicate with us on this studio website.

Sounds from the empty city : a practice-led case study in the confluence of music, narrative and emotion

The creative practice: the adaptation of picture book The Empty City (Megarrity/Oxlade, Hachette 2007) into an innovative, interdisciplinary performance for children which combines live performance, music, projected animation and performing objects. The researcher, in the combined roles of writer/composer proposes deliberate experiments in music, narrative and emotion in the various drafts of the adaptation, and tests them in process and performance product. A particular method of composing music for live performance is tested in against the emergent needs of a collaborative, intermedial process. The unpredictable site of research means that this project is both looking to address both pre-determined and emerging points of inquiry. This analysis (directed by audience reception) finds that critical incidents of intermediality between music, narrative, action and emotion translate directly into highlights of the performance.

The power of a single prototype : sustainable fashion textile design and the prevention of carcinogenic melanoma

Is there a role for prototyping (sketching, pattern making and sampling) in addressing real world problems of sustainability (People, Profit, and Planet), in this case social/healthcare issues, through fashion and textiles research? Skin cancer and related illnesses are a major cause of disfigurement and death in New Zealand and Australia where the rates of Melanoma, a serious form of skin cancer, are four times higher than in the Northern Hemisphere regions of USA, UK and Canada (IARC, 1992). In 2007, AUT University (Auckland University of Technology) Fashion Department and the Health Promotion Department of Cancer Society - Auckland Division (CSA) developed a prototype hat aimed at exploring a barrier type solution to prevent facial and neck skin damage. This is a paradigm shift from the usual medical research model. This paper provides an overview of the project and examines how a fashion prototype has been used to communicate emergent social, environmental, personal, physiological and technological concerns to the trans-disciplinary research team. The authors consider how the design of a product can enhance and support sustainable design practice while contributing a potential solution to an ongoing health issue. Analysis of this case study provides an insight into prototyping in fashion and textiles design, user engagement and the importance of requirements analysis in relation to sustainable development. The analysis and a successful outcome of the final prototype have provided a gateway to future collaborative research and product development.

Directing for the 360 degree frame : developing a directorial approach to performance capture

What happens when the traditional framing mechanisms of our performance environments are removed and we are forced as directors to work with actors in digital environments that capture performance in 360 degrees? As directors contend with the challenges of interactive performance, the emergence of the online audience and the powerful influence of the games industry, how can we approach the challenges of directing work that is performance captured and presented in real time using motion capture and associated 3D imaging software? The 360 degree real time capture of performance, while allowing for an unlimited amount of framing potential, demands a unique and uncompromisingly disciplined style of direction and performance that has thus far remained unstudied and unquantified. By a close analysis of the groundbreaking work of artists like Robert Zemeckis and the Wetta Digital studio it is possible to begin to quantify what the technical requirements and challenges of 360 degree direction might be, but little has been discovered about the challenges of communicating the unlimited potential of framing and focus to the actors who work with these directors within these systems. It cannot be argued that the potential of theatrical space has evolved beyond the physical and moved into a more accessible virtual and digitised form, so how then can we direct for this unlimited potential and where do we place the focus of our directed (and captured) performance?

Urban Informatics in Creative Industries

Presentation of research projects