The educational affordances of generative media in arts education

Network Jamming systems provide real-time collaborative media performance experiences for novice or inexperienced users. In this paper we will outline the theoretical and developmental drivers for our Network Jamming software, called jam2jam. jam2jam employs generative algorithmic techniques with particular implications for accessibility and learning. We will describe how theories of engagement have directed the design and development of jam2jam and show how iterative testing cycles in numerous international sites have informed the evolution of the system and its educational potential. Generative media systems present an opportunity for users to leverage computational systems to make sense of complex media forms through interactive and collaborative experiences. Generative music and art are a relatively new phenomenon that use procedural invention as a creative technique to produce music and visual media. These kinds of systems present a range of affordances that can facilitate new kinds of relationships with music and media performance and production. Early systems have demonstrated the potential to provide access to collaborative ensemble experiences to users with little formal musical or artistic expertise.This presentation examines the educational affordances of these systems evidenced by field data drawn from the Network Jamming Project. These generative performance systems enable access to a unique kind of music/media’ ensemble performance with very little musical/ media knowledge or skill and they further offer the possibility of unique interactive relationships with artists and creative knowledge through collaborative performance. Through the process of observing, documenting and analysing young people interacting with the generative media software jam2jam a theory of meaningful engagement has emerged from the need to describe and codify how users experience creative engagement with music/media performance and the locations of meaning. In this research we observed that the musical metaphors and practices of ‘ensemble’ or collaborative performance and improvisation as a creative process for experienced musicians can be made available to novice users. The relational meanings of these musical practices afford access to high level personal, social and cultural experiences. Within the creative process of collaborative improvisation lie a series of modes of creative engagement that move from appreciation through exploration, selection, direction toward embodiment. The expressive sounds and visions made in real-time by improvisers collaborating are immediate and compelling. Generative media systems let novices access these experiences with simple interfaces that allow them to make highly professional and expressive sonic and visual content simply by using gestures and being attentive and perceptive to their collaborators. These kinds of experiences present the potential for highly complex expressive interactions with sound and media as a performance. Evidence that has emerged from this research suggest that collaborative performance with generative media is transformative and meaningful. In this presentation we draw out these ideas around an emerging theory of meaningful engagement that has evolved from the development of network jamming software. Primarily we focus on demonstrating how these experiences might lead to understandings that may be of educational and social benefit.

Contemporary dramaturgy in theatre for young people : the conceptual shape of displacement and installation

This thesis investigates Theatre for Young People (TYP) as a site of performance innovation. The inquiry is focused on contemporary dramaturgy and its fieldwork aims to identify new dramaturgical principles operating in the creation and presentation of TYP. The research then seeks to assess how these new principles contribute to Postdramatic Theatre theory. This research inquiry springs from an imperative based in practice: Young people under 25 years have a literacy based on online hypertextual experiences which take the reader outside the frames of a dramatic narrative and beyond principles such as linearity, dramatic unity, teleology and resolution. As a dramaturg and educator I wanted to understand the new ways that young people engage in cultural products, to identify and utilize the new principles of dramaturgy that are now in evidence. My research examines how two playwright/directors approach their work and the new principles that can be identified in their dramaturgy. The fieldwork is scoped into two case studies: the first on TJ Eckleberg working in Australian Theatre for Young People and the second on Kristo Šagor working in German Children’s and Young People’s Theatre (KJT). These case studies address both types of production dramaturgy - the dramaturgy emergent through process in devised performance making, and that emergent in a performance based on a written playscript. On Case Study One the researcher, as participant observer, worked as production dramaturg on a large scale, site specific performance, observing the dramaturgy in process of its director and chief devisor. On Case Study Two the researcher, as observer and analyst, undertook a performance analysis of three playscripts and productions by a contemporary German playwright and director. Utilizing participant observation, reflective practice and grounded analysis the case studies have identified two new principles animating the dramaturgy of these TYP practitioners, namely ‘displacement’ and ‘installation.’ Taking practice into theory, the thesis concludes by demonstrating how displacement and installation contribute to Postdramatic Theatre’s “arsenal of expressive gestures which serve as theatre’s response to changed social communication under the conditions of generalized communication technologies” (Lehmann, H.-T., 2006, p.23). This research makes an original contribution to knowledge by evidencing that the principles of Postdramatic Theory lie within the practice of contemporary Theatre for Young People. It also contributes valuable research to a specialized, often overlooked terrain, namely Dramaturgy in Theatre for Young People, presented here with a contemporary, international and intercultural perspective.

IDOL

Idol is a collaborative performance work for vocal performer and dancers. The work explores movement and sound relative to a vocal interface called the eMic (Extended Microphone Interface Controller). The eMic is a gestural controller designed by the composer for live vocal performance an real-time processing. The process for generating the work involves the choreographer being provided an opportunity to experiment with gestures ad movement relative to the eMic interface. The choreographer explored the interface as an object,a prop, an instrument and as an extension of the body. the movement was then videoed and the data coming from the sensors simultaneously recorded. The data and the video were then used as part of the compositional process, allowing the composer to see what the performance looks like and to experiment with mapping strategies using the captured sensor data. This approach represents a new compositional direction for working with the eMic, in that previously the compositional process commenced at the computer, building processing patches and assigning parameters to eMic sensors. In order to play the composition, the body needed to adapt to 'playing' the instrument. This approach treats the eMic like a traditional instrument that requires the human body to develop a command over the instrument. Working with the movement as a starting point inverts the process using choreographic gestures as the basis for musical structures.

Visualizing digital media interactions : providing feedback on jam2jam AV performances

Instrumental music performance is a well-established case of real-time interaction with technology and, when extended to ensembles, of interaction with others. However, these interactions are fleeting and the opportunities to reflect on action is limited, even though audio and video recording has recently provided important opportunities in this regard. In this paper we report on research to further extend these reflective opportunities through the capture and visualization of gestural data collected during collaborative virtual performances; specifically using the digital media instrument Jam2jam AV and the specifically-developed visualization software Jam2jam AV Visualize. We discusses how such visualization may assist performance development and understanding. The discussion engages with issues of representation, authenticity of virtual experiences, intersubjectivity and wordless collaboration, and creativity support. Two usage scenarios are described showing that collaborative intent is evident in the data visualizations more clearly than in audio-visual recordings alone, indicating that the visualization of performance gestures can be an efficient way of identifying deliberate and co-operative performance behaviours.

From Jindabyne to 'Jindabyne' : immigrant and indigenous specters

This paper reads Ray Lawrence's film Jindabyne (2006) in order to consider how "Australian" connotes as "immigrant" or "Indigenous" in contemporary Australia. Although the film is an adaptation of an American short story, it exploits an existing grammar of place in Australian cultural production in order to interrogate this very culture. If questions of race, gender, and class have haunted post-settlement Australia, Lawrence's film simultaneously stages these spectres and gestures towards the necessary failure of any attempt to exorcise them in a place where indigeneity is invisible. Thus, the location of Jindabyne, the town drowned in the name of progress, offers an exemplary visual metaphor for the failed project of identity formation in a place where forgetting is a survival tool.

The play's the thing? : Hamlet, Slings & Arrows, and the authority of theatrical consumption

This paper reads season 1 of the critically-acclaimed Canadian television series “Slings & Arrows” (2003). This six-episode series is set in a fictionalised version of the Stratford Festival, and tells the story of a plagued production of Shakespeare’s Hamlet. It follows the play’s rehearsal after the death of the festival’s artistic director; Geoffrey Tennant (himself a plagued Hamlet) takes over the role of director, and must face his past in order to produce a Hamlet that will save the festival, redeem his reputation, and repair his interpersonal relationships. Drawing on popular and theatrical understandings of Shakespeare’s play, the series negotiates tropes of metatheatre, filiality, cultural production and consumption, in order to demonstrate the ongoing relevance and legitimacy of “Shakespeare” in the twenty-first century. The “Slings & Arrows” narrative revolves around the doubled-plot of Hamlet and the experiences of the company mounting Hamlet. In quite obvious ways, the show thus thematises ways in which Shakespeare can be used to read one’s own life and world. In the broader sense, however, the show also offers theatre/performance as a catalyst for affect. In doing so, the show functions as a relatively straight adaptation of Hamlet, and a metatheatrical/metafictional commentary on the functions of Hamlet within contemporary culture. In Shakespeare’s play, the production of “The Mouse-Trap” proves, both to Hamlet and the audience, the legitimacy of the ghost’s claims. Similarly, in “Slings & Arrows”, the successful performance of Hamlet legitimises Geoffrey’s position as artistic director of the festival, and affirms for the viewer the value of Shakespearean production in contemporary culture. In each text, theatre/performance enables and legitimises a son carrying out a dead father’s wishes in order to restore or reproduce socio-cultural order. The metatheatrics of these gestures engage the reader/viewer in a self-reflexive process whereby the ‘value’ of theatre is thematised and performed, and the consumer is positioned as the arbiter and agent of that value: complicit in its production even as they are the site of its consumption.

Primary students’ interpretation of maps : gesture use and mapping knowledge

Maps are used to represent three-dimensional space and are integral to a range of everyday experiences. They are increasingly used in mathematics, being prominent both in school curricula and as a form of assessing students understanding of mathematics ideas. In order to successfully interpret maps, students need to be able to understand that maps: represent space, have their own perspective and scale, and their own set of symbols and texts. Despite the fact that maps have an increased prevalence in society and school, there is evidence to suggest that students have difficulty interpreting maps. This study investigated 43 primary-aged students’ (aged 9-12 years) verbal and gestural behaviours as they engaged with and solved map tasks. Within a multiliteracies framework that focuses on spatial, visual, linguistic, and gestural elements, the study investigated how students interpret map tasks. Specifically, the study sought to understand students’ skills and approaches used to solving map tasks and the gestural behaviours they utilised as they engaged with map tasks. The investigation was undertaken using the Knowledge Discovery in Data (KDD) design. The design of this study capitalised on existing research data to carry out a more detailed analysis of students’ interpretation of map tasks. Video data from an existing data set was reorganised according to two distinct episodes—Task Solution and Task Explanation—and analysed within the multiliteracies framework. Content Analysis was used with these data and through anticipatory data reduction techniques, patterns of behaviour were identified in relation to each specific map task by looking at task solution, task correctness and gesture use. The findings of this study revealed that students had a relatively sound understanding of general mapping knowledge such as identifying landmarks, using keys, compass points and coordinates. However, their understanding of mathematical concepts pertinent to map tasks including location, direction, and movement were less developed. Successful students were able to interpret the map tasks and apply relevant mathematical understanding to navigate the spatial demands of the map tasks while the unsuccessful students were only able to interpret and understand basic map conventions. In terms of their gesture use, the more difficult the task, the more likely students were to exhibit gestural behaviours to solve the task. The most common form of gestural behaviour was deictic, that is a pointing gesture. Deictic gestures not only aided the students capacity to explain how they solved the map tasks but they were also a tool which assisted them to navigate and monitor their spatial movements when solving the tasks. There were a number of implications for theory, learning and teaching, and test and curriculum design arising from the study. From a theoretical perspective, the findings of the study suggest that gesturing is an important element of multimodal engagement in mapping tasks. In terms of teaching and learning, implications include the need for students to utilise gesturing techniques when first faced with new or novel map tasks. As students become more proficient in solving such tasks, they should be encouraged to move beyond a reliance on such gesture use in order to progress to more sophisticated understandings of map tasks. Additionally, teachers need to provide students with opportunities to interpret and attend to multiple modes of information when interpreting map tasks.

The cradle of whose civilisation? : reading the Theseus myth in Riordan’s Percy Jackson and Ottley’s Requiem for a Beast

This paper considers the functions of Greek mythology in general and the “Theseus and the Minotaur” myth in particular in two contemporary texts of adolescent masculinity: Rick Riordan’s Percy Jackson series (2005-2009) and Matt Ottley’s Requiem for a Beast: A Work for Image, Word and Music (2007). These texts reveal the ongoing flexibility of mythic texts to be pressed into service of shoring up or challenging currently hegemonic ideologies of self and state. Both Riordan and Ottley make a variety of intertextual uses of classical hero plots in order to facilitate their own narrative explorations of contemporary adolescent men ‘coming of age’. These intertextual gestures might easily be read as gestures of alignment with narrative traditions and authority which simultaneously confer “legitimacy” on Riordan and Ottley, on their texts, and by extension, on their readers. However, when read in juxtaposition, it is clear that Riordan and Ottley may use classical mythology to articulate similarly gendered adolescence, they produce divergent visions of nationed adolescence.

Cyclists' experiences of harassment from motorists : findings from a survey of cyclists in Queensland, Australia

Objective Harassment from motorists is a major constraint on cycling that has been under-researched. We examined incidence and correlates of harassment of cyclists. Methods Cyclists in Queensland, Australia were surveyed in 2009 about their experiences of harassment while cycling, from motor vehicle occupants. Respondents also indicated the forms of harassment they experienced. Logistic regression modeling was used to examine gender and other correlates of harassment. Results Of 1830 respondents, 76% of men and 72% of women reported harassment in the previous 12 months. The most reported forms of harassment were driving too close (66%), shouting abuse (63%), and making obscene gestures/sexual harassment (45%). Older age, overweight/obesity, less cycling experience (< 2 years) and less frequent cycling (< 3 days/week) were associated with less likelihood of harassment, while living in highly advantaged areas (SEIFA deciles 8 or 9), cycling for recreation, and cycling for competition were associated with increased likelihood of harassment. Gender was not associated with reports of harassment. Conclusions Efforts to decrease harassment should include a closer examination of the circumstances that give rise to harassment, as well as fostering road environments and driver attitudes and behaviors that recognize that cyclists are legitimate road users.

Choreographic approaches to music composition for a new musical interface : the eMic

Gesture in performance is widely acknowledged in the literature as an important element in making a performance expressive and meaningful. The body has been shown to play an important role in the production and perception of vocal performance in particular. This paper is interested in the role of gesture in creative works that seek to extend vocal performance via technology. A creative work for vocal performer, laptop computer and a Human Computer Interface called the eMic (Extended Microphone Stand Interface controller) is presented as a case study, to explore the relationships between movement, voice production, and musical expression. The eMic is an interface for live vocal performance that allows the singers’ gestures and interactions with a sensor based microphone stand to be captured and mapped to musical parameters. The creative work discussed in this paper presents a new compositional approach for the eMic by working with movement as a starting point for the composition and thus using choreographed gesture as the basis for musical structures. By foregrounding the body and movement in the creative process, the aim is to create a more visually engaging performance where the performer is able to more effectively use the body to express their musical objectives.

Detecting gesture force peaks for intuitive interaction

With the release of the Nintendo Wii in 2006, the use of haptic force gestures has become a very popular form of input for interactive entertainment. However, current gesture recognition techniques utilised in Nintendo Wii games fall prey to a lack of control when it comes to recognising simple gestures. This paper presents a simple gesture recognition technique called Peak Testing which gives greater control over gesture interaction. This recognition technique locates force peaks in continuous force data (provided by a gesture device such as the Wiimote) and then cancels any peaks which are not meant for input. Peak Testing is therefore technically able to identify movements in any direction. This paper applies this recognition technique to control virtual instruments and investigates how users respond to this interaction. The technique is then explored as the basis for a robust way to navigate menus with a simple flick of the wrist. We propose that this flick-form of interaction could be a very intuitive way to navigate Nintendo Wii menus instead of the current pointer techniques implemented.

Designing relational pedagogies with jam2jamXO

This paper examines the affordances of the philosophy and practice of open source and the application of it in developing music education software. In particular I will examine the parallels inherent in the ‘openness’ of pragmatist philosophy in education (Dewey 1916, 1989) such as group or collaborative learning, discovery learning (Bruner 1966) and learning through creative activity with computers (Papert 1980, 1994). Primarily I am interested in ‘relational pedagogies’ (Ruthmann and Dillon In Press) which is in a real sense about the ethics of the transaction between student and teacher in an ecology where technology plays a more significant role. In these contexts relational pedagogies refers to how the music teacher manages their relationships with students and evaluates the affordances of open source technology in that process. It is concerned directly with how the relationship between student and teacher is affected by the technological tools, as is the capacity for music making and learning. In particular technologies that have agency present the opportunity for a partnership between user and technology that enhances the capacity for expressive music making, productive social interaction and learning. In this instance technologies with agency are defined as ones that enhance the capacity to be expressive and perform tasks with virtuosity and complexity where the technology translates simple commands and gestures into complex outcomes. The technology enacts a partnership with the user that becomes both a cognitive and performative amplifier. Specifically we have used this term to describe interactions with generative technologies that use procedural invention as a creative technique to produce music and visual media.

Everything

Everything (2008) is a looped 3 channel digital video (extracted from a 3D computer animation) that appropriates a range of media including photography, drawing, painting, and pre-shot video. The work departs from traditional time-based video which is generally based on a recording of an external event. Instead, “Everything” constructs an event and space more like a painting or drawing might. The works combines constructed events (including space, combinations of objects, and aesthetic relationship of forms) with pre-recorded video footage and pre-made paintings and drawings. The result is a montage of objects, images – both still and moving – and abstracted ‘painterly’ gestures. This technique creates a complex temporal displacement. 'Past' refers to pre-recorded media such as painting and photography, and 'future' refers to a possible virtual space not in the present, that these objects may occupy together. Through this simultaneity between the real and the virtual, the work comments on a disembodied sense of space and time, while also puncturing the virtual with a sense of materiality through the tactility of drawing and painting forms and processes. In so doing, te work challenges the perspectival Cartesian space synonymous with the virtual. In this work the disembodied wandering virtual eye is met with an uncanny combination of scenes, where scale and the relationships between objects are disrupted and changed. Everything is one of the first international examples of 3D animation technology being utilised in contemporary art. The work won the inaugural $75,000 Premier of Queensland National New Media Art Award and was subsequently acquired by the Queensland Art Gallery. The work has been exhibited and reviewed nationally and internationally.

Reducing aggression on our roads : testing a comprehensive model of aggressive driving

Background: Trauma resulting from traffic crashes poses a significant problem in highly motorised countries. Over a million people worldwide are killed annually and 50 million are critically injured as a result of traffic collisions. In Australia, road crashes cost an average of $17 billion annually in personal loss of income and quality of life, organisational losses in productivity and workplace quality, and health care costs. Driver aggression has been identified as a key factor contributing to crashes, and many motorists report experiencing mild forms of aggression (e.g., rude gestures, horn honking). However despite this concern, driver aggression has received relatively little attention in empirical research, and existing research has been hampered by a number of methodological and conceptual shortcomings. Specifically, there has been substantial disagreement regarding what constitutes aggressive driving and a failure to examine both the situational factors and the emotional and cognitive processes underlying driver aggression. To enhance current understanding of aggressive driving, a model of driver aggression that highlights the cognitive and emotional processes at play in aggressive driving incidents is proposed. Aims: The research aims to improve current understanding of the complex nature of driver aggression by testing and refining a model of aggressive driving that incorporates the person-related and situational factors and the cognitive and emotional appraisal processes fundamental to driver aggression. In doing so, the research will assist to provide a clear definition of what constitutes aggressive driving, assist to identify on-road incidents that trigger driver aggression, and identify the emotional and cognitive appraisal processes that underlie driver aggression. Methods: The research involves three studies. Firstly, to contextualise the model and explore the cognitive and emotional aspects of driver aggression, a diary-based study using self-reports of aggressive driving events will be conducted with a general population of drivers. This data will be supplemented by in-depth follow-up interviews with a sub-sample of participants. Secondly, to test generalisability of the model, a large sample of drivers will be asked to respond to video-based scenarios depicting driving contexts derived from incidents identified in Study 1 as inciting aggression. Finally, to further operationalise and test the model an advanced driving simulator will be used with sample of drivers. These drivers will be exposed to various driving scenarios that would be expected to trigger negative emotional responses. Results: Work on the project has commenced and progress on the first study will be reported.

Something rotten in the state of Minnesota: or the morality of backwoodsmen: 'A Simple Plan'

'A Simple Plan' is a deceptively complex and multilayered film, combining elements of Celtic mythology with the morality play and the windfall fantasy gone disastrously wrong. Despite its blending of realism and heavyhanded symbolism, and its abundant trans-textual gestures, 'A Simple Plan' is in many ways defiantly not a 90s movie: its leading characters are fashionably flawed, but they are neither sensitive, nor honourable, nor heroic; there are no startling special effects or intricate timeshifts; and it desperately gives the impression of depth, of being emphatically more than mere superficial excess. At a stretch it almost appears to be a throwback to the 1930s Production Code emphasis on the role of cinema in moral instruction; while good hardly triumphs over evil, venality is painfully and emphatically punished. But in other ways it is a quintessential late 90s film: an American/British/Japanese/German/French co-production, 'A Simple Plan' acts most palpably as a commentary on the moral, economic and social condition of the United States at the end of the American century.