Improvisation in interactive music systems

This project investigates machine listening and improvisation in interactive music systems with the goal of improvising musically appropriate accompaniment to an audio stream in real-time. The input audio may be from a live musical ensemble, or playback of a recording for use by a DJ. I present a collection of robust techniques for machine listening in the context of Western popular dance music genres, and strategies of improvisation to allow for intuitive and musically salient interaction in live performance. The findings are embodied in a computational agent – the Jambot – capable of real-time musical improvisation in an ensemble setting. Conceptually the agent’s functionality is split into three domains: reception, analysis and generation. The project has resulted in novel techniques for addressing a range of issues in each of these domains. In the reception domain I present a novel suite of onset detection algorithms for real-time detection and classification of percussive onsets. This suite achieves reasonable discrimination between the kick, snare and hi-hat attacks of a standard drum-kit, with sufficiently low-latency to allow perceptually simultaneous triggering of accompaniment notes. The onset detection algorithms are designed to operate in the context of complex polyphonic audio. In the analysis domain I present novel beat-tracking and metre-induction algorithms that operate in real-time and are responsive to change in a live setting. I also present a novel analytic model of rhythm, based on musically salient features. This model informs the generation process, affording intuitive parametric control and allowing for the creation of a broad range of interesting rhythms. In the generation domain I present a novel improvisatory architecture drawing on theories of music perception, which provides a mechanism for the real-time generation of complementary accompaniment in an ensemble setting. All of these innovations have been combined into a computational agent – the Jambot, which is capable of producing improvised percussive musical accompaniment to an audio stream in real-time. I situate the architectural philosophy of the Jambot within contemporary debate regarding the nature of cognition and artificial intelligence, and argue for an approach to algorithmic improvisation that privileges the minimisation of cognitive dissonance in human-computer interaction. This thesis contains extensive written discussions of the Jambot and its component algorithms, along with some comparative analyses of aspects of its operation and aesthetic evaluations of its output. The accompanying CD contains the Jambot software, along with video documentation of experiments and performances conducted during the project.

Re-engaging marginalized youth through digital music production: performance, audience and evaluation

This paper presents two case studies of marginalised youth experimenting with digital music production in flexible education settings. The cases were drawn from a three-year study of alternative assessment in flexible learning centres that enrol 650+ students who have left formal schooling in Queensland, Australia. The cases are framed in reference to the literature on cultural studies approaches to education and the digital arts. Each case describes the student’s histories, cultural background and experiences, music productions, evidence of learning and re-engagement with education. Findings document how digital music production can re-engage and extend participation among students who have left formal education. They do so by theorising the online judgements and blog comments about the digital music production as a social field of exchange. It also raises critical questions about the adequacy of current approaches to evaluating and accounting for the learning and development of such youth, especially where this has occurred through creative arts and digital production.

When There's Love

This work is an installation featuring three video projections, music and mirror balls. The three projections fill the walls with scrolling text borrowed from love song lyrics. Headphones in the gallery space allow you to hear a male voice sing the same words to an impromptu tune. Mirror balls send fragments of light spinning around the room while The Righteous Brothers’ Unchained Melody plays on repeat. This work emphasizes fragmentary, repetitious and spatio-temporal experiences of language in order to question the symbolic conventions of romance. By exaggerating and mixing hackneyed symbolic elements, this work extends on some of Nicolas Bourriaud’s theoretical insights into the creative and critical strategies of ‘postproduction’. In particular, it toys with the intersections between popular culture and inter-subjective experiences.

The feeling

In this video, a thumping house-music track is accompanied by lines of rotating text, which resemble computer screen-savers. The text is sourced from websites offering tips for dating and seducing potential lovers. This work engages with the language of online forums. It reworks text from online advice forums and mixes them with visual codes of computer graphics. By extending on some of Nicolas Bourriaud’s ideas around ‘postproduction’ and the creative and critical strategies of ‘editing’, it offers new speculative perspectives on the relationship between screen realities, desire and romance.

The switch

In this video, text types across the screen one line at a time set to an emotive stock music soundtrack. The text combines two teen film plot descriptions into one story. This work engages with the language of Hollywood narratives. By emphasizing the potentially abstract and convoluted qualities of linguistic communication, it challenges our capacity to assimilate information into conventional narratives. It draws specific attention to the conventions of Hollywood plot development, and questions the mechanisms by which they construct and communicate meaning.

Peace unknown

In this freestanding sculpture, domestic ‘in-wall’ speakers are mounted in custom-built cabinets. The speakers play a calming stock music soundtrack. The cabinets are faced with photographic mural wallpaper of a stereotypical waterfall scene. This work examines how we construct, represent and deploy notions of nature in our contemporary lives. It mixes the languages of furniture design, landscape photography and sculpture. Drawing on Zygmunt Bauman’s theoretical work on “liquid modernity”, this work questions how and where we find space for contemplation and reflection in a contemporary context increasingly defined by temporary social bonds and consumer choices.

It will be tonight

In this wall-mounted sculpture, speakers are mounted into a shelf-like object finished with timber veneer. The speakers play a corny groove stock music soundtrack. On top of the shelf sits a digital photographic image approximating a fireplace floating against a colour-gradient background. This work examines how we construct, represent and deploy notions of nature in our contemporary lives. It mixes the languages of furniture design, landscape photography, digital graphics and sculpture. Drawing on Zygmunt Bauman’s theoretical work on “liquid modernity”, this work questions how and where we find space for contemplation and reflection in a contemporary context increasingly defined by temporary social bonds and consumer choices.

Questioning pedagogies : Hong Kong pre-service teachers' dialogic reflections on a transnational school experience

There are increasing opportunities in many countries for pre-service teachers to engage in a transnational school-based experience as part of study abroad programmes. The transformative potential of such transnational teaching experiences is recorded in research studies, often supported by data from participant surveys. However, there has been a lack of evidence investigating how shifts in professional understanding derive from such experiences. This qualitative study addresses this issue by exploring the perspectives of 16 pre-service teachers of English as a Second language from Hong Kong, who engaged in transnational teaching activities with primary school pupils in Australia, during their study abroad program. Discourse analysis of participants’ dialogues traces how they encountered conflicting Discourses of ‘student-centredness’ in the Australian classroom. Reflecting dialogically on their experiences led participants to negotiate and reframe their understandings of language teaching pedagogy and themselves as language teachers. The findings demonstrate the importance of both peer and lecturer feedback into the process of dialogic reflection and the need for more longitudinal research into the impact of transnational school-based experience in pre-service teacher education.

Practices of interactive courseware at Malaysia primary smart school : usage standing and causes attributing

Malaysian teachers are now using interactive courseware in their teaching practices as part of teaching activity in classroom, to teach some subjects such as languages, mathematics, and science. Towards this, there is some debate going on the effectiveness of interactive courseware used in classroom. This paper reports data from interviews conducted with school principals and teachers from six selected primary Smart Schools across Malaysia.The interview conducted is looked on their current school practices and challenges in the implementation of interactive courseware in the classroom. The interview covers several aspects of their school facilities, the causes attributed and their concerns. However, the findings revealed that these six schools generally need more supports in the physical and technical form, in order to utilize the interactive courseware. Initially, the current support from the Malaysian Ministry of Education in physical form has proved that not very helpful. Thus, the respondents suggested that supports should be both: physical and technical. Therefore, this preliminary findings could be used as a pointer to the Malaysian government and other stakeholders to the improvement of interface design for future interactive courseware.

Grant Stevens : Are You Upset with Me?

Grant Stevens is ambivalent. The young Brisbane artist made his name with a series of computer-generated animated-text videos that explore clichés but seem undecided as to whether they are trivial and vacuous, profound and authentic or somehow both at once. Stevens plunders mass-media sources (the familiar image repertoire dished up by Hollywood, television, pop music and the Internet) as readymade content. He explores this everyday language, sometimes for its ambiguity, but more often for its almost uncanny lucidity. Resembling meditation and relaxation guides, his recent videos beg the question: what made us so anxious? This book examines Stevens' artistic output over the first ten years of his practice. It includes essays by Mark Pennings and Chris Kraus.

The drift

In this video, text floats on screen amidst a field of swirling coloured orbs and a stock music soundtrack. The text is sourced from Internet dating websites and combine into a single animated portrait charting an array of likes, dislikes, influences, beliefs and hobbies. This work examines the nature of consciousness and identity in a contemporary context. It reworks the languages of Internet dating websites to question how we construct and communicate our sense of self. Drawing on Zygmunt Bauman’s theoretical work on “liquid modernity”, this work presents an exaggerated take on contemporary identity that emphasizes its construction through consumer tastes, lifestyle choices and relationships with popular culture.

Threshold

In this video, the words of a translated poem fade in and out above an abstract, moving horizon line. The animated words are set to an emotive stock music track. This work examines processes of signification. It emphasizes abstraction and disconnection as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work questions the signifying processes of translation and metaphor. By emphasizing the abstract qualities of a translated love poem, it questions the sites and mechanisms of signification.

Volume

In this video, words describing socially awkward conversations float around an animated cloud of gas. A cosmic stock music track accompanies the words. This work examines processes of signification. It emphasizes multiplicity and disconnection as fundamental and generative operations in making meaning. By playing with the simultaneity of internal monologues and external conversations, it draws attention to the seams, gaps and slippages that occur in signifying acts.

Evaluation of the skills for preventing injury in youth program : impact on health risk behaviors, injury and school connectedness

Injury is the leading cause of death among young people, and involvement in health risk behaviors, such as alcohol use and transport-related risks, is related to increased risk for injury. Effective health promotion programs for adolescents focus on multiple levels, including relationships with peers and parents, student knowledge, behavior and attitudes, and school-level factors such as school connectedness. This study describes the pilot evaluation of a comprehensive, multi-level injury prevention program for 13-14 year old adolescents, targeting change in injury associated with transport and alcohol risks. The program, called Skills for Preventing Injury in Youth (SPIY), incorporates two primary elements: an 8-week, teacher delivered attitude and behavior change curriculum with peer protection and first aid messages; and professional development for program teachers focusing on strategies to increase students’ connectedness to school. Five Australian high schools were recruited for the pilot evaluation research, with three being assigned to receive intervention components and two assigned as curriculum-as-usual controls. In the intervention schools, 118 Year 8 students participated in surveys at baseline, with 105 completing surveys at follow up, six months following the intervention. In the control schools, 196 Year 8 students completed surveys at baseline and 207 at follow up. Survey measures included self-reported injury, risk taking behavior and school connectedness. Results showed that students in the control schools were significantly more likely to report riding bikes without helmets, riding with dangerous drivers, having driven cars on the road, and using alcohol six months after the program, while the intervention group showed no such increase in these behaviors. Additionally, students in the control schools were significantly more likely to report having had pedestrian-related injuries at follow up than they were at the baseline measurement, while intervention school students showed no change. There was also a trend observed in terms of a decrease in bicycle related injuries among intervention school students, compared with a slight increasing trend in bicycle injuries among control students. Overall, scores on the school connectedness scale decreased significantly from baseline to follow up for both intervention and control students, however measurement limitations may have impacted on results relating to students’ connectedness. Overall, the SPIY program has shown promising results in regards to prevention of students’ health risk behavior and injuries. Evidence suggests that the curriculum component was important; however there was limited evidence to suggest that teacher training in school connectedness strategies contributed to these promising results. While school connectedness may be an important factor to target in risk and injury prevention programs, programs may need to incorporate whole-of-school strategies or target a broader range of teachers than were selected for the current research.

Factors influencing speeding in school zones : the role of mindfulness

Background Excessive speed contributes to the incidence and severity of road crashes. The Theory of Planned Behaviour (TPB) has successfully explained variance in speeding intentions and behaviour. However, studies have shown that more than 40% of the variance in outcome measures of speeding remains unexplained, thus, suggesting additional constructs may help to enhance the TPB’s predictive power. Therefore, this study examined mindfulness; a promising construct which has not yet been tested as an additional TPB predictor. Aims The aims of this study were to explore drivers’ beliefs about speeding in school zones using the extended TPB as a framework and to examine the effect that mindfulness had on driver speeding behaviour in school zones. Methods Australian drivers (N = 17) participated in one of four focus group discussions. The overall sample was comprised of five males and twelve females who were aged between 17 to56 years. All participants were recruited via purposive sampling among 1st year psychology students at a large South East Queensland University. The group discussions took approximately one hour and were guided by a structured interview schedule which sought to elicit drivers’ beliefs, thoughts and opinions on speeding in school zones and the factors which motivate such behaviour. Results Overall, thematic analysis revealed some similar issues emerged across the groups. . In particular and perhaps somewhat unsurprisingly, given public concerns regarding the want to ensure the safety of school children, there was much agreement that speeding in school zones was dangerous and unacceptable. Somewhat paradoxically however, some participants also agreed that they had unintentionally or mindlessly sped in school zones. There were several factors that drivers believed influenced their speeding in school zones including their current mood (e.g., if in a bad mood, anxious, or excited they may be more likely to drive without awareness of, and being attentive to, their driving environment) and the extent to which they were familiar with the environment (i.e., more familiar contexts, more likely to drive mindlessly). Thus, although drivers expressed a belief that speeding in school zones was dangerous and acceptable, the extent to which a driver is mindful does influence whether or not a driver may actually engage in speeding in this context. Discussion and conclusions This study highlights the potential role of mindfulness in helping to explain speeding behaviour in school zones. Mindless drivers may speed unintentionally and while unintentional still be endangering the safety and lives of school children. The findings of this research suggest that unintentional speeding, especially in school zones, may be reduced by countermeasures which heighten the extent to which drivers are mindful of approaching and/or driving through a school zone, such as street markings and engineering measures (e.g.,flashing lights and speed bumps).