Improvisation in interactive music systems

This project investigates machine listening and improvisation in interactive music systems with the goal of improvising musically appropriate accompaniment to an audio stream in real-time. The input audio may be from a live musical ensemble, or playback of a recording for use by a DJ. I present a collection of robust techniques for machine listening in the context of Western popular dance music genres, and strategies of improvisation to allow for intuitive and musically salient interaction in live performance. The findings are embodied in a computational agent – the Jambot – capable of real-time musical improvisation in an ensemble setting. Conceptually the agent’s functionality is split into three domains: reception, analysis and generation. The project has resulted in novel techniques for addressing a range of issues in each of these domains. In the reception domain I present a novel suite of onset detection algorithms for real-time detection and classification of percussive onsets. This suite achieves reasonable discrimination between the kick, snare and hi-hat attacks of a standard drum-kit, with sufficiently low-latency to allow perceptually simultaneous triggering of accompaniment notes. The onset detection algorithms are designed to operate in the context of complex polyphonic audio. In the analysis domain I present novel beat-tracking and metre-induction algorithms that operate in real-time and are responsive to change in a live setting. I also present a novel analytic model of rhythm, based on musically salient features. This model informs the generation process, affording intuitive parametric control and allowing for the creation of a broad range of interesting rhythms. In the generation domain I present a novel improvisatory architecture drawing on theories of music perception, which provides a mechanism for the real-time generation of complementary accompaniment in an ensemble setting. All of these innovations have been combined into a computational agent – the Jambot, which is capable of producing improvised percussive musical accompaniment to an audio stream in real-time. I situate the architectural philosophy of the Jambot within contemporary debate regarding the nature of cognition and artificial intelligence, and argue for an approach to algorithmic improvisation that privileges the minimisation of cognitive dissonance in human-computer interaction. This thesis contains extensive written discussions of the Jambot and its component algorithms, along with some comparative analyses of aspects of its operation and aesthetic evaluations of its output. The accompanying CD contains the Jambot software, along with video documentation of experiments and performances conducted during the project.

Re-engaging marginalized youth through digital music production: performance, audience and evaluation

This paper presents two case studies of marginalised youth experimenting with digital music production in flexible education settings. The cases were drawn from a three-year study of alternative assessment in flexible learning centres that enrol 650+ students who have left formal schooling in Queensland, Australia. The cases are framed in reference to the literature on cultural studies approaches to education and the digital arts. Each case describes the student’s histories, cultural background and experiences, music productions, evidence of learning and re-engagement with education. Findings document how digital music production can re-engage and extend participation among students who have left formal education. They do so by theorising the online judgements and blog comments about the digital music production as a social field of exchange. It also raises critical questions about the adequacy of current approaches to evaluating and accounting for the learning and development of such youth, especially where this has occurred through creative arts and digital production.

Meaningful musical engagement : the potential impact of generative music systems on learning experiences

In order to create music, the student must establish a relationship with the musical materials. In this thesis, I examine the capacity of a generative music system called jam2jam to offer individuals a virtual musical play-space to explore. I outline the development of an iteration of software development named jam2jam blue and the evolution of a games-like user interface in the research design that jointly revealed the nature of this musical exploration. The findings suggest that the jam2jam blue interface provided an expressive gestural instrument to jam and experience musicmaking. By using the computer as an instrument, participants in this study were given access to meaningful musical experiences in both solo and ensemble situations and the researcher is allowed a view of their development of a relationship with the musical materials from the perspective of the individual participants. Through an iterative software development methodology, pedagogy and experience design were created simultaneously. The research reveals the potential for the jam2jam software to be used as a reflective tool for feedback and assessment purposes. The power of access to ensemble music making is realised though the participants’ virtual experiences which are brought into their physical space by sharing their experience with others. It is suggested that this interaction creates an environment conducive to self-initiated learning in which music is the language of interaction. The research concludes that the development of a relationship between the explorer and the musical materials is subject to the collaborative nature of the interaction through which the music is experienced.

The music of the spheres

This article describes a method for making a spectroscope from scrap materials, i.e. a fragment of compact disc, a cardboard box, a tube and a digital camera to record the spectrum. An image processing program such as ImageJ can be used to calculate the wavelength of emission and absorption lines from the digital photograph. Multiple images of a spectrum can be stacked to reduce random noise, enabling spectra of faint objects to be obtained. Some basic experiments are described, such as viewing the spectrum produced by various types of lamp and the Sun. © 2012 IOP Publishing Ltd.

The identification of therapeutic targets in metastatic melanoma

Metastatic melanoma, a cancer historically refractory to chemotherapeutic strategies, has a poor prognosis and accounts for the majority of skin cancer related mortality. Although the recent approval of two new drugs combating this disease, Ipilimumab and Vemurafenib (PLX4032), has demonstrated for the first time in decades an improvement in overall survival; the clinical efficacy of these drugs has been marred by severe adverse immune reactions and acquired drug resistance in patients, respectively. Thus, understanding the etiology of metastatic melanoma will contribute to the improvement of current therapeutic strategies while leading to the development of novel drug approaches. In order to identify recurrently mutated genes of therapeutic relevance in metastatic melanoma, a panel of stage III local lymph node melanomas were extensively characterised using high-throughput genomic technologies. This led to the identification of mutations in TFG in 5% of melanomas from a candidate gene sequencing approach using SNP array analysis, 24% of melanomas with mutations in MAP3K5 or MAP3K9 though unbiased whole-exome sequencing strategies, and inactivating mutations in NF1 in BRAF/NRAS wild type tumours though pathway analysis. Lastly, this thesis describes the development of a melanoma specific mutation panel that can rapidly identify clinically relevant mutation profiles that could guide effective treatment strategies through a personalised therapeutic approach. These findings are discussed in respect to a number of important issues raised by this study including the current limitation of next-generation sequencing technology, the difficulty in identifying ‘driver’ mutations critical to the development of melanoma due to high carcinogenic exposure by UV radiation, and the ultimate application of mutation screening in a personalised therapeutic setting. In summary, a number novel genes involved in metastatic melanoma have been identified that may have relevance for current therapeutic strategies in treating this disease.

The sound of music : sharing song selections between collocated strangers in public urban places

This paper presents Capital Music, a mobile application enabling real-time sharing of song choices with collocated urban dwellers. Due to the real-time, location-based peer-to-peer approach of the application, a user experience study was performed utilising the Wizard of Oz method. The study provides insight into how sharing non-privacy sensitive but personal data in an anonymous way can influence the user experience of people in public urban places. We discuss the findings in relation to how Capital Music influences the process of “cocooning” in public urban places, the practice of designing anonymous interactions between collocated strangers, and how the sharing of song choices can create a sense of commonality between anonymous users in the urban space. The outcomes of this study are relevant for future location-based social networking applications that aim to create interactions between collocated strangers.

Preparing for portfolio careers in Australian music : setting a research agenda

In the twenty-first century, Australian musicians increasingly maintain ‘portfolio’ careers, in which they combine diverse employment arrangements and activities. Often, these incorporate industry sectors outside of music. This career pattern is widespread but not well understood, largely because of the limitations of existing research. The lack of knowledge about musicians’ work and careers means that Australia currently may not provide appropriate and effective policy, funding, initial training and continuing career support across the diverse music sector. This article discusses existing research relating to the careers and skilling needs of musicians in Australia, and outlines a targeted agenda for further research that has the potential to inform stronger alignment between the requirements of building sustainable music careers and musicians’ education and training.

Therapeutic immunisation of rabbits with cottontail rabbit papillomavirus (CRPV) virus-like particles (VLP) induces regression of established papillomas

There is overwhelming evidence that persistent infection with high-risk human papillomaviruses (HR-HPV) is the main risk factor for invasive cancer of the cervix. Due to this global public health burden, two prophylactic HPV L1 virus-like particles (VLP) vaccines have been developed. While these vaccines have demonstrated excellent type-specific prevention of infection by the homologous vaccine types (high and low risk HPV types), no data have been reported on the therapeutic effects in people already infected with the low-risk HPV type. In this study we explored whether regression of CRPV-induced papillomas could be achieved following immunisation of out-bred New Zealand White rabbits with CRPV VLPs. Rabbits immunised with CRPV VLPs had papillomas that were significantly smaller compared to the negative control rabbit group (P ≤ 0.05). This data demonstrates the therapeutic potential of PV VLPs in a well-understood animal model with potential important implications for human therapeutic vaccination for low-risk HPVs. © 2008 Govan et al; licensee BioMed Central Ltd.

A longitudinal study of mental health in refugees from Burma : the impact of therapeutic interventions

Objective: The present study seeks to examine the impact of therapeutic interventions for people from refugee backgrounds within a naturalistic setting. Method: Sixty-two refugees from Burma were assessed soon after arriving in Australia. All participants received standard interventions provided by a resettlement organisation which included therapeutic interventions, assessment, social assistance, and referrals where appropriate. At the completion of service provision a follow-up assessment was conducted. Results: Over the course of the intervention, participants experienced a significant decrease in symptoms of post-traumatic stress disorder, anxiety, depression and somatisation. Pre-intervention symptoms predicted symptoms post-intervention for post-traumatic stress, anxiety, and somatisation. Post-migration living difficulties, the number of traumas experienced, and the number of contacts with the service agency were unrelated to all mental health outcomes. Conclusions: In the first Australian study of its kind, reductions in mental health symptoms post-intervention were significantly linked to pre-intervention symptomatology and the number of therapy sessions predicted post-intervention symptoms of post-traumatic stress. Future studies need to include larger samples and control groups to verify findings.

Direct fabrication as a patient-targeted therapeutic in a clinical environment

A paradigm shift is taking place in orthopaedic and reconstructive surgery. This transition from using medical devices and tissue grafts towards the utilization of a tissue engineering approach combines biodegradable scaffolds with cells and/or biological molecules in order to repair and/or regenerate tissues. One of the potential benefits offered by solid freeform fabrication (SFF) technologies is the ability to create such biodegradable scaffolds with highly reproducible architecture and compositional variation across the entire scaffold due to their tightly controlled computer-driven fabrication. Many of these biologically activated materials can induce bone formation at ectopic and orthotopic sites, but they have not yet gained widespread use due to several continuing limitations, including poor mechanical properties, difficulties in intraoperative handling, lack of porosity suitable for cellular and vascular infiltration, and suboptimal degradation characteristics. In this chapter, we define scaffold properties and attempt to provide some broad criteria and constraints for scaffold design and fabrication in combination with growth factors for bone engineering applications. Lastly, we comment on the current and future developments in the field, such as the functionalization of novel composite scaffolds with combinations of growth factors designed to promote cell attachment, cell survival, vascular ingrowth, and osteoinduction.

Complications related to therapeutic anticoagulation in total hip arthroplasty

Bleeding related wound complications cause significant morbidity in lower limb arthroplasty surgery. Patients who require therapeutic anticoagulation in the peri operative period are potentially at higher risk of these complications. This is a retrospective case control study reviewing all primary total hip replacements performed in a single center over a five year period and comparing outcomes of the patients on warfarin with a double-matched control group of patients not on warfarin. The warfarin group had significantly higher risk of deep joint infection (9% vs 2.2%), haematoma/ wound ooze (28% vs 4%) and superficial infection (13.5% vs 2.2%). Managing the total hip arthroplasty patient with therapeutic anticoagulation is a balance between the risk of thromboembolic disease and bleeding related complications. Improved understanding of this risk will better allow the patient to make an informed decision regarding their elective arthroplasty surgery.

An open-source approach to music education through jam2jam XO

This article examines the philosophy and practice of open-source technology in the development of the jam2jam XO software for the One Laptop Per Child (OLPC) computer. It explores how open-source software principles, pragmatist philosophy, improvisation and constructionist epistemologies are operationalized in the design and development of music software, and how such reflection reveals both the strengths and weaknesses of the open-source software development paradigm. An overview of the jam2jam XO platform, its development processes and music educational uses is provided and resulting reflections on the strengths and weaknesses of open-source development for music education are discussed. From an educational and software development perspective, the act of creating open-source software is shown to be a valuable enterprise, however, just because the source code, creative content and experience design are accessible and 'open' to be changed, does not guarantee that educational practices in the use of that software will change. Research around the development and use of jam2jam XO suggests that open-source software development principles can have an impact beyond software development and on to aspects of experience design and learning relationships.

A survey of tagging techniques for music, speech and environmental sound

Sound tagging has been studied for years. Among all sound types, music, speech, and environmental sound are three hottest research areas. This survey aims to provide an overview about the state-of-the-art development in these areas.We discuss about the meaning of tagging in different sound areas at the beginning of the journey. Some examples of sound tagging applications are introduced in order to illustrate the significance of this research. Typical tagging techniques include manual, automatic, and semi-automatic approaches.After reviewing work in music, speech and environmental sound tagging, we compare them and state the research progress to date. Research gaps are identified for each research area and the common features and discriminations between three areas are discovered as well. Published datasets, tools used by researchers, and evaluation measures frequently applied in the analysis are listed. In the end, we summarise the worldwide distribution of countries dedicated to sound tagging research for years.