Improvisation in interactive music systems

This project investigates machine listening and improvisation in interactive music systems with the goal of improvising musically appropriate accompaniment to an audio stream in real-time. The input audio may be from a live musical ensemble, or playback of a recording for use by a DJ. I present a collection of robust techniques for machine listening in the context of Western popular dance music genres, and strategies of improvisation to allow for intuitive and musically salient interaction in live performance. The findings are embodied in a computational agent – the Jambot – capable of real-time musical improvisation in an ensemble setting. Conceptually the agent’s functionality is split into three domains: reception, analysis and generation. The project has resulted in novel techniques for addressing a range of issues in each of these domains. In the reception domain I present a novel suite of onset detection algorithms for real-time detection and classification of percussive onsets. This suite achieves reasonable discrimination between the kick, snare and hi-hat attacks of a standard drum-kit, with sufficiently low-latency to allow perceptually simultaneous triggering of accompaniment notes. The onset detection algorithms are designed to operate in the context of complex polyphonic audio. In the analysis domain I present novel beat-tracking and metre-induction algorithms that operate in real-time and are responsive to change in a live setting. I also present a novel analytic model of rhythm, based on musically salient features. This model informs the generation process, affording intuitive parametric control and allowing for the creation of a broad range of interesting rhythms. In the generation domain I present a novel improvisatory architecture drawing on theories of music perception, which provides a mechanism for the real-time generation of complementary accompaniment in an ensemble setting. All of these innovations have been combined into a computational agent – the Jambot, which is capable of producing improvised percussive musical accompaniment to an audio stream in real-time. I situate the architectural philosophy of the Jambot within contemporary debate regarding the nature of cognition and artificial intelligence, and argue for an approach to algorithmic improvisation that privileges the minimisation of cognitive dissonance in human-computer interaction. This thesis contains extensive written discussions of the Jambot and its component algorithms, along with some comparative analyses of aspects of its operation and aesthetic evaluations of its output. The accompanying CD contains the Jambot software, along with video documentation of experiments and performances conducted during the project.

Re-engaging marginalized youth through digital music production: performance, audience and evaluation

This paper presents two case studies of marginalised youth experimenting with digital music production in flexible education settings. The cases were drawn from a three-year study of alternative assessment in flexible learning centres that enrol 650+ students who have left formal schooling in Queensland, Australia. The cases are framed in reference to the literature on cultural studies approaches to education and the digital arts. Each case describes the student’s histories, cultural background and experiences, music productions, evidence of learning and re-engagement with education. Findings document how digital music production can re-engage and extend participation among students who have left formal education. They do so by theorising the online judgements and blog comments about the digital music production as a social field of exchange. It also raises critical questions about the adequacy of current approaches to evaluating and accounting for the learning and development of such youth, especially where this has occurred through creative arts and digital production.

Meaningful musical engagement : the potential impact of generative music systems on learning experiences

In order to create music, the student must establish a relationship with the musical materials. In this thesis, I examine the capacity of a generative music system called jam2jam to offer individuals a virtual musical play-space to explore. I outline the development of an iteration of software development named jam2jam blue and the evolution of a games-like user interface in the research design that jointly revealed the nature of this musical exploration. The findings suggest that the jam2jam blue interface provided an expressive gestural instrument to jam and experience musicmaking. By using the computer as an instrument, participants in this study were given access to meaningful musical experiences in both solo and ensemble situations and the researcher is allowed a view of their development of a relationship with the musical materials from the perspective of the individual participants. Through an iterative software development methodology, pedagogy and experience design were created simultaneously. The research reveals the potential for the jam2jam software to be used as a reflective tool for feedback and assessment purposes. The power of access to ensemble music making is realised though the participants’ virtual experiences which are brought into their physical space by sharing their experience with others. It is suggested that this interaction creates an environment conducive to self-initiated learning in which music is the language of interaction. The research concludes that the development of a relationship between the explorer and the musical materials is subject to the collaborative nature of the interaction through which the music is experienced.

The music of the spheres

This article describes a method for making a spectroscope from scrap materials, i.e. a fragment of compact disc, a cardboard box, a tube and a digital camera to record the spectrum. An image processing program such as ImageJ can be used to calculate the wavelength of emission and absorption lines from the digital photograph. Multiple images of a spectrum can be stacked to reduce random noise, enabling spectra of faint objects to be obtained. Some basic experiments are described, such as viewing the spectrum produced by various types of lamp and the Sun. © 2012 IOP Publishing Ltd.

The sound of music : sharing song selections between collocated strangers in public urban places

This paper presents Capital Music, a mobile application enabling real-time sharing of song choices with collocated urban dwellers. Due to the real-time, location-based peer-to-peer approach of the application, a user experience study was performed utilising the Wizard of Oz method. The study provides insight into how sharing non-privacy sensitive but personal data in an anonymous way can influence the user experience of people in public urban places. We discuss the findings in relation to how Capital Music influences the process of “cocooning” in public urban places, the practice of designing anonymous interactions between collocated strangers, and how the sharing of song choices can create a sense of commonality between anonymous users in the urban space. The outcomes of this study are relevant for future location-based social networking applications that aim to create interactions between collocated strangers.

Preparing for portfolio careers in Australian music : setting a research agenda

In the twenty-first century, Australian musicians increasingly maintain ‘portfolio’ careers, in which they combine diverse employment arrangements and activities. Often, these incorporate industry sectors outside of music. This career pattern is widespread but not well understood, largely because of the limitations of existing research. The lack of knowledge about musicians’ work and careers means that Australia currently may not provide appropriate and effective policy, funding, initial training and continuing career support across the diverse music sector. This article discusses existing research relating to the careers and skilling needs of musicians in Australia, and outlines a targeted agenda for further research that has the potential to inform stronger alignment between the requirements of building sustainable music careers and musicians’ education and training.

Diversity of dicotyledenous-infecting geminiviruses and their associated DNA molecules in Southern Africa, including the South-west Indian Ocean Islands

The family Geminiviridae comprises a group of plant-infecting circular ssDNA viruses that severely constrain agricultural production throughout the temperate regions of the world, and are a particularly serious threat to food security in sub-Saharan Africa. While geminiviruses exhibit considerable diversity in terms of their nucleotide sequences, genome structures, host ranges and insect vectors, the best characterised and economically most important of these viruses are those in the genus Begomovirus. Whereas begomoviruses are generally considered to be either monopartite (one ssDNA component) or bipartite (two circular ssDNA components called DNA-A and DNA-B), many apparently monopartite begomoviruses are associated with additional subviral ssDNA satellite components, called alpha- (DNA-αs) or betasatellites (DNA-βs). Additionally, subgenomic molecules, also known as defective interfering (DIs) DNAs that are usually derived from the parent helper virus through deletions of parts of its genome, are also associated with bipartite and monopartite begomoviruses. The past three decades have witnessed the emergence and diversification of various new begomoviral species and associated DI DNAs, in southern Africa, East Africa, and proximal Indian Ocean islands, which today threaten important vegetable and commercial crops such as, tobacco, cassava, tomato, sweet potato, and beans. This review aims to describe what is known about these viruses and their impacts on sustainable production in this sensitive region of the world. © 2012 by the authors licensee MDPI, Basel, Switzerland.

An open-source approach to music education through jam2jam XO

This article examines the philosophy and practice of open-source technology in the development of the jam2jam XO software for the One Laptop Per Child (OLPC) computer. It explores how open-source software principles, pragmatist philosophy, improvisation and constructionist epistemologies are operationalized in the design and development of music software, and how such reflection reveals both the strengths and weaknesses of the open-source software development paradigm. An overview of the jam2jam XO platform, its development processes and music educational uses is provided and resulting reflections on the strengths and weaknesses of open-source development for music education are discussed. From an educational and software development perspective, the act of creating open-source software is shown to be a valuable enterprise, however, just because the source code, creative content and experience design are accessible and 'open' to be changed, does not guarantee that educational practices in the use of that software will change. Research around the development and use of jam2jam XO suggests that open-source software development principles can have an impact beyond software development and on to aspects of experience design and learning relationships.

A survey of tagging techniques for music, speech and environmental sound

Sound tagging has been studied for years. Among all sound types, music, speech, and environmental sound are three hottest research areas. This survey aims to provide an overview about the state-of-the-art development in these areas.We discuss about the meaning of tagging in different sound areas at the beginning of the journey. Some examples of sound tagging applications are introduced in order to illustrate the significance of this research. Typical tagging techniques include manual, automatic, and semi-automatic approaches.After reviewing work in music, speech and environmental sound tagging, we compare them and state the research progress to date. Research gaps are identified for each research area and the common features and discriminations between three areas are discovered as well. Published datasets, tools used by researchers, and evaluation measures frequently applied in the analysis are listed. In the end, we summarise the worldwide distribution of countries dedicated to sound tagging research for years.

Discrimination experienced by HIV/AIDS infected persons and its associations with mental health in an Indian sample

Purpose The purpose of this study was to investigate the nature and prevalence of discrimination against people living with HIV/AIDS in West Bengal, India, and how discrimination is associated with depression, suicidal ideation and suicidal attempts. Method Semi-structured interviews and the Beck Depression Inventory were administered to 105 HIV infected persons recruited by incidental sampling, at an Integrated Counseling and Testing Center (ICTC) and through Networks of People Living with HIV/AIDS, in the West Bengal area. Results Findings showed that 40.8% of the sample has experienced discrimination at least in one social setting – such as family (29.1%), health centers (18.4%), community (17.5%) and workplace (6.8%). About two-fifths (40.8%) reported experiencing discrimination in multiple social settings. Demographic factors associated with discrimination were gender, age, occupation, education, and current residence. More than half of the sample was suffering from severe depression while 8.7% had attempted suicide. Discrimination in most areas was significantly associated with suicidal ideation and suicidal attempts. Conclusions Prevalence of discrimination associated with HIV/AIDS is high in our sample from West Bengal. While discrimination was not associated with depressive symptomatology, discrimination was associated with suicidal ideation and attempts. These findings suggest that there is an urgent need for interventions to reduce discrimination of HIV/AIDS in the West Bengal region.

Indian students at QUT : expectations and experiences

India currently ranks among the top source countries for the Australian education industry and therefore, a better understanding of the concerns and challenges confronted by Indian students is essential. This study was undertaken to assess the needs and expectations of Indian students enrolled at Queensland University of Technology (QUT) that would inform the formulation of strategies to provide superior service to the current and future cohorts of students coming from India. Data collection was undertaken through surveys and focus group meetings. The findings reveal the acute need for more effective dissemination of information prior to the students commencing their programs on both academic and non-academic aspects of university life as well as the resources and support available at QUT. Usage of English in an academic setting, career related services, accommodation, and networking opportunities were identified as some of the key areas of concern by the participants.

Can a “Blue Sky” return to Indian megacities?

Deterioration of air quality in Indian megacities (Delhi, Mumbai or Kolkata) is much more significant than that observed in the megacities of developed countries. Densely packed high-rise buildings restrict the self-cleaning capabilities of Indian megacities. Also, the ever growing number of on-road vehicles, resuspension of the dust, and anthropogenic activities exacerbate the levels of ambient air pollution, which is in turn breathed by urban dwellers. Pollution levels exceeding the standards on a regular basis often result in a notable increase in morbidity and mortality. This article discusses the challenges faced by Indian megacities in their quest for sustainable growth, without compromising the air quality and urban way of life.