Improvisation in interactive music systems

This project investigates machine listening and improvisation in interactive music systems with the goal of improvising musically appropriate accompaniment to an audio stream in real-time. The input audio may be from a live musical ensemble, or playback of a recording for use by a DJ. I present a collection of robust techniques for machine listening in the context of Western popular dance music genres, and strategies of improvisation to allow for intuitive and musically salient interaction in live performance. The findings are embodied in a computational agent – the Jambot – capable of real-time musical improvisation in an ensemble setting. Conceptually the agent’s functionality is split into three domains: reception, analysis and generation. The project has resulted in novel techniques for addressing a range of issues in each of these domains. In the reception domain I present a novel suite of onset detection algorithms for real-time detection and classification of percussive onsets. This suite achieves reasonable discrimination between the kick, snare and hi-hat attacks of a standard drum-kit, with sufficiently low-latency to allow perceptually simultaneous triggering of accompaniment notes. The onset detection algorithms are designed to operate in the context of complex polyphonic audio. In the analysis domain I present novel beat-tracking and metre-induction algorithms that operate in real-time and are responsive to change in a live setting. I also present a novel analytic model of rhythm, based on musically salient features. This model informs the generation process, affording intuitive parametric control and allowing for the creation of a broad range of interesting rhythms. In the generation domain I present a novel improvisatory architecture drawing on theories of music perception, which provides a mechanism for the real-time generation of complementary accompaniment in an ensemble setting. All of these innovations have been combined into a computational agent – the Jambot, which is capable of producing improvised percussive musical accompaniment to an audio stream in real-time. I situate the architectural philosophy of the Jambot within contemporary debate regarding the nature of cognition and artificial intelligence, and argue for an approach to algorithmic improvisation that privileges the minimisation of cognitive dissonance in human-computer interaction. This thesis contains extensive written discussions of the Jambot and its component algorithms, along with some comparative analyses of aspects of its operation and aesthetic evaluations of its output. The accompanying CD contains the Jambot software, along with video documentation of experiments and performances conducted during the project.

Time-varying bispectral analysis of auditory evoked multi-channel scalp EEG

Time-varying bispectra, computed using a classical sliding window short-time Fourier approach, are analyzed for scalp EEG potentials evoked by an auditory stimulus and new observations are presented. A single, short duration tone is presented from the left or the right, direction unknown to the test subject. The subject responds by moving the eyes to the direction of the sound. EEG epochs sampled at 200 Hz for repeated trials are processed between -70 ms and +1200 ms with reference to the stimulus. It is observed that for an ensemble of correctly recognized cases, the best matching timevarying bispectra at (8 Hz, 8Hz) are for PZ-FZ channels and this is also largely the case for grand averages but not for power spectra at 8 Hz. Out of 11 subjects, the only exception for time-varying bispectral match was a subject with family history of Alzheimer’s disease and the difference was in bicoherence, not biphase.

Meaningful musical engagement : the potential impact of generative music systems on learning experiences

In order to create music, the student must establish a relationship with the musical materials. In this thesis, I examine the capacity of a generative music system called jam2jam to offer individuals a virtual musical play-space to explore. I outline the development of an iteration of software development named jam2jam blue and the evolution of a games-like user interface in the research design that jointly revealed the nature of this musical exploration. The findings suggest that the jam2jam blue interface provided an expressive gestural instrument to jam and experience musicmaking. By using the computer as an instrument, participants in this study were given access to meaningful musical experiences in both solo and ensemble situations and the researcher is allowed a view of their development of a relationship with the musical materials from the perspective of the individual participants. Through an iterative software development methodology, pedagogy and experience design were created simultaneously. The research reveals the potential for the jam2jam software to be used as a reflective tool for feedback and assessment purposes. The power of access to ensemble music making is realised though the participants’ virtual experiences which are brought into their physical space by sharing their experience with others. It is suggested that this interaction creates an environment conducive to self-initiated learning in which music is the language of interaction. The research concludes that the development of a relationship between the explorer and the musical materials is subject to the collaborative nature of the interaction through which the music is experienced.

‘Wide Atlantic Ocean’ : acting methods and cultural translation in mainstream theatre

A recent production of Nicholson’s Shadowlands at the Brisbane Powerhouse could have included two advertising lines: “Outspoken American-Jewish poet meets conservative British Oxford scholar” and “Emotive American Method trained actor meets contained British trained actor.” While the fusion of acting methodologies in intercultural acting has been discussed at length, little discussion has focussed on the juxtaposition of diverse acting styles in production in mainstream theatre. This paper explores how the permutation of American Method acting and a more traditional British conservatory acting in Crossbow’s August 2010 production of Shadowlands worked to add extra layers of meaning to the performance text. This sometimes inimical relationship between two acting styles had its beginnings in the rehearsal room and continued onstage. Audience reception to the play in post-performance discussions revealed the audience’s acute awareness of the transatlantic cultural tensions on stage. On one occasion, this resulted in a heated debate on cultural expression, continuing well after the event, during which audience members became co-performers in the cultural discourses of the play.

A distributed memory for networked livecoding performance

The symbolic and improvisational nature of Livecoding requires a shared networking framework to be flexible and extensible, while at the same time providing support for synchronisation, persistence and redundancy. Above all the framework should be robust and available across a range of platforms. This paper proposes tuple space as a suitable framework for network communication in ensemble livecoding contexts. The role of tuple space as a concurrency framework and the associated timing aspects of the tuple space model are explored through Spaces, an implementation of tuple space for the Impromptu environment.

The adventure of the refrain : composing with improvised music

This practice-based inquiry investigates the process of composing notated scores using improvised solos by saxophonists John Butcher and Anthony Braxton. To compose with these improvised sources, I developed a new method of analysis and through this method I developed new compositional techniques in applying these materials into a score. This method of analysis and composition utilizes the conceptual language of Gilles Deleuze and Felix Guattari found in A Thousand Plateaus. The conceptual language of Deleuze and Guattari, in particular the terms assemblage, refrain and deterritorialization are discussed in depth to give a context for the philosophical origins and also to explain how the language is used in reference to improvised music and the compositional process. The project seeks to elucidate the conceptual language through the creative practice and in turn for the creative practice to clarify the use of the conceptual terminology. The outcomes of the research resulted in four notated works being composed. Firstly, Gravity, for soloist and ensemble based on the improvisational language of John Butcher and secondly a series of 3 studies titled Transbraxton Studies for solo instruments based on the improvisational-compositional language of Anthony Braxton. The implications of this research include the application of the analysis method to a number of musical contexts including: to be used in the process of composing with improvised music; in the study of style and authorship in solo improvisation; as a way of analyzing group improvisation; in the analysis of textural music including electronic music; and in the analysis of music from different cultures—particularly cultures where improvisation and per formative aspects to the music are significant to the overall meaning of the work. The compositional technique that was developed has further applications in terms of an expressive method of composing with non-metered improvised materials and one that merges well with the transcription method developed of notating pitch and sounds to a timeline. It is hoped that this research can open further lines of enquiry into the application of the conceptual ideas of Deleuze and Guattari to the analysis of more forms of music.

Direct electrochemical formation of alloyed AuPt nanostructured electrocatalysts for the oxidation of formic acid

The formation of highly anisotropic AuPt alloys has been achieved via a simple electrochemical approach without the need for organic surfactants to direct the growth process. The surface and bulk properties of these materials were characterised by scanning electron microscopy (SEM), X-ray diffraction (XRD), energy dispersive X-ray spectroscopy (EDX) and electrochemically by cyclic voltammetry to confirm alloy formation. It was found that AuPt materials are highly active for both the model hydrogen evolution reaction and the fuel cell relevant formic acid oxidation reaction. In particular for the latter case the preferred dehydrogenation pathway was observed at AuPt compared to nanostructured Pt prepared under identical electrochemical conditions which demonstrated the less preferred dehydration pathway. The enhanced performance is attributed to both the ensemble effect which facilitates CO(ads) removal from the surface as well as the highly anisotropic nanostructure of AuPt.

Hemi-field and full-field form-deprivation induce timing changes in multifocal ERG responses in chick

Purpose: In animal models hemi-field deprivation results in localised, graded vitreous chamber elongation and presumably deprivation induced localised changes in retinal processing. The aim of this research was to determine if there are variations in ERG responses across the retina in normal chick eyes and to examine the effect of hemi-field and full-field deprivation on ERG responses across the retina and at earlier times than have previously been examined electrophysiologically. Methods: Chicks were either untreated, wore monocular full-diffusers or half-diffusers (depriving nasal retina) (n = 6-8 each group) from day 8. mfERG responses were measured using the VERIS mfERG system across the central 18.2º× 16.7º (H × V) field. The stimulus consisted of 61 unscaled hexagons with each hexagon modulated between black and white according to a pseudorandom binary m-sequence. The mfERG was measured on day 12 in untreated chicks, following 4 days of hemi-field diffuser wear, and 2, 48 and 96 h after application of full-field diffusers. Results: The ERG response of untreated chick eyes did not vary across the measured field; there was no effect of retinal location on the N1-P1 amplitude (p = 0.108) or on P1 implicit time (p > 0.05). This finding is consistent with retinal ganglion cell density of the chick varying by only a factor of two across the entire retina. Half-diffusers produced a ramped retina and a graded effect of negative lens correction (p < 0.0001); changes in retinal processing were localized. The untreated retina showed increasing complexity of the ERG waveform with development; form-deprivation prevented the increasing complexity of the response at the 2, 48 and 96 h measurement times and produced alterations in response timing. Conclusions: Form-deprivation and its concomitant loss of image contrast and high spatial frequency images prevented development of the ERG responses, consistent with a disruption of development of retinal feedback systems. The characterisation of ERG responses in normal and deprived chick eyes across the retina allows the assessment of concurrent visual and retinal manipulations in this model. (Ophthalmic & Physiological Optics © 2013 The College of Optometrists.)

Physiological tolerance times while wearing explosive ordnance disposal protective clothing in simulated environmental extremes

Explosive ordnance disposal (EOD) technicians are required to wear protective clothing to protect themselves from the threat of overpressure, fragmentation, impact and heat. The engineering requirements to minimise these threats results in an extremely heavy and cumbersome clothing ensemble that increases the internal heat generation of the wearer, while the clothing’s thermal properties reduce heat dissipation. This study aimed to evaluate the heat strain encountered wearing EOD protective clothing in simulated environmental extremes across a range of differing work intensities. Eight healthy males [age 25±6 years (mean ± sd), height 180±7 cm, body mass 79±9 kg, V˙O2max 57±6 ml.kg−1.min−1] undertook nine trials while wearing an EOD9 suit (weighing 33.4 kg). The trials involved walking on a treadmill at 2.5, 4 and 5.5 km⋅h−1 at each of the following environmental conditions, 21, 30 and 37°C wet bulb globe temperature (WBGT) in a randomised controlled crossover design. The trials were ceased if the participants’ core temperature reached 39°C, if heart rate exceeded 90% of maximum, if walking time reached 60 minutes or due to fatigue/nausea. Tolerance times ranged from 10–60 minutes and were significantly reduced in the higher walking speeds and environmental conditions. In a total of 15 trials (21%) participants completed 60 minutes of walking; however, this was predominantly at the slower walking speeds in the 21°C WBGT environment. Of the remaining 57 trials, 50 were ceased, due to attainment of 90% maximal heart rate. These near maximal heart rates resulted in moderate-high levels of physiological strain in all trials, despite core temperature only reaching 39°C in one of the 72 trials.

UV Photodissociation Action Spectroscopy of Haloanilinium Ions in a Linear Quadrupole Ion Trap Mass Spectrometer

UV-vis photodissociation action spectroscopy is becoming increasingly prevalent because of advances in, and commercial availability of, ion trapping technologies and tunable laser sources. This study outlines in detail an instrumental arrangement, combining a commercial ion-trap mass spectrometer and tunable nanosecond pulsed laser source, for performing fully automated photodissociation action spectroscopy on gas-phase ions. The components of the instrumentation are outlined, including the optical and electronic interfacing, in addition to the control software for automating the experiment and performing online analysis of the spectra. To demonstrate the utility of this ensemble, the photodissociation action spectra of 4-chloroanilinium, 4-bromoanilinium, and 4-iodoanilinium cations are presented and discussed. Multiple photoproducts are detected in each case and the photoproduct yields are followed as a function of laser wavelength. It is shown that the wavelength-dependent partitioning of the halide loss, H loss, and NH3 loss channels can be broadly rationalized in terms of the relative carbon-halide bond dissociation energies and processes of energy redistribution. The photodissociation action spectrum of (phenyl)Ag-2 (+) is compared with a literature spectrum as a further benchmark.

Known and chosen key differential distinguishers for block ciphers

In this paper we investigate the differential properties of block ciphers in hash function modes of operation. First we show the impact of differential trails for block ciphers on collision attacks for various hash function constructions based on block ciphers. Further, we prove the lower bound for finding a pair that follows some truncated differential in case of a random permutation. Then we present open-key differential distinguishers for some well known round-reduced block ciphers.

From democracy in America to a la francaise accountability. Grasping the sociopolitical origins of accountability [De la démocratie en Amérique du Nord à l’accountability à la française]

Whilst native French speakers oftentimes collapse accountability to account giving, this paper outlines the shape of an accountability ala française. Reading Tocqueville’s (1835) work highlights that accountability as practiced in Anglo-Saxonc countries has been an offspring of American democracy. An accountability a la française would be characterised by conformance to a set or universal values, the submission of minorities to choices made by the majority, a means obligation as well as the rejection of transparency. [Alors que le francophone réduit généralement l’accountability à la reddition de comptes, cet article esquisse les contours d’une véritable accountability à la française. La lecture de Tocqueville (1835) révèle que l’accountability pratiquée dans les pays anglo-saxons trouve ses origines dans les fondements de la démocratie américaine. En France, l’accountability serait caractérisée par le respect d’un ensemble de valeurs universelles, l’adhésion des minorités aux choix majoritaires, l’absence de discriminations, une obligation de moyens et un rejet de la transparence.]

Deterministic control of plasma-assembled self-organized Ge/Si quantum dot arrays

Self-assembly of size-uniform and spatially ordered quantum dot (QD) arrays is one of the major challenges in the development of the new generation of semiconducting nanoelectronic and photonic devices. Assembly of Ge QD (in the ∼5-20 nm size range) arrays from randomly generated position and size-nonuniform nanodot patterns on plasma-exposed Si (100) surfaces is studied using hybrid multiscale numerical simulations. It is shown, by properly manipulating the incoming ion/neutral flux from the plasma and the surface temperature, the uniformity of the nanodot size within the array can be improved by 34%-53%, with the best improvement achieved at low surface temperatures and high external incoming fluxes, which are intrinsic to plasma-aided processes. Using a plasma-based process also leads to an improvement (∼22% at 700 K surface temperature and 0.1 MLs incoming flux from the plasma) of the spatial order of a randomly sampled nanodot ensemble, which self-organizes to position the dots equidistantly to their neighbors within the array. Remarkable improvements in QD ordering and size uniformity can be achieved at high growth rates (a few nms) and a surface temperature as low as 600 K, which broadens the range of suitable substrates to temperature-sensitive ultrathin nanofilms and polymers. The results of this study are generic, can also be applied to nonplasma-based techniques, and as such contributes to the development of deterministic strategies of nanoassembly of self-ordered arrays of size-uniform QDs, in the size range where nanodot ordering cannot be achieved by presently available pattern delineation techniques.

A quantification of the interaction and spatial ordering in nano-arrays

This paper reports on the use of a local order measure to quantify the spatial ordering of a quantum dot array (QDA). By means of electron ground state energy analysis in a quantum dot pair, it is demonstrated that the length scale required for such a measure to characterize the opto-electronic properties of a QDA is of the order of a few QD radii. Therefore, as local order is the primary factor that affects the opto-electronic properties of an array of quantum dots of homogeneous size, this order was quantified through using the standard deviation of the nearest neighbor distances of the quantum dot ensemble. The local order measure is successfully applied to quantify spatial order in a range of experimentally synthesized and numerically generated arrays of nanoparticles. This measure is not limited to QDAs and has wide ranging applications in characterizing order in dense arrays of nanostructures.

RPAS integration within an Australian ATM system : what equipment and which airspace

The Australian Civil Aviation Safety Authority (CASA) currently lists more than 100 separate entities or organisations which maintain a UAS Operator Certificate (UOC) [1]. Approved operations are overwhelmingly a permutation of aerial photography, surveillance, survey or spotting and predominantly, are restricted to Visual Line of Sight (VLOS) operations, below 400 feet, and not within 3 NM of an aerodrome. However, demand is increasing for a Remote Piloted Aerial System (RPAS) regulatory regime which facilitates more expansive operations, in particular unsegregated, Beyond Visual Line of Sight (BVLOS) operations. Despite this demand, there is national and international apprehension regarding the necessary levels of airworthiness and operational regulation required to maintain safety and minimise the risk associated with unsegregated operations. Fundamental to addressing these legitimate concerns will be the mechanisms that underpin safe separation and collision avoidance. Whilst a large body of research has been dedicated to investigating on-board, Sense and Avoid (SAA) technology necessary to meet this challenge, this paper focuses on the contribution of the NAS to separation assurance, and how it will support, as well as complicate RPAS integration. The paper collates and presents key, but historically disparate, threads of Australian RPAS and NAS related information, and distils it with a filter focused on minimising RPAS collision risk. Our ongoing effort is motivated by the need to better understand the separation assurance contribution provided by the NAS layers, in the first instance, and subsequently employ this information to identify scenarios where the coincident collision risk is demonstrably low, providing legitimate substantiation for concessions on equipage and airworthiness standards.