Improvisation in interactive music systems

This project investigates machine listening and improvisation in interactive music systems with the goal of improvising musically appropriate accompaniment to an audio stream in real-time. The input audio may be from a live musical ensemble, or playback of a recording for use by a DJ. I present a collection of robust techniques for machine listening in the context of Western popular dance music genres, and strategies of improvisation to allow for intuitive and musically salient interaction in live performance. The findings are embodied in a computational agent – the Jambot – capable of real-time musical improvisation in an ensemble setting. Conceptually the agent’s functionality is split into three domains: reception, analysis and generation. The project has resulted in novel techniques for addressing a range of issues in each of these domains. In the reception domain I present a novel suite of onset detection algorithms for real-time detection and classification of percussive onsets. This suite achieves reasonable discrimination between the kick, snare and hi-hat attacks of a standard drum-kit, with sufficiently low-latency to allow perceptually simultaneous triggering of accompaniment notes. The onset detection algorithms are designed to operate in the context of complex polyphonic audio. In the analysis domain I present novel beat-tracking and metre-induction algorithms that operate in real-time and are responsive to change in a live setting. I also present a novel analytic model of rhythm, based on musically salient features. This model informs the generation process, affording intuitive parametric control and allowing for the creation of a broad range of interesting rhythms. In the generation domain I present a novel improvisatory architecture drawing on theories of music perception, which provides a mechanism for the real-time generation of complementary accompaniment in an ensemble setting. All of these innovations have been combined into a computational agent – the Jambot, which is capable of producing improvised percussive musical accompaniment to an audio stream in real-time. I situate the architectural philosophy of the Jambot within contemporary debate regarding the nature of cognition and artificial intelligence, and argue for an approach to algorithmic improvisation that privileges the minimisation of cognitive dissonance in human-computer interaction. This thesis contains extensive written discussions of the Jambot and its component algorithms, along with some comparative analyses of aspects of its operation and aesthetic evaluations of its output. The accompanying CD contains the Jambot software, along with video documentation of experiments and performances conducted during the project.

L'utilisation de la musique comme support de nouveaux apprentissages dans le vieillissement normal et la maladie d'Alzheimer

L’objectif de ce travail de thèse est d’évaluer le potentiel de la musique comme support mnémotechnique pour l’acquisition de nouvelles informations chez des personnes âgées saines et atteintes de la maladie d’Alzheimer (MA). Les bénéfices de la musique sur la cognition ont souvent été mis en évidence, y compris chez des populations âgées ou atteintes de démence. Parallèlement, chez des sujets jeunes, l’idée que la musique peut servir de support pour la mémoire a été largement débattue. Pourtant, très peu d’études ont posé cette question auprès de populations âgées ou dans la démence, malgré le besoin persistant de stratégies d’intervention dans ce domaine. Dans le présent travail, deux études sont menées dans une cohorte de 8 participants atteints d’un stade léger de la maladie d’Alzheimer, et 7 participants âgés sains appariés en âge et niveau de scolarité. La première étude porte sur la mémoire verbale, et compare l’apprentissage et la rétention de paroles (textes inconnus) présentées de manière récitée ou chantée. Lorsque les paroles sont chantées, différents degrés de familiarité de la mélodie sont contrastés. Aussi, l’action motrice étant intimement liée à l’écoute musicale, nous contrastons deux procédures d’apprentissage impliquant (ou non) la production synchronisée des paroles à mémoriser pendant l’encodage : le participant est invité à chanter à l’unisson avec un modèle (ou à écouter simplement sans chanter). Les résultats de cette étude sont présentés et discutés dans les deux premiers articles de la partie expérimentale. Ils suggèrent globalement que la musique n’aide pas l’apprentissage en rappel immédiat ; un effet délétère est même observé lorsque la mélodie utilisée est non familière. Par contre, la musique favorise la rétention à long terme des paroles, principalement pour les participants MA. Elle ne semble cependant pas interagir avec la procédure d’apprentissage impliquant le chant à l’unisson. La seconde étude porte sur l’apprentissage de séquences de gestes. Suivant la même logique que dans la première étude, nous explorons l’influence d’un accompagnement musical (versus apprentissage en silence) et d’une procédure d’apprentissage avec production synchronisée (versus observation) des gestes durant l’encodage. Les résultats (article 3) ne montrent pas non plus d’interaction entre l’accompagnement et la procédure d’apprentissage, mais différents effets de chaque composante sur les deux groupes de participants. Effectuer les gestes en synchronie avec un modèle lors de l’encodage est bénéfique pour les sujets Contrôles, mais plutôt délétère pour les participants MA. Par contre, l’accompagnement musical favorise davantage l’apprentissage chez les sujet MA que chez les Contrôles. En discussion générale, nous discutons les implications de ces résultats pour la neuropsychologie fondamentale et clinique, et proposons notamment différentes recommandations visant à maximiser ces effets et à les rendre pertinents pour l’usage thérapeutique en stimulation cognitive.

A música em As Báquides, de Plauto: tradução e análise dos cantica

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Studi sull'immaginario musicale in Euripide

La dissertazione è suddivisa in due capitoli più tre appendici. Nel I capitolo, Musica e dolore, si indagano i casi di metamusicalità in riferimento al dolore, che si intensificano in Euripide: si nota lo sviluppo di una riflessione sul ruolo della mousike rispetto al dolore, espressa attraverso un lessico medico e musicale. Si dimostra che in Euripide si pone il problema di quale scopo abbia la musica, se sia utile, e in quale forma lo sia. Nella prima produzione si teorizza una mousa del lamento come dolce o terapeutica per chi soffre. Molti personaggi, però, mostrano sfiducia nel potere curativo del lamento. Nell’ultima produzione si intensificano gli interrogativi sulla performance del canto, che si connotano come casi metamusicali e metateatrali. Nell’Elena, nell’Ipsipile e nelle Baccanti, E. sembra proporre una terapia ‘omeopatica’ del dolore attraverso la musica orgiastico-dionisiaca. Nel II capitolo, Natura e musica, si sceglie l’Ifigenia Taurica come esempio di mimetismo orchestico-musicale fondato – oltre che su casi di autoreferenzialità – su un immaginario naturale che, ‘facendo musica’, contribuisce all’espressività della choreia e della musica in scena. Si ipotizza inoltre un accompagnamento musicale mimetico rispetto ai suoni della natura e movimenti di danza lineari accanto a formazioni circolari, che sembrano richiamare la ‘doppia natura’ del ditirambo. L’Appendice I, Gli aggettivi poetici ξουθός e ξουθόπτερος: il loro significato e la loro potenzialità allusiva, affronta un caso particolare e problematico di ‘mimetismo lessicale’, innescato dal termine ξουθός e dal composto euripideo ξουθόπτερος. Si dimostra che l’aggettivo indica originariamente un movimento vibratorio, ma sviluppa anche un senso sonoro, ed è quindi un termine evocativo rispetto alla performance. Nell’Appendice II, Il lessico musicale in Euripide, è raccolto il lessico euripideo coreutico-musicale. Nell’Appendice III, La mousike nei drammi euripidei, sono raccolti i riferimenti alla mousike in ogni dramma.

Dissertazione sull'armonia, ossia, sull'accompagnamento /

"Letta il 19. Febbrajo 1824."

Sämmtliche Schriften über Generalbass, Harmonie-Lehre und Tonsetzkunst : zum Selbstunterrichte : systemat. geordnet, mit zahlr., aus dessen mündl. Mittheilungen geschöpften Erl.-Beysp. u.e. kurzen Anleitung zum Partitur-Spiel nebst Beschreibung aller bis jetzt gebräuchl. Instrumente /

Contentine: Bd. 1-2. Generalbass- und Harmonie-Lehre. -- Bd. 3. Anweisung zur Composition.

El teponaztli en la tradición musical mexica

Lecture about the teponaztli (a specific type of slit drum), traditionally used by the Aztec (or Mexica) people, and its associated repertoire. Special attention is paid to the usage of this instrument in the Cantares Mexicanos (a song compilation from the 16th century) accompaniment.

The musical miscellany : comprising the music published in the Musical Magazine /

Open score; tenor, 2nd treble, air, base [sic] or accompaniment.

The Boston musical education society's collection of church music : consisting of original psalm and hymn tunes, select pieces, chants, &c., including compositions adapted to the service of the Protestant Episcopal Church /

Two voice parts with keyboard accompaniment.

The life of Beethoven, including his correspondence with his friends, numerous characteristic traits, and remarks on his musical works.

"Systematic catalogue of all the original works by Ludwig von Beethoven, as published by T. Haslinger, from Vienna": v. 2, p. 377-384.

Generation in context : an exploratory method for musical enquiry

This paper discusses a method, Generation in Context, for interrogating theories of music analysis and music perception. Given an analytic theory, the method consists of creating a generative process that implements the theory in reverse. Instead of using the theory to create analyses from scores, the theory is used to generate scores from analyses. Subjective evaluation of the quality of the musical output provides a mechanism for testing the theory in a contextually robust fashion. The method is exploratory, meaning that in addition to testing extant theories it provides a general mechanism for generating new theoretical insights. We outline our initial explorations in the use of generative processes for music research, and we discuss how generative processes provide evidence as to the veracity of theories about how music is experienced, with insights into how these theories may be improved and, concurrently, provide new techniques for music creation. We conclude that Generation in Context will help reveal new perspectives on our understanding of music.

Eco-structure data forms : classification of data analysis using perceived design affordances for musical outcomes

This paper explores a method of comparative analysis and classification of data through perceived design affordances. Included is discussion about the musical potential of data forms that are derived through eco-structural analysis of musical features inherent in audio recordings of natural sounds. A system of classification of these forms is proposed based on their structural contours. The classifications include four primitive types; steady, iterative, unstable and impulse. The classification extends previous taxonomies used to describe the gestural morphology of sound. The methods presented are used to provide compositional support for eco-structuralism.

Changing musical emotion : a computational rule system for modifying score and performance

When communicating emotion in music, composers and performers encode their expressive intentions through the control of basic musical features such as: pitch, loudness, timbre, mode, and articulation. The extent to which emotion can be controlled through the systematic manipulation of these features has not been fully examined. In this paper we present CMERS, a Computational Music Emotion Rule System for the control of perceived musical emotion that modifies features at the levels of score and performance in real-time. CMERS performance was evaluated in two rounds of perceptual testing. In experiment I, 20 participants continuously rated the perceived emotion of 15 music samples generated by CMERS. Three music works, each with five emotional variations were used (normal, happy, sad, angry, and tender). The intended emotion by CMERS was correctly identified 78% of the time, with significant shifts in valence and arousal also recorded, regardless of the works’ original emotion.

View from a bridge : what makes a musical city

The attention paid by the British music press in 1976 to the release of The Saints first single “I’m Stranded” was the trigger for a commercial and academic interest in the Brisbane music scene which still has significant energy. In 2007, Brisbane was identifed by Billboard Magazine as a “hot spot” of independent music. A place to watch. Someone turned a torch on this town, had a quick look, moved on. But this town has always had music in it. Some of it made by me. So, I’m taking this connection of mine, and working it into a contextual historical analysis of the creative lives of Brisbane musicians. I will be interviewing a number of Brisbane musicians. These interviews have begun, and will continue to be be conducted in 2011/2012. I will ask questions and pursue memories that will encompass family, teenage years, siblings, the suburbs, the city, venues, television and radio; but then widen to welcome the river, the hills and mountains, foes and friends, beliefs and death. The wider research will be a contextual historical analysis of the creative lives of Brisbane musicians. It will explore the changing nature of their work practices over time and will consider the notion, among other factors, of ‘place’ in both their creative practice and their creative output. It will also examine how the presence of the practitioners and their work is seen to contribute to the cultural life of the city and the creative lives of its citizens into the future. This paper offers an analysis of this last notion: how does this city see its music-makers? In addition to the interviews, over 300 Brisbane musicians were surveyed in September 2009 as part of a QUT-initiated recorded music event (BIGJAM). Their responses will inform the production of this paper.