Towards an emotion-driven interactive music system: ridging the gaps between affect, physiology and sound generation

Report for the scientific sojourn at the Stanford University from January until June 2007. Music is well known for affecting human emotional states, yet the relationship between specific musical parameters and emotional responses is still not clear. With the advent of new human-computer interaction (HCI) technologies, it is now possible to derive emotion-related information from physiological data and use it as an input to interactive music systems. Providing such implicit musical HCI will be highly relevant for a number of applications including music therapy, diagnosis, nteractive gaming, and physiologically-based musical instruments. A key question in such physiology-based compositions is how sound synthesis parameters can be mapped to emotional states of valence and arousal. We used both verbal and heart rate responses to evaluate the affective power of five musical parameters. Our results show that a significant correlation exists between heart rate and the subjective evaluation of well-defined musical parameters. Brightness and loudness showed to be arousing parameters on subjective scale while harmonicity and even partial attenuation factor resulted in heart rate changes typically associated to valence. This demonstrates that a rational approach to designing emotion-driven music systems for our public installations and music therapy applications is possible.

Gérard Grisey : la cuantificación temporal deducida de los procesos perceptivos

En el presente trabajo, tratamos diferentes perspectivas sobre la poética, estrategias compositivas y repercusión perceptiva del tiempo en la música de Gérard Grisey. En el primer capítulo, abordamos la concepción del tiempo como unidad y proporcionalidad duracional y su relación con otros parámetros musicales. A continuación, presentamos tres enfoques sobre el tiempo que emergen de la poética de Grisey y del análisis de sus obras: la ruptura con la proporcionalidad duracional y la relación entre tiempo y sonido, el concepto de cambio de escala temporal y la analogía entre tiempo y cosmos. En el segundo capítulo, proponemos tres categorías temporales basadas principalmente en el concepto de previsibilidad: tiempo no lineal, tiempo lineal y tiempo procesual. En el tercer y último capítulo, exponemos los fundamentos de la Teoría de la Información, su relación con el discurso de Grisey y su método de aplicación.

Comparison Structure Analysis

This study presents an automatic, computer-aided analytical method called Comparison Structure Analysis (CSA), which can be applied to different dimensions of music. The aim of CSA is first and foremost practical: to produce dynamic and understandable representations of musical properties by evaluating the prevalence of a chosen musical data structure through a musical piece. Such a comparison structure may refer to a mathematical vector, a set, a matrix or another type of data structure and even a combination of data structures. CSA depends on an abstract systematic segmentation that allows for a statistical or mathematical survey of the data. To choose a comparison structure is to tune the apparatus to be sensitive to an exclusive set of musical properties. CSA settles somewhere between traditional music analysis and computer aided music information retrieval (MIR). Theoretically defined musical entities, such as pitch-class sets, set-classes and particular rhythm patterns are detected in compositions using pattern extraction and pattern comparison algorithms that are typical within the field of MIR. In principle, the idea of comparison structure analysis can be applied to any time-series type data and, in the music analytical context, to polyphonic as well as homophonic music. Tonal trends, set-class similarities, invertible counterpoints, voice-leading similarities, short-term modulations, rhythmic similarities and multiparametric changes in musical texture were studied. Since CSA allows for a highly accurate classification of compositions, its methods may be applicable to symbolic music information retrieval as well. The strength of CSA relies especially on the possibility to make comparisons between the observations concerning different musical parameters and to combine it with statistical and perhaps other music analytical methods. The results of CSA are dependent on the competence of the similarity measure. New similarity measures for tonal stability, rhythmic and set-class similarity measurements were proposed. The most advanced results were attained by employing the automated function generation – comparable with the so-called genetic programming – to search for an optimal model for set-class similarity measurements. However, the results of CSA seem to agree strongly, independent of the type of similarity function employed in the analysis.

Des relations entre les structures musicales et les contextes sociaux dans un répertoire de "sessions" instrumentales irlandaises

La version intégrale de ce mémoire [ou de cette thèse] est disponible uniquement pour consultation individuelle à la Bibliothèque de musique de l’Université de Montréal (www.bib.umontreal.ca/MU)

Le langage de Claude Vivier : essai d’approche endogénétique d’un style musical

La version intégrale de cette thèse est disponible uniquement pour consultation individuelle à la Bibliothèque de musique de l’Université de Montréal (www.bib.umontreal.ca/MU)

Dynamic game soundtrack generation in response to a continously varying emotional trajectory

Dynamic soundtracking presents various practical and aesthetic challenges to composers working with games. This paper presents an implementation of a system addressing some of these challenges with an affectively-driven music generation algorithm based on a second order Markov-model. The system can respond in real-time to emotional trajectories derived from 2-dimensions of affect on the circumplex model (arousal and valence), which are mapped to five musical parameters. A transition matrix is employed to vary the generated output in continuous response to the affective state intended by the gameplay.

O ator que canta um conto: a manipulação de parâmetros musicais na voz do ator

This research started with an investigation about the theatrical speaking. Through an empirical methodology that analyzed a practical experience of creating a play and bibliographical research, the actress/researcher investigated ways to manipulate musical parameters as tools in the creation process of the actor s voice. The actress/researcher attempted to connect theory and practice, moved by the desire to find a vocal expression in theater that unfolds as living and transforming movement. This dissertation also contains the report of pedagogical experiences, in which the actress/researcher explored strategies to teach the appropriation of musical parameters in the construction of the vocal work of the actor. Considering that speaking in theater is closer to singing than everyday speech, she concluded that the actor may compose music as a music composer does in the elaborating process of building vocal scores. Therefore, she demonstrated that it is of fundamental importance a musical training in the development of the actor.

Ampliando o repertório do coro infanto-juvenil: um estudo de repertório inserido numa nova estética

Pós-graduação em Música - IA

Formazione e pratica del pensiero orchestrale di Hector Berlioz. Caratteri poetici e strategie del suono

Lo scopo della dissertazione “Formazione e pratica del pensiero orchestrale di Hector Berlioz. Caratteri poetici e strategie del suono” è quello di indagare i tratti essenziali del pensiero di Berlioz in merito all’orchestra riprendendo in considerazione gli elementi della sua educazione giovanile. In particolare, le nozioni ricavate dai suoi insegnanti di composizione Le Sueur e Reicha e dai corsi di medicina brevemente frequentati a Parigi sono indagate con approccio rinnovato, alla luce di nuovi filoni di studio indagati dalla musicologia negli anni più recenti. Sono analizzate anche le recensioni di Berlioz, alla ricerca di elementi che aiutino a comprendere la sua musica con le argomentazioni destinate a quella altrui. È analizzato anche il percorso della trattatistica che da un iniziale approccio di tipo pratico tipico del XVIII secolo, giunge con il trattato di Berlioz a una forte connotazione poetica delle risorse strumentali e orchestrali. Nella seconda parte della dissertazione sono analizzate invece alcune opere di Berlioz e alcune questioni generali concernenti il suo modo di scrivere per l’orchestra, specialmente in relazione ad altri parametri musicali. Nella dissertazione notevole attenzione è data al rapporto fra questioni tecniche e poetiche, proponendo un approccio leggermente rinnovato.

Theoretical interfaces in the acute paediatric context: A psychotherapeutic understanding of the application of infant-directed singing

Psychotherapy literature provides a theoretical understanding of parent-infant attachment. This article will reflect upon the specific need to give thoughtful consideration to those infants admitted to the acute-care setting, such as neonatal and paediatric intensive care units, and the potential for this environment to affect infant development and the parent-infant relationship. Infant-directed singing, as described in this article, is an improvised form of vocal interaction that is specifically informed by an understanding of the musical parameters of pitch, rhythm, phrasing, timbre, register, dynamic, tempo and silence. This article will detail a theoretical understanding of using infant-directed singing to foster parent-infant interaction within the acute care environment. In particular, the potentially sensitive, reciprocal and engaging nature of infant-directed singing, coupled with its ability to promote and support maternal demonstrations of empathy, will be discussed with a view to the psychological and physical development of the hospitalised infant.

O ator que canta um conto: a manipulação de parâmetros musicais na voz do ator

This research started with an investigation about the theatrical speaking. Through an empirical methodology that analyzed a practical experience of creating a play and bibliographical research, the actress/researcher investigated ways to manipulate musical parameters as tools in the creation process of the actor s voice. The actress/researcher attempted to connect theory and practice, moved by the desire to find a vocal expression in theater that unfolds as living and transforming movement. This dissertation also contains the report of pedagogical experiences, in which the actress/researcher explored strategies to teach the appropriation of musical parameters in the construction of the vocal work of the actor. Considering that speaking in theater is closer to singing than everyday speech, she concluded that the actor may compose music as a music composer does in the elaborating process of building vocal scores. Therefore, she demonstrated that it is of fundamental importance a musical training in the development of the actor.

O ator que canta um conto: a manipulação de parâmetros musicais na voz do ator

This research started with an investigation about the theatrical speaking. Through an empirical methodology that analyzed a practical experience of creating a play and bibliographical research, the actress/researcher investigated ways to manipulate musical parameters as tools in the creation process of the actor s voice. The actress/researcher attempted to connect theory and practice, moved by the desire to find a vocal expression in theater that unfolds as living and transforming movement. This dissertation also contains the report of pedagogical experiences, in which the actress/researcher explored strategies to teach the appropriation of musical parameters in the construction of the vocal work of the actor. Considering that speaking in theater is closer to singing than everyday speech, she concluded that the actor may compose music as a music composer does in the elaborating process of building vocal scores. Therefore, she demonstrated that it is of fundamental importance a musical training in the development of the actor.

Entre o palco e o ecrã: feras amestradas: comédia musical negra à portuguesa: intermédia

Trabalho de Projeto submetido à Escola Superior de Teatro e Cinema para cumprimento dos requisitos necessários à obtenção do grau de Mestre em Teatro - especialização em Encenação

Finalidades do estudo de um instrumento musical: intervenção pedagógica com recurso a estratégias no ensino do violino para desenvolver a atenção seletiva

Relatório de estágio de mestrado em Ensino de Música

Manipulating Greek musical modes and tempo affects perceived musical emotion in musicians and nonmusicians

The combined influence of tempo and mode on emotional responses to music was studied by crossing 7 changes in mode with 3 changes in tempo. Twenty-four musicians aged 19 to 25 years (12 males and 12 females) and 24 nonmusicians aged 17 to 25 years (12 males and 12 females) were required to perform two tasks: 1) listening to different musical excerpts, and 2) associating an emotion to them such as happiness, serenity, fear, anger, or sadness. ANOVA showed that increasing the tempo strongly affected the arousal (F(2,116) = 268.62, mean square error (MSE) = 0.6676, P < 0.001) and, to a lesser extent, the valence of emotional responses (F(6,348) = 8.71, MSE = 0.6196, P < 0.001). Changes in modes modulated the affective valence of the perceived emotions (F(6,348) = 4.24, MSE = 0.6764, P < 0.001). Some interactive effects were found between tempo and mode (F (1,58) = 115.6, MSE = 0.6428, P < 0.001), but, in most cases, the two parameters had additive effects. This finding demonstrates that small changes in the pitch structures of modes modulate the emotions associated with the pieces, confirming the cognitive foundation of emotional responses to music.