Towards an emotion-driven interactive music system: ridging the gaps between affect, physiology and sound generation

Report for the scientific sojourn at the Stanford University from January until June 2007. Music is well known for affecting human emotional states, yet the relationship between specific musical parameters and emotional responses is still not clear. With the advent of new human-computer interaction (HCI) technologies, it is now possible to derive emotion-related information from physiological data and use it as an input to interactive music systems. Providing such implicit musical HCI will be highly relevant for a number of applications including music therapy, diagnosis, nteractive gaming, and physiologically-based musical instruments. A key question in such physiology-based compositions is how sound synthesis parameters can be mapped to emotional states of valence and arousal. We used both verbal and heart rate responses to evaluate the affective power of five musical parameters. Our results show that a significant correlation exists between heart rate and the subjective evaluation of well-defined musical parameters. Brightness and loudness showed to be arousing parameters on subjective scale while harmonicity and even partial attenuation factor resulted in heart rate changes typically associated to valence. This demonstrates that a rational approach to designing emotion-driven music systems for our public installations and music therapy applications is possible.

Music identification

L'evolució ens els últims decennis de les possibilitats relacionades amb les tecnologies de la informació han provocat l'aparició de diferents camps, entre ells l'anomenat “recuperació de música basant-se en el contingut”, que tracta de calcular la similitud entre diferents sons. En aquest projecte hem fet una recerca sobre els diferents mètodes que existeixen avui en dia, i posteriorment n'hem comparat tres, un basat en característiques del so, un basat en la transformada discreta del cosinus, i un que combina els dos anteriors. Els resultats han mostrat, que el basat en la transformada de Fourier és el més fiable.

Predictability of music descriptor time series and its application to cover song detection

Intuitively, music has both predictable and unpredictable components. In this work we assess this qualitative statement in a quantitative way using common time series models fitted to state-of-the-art music descriptors. These descriptors cover different musical facets and are extracted from a large collection of real audio recordings comprising a variety of musical genres. Our findings show that music descriptor time series exhibit a certain predictability not only for short time intervals, but also for mid-term and relatively long intervals. This fact is observed independently of the descriptor, musical facet and time series model we consider. Moreover, we show that our findings are not only of theoretical relevance but can also have practical impact. To this end we demonstrate that music predictability at relatively long time intervals can be exploited in a real-world application, namely the automatic identification of cover songs (i.e. different renditions or versions of the same musical piece). Importantly, this prediction strategy yields a parameter-free approach for cover song identification that is substantially faster, allows for reduced computational storage and still maintains highly competitive accuracies when compared to state-of-the-art systems.

Applause identification and its relevance to archival of Carnatic music

A Carnatic music concert is made up of a sequence of pieces, where each piece corresponds to a particular genre and ra¯aga (melody). Unlike a western music concert, the artist may be applauded intra-performance inter-performance. Most Carnatic music that is archived today correspond to a single audio recordings of entire concerts.The purpose of this paper is to segment single audio recordings into a sequence of pieces using thecharacteristic features of applause and music. Spectral flux, spectral entropy change quite significantly from music to applause and vice-versa. The characteristics of these features for a subset of concerts was studied. A threshold based approach was used to segment the pieces into music fragments and applauses. Preliminary resultson recordings 19 concerts from matched microphones show that the EER is about 17% for a resolution of 0.25 seconds. Further, a parameter called CUSUM is estimatedfor the applause regions. The CUSUM values determine the strength of the applause. The CUSUM is used to characterise the highlights of a concert.

A method for extracting semantic information from on-line art music discussion forums

In this paper a method for extracting semantic informationfrom online music discussion forums is proposed. The semantic relations are inferred from the co-occurrence of musical concepts in forum posts, using network analysis. The method starts by defining a dictionary of common music terms in an art music tradition. Then, it creates a complex network representation of the online forum by matchingsuch dictionary against the forum posts. Once the complex network is built we can study different network measures, including node relevance, node co-occurrence andterm relations via semantically connecting words. Moreover, we can detect communities of concepts inside the forum posts. The rationale is that some music terms are more related to each other than to other terms. All in all, this methodology allows us to obtain meaningful and relevantinformation from forum discussions.

A Musically aware system for browsing and interacting with audio music collections

In the context of the CompMusic project we are developing methods to automatically describe/annotate audio music recordings pertaining to various music cultures. As away to demonstrate the usefulness of the methods we are also developing a system to browse and interact with specific audio collections. The system is an online web application that interfaces with all the data gathered (audio, scores plus contextual information) and all the descriptions that are automatically generated with the developed methods. In this paper we present the basic architecture of the proposed system, the types of data sources that it includes,and we mention some of the culture specific issues that we are working on for its development. The system is in a preliminary stage but it shows the potential that MIR technologies can have in browsing and interacting with musiccollections of various cultures.

The Arts (Music, Arts&Crafts and Drama) as a procedure for learning pre-school content: Grupo Edebé Project

There is nothing as amazing and fascinating as children learning process. Between 0 and 6 years old, a child brain develops in a waythat will never be repeated. At this age, children are eager to discover and they have great potential of active and affective life.Because of this, their learning capacity in this period is incalculable. (Jordan-Decarbo y Nelson, 2002; Wild, 1999).Pre-school Education is a unique and special stage, with self identity, which aims are:attending children as a whole,motivate them to learn,give them an affective and stable environment in which they can grow up and get to be balanced and confident people and inwhich they can relate to others, learn, enjoy and be happy.Arts, Music, Visual Arts and Drama (Gardner, 1994) can provide a framework of special, even unique, personal expression.With the aim of introducing qualitative improvements in the education of children and to ensure their emotional wellbeing, and havingnoticed that teachers had important needs and concerns as regards to diversity in their student groups, we developed a programbased on the detection of needs and concerns explained by professionals in education.This program of Grupo edebé, object of our research, is a multicultural, interdisciplinary and globalizing project the aims of which are:developing children's talent and personality,keeping their imagination and creativity and using these as a learning resource,promoting reasoning, favouring expression and communication,providing children with the tools to manage their emotions,and especially, introducing Arts as a procedure to increase learning.We wanted to start the research by studying the impact (Brice, 2003) that this last point had on the learning of five-year-old childrenschooled in multicultural environments.Therefore, the main goal of the research was the assessment of the implementation of a child education programme attending todiversity in a population of five-year-old children, specifically in the practice of procedures based on the use of Arts (music, arts andcrafts and theatre) as a vehicle or procedure for learning contents in Pre-school stage.Because children emotional welfare was a subject of our concern, and bearing in mind that the affective aspects are of vitalimportance for learning and child development (Parke and Gauvain, 2009), Grupo Edebé has also evaluated the starting, evolving andfinal impact in five-year-old children given that they finish Pre-school education at that age.

Features for analysis of Makam music

For computational studies of makam music, it is essential to gather a list of characteristics that constitute a makam and explore corresponding quantitative features for automaticanalysis. This study is such an attempt where we address the characteristics for makams as defined in theory books and deduce a list of quantitative features. The target here is to evoke discussions on some measurable features other than providing complete analysis on thediscriminative potentials of each proposed feature which could be the subject of a few larger studies.

Detection of Raga-characteristic phrases from Hindustani Classical Music Audio

Melodic motifs form essential building blocks in Indian Classical music. The motifs, or key phrases, providestrong cues to the identity of the underlying raga in both Hindustani and Carnatic styles of Indian music. Automatic identification and clustering of similar motifs is relevant in this context. The inherent variations in various instances of a characteristic phrase in a bandish (composition)performance make it challenging to identify similar phrases in a performance. A nyas svara (long note)marks the ending of these phrases. The proposed method does segmentation of phrases through identification ofnyas and computes similarity with the reference characteristic phrase.

Carnatic music: Svara, Gamaka, Motif and Raga identity

Over the last century in Karnatik music, the method ofunderstanding raga has been to break it down into its variouscomponents, svara, scale, gamaka, and phrases. In this paper, an attempt is made to define the abstract concept of raga in its entirety within the aesthetics of Karnatik music considering the various components and their symbiotic relationship. This paper also attempts to prove that theidentity of a raga exists as a whole. Section 2 explains theconcept of a fundamental musical note or svara. Section 3 illustrates the concept of gamaka or inflections. Section 4 delves into the concept of raga in detail and then flows into Section 5 which enunciates the identity of a raga in terms of svara, gamaka, and phraseology. The paper concludes in Section 6, and Section 7 gives the references.

Using music as a signal for biofeedback

Studies on the potential benefits of conveying biofeedback stimulus using a musical signal have appeared in recent years with the intent of harnessing the strong effects that music listening may have on subjects. While results are encouraging, the fundamental question has yet to be addressed, of how combined music and biofeedback compares to the already established use of either of these elements separately. This experiment, involving young adults (N = 24), compared the effectiveness at modulating participants' states of physiological arousal of each of the following conditions: A) listening to pre-recorded music, B) sonification biofeedback of the heart rate, and C) an algorithmically modulated musical feedback signal conveying the subject's heart rate. Our hypothesis was that each of the conditions (A), (B) and (C) would differ from the other two in the extent to which it enables participants to increase and decrease their state of physiological arousal, with (C) being more effective than (B), and both more than (A). Several physiological measures and qualitative responses were recorded and analyzed. Results show that using musical biofeedback allowed participants to modulate their state of physiological arousal at least equally well as sonification biofeedback, and much better than just listening to music, as reflected in their heart rate measurements, controlling for respiration-rate. Our findings indicate that the known effects of music in modulating arousal can therefore be beneficially harnessed when designing a biofeedback protocol.

Using music as a signal for biofeedback

Studies on the potential benefits of conveying biofeedback stimulus using a musical signal have appeared in recent years with the intent of harnessing the strong effects that music listening may have on subjects. While results are encouraging, the fundamental question has yet to be addressed, of how combined music and biofeedback compares to the already established use of either of these elements separately. This experiment, involving young adults (N = 24), compared the effectiveness at modulating participants' states of physiological arousal of each of the following conditions: A) listening to pre-recorded music, B) sonification biofeedback of the heart rate, and C) an algorithmically modulated musical feedback signal conveying the subject's heart rate. Our hypothesis was that each of the conditions (A), (B) and (C) would differ from the other two in the extent to which it enables participants to increase and decrease their state of physiological arousal, with (C) being more effective than (B), and both more than (A). Several physiological measures and qualitative responses were recorded and analyzed. Results show that using musical biofeedback allowed participants to modulate their state of physiological arousal at least equally well as sonification biofeedback, and much better than just listening to music, as reflected in their heart rate measurements, controlling for respiration-rate. Our findings indicate that the known effects of music in modulating arousal can therefore be beneficially harnessed when designing a biofeedback protocol.

Pathétique Sonata : a study of musical aspects in subjection of aesthetic aims

This study makes an attempt to capture some of the aesthetic ideas prospering in the latter half of the eighteenth century and investigates in what way these are possibly being manifested in different musical aspects in Beethoven's early work, and most specifically in his eight sonata, often referred to as the Pathétique sonata. Beginning the first chapter with an introduction to aesthetic notions in Beethoven's age, the second chapter is mostly concerned with anecdotes regarding the Pathétique sonata. Further the third chapter exhibits possible influences between Cherubini, Beethoven and Wagner, and the last three chapters treat different musical and aesthetic aspects like Beethoven's relation to the C minor tonality, the German Sturm und Drang movement, and finally some parallels that can be found between literature and music.

El canto coral y las orquestas infantiles, una educación en valores = Choir singing and children’s orchestras, an education in values

This article looks at the musical activity carried out at Palafrugell Music School as a musical education centre over the past forty years. After giving a brief description of the work carried out there by vocal and instrumental groups, the article analyses and offers examples and tangible motives that use activities to show that forming part of a coral or instrumental group helps personal development and promotes the acquisition of habits, alongside musical training and learning. In short, an education in values