Towards an emotion-driven interactive music system: ridging the gaps between affect, physiology and sound generation

Report for the scientific sojourn at the Stanford University from January until June 2007. Music is well known for affecting human emotional states, yet the relationship between specific musical parameters and emotional responses is still not clear. With the advent of new human-computer interaction (HCI) technologies, it is now possible to derive emotion-related information from physiological data and use it as an input to interactive music systems. Providing such implicit musical HCI will be highly relevant for a number of applications including music therapy, diagnosis, nteractive gaming, and physiologically-based musical instruments. A key question in such physiology-based compositions is how sound synthesis parameters can be mapped to emotional states of valence and arousal. We used both verbal and heart rate responses to evaluate the affective power of five musical parameters. Our results show that a significant correlation exists between heart rate and the subjective evaluation of well-defined musical parameters. Brightness and loudness showed to be arousing parameters on subjective scale while harmonicity and even partial attenuation factor resulted in heart rate changes typically associated to valence. This demonstrates that a rational approach to designing emotion-driven music systems for our public installations and music therapy applications is possible.

Reading Ng Kim Chew: Malaysian-Chineseness and memory in contemporary Malaysian Chinese literature in taiwan

The idea of Chineseness as a geographic, cultural-specific and ethnically-charged concept, and the pivotal role assumed by memory linger throughout the writings of most authors hailing from Chinese community in Southeast Asia. Among these communities, being the Malaysian Chinese the more prolific in terms of number of writers and pieces of literature produced, this paper deals specifically with it. Its focus is put on the literature produced by Malaysian Chinese authors residing in Taiwan, which topic constitutes an important part of the first chapter, and on one of its main representatives, Ng Kim Chew, to whom chapter two and three are fully dedicated. A literary analysis of one of his short stories, Huo yu tu, will allow the reader to have a first-hand experience, through excerpts from the original text, of the importance of Chineseness and memory in the literary production of Ng and of many authors sharing with him similar life and literary experiences. I started this research from the assumption that these authors make large use of their own memories and memories from their own community in their writing as a way to re-tie themselves to the Chineseness they left in their places of origin. However in the case of Ng Kim Chew, the analysis of his works led be to theorizing that the identity he is imbued with, if there is one, is not Chinese, nor Malaysian, but purely and distinctively Malaysian-Chinese. This paper can also serve as an introduction for the general public to the field of Sinophone literature from Southeast Asia and to promote wider and innovative paths of research within the realm of Chinese studies that go beyond China proper.

Traduccions cantables per a corals infantils catalanes: el repertori anglès-català del SCIC

En primer lloc els objectius que s’estableixen en aquest estudi són: Valorar la importància de la melodia, dels accents i la musicalitat del text en les cançons traduïdes analitzades. Plantejar la necessitat de la traducció de cançons infantils. Analitzar les traduccions existents de l’anglès al català del repertori de cançons infantils que es canten a les corals infantils. Relacionar poesia infantil i cançó. Visualitzar l’ús de la cançó infantil per a l’ensenyament dels infants, tant pel que fa a la transmissió de valors com per a l’ensenyament de llengües. La metodologia utilitzada fa referència a dos aspectes. El mètode qualitatiu amb la lectura d’articles i la bibliografia seleccionada i el mètode quantitatiu amb l’anàlisi de tres entrevistes i vint-i-una enquestes a responsables de corals infantils. En aquest estudi ofereixo l’estat de la qüestió sobre la traducció de cançons, amb especial atenció a la traducció de cançons per ser cantades. Després s’aborda la traducció de cançons infantils per ser cantades, per acabar especificant el tema d’aquest treball d’investigació en concret: la traducció de cançons infantils per ser cantades, amb l’estudi de traduccions de l’anglès al català de cançons cantades per corals infantils de Catalunya, i se n’ubica el context: el moviment coral infantil a Catalunya. Per a la confecció d’aquest estudi s’ha fet un recull de vint-i-set cançons traduïdes (anglès-català) que canten les corals infantils de Catalunya aplegades en el Secretariat de Corals Infantils de Catalunya (SCIC). Se n’ha seleccionat les cançons traduïdes de l’anglès al català, incloent-hi la partitura, la lletra original i la traducció. Aquest recull permet establir un lligam entre la traducció, la música i la pedagogia musical a Catalunya, els tres eixos principals d’aquest treball. D’aquestes cançons se n’han analitzat tres seguint els criteris establerts per autors com Peter Low, per la seva àmplia experiència en la traducció de música vocal. Els criteris són referents al ritme, rima, cantabilitat, naturalitat i sentit. Per tal de fer aquest estudi es van portar a terme tres entrevistes a traductors de cançons infantils: Enriqueta Anglada, Maria Martorell i Josep Vigo. Per valorar l’ús de cançons traduïdes dins del moviment coral infantil en l’actualitat i de manera més global, el treball inclou una enquesta, adreçada a directors de cors infantils, resposta per 21 cors. Aquestes enquestes palesen els canvis produïts amb el temps respecte a la necessitat de traduir cançons, ja que actualment la traducció no és tant important tot i que es continua valorant la seva importància, sobretot per afavorir la comprensió del que es canta. Però alhora es referma el desig de cantar en l’idioma original (especialment en el cas de l’anglès), quan aquest idioma l’entén qui dirigeix o interpreta la cançó, quan aquest fet es veu com a repte, o quan es prioritza la relació original entre música i text.

Programa de suport per a la millora de les competències musicals

El projecte desenvolupat ha assolit l'objectiu principal d'elaborar materials multimèdia per a la millora de les competències auditives dels estudiants de la Titulació de Mestre de Primària-Especialitat d'Educació Musical (Facultat de Ciències de l'Educació; Universitat Autònoma de Barcelona - UAB). Aquest material està a la lliure disposició de tot l'alumnat d'aquesta titulació, en els webs indicats en l'apartat 2.3. El seu ús està especialment recomanat per a aquells que tenen més dificultats en alguna de les diferents competències que s'han determinat com a essencials per a un mestre de música. Els materials inclouen: la lectura de ritmes (a una i a dues veus) i el reconeixement d'intervals, acords i tonalitats. El programari que s'ha creat permet l'autocorrecció i la repetició dels exercicis. Cada estudiant pot seguir el seu propi ritme d'aprenentatge segons les seves possibilitats de dedicació i d'exigència personal. Es pot escollir el nivell de dificultat i obtenir unes estadístiques per tal que professor i alumne en puguin fer un seguiment. Així mateix, i tal com s'havia previst en els objectius del projecte, s'ha dut a terme una anàlisi del perfil de l'alumnat que ha accedit a la titulació durant els cursos 2004-05, 05-06 i 06-07, fent especial incidència en aquells factors susceptibles de tenir alguna relació amb l'alta taxa d'abandonaments, la més alta de totes les titulacions de mestre de la UAB. S'ha pogut establir que la manca de formació musical està directament relacionada amb aquest fet. També és significativa l'opció amb què s'ha triat la titulació en el procés de preinscripció universitària. També s'ha elaborat un referencial de competències musicals a partir de la consulta de bibliografia i del contrast del criteri de cinc experts externs i del professorat de les assignatures on es fa més evident la manca de coneixements musicals previs.

Music identification

L'evolució ens els últims decennis de les possibilitats relacionades amb les tecnologies de la informació han provocat l'aparició de diferents camps, entre ells l'anomenat “recuperació de música basant-se en el contingut”, que tracta de calcular la similitud entre diferents sons. En aquest projecte hem fet una recerca sobre els diferents mètodes que existeixen avui en dia, i posteriorment n'hem comparat tres, un basat en característiques del so, un basat en la transformada discreta del cosinus, i un que combina els dos anteriors. Els resultats han mostrat, que el basat en la transformada de Fourier és el més fiable.

On the writer identification in old handwritten music scores

Report for the scientific sojourn at the University of Bern, Swiss, from Mars until June 2008. Writer identification consists in determining the writer of a piece of handwriting from a set of writers. Even though an important amount of compositions contains handwritten text in the music scores, the aim of the work is to use only music notation to determine the author. It’s been developed two approaches for writer identification in old handwritten music scores. The methods proposed extract features from every music line, and also features from a texture image of music symbols. First of all, the music sheet is first preprocessed for obtaining a binarized music score without the staff lines. The classification is performed using a k-NN classifier based on Euclidean distance. The proposed method has been tested on a database of old music scores from the 17th to 19th centuries, achieving encouraging identification rates.

Eye tracking for on-screen reading

A medida que avanza la tecnolog a, cada vez son m as comunes los libros digitales. Por eso, existen varias formas de mejorar la experiencia de lectura del usuario, como mostrar la de nici on de una palabra que resulte dif cil, o resaltar lo importante del texto cuando se pasa la vista por encima. En este proyecto, se ha investigado la base de esto con la ayuda de un Eye Tracker. Se ha implementado una clasi caci on en palabras f aciles y dif ciles dependiendo de c omo una persona lee, y una forma de saber si se est a leyendo el texto o pasando la vista por encima.

Simon music

Projecte que presenta la implementació per a dispositius Android del joc 'Simon says'.

Predictability of music descriptor time series and its application to cover song detection

Intuitively, music has both predictable and unpredictable components. In this work we assess this qualitative statement in a quantitative way using common time series models fitted to state-of-the-art music descriptors. These descriptors cover different musical facets and are extracted from a large collection of real audio recordings comprising a variety of musical genres. Our findings show that music descriptor time series exhibit a certain predictability not only for short time intervals, but also for mid-term and relatively long intervals. This fact is observed independently of the descriptor, musical facet and time series model we consider. Moreover, we show that our findings are not only of theoretical relevance but can also have practical impact. To this end we demonstrate that music predictability at relatively long time intervals can be exploited in a real-world application, namely the automatic identification of cover songs (i.e. different renditions or versions of the same musical piece). Importantly, this prediction strategy yields a parameter-free approach for cover song identification that is substantially faster, allows for reduced computational storage and still maintains highly competitive accuracies when compared to state-of-the-art systems.

A two-stage approach for tonic identification in indian art music

In this paper we propose a new approach for tonic identification in Indian art music and present a proposal for acomplete iterative system for the same. Our method splits the task of tonic pitch identification into two stages. In the first stage, which is applicable to both vocal and instrumental music, we perform a multi-pitch analysis of the audio signal to identify the tonic pitch-class. Multi-pitch analysisallows us to take advantage of the drone sound, which constantlyreinforces the tonic. In the second stage we estimate the octave in which the tonic of the singer lies and is thusneeded only for the vocal performances. We analyse the predominant melody sung by the lead performer in order to establish the tonic octave. Both stages are individually evaluated on a sizable music collection and are shown toobtain a good accuracy. We also discuss the types of errors made by the method.Further, we present a proposal for a system that aims to incrementally utilize all the available data, both audio and metadata in order to identify the tonic pitch. It produces a tonic estimate and a confidence value, and is iterative in nature. At each iteration, more data is fed into the systemuntil the confidence value for the identified tonic is above a defined threshold. Rather than obtain high overall accuracy for our complete database, ultimately our goal is to develop a system which obtains very high accuracy on a subset of the database with maximum confidence.

Applause identification and its relevance to archival of Carnatic music

A Carnatic music concert is made up of a sequence of pieces, where each piece corresponds to a particular genre and ra¯aga (melody). Unlike a western music concert, the artist may be applauded intra-performance inter-performance. Most Carnatic music that is archived today correspond to a single audio recordings of entire concerts.The purpose of this paper is to segment single audio recordings into a sequence of pieces using thecharacteristic features of applause and music. Spectral flux, spectral entropy change quite significantly from music to applause and vice-versa. The characteristics of these features for a subset of concerts was studied. A threshold based approach was used to segment the pieces into music fragments and applauses. Preliminary resultson recordings 19 concerts from matched microphones show that the EER is about 17% for a resolution of 0.25 seconds. Further, a parameter called CUSUM is estimatedfor the applause regions. The CUSUM values determine the strength of the applause. The CUSUM is used to characterise the highlights of a concert.

A method for extracting semantic information from on-line art music discussion forums

In this paper a method for extracting semantic informationfrom online music discussion forums is proposed. The semantic relations are inferred from the co-occurrence of musical concepts in forum posts, using network analysis. The method starts by defining a dictionary of common music terms in an art music tradition. Then, it creates a complex network representation of the online forum by matchingsuch dictionary against the forum posts. Once the complex network is built we can study different network measures, including node relevance, node co-occurrence andterm relations via semantically connecting words. Moreover, we can detect communities of concepts inside the forum posts. The rationale is that some music terms are more related to each other than to other terms. All in all, this methodology allows us to obtain meaningful and relevantinformation from forum discussions.

A Musically aware system for browsing and interacting with audio music collections

In the context of the CompMusic project we are developing methods to automatically describe/annotate audio music recordings pertaining to various music cultures. As away to demonstrate the usefulness of the methods we are also developing a system to browse and interact with specific audio collections. The system is an online web application that interfaces with all the data gathered (audio, scores plus contextual information) and all the descriptions that are automatically generated with the developed methods. In this paper we present the basic architecture of the proposed system, the types of data sources that it includes,and we mention some of the culture specific issues that we are working on for its development. The system is in a preliminary stage but it shows the potential that MIR technologies can have in browsing and interacting with musiccollections of various cultures.

Opportunities for a cultural specific approach in the computational description of music

The current research in Music Information Retrieval (MIR) is showing the potential that the Information Technologies can have in music related applications. Amajor research challenge in that direction is how to automaticallydescribe/annotate audio recordings and how to use the resulting descriptions to discover and appreciate music in new ways. But music is a complex phenomenonand the description of an audio recording has to deal with this complexity. For example, each musicculture has specificities and emphasizes different musicaland communication aspects, thus the musical recordings of each culture should be described differently. At the same time these cultural specificities give us the opportunity to pay attention to musical concepts andfacets that, despite being present in most world musics, are not easily noticed by listeners. In this paper we present some of the work done in the CompMusic project, including ideas and specific examples on how to take advantage of the cultural specificities of differentmusical repertoires. We will use examples from the art music traditions of India, Turkey and China.

Fermat's treatise on quadrature: A new reading

The Treatise on Quadrature of Fermat (c. 1659), besides containing the first known proof of the computation of the area under a higher parabola, R x+m/n dx, or under a higher hyperbola, R x-m/n dx with the appropriate limits of integration in each case , has a second part which was not understood by Fermat s contemporaries. This second part of the Treatise is obscure and difficult to read and even the great Huygens described it as'published with many mistakes and it is so obscure (with proofs redolent of error) that I have been unable to make any sense of it'. Far from the confusion that Huygens attributes to it, in this paper we try to prove that Fermat, in writing the Treatise, had a very clear goal in mind and he managed to attain it by means of a simple and original method. Fermat reduced the quadrature of a great number of algebraic curves to the quadrature of known curves: the higher parabolas and hyperbolas of the first part of the paper. Others, he reduced to the quadrature of the circle. We shall see how the clever use of two procedures, quite novel at the time: the change of variables and a particular case of the formulaof integration by parts, provide Fermat with the necessary tools to square very easily curves as well-known as the folium of Descartes, the cissoid of Diocles or the witch of Agnesi.