Bowing the violin : a case study for auditory-motor pattern modelling in the context of music performance

This project addresses methodological and technological challenges in the development of multi-modal data acquisition and analysis methods for the representation of instrumental playing technique in music performance through auditory-motor patterning models. The case study is violin playing: a multi-modal database of violin performances has been constructed by recording different musicians while playing short exercises on different violins. The exercise set and recording protocol have been designed to sample the space defined by dynamics (from piano to forte) and tone (from sul tasto to sul ponticello), for each bow stroke type being played on each of the four strings (three different pitches per string) at two different tempi. The data, containing audio, video, and motion capture streams, has been processed and segmented to facilitate upcoming analyses. From the acquired motion data, the positions of the instrument string ends and the bow hair ribbon ends are tracked and processed to obtain a number of bowing descriptors suited for a detailed description and analysis of the bow motion patterns taking place during performance. Likewise, a number of sound perceptual attributes are computed from the audio streams. Besides the methodology and the implementation of a number of data acquisition tools, this project introduces preliminary results from analyzing bowing technique on a multi-modal violin performance database that is unique in its class. A further contribution of this project is the data itself, which will be made available to the scientific community through the repovizz platform.

Towards an emotion-driven interactive music system: ridging the gaps between affect, physiology and sound generation

Report for the scientific sojourn at the Stanford University from January until June 2007. Music is well known for affecting human emotional states, yet the relationship between specific musical parameters and emotional responses is still not clear. With the advent of new human-computer interaction (HCI) technologies, it is now possible to derive emotion-related information from physiological data and use it as an input to interactive music systems. Providing such implicit musical HCI will be highly relevant for a number of applications including music therapy, diagnosis, nteractive gaming, and physiologically-based musical instruments. A key question in such physiology-based compositions is how sound synthesis parameters can be mapped to emotional states of valence and arousal. We used both verbal and heart rate responses to evaluate the affective power of five musical parameters. Our results show that a significant correlation exists between heart rate and the subjective evaluation of well-defined musical parameters. Brightness and loudness showed to be arousing parameters on subjective scale while harmonicity and even partial attenuation factor resulted in heart rate changes typically associated to valence. This demonstrates that a rational approach to designing emotion-driven music systems for our public installations and music therapy applications is possible.

Tocant totes les tecles: Vicenç Sabater, un obrer de la música

Treball de recerca realitzat per un alumne d'ensenyament secundari i guardonat amb un Premi CIRIT per fomentar l'esperit cientí­fic del Jovent l'any 2009. El treball tracta sobre la petita memòria històrica en la faceta de l'oci de la nostra societat , el ball i la música concretament, centrat en la memòria de l'avi de l'autor, músic, arranjador i compositor. Es tracta doncs, d'una investigació sobre la música de ball a Barcelona i a Catalunya, i en general també a Europa, atès que gràcies a les vivències d'en Vicenç Sabater (l'avi), es relata com era la seva feina i el seu ofici, el de músic. La recerca està ordenada cronològicament, començant pel seu naixement (1930), la formació i les primeres actuacions, passant per tota la seva vida personal, però sobretot professional, i conclou amb un epíleg sense el qual el treball de recerca no tindria sentit, ja que aquest explica com el Vicenç no s'ha jubilat mai, perquè sempre ha estat treballant amb la música, i perquè sempre que el seu físic li permeti, ell s'hi seguirà dedicant. El treball inclou un apartat destacat de la llarga etapa (30 anys) de Sabater amb el grup musical 'Rudy Ventura y su conjunto'. Molta d'aquesta informació s'obté a través d'entrevistes a dos dels cinc integrants del grup: el mateix Jaume Ventura, i en Joan Antoni Calvet, cantant i bateria, respectivament. Apartat que, dissortadament, s'ha convertit en el meu involuntari i modest homenatge a Jaume ('Rudy') Ventura , recentment traspassat.

Concepció, disseny i implantació d'un sistema de proves psicomètriques de rendiment acadèmic per a la matèria d'Història de la Música

Amb aquest projecte s'ha treballat en la direcció de: 1) Implementar un nou recurs en un projecte global de millora de la qualitat docent i d’aplicació de les TIC a l’ensenyament de les diferents assignatures de la matèria d’Història de la Música a la UdL en curs des de fa alguns anys. Concretament, diverses eines per a l’autoavaluació de l’alumnat a través d’un banc de preguntes segons el format de les proves psicomètriques (proves objectives en l’avaluació del rendiment acadèmic dels estudiants o d’elecció múltiple). 2) Arribar a disposar d’un extens banc de preguntes d’elecció múltiple i correcció objectiva en diferents formats, ordenades per blocs, temes, nivells de dificultat, etc., que reuneixin els criteris mínims de fiabilitat, objectivitat i validesa necessaris per a una correcta avaluació del rendiment acadèmic. Entenem que l’avaluació ha de tenir utilitats diferents que van més enllà de la simple puntuació de l’alumnat. Ha de servir també per millorar la docència, per facilitar l’aprenentatge de l’alumne, per assegurar un nivell de competència mínim, per discriminar entre estudiants o per informar la pròpia institució. 3) Aconseguir que l’alumne, a través de l’autoavaluació, entengui que aquest tipus de proves són instruments per continuar aprenent. En aquest sentit les proves d’elecció múltiple permeten tot un seguit d’opcions que ho afavoreixen. 4) Elaborar una eina amb capacitat de generar estadístiques, índex de discriminació i de fer l’anàlisi d’items, tot permetent anar redefinint i millorant els ítems.

Music identification

L'evolució ens els últims decennis de les possibilitats relacionades amb les tecnologies de la informació han provocat l'aparició de diferents camps, entre ells l'anomenat “recuperació de música basant-se en el contingut”, que tracta de calcular la similitud entre diferents sons. En aquest projecte hem fet una recerca sobre els diferents mètodes que existeixen avui en dia, i posteriorment n'hem comparat tres, un basat en característiques del so, un basat en la transformada discreta del cosinus, i un que combina els dos anteriors. Els resultats han mostrat, que el basat en la transformada de Fourier és el més fiable.

Assembly and disassembly of the Golgi Complex: two prodesses arranged in a cis to trans direction

We have studied the disassembly and assembly of two morphologically and functionally distinct parts of the Golgi complex, the cis/middle and trans cisterna/trans network compartments. For this purpose we have followed the redistribution of three cis/middle- (GMPc-1, GMPc-2, MG 160) and two trans- (GMPt-1 and GMPt-2) Golgi membrane proteins during and after treatment of normal rat kidney (NRK) cells with brefeldin A (BFA). BFA induced complete disassembly of the cis/middle- and trans-Golgi complex and translocation of GMPc and GMPt to the ER. Cells treated for short times (3 min) with BFA showed extensive disorganization of both cis/middle- and trans-Golgi complexes. However, complete disorganization of the trans part required much longer incubations with the drug. Upon removal of BFA the Golgi complex was reassembled by a process consisting of three steps: (a) exist of cis/middle proteins from the ER and their accumulation into vesicular structures scattered throughout the cytoplasm; (b) gradual relocation and accumulation of the trans proteins in the vesicles containing the cis/middle proteins; and (c) assembly of the cisternae, and reconstruction of the Golgi complex within an area located in the vicinity of the centrosome from which the ER was excluded. Reconstruction of the cis/middle-Golgi complex occurred under temperature conditions inhibitory of the reorganization of the trans-Golgi complex, and was dependent on microtubules. Reconstruction of the trans-Golgi complex, disrupted with nocodazole after selective fusion of the cis/middle-Golgi complex with the ER, occurred after the release of cis/middle-Golgi proteins from the ER and the assembly of the cis/middle cisternae.

Statistical modeling of bowing control applied to violin sound synthesis

Excitation-continuous music instrument control patterns are often not explicitly represented in current sound synthesis techniques when applied to automatic performance. Both physical model-based and sample-based synthesis paradigmswould benefit from a flexible and accurate instrument control model, enabling the improvement of naturalness and realism. Wepresent a framework for modeling bowing control parameters inviolin performance. Nearly non-intrusive sensing techniques allow for accurate acquisition of relevant timbre-related bowing control parameter signals.We model the temporal contour of bow velocity, bow pressing force, and bow-bridge distance as sequences of short Bézier cubic curve segments. Considering different articulations, dynamics, and performance contexts, a number of note classes are defined. Contours of bowing parameters in a performance database are analyzed at note-level by following a predefined grammar that dictates characteristics of curve segment sequences for each of the classes in consideration. As a result, contour analysis of bowing parameters of each note yields an optimal representation vector that is sufficient for reconstructing original contours with significant fidelity. From the resulting representation vectors, we construct a statistical model based on Gaussian mixtures suitable for both the analysis and synthesis of bowing parameter contours. By using the estimated models, synthetic contours can be generated through a bow planning algorithm able to reproduce possible constraints caused by the finite length of the bow. Rendered contours are successfully used in two preliminary synthesis frameworks: digital waveguide-based bowed stringphysical modeling and sample-based spectral-domain synthesis.

Gesture sampling for instrumental sound synthesis: violin bowing as a case study

This paper presents a framework in which samples of bowing gesture parameters are retrieved and concatenated from a database of violin performances by attending to an annotated input score. Resulting bowing parameter signals are then used to synthesize sound by means of both a digital waveguide violin physical model, and an spectral-domainadditive synthesizer.

Statistical modeling of violin bowing parameter contours

We present a framework for modeling right-hand gestures in bowed-string instrument playing, applied to violin. Nearly non-intrusive sensing techniques allow for accurate acquisition of relevant timbre-related bowing gesture parameter cues. We model the temporal contour of bow transversal velocity, bow pressing force, and bow-bridge distance as sequences of short segments, in particular B´ezier cubic curve segments. Considering different articulations, dynamics, andcontexts, a number of note classes is defined. Gesture parameter contours of a performance database are analyzed at note-level by following a predefined grammar that dictatescharacteristics of curve segment sequences for each of the classes into consideration. Based on dynamic programming, gesture parameter contour analysis provides an optimal curve parameter vector for each note. The informationpresent in such parameter vector is enough for reconstructing original gesture parameter contours with significant fidelity. From the resulting representation vectors, weconstruct a statistical model based on Gaussian mixtures, suitable for both analysis and synthesis of bowing gesture parameter contours. We show the potential of the modelby synthesizing bowing gesture parameter contours from an annotated input score. Finally, we point out promising applicationsand developments.

Carnatic music: Svara, Gamaka, Motif and Raga identity

Over the last century in Karnatik music, the method ofunderstanding raga has been to break it down into its variouscomponents, svara, scale, gamaka, and phrases. In this paper, an attempt is made to define the abstract concept of raga in its entirety within the aesthetics of Karnatik music considering the various components and their symbiotic relationship. This paper also attempts to prove that theidentity of a raga exists as a whole. Section 2 explains theconcept of a fundamental musical note or svara. Section 3 illustrates the concept of gamaka or inflections. Section 4 delves into the concept of raga in detail and then flows into Section 5 which enunciates the identity of a raga in terms of svara, gamaka, and phraseology. The paper concludes in Section 6, and Section 7 gives the references.