Towards an emotion-driven interactive music system: ridging the gaps between affect, physiology and sound generation

Report for the scientific sojourn at the Stanford University from January until June 2007. Music is well known for affecting human emotional states, yet the relationship between specific musical parameters and emotional responses is still not clear. With the advent of new human-computer interaction (HCI) technologies, it is now possible to derive emotion-related information from physiological data and use it as an input to interactive music systems. Providing such implicit musical HCI will be highly relevant for a number of applications including music therapy, diagnosis, nteractive gaming, and physiologically-based musical instruments. A key question in such physiology-based compositions is how sound synthesis parameters can be mapped to emotional states of valence and arousal. We used both verbal and heart rate responses to evaluate the affective power of five musical parameters. Our results show that a significant correlation exists between heart rate and the subjective evaluation of well-defined musical parameters. Brightness and loudness showed to be arousing parameters on subjective scale while harmonicity and even partial attenuation factor resulted in heart rate changes typically associated to valence. This demonstrates that a rational approach to designing emotion-driven music systems for our public installations and music therapy applications is possible.

On the Incorporation of Psychologically-Driven 'Music' Preference Models for Music Recommendation

There are hundreds of millions of songs available to the public, necessitating the use of music recommendation systems to discover new music. Currently, such systems account for only the quantitative musical elements of songs, failing to consider aspects of human perception of music and alienating the listener’s individual preferences from recommendations. Our research investigated the relationships between perceptual elements of music, represented by the MUSIC model, with computational musical features generated through The Echo Nest, to determine how a psychological representation of music preference can be incorporated into recommendation systems to embody an individual’s music preferences. Our resultant model facilitates computation of MUSIC factors using The Echo Nest features, and can potentially be integrated into recommendation systems for improved performance.

“Valley co-creation” – exploring the emergence of a cultural product in an entrepreneur-driven value network: Case study: Black Weekend festival

The interconnected domains are attracting interest from industries and academia, although this phenomenon, called ‘convergence’ is not new. Organizational research has indeed focused on uncovering co-creation for manufacturing and the industrial organization, with limited implications to entrepreneurship. Although convergence has been characterized as a process connecting seemingly disparate disciplines, it is argued that these studies tend to leave the creative industries unnoticed. With the art market boom and new forms of collaboration riding past the institution-focused arts marketing literature, this thesis takes a leap to uncover the processes of entrepreneurship in the emergence of a cultural product. As a symbolic work of synergism itself, the thesis combines organizational theory with literature in natural sciences and arts. Assuming nonlinearity, a framework is created for analysing aesthetic experience in an empirical event where network actors are connected to multiple contexts. As the focal case in study, the empirical analysis performed for a music festival organized in a skiing resort in the French Alps in March. The researcher attends the festival and models its cocreation process by enquiring from an artist, festival organisers, and a festival visitor. The findings contribute to fields of entrepreneurship, aesthetics and marketing mainly. It is found that the network actors engage in intimate and creative interaction where activity patterns are interrupted and cultural elements combined. This process is considered to both create and destruct value, through identity building, legitimisation, learning, and access to larger audiences, and it is considered particularly useful for domains where resources are too restrained for conventional marketing practices. This thesis uncovered the role of artists and informants and posits that particularly through experience design, this type of skilled individual be regarded more often as a research informant. Future research is encouraged to engage in convergence by experimenting with different fields and research designs, and it is suggested that future studies could arrive at different descriptive results.

Non-negative matrix decomposition approaches to frequency domain analysis of music audio signals

On étudie l’application des algorithmes de décomposition matricielles tel que la Factorisation Matricielle Non-négative (FMN), aux représentations fréquentielles de signaux audio musicaux. Ces algorithmes, dirigés par une fonction d’erreur de reconstruction, apprennent un ensemble de fonctions de base et un ensemble de coef- ficients correspondants qui approximent le signal d’entrée. On compare l’utilisation de trois fonctions d’erreur de reconstruction quand la FMN est appliquée à des gammes monophoniques et harmonisées: moindre carré, divergence Kullback-Leibler, et une mesure de divergence dépendente de la phase, introduite récemment. Des nouvelles méthodes pour interpréter les décompositions résultantes sont présentées et sont comparées aux méthodes utilisées précédemment qui nécessitent des connaissances du domaine acoustique. Finalement, on analyse la capacité de généralisation des fonctions de bases apprises par rapport à trois paramètres musicaux: l’amplitude, la durée et le type d’instrument. Pour ce faire, on introduit deux algorithmes d’étiquetage des fonctions de bases qui performent mieux que l’approche précédente dans la majorité de nos tests, la tâche d’instrument avec audio monophonique étant la seule exception importante.

A quantitative approach to evolution of music and philosophy

The development of new statistical and computational methods is increasingly making it possible to bridge the gap between hard sciences and humanities. In this study, we propose an approach based on a quantitative evaluation of attributes of objects in fields of humanities, from which concepts such as dialectics and opposition are formally defined mathematically. As case studies, we analyzed the temporal evolution of classical music and philosophy by obtaining data for 8 features characterizing the corresponding fields for 7 well-known composers and philosophers, which were treated with multivariate statistics and pattern recognition methods. A bootstrap method was applied to avoid statistical bias caused by the small sample data set, with which hundreds of artificial composers and philosophers were generated, influenced by the 7 names originally chosen. Upon defining indices for opposition, skewness and counter-dialectics, we confirmed the intuitive analysis of historians in that classical music evolved according to a master apprentice tradition, while in philosophy changes were driven by opposition. Though these case studies were meant only to show the possibility of treating phenomena in humanities quantitatively, including a quantitative measure of concepts such as dialectics and opposition, the results are encouraging for further application of the approach presented here to many other areas, since it is entirely generic.

Professional musicians listen differently to music

INTRODUCTION: Experience-based adaptation of emotional responses is an important faculty for cognitive and emotional functioning. Professional musicians represent an ideal model in which to elicit experience-driven changes in the emotional processing domain. The changes of the central representation of emotional arousal due to musical expertise are still largely unknown. The aim of the present study was to investigate the electroencephalogram (EEG) correlates of experience-driven changes in the domain of emotional arousal. Therefore, the differences in perceived (subjective arousal via ratings) and physiologically measured (EEG) arousal between amateur and professional musicians were examined. PROCEDURE: A total of 15 professional and 19 amateur musicians listened to the first movement of Ludwig van Beethoven's 5th symphony (duration=∼7.4min), during which a continuous 76-channel EEG was recorded. In a second session, the participants evaluated their emotional arousal during listening. In a tonic analysis, we examined the average EEG data over the time course of the music piece. For a phasic analysis, a fast Fourier transform was performed and covariance maps of spectral power were computed in association with the subjective arousal ratings. RESULTS: The subjective arousal ratings of the professional musicians were more consistent than those of the amateur musicians. In the tonic EEG analysis, a mid-frontal theta activity was observed in the professionals. In the phasic EEG, the professionals exhibited an increase of posterior alpha, central delta, and beta rhythm during high arousal. DISCUSSION: Professionals exhibited different and/or more intense patterns of emotional activation when they listened to the music. The results of the present study underscore the impact of music experience on emotional reactions.

Iberian and Latin American Music Scholarship on the Ascent: Reflections from the United States

In the early twentieth century, musicology was established as an academic discipline in the United States. Nonetheless, with the exception of Iberian medieval and Renaissance repertories, U.S. scholars largely overlooked the music of the Spanish- and Portuguese- speaking world. Why should this have been the case, especially in light of Spain’s strong historical presence in the United States? This autobiographical essay examines this question by tracing the career of an individual musicologist, the Hispanist musicologist Carol A. Hess. Evaluated here are disciplinary shifts in U.S. musicology —methodological, philosophical, and ideological— over the past thirty years. These transformations have combined to make this repertory a viable field of study today. Musicologists in the United States can now make their careers by specializing in Iberian and Latin American music, as well as the music of the Hispanic diaspora. They research topics ranging from the avant-garde composer Llorenç Barber to the rapper Nach Scratch or the popular bandleader Xavier Cugat and his U.S. audiences of the 1940s, while others also pursue the time-tested areas of medieval and Renaissance music. Iberian and Latin American music is regularly offered in postsecondary institutions while instructors now have a variety of textbooks and other pedagogical resources from which to choose. All add up to a disciplinary freedom that would have been unthinkable only a few decades ago.

Extreme Harmonic Generation In Electrically Driven Spin Resonance.

We report the observation of multiple harmonic generation in electric dipole spin resonance in an InAs nanowire double quantum dot. The harmonics display a remarkable detuning dependence: near the interdot charge transition as many as eight harmonics are observed, while at large detunings we only observe the fundamental spin resonance condition. The detuning dependence indicates that the observed harmonics may be due to Landau-Zener transition dynamics at anticrossings in the energy level spectrum.

Urothelial Carcinogen Resistance Driven By Stronger Toll-like Receptor 2 (tlr2) And Uroplakin Iii (up Iii) Defense Mechanisms: A New Model.

The objective of the study was to illustrate the applicability and significance of the novel Lewis urothelial cancer model compared to the classic Fisher 344. Fischer 344 and Lewis females rats, 7 weeks old, were intravesical instilled N-methyl-N-nitrosourea 1.5 mg/kg every other week for a total of four doses. After 15 weeks, animals were sacrificed and bladders analyzed: histopathology (tumor grade and stage), immunohistochemistry (apoptotic and proliferative indices) and blotting (Toll-like receptor 2-TLR2, Uroplakin III-UP III and C-Myc). Control groups received placebo. There were macroscopic neoplastic lesions in 20 % of Lewis strain and 70 % of Fischer 344 strain. Lewis showed hyperplasia in 50 % of animals, normal bladders in 50 %. All Fischer 344 had lesions, 20 % papillary hyperplasia, 30 % dysplasia, 40 % neoplasia and 10 % squamous metaplasia. Proliferative and apoptotic indices were significantly lower in the Lewis strain (p < 0.01). The TLR2 and UP III protein levels were significantly higher in Lewis compared to Fischer 344 strain (70.8 and 46.5 % vs. 49.5 and 16.9 %, respectively). In contrast, C-Myc protein levels were significantly higher in Fischer 344 (22.5 %) compared to Lewis strain (13.7 %). The innovative Lewis carcinogen resistance urothelial model represents a new strategy for translational research. Preservation of TLR2 and UP III defense mechanisms might drive diverse urothelial phenotypes during carcinogenesis in differently susceptible individuals.

Adaptive Immunity against Leishmania Nucleoside Hydrolase Maps Its C-Terminal Domain as the Target of the CD4+ T Cell-Driven Protective Response

Nucleoside hydrolases (NHs) show homology among parasite protozoa, fungi and bacteria. They are vital protagonists in the establishment of early infection and, therefore, are excellent candidates for the pathogen recognition by adaptive immune responses. Immune protection against NHs would prevent disease at the early infection of several pathogens. We have identified the domain of the NH of L. donovani (NH36) responsible for its immunogenicity and protective efficacy against murine visceral leishmaniasis (VL). Using recombinant generated peptides covering the whole NH36 sequence and saponin we demonstrate that protection against L. chagasi is related to its C-terminal domain (amino-acids 199-314) and is mediated mainly by a CD4+ T cell driven response with a lower contribution of CD8+ T cells. Immunization with this peptide exceeds in 36.73 +/- 12.33% the protective response induced by the cognate NH36 protein. Increases in IgM, IgG2a, IgG1 and IgG2b antibodies, CD4+ T cell proportions, IFN-gamma secretion, ratios of IFN-gamma/IL-10 producing CD4+ and CD8+ T cells and percents of antibody binding inhibition by synthetic predicted epitopes were detected in F3 vaccinated mice. The increases in DTH and in ratios of TNF alpha/IL-10 CD4+ producing cells were however the strong correlates of protection which was confirmed by in vivo depletion with monoclonal antibodies, algorithm predicted CD4 and CD8 epitopes and a pronounced decrease in parasite load (90.5-88.23%; p = 0.011) that was long-lasting. No decrease in parasite load was detected after vaccination with the N-domain of NH36, in spite of the induction of IFN-gamma/IL-10 expression by CD4+ T cells after challenge. Both peptides reduced the size of footpad lesions, but only the C-domain reduced the parasite load of mice challenged with L. amazonensis. The identification of the target of the immune response to NH36 represents a basis for the rationale development of a bivalent vaccine against leishmaniasis and for multivalent vaccines against NHs-dependent pathogens.

Polyelectrolyte-protein complexation driven by charge regulation

The interplay between the biocolloidal characteristics (especially size and charge), pH, salt concentration and the thermal energy results in a unique collection of mesoscopic forces of importance to the molecular organization and function in biological systems. By means of Monte Carlo simulations and semi-quantitative analysis in terms of perturbation theory, we describe a general electrostatic mechanism that gives attraction at low electrolyte concentrations. This charge regulation mechanism due to titrating amino acid residues is discussed in a purely electrostatic framework. The complexation data reported here for interaction between a polyelectrolyte chain and the proteins albumin, goat and bovine alpha-lactalbumin, beta-lactoglobulin, insulin, k-casein, lysozyme and pectin methylesterase illustrate the importance of the charge regulation mechanism. Special attention is given to pH congruent to pI where ion-dipole and charge regulation interactions could overcome the repulsive ion-ion interaction. By means of protein mutations, we confirm the importance of the charge regulation mechanism, and quantify when the complexation is dominated either by charge regulation or by the ion-dipole term.

The International LAM Registry: A Component of an Innovative Web-Based Clinician, Researcher, and Patient-Driven Rare Disease Research Platform

Background: A relative friability to capture a sufficiently large patient population in any one geographic location has traditionally limited research into rare diseases. Methods and Results: Clinicians interested in the rare disease lymphangioleiomyomatosis (LAM) have worked with the LAM Treatment Alliance, the MIT Media Lab, and Clozure Associates to cooperate in the design of a state-of-the-art data coordination platform that can be used for clinical trials and other research focused on the global LAM patient population. This platform is a component of a set of web-based resources, including a patient self-report data portal, aimed at accelerating research in rare diseases in a rigorous fashion. Conclusions: Collaboration between clinicians, researchers, advocacy groups, and patients can create essential community resource infrastructure to accelerate rare disease research. The International LAM Registry is an example of such an effort.

Characterizing chaotic melodies in automatic music composition

In this paper, we initially present an algorithm for automatic composition of melodies using chaotic dynamical systems. Afterward, we characterize chaotic music in a comprehensive way as comprising three perspectives: musical discrimination, dynamical influence on musical features, and musical perception. With respect to the first perspective, the coherence between generated chaotic melodies (continuous as well as discrete chaotic melodies) and a set of classical reference melodies is characterized by statistical descriptors and melodic measures. The significant differences among the three types of melodies are determined by discriminant analysis. Regarding the second perspective, the influence of dynamical features of chaotic attractors, e.g., Lyapunov exponent, Hurst coefficient, and correlation dimension, on melodic features is determined by canonical correlation analysis. The last perspective is related to perception of originality, complexity, and degree of melodiousness (Euler's gradus suavitatis) of chaotic and classical melodies by nonparametric statistical tests. (c) 2010 American Institute of Physics. [doi: 10.1063/1.3487516]

Bicoherence in electrostatic turbulence driven by high magnetohydrodynamic activity in Tokamak Chauffage Alfven Bresilien

During some discharges in Tokamak Chauffage Alfven Bresilien [R. M. O. Galvao et al., Plasma Phys. Controlled Fusion 43, 1181 (2001)] high magnetohydrodynamic activity may appear with a peaked frequency spectrum. Whenever this peak occurs, the ambient broadband electrostatic turbulence is remarkably modified, synchronizing into the dominant magnetic fluctuation frequency and presenting high bicoherence in the whole plasma edge with a maximum bicoherence inside the plasma. A phenomenological model is introduced to investigate this driven turbulence bicoherence, consisting of nonlinearly coupled phase-randomized drift modes with time-periodic external driving at the dominant magnetic fluctuation frequency. The bicoherence spectrum of this model can mimic features of the experimental results. (C) 2009 American Institute of Physics. [DOI: 10.1063/1.3099701]

Reduction of chaotic particle transport driven by drift waves in sheared flows

Investigations of chaotic particle transport by drift waves propagating in the edge plasma of tokamaks with poloidal zonal flow are described. For large aspect ratio tokamaks, the influence of radial electric field profiles on convective cells and transport barriers, created by the nonlinear interaction between the poloidal flow and resonant waves, is investigated. For equilibria with edge shear flow, particle transport is seen to be reduced when the electric field shear is reversed. The transport reduction is attributed to the robust invariant tori that occur in nontwist Hamiltonian systems. This mechanism is proposed as an explanation for the transport reduction in Tokamak Chauffage Alfven Bresilien [R. M. O. Galvao , Plasma Phys. Controlled Fusion 43, 1181 (2001)] for discharges with a biased electrode at the plasma edge.