Towards an emotion-driven interactive music system: ridging the gaps between affect, physiology and sound generation

Report for the scientific sojourn at the Stanford University from January until June 2007. Music is well known for affecting human emotional states, yet the relationship between specific musical parameters and emotional responses is still not clear. With the advent of new human-computer interaction (HCI) technologies, it is now possible to derive emotion-related information from physiological data and use it as an input to interactive music systems. Providing such implicit musical HCI will be highly relevant for a number of applications including music therapy, diagnosis, nteractive gaming, and physiologically-based musical instruments. A key question in such physiology-based compositions is how sound synthesis parameters can be mapped to emotional states of valence and arousal. We used both verbal and heart rate responses to evaluate the affective power of five musical parameters. Our results show that a significant correlation exists between heart rate and the subjective evaluation of well-defined musical parameters. Brightness and loudness showed to be arousing parameters on subjective scale while harmonicity and even partial attenuation factor resulted in heart rate changes typically associated to valence. This demonstrates that a rational approach to designing emotion-driven music systems for our public installations and music therapy applications is possible.

MART-1 peptide vaccination plus IMP321 (LAG-3Ig fusion protein) in patients receiving autologous PBMCs after lymphodepletion: results of a Phase I trial.

BACKGROUND: Immunotherapy offers a promising novel approach for the treatment of cancer and both adoptive T-cell transfer and immune modulation lead to regression of advanced melanoma. However, the potential synergy between these two strategies remains unclear. METHODS: We investigated in 12 patients with advanced stage IV melanoma the effect of multiple MART-1 analog peptide vaccinations with (n = 6) or without (n = 6) IMP321 (LAG-3Ig fusion protein) as an adjuvant in combination with lymphodepleting chemotherapy and adoptive transfer of autologous PBMCs at day (D) 0 (Trial registration No: NCT00324623). All patients were selected on the basis of ex vivo detectable MART-1-specific CD8 T-cell responses and immunized at D0, 8, 15, 22, 28, 52, and 74 post-reinfusion. RESULTS: After immunization, a significant expansion of MART-1-specific CD8 T cells was measured in 83% (n = 5/6) and 17% (n = 1/6) of patients from the IMP321 and control groups, respectively (P < 0.02). Compared to the control group, the mean fold increase of MART-1-specific CD8 T cells in the IMP321 group was respectively >2-, >4- and >6-fold higher at D15, D30 and D60 (P < 0.02). Long-lasting MART-1-specific CD8 T-cell responses were significantly associated with IMP321 (P < 0.02). At the peak of the response, MART-1-specific CD8 T cells contained higher proportions of effector (CCR7⁻ CD45RA⁺/⁻) cells in the IMP321 group (P < 0.02) and showed no sign of exhaustion (i.e. were mostly PD1⁻CD160⁻TIM3⁻LAG3⁻2B4⁺/⁻). Moreover, IMP321 was associated with a significantly reduced expansion of regulatory T cells (P < 0.04); consistently, we observed a negative correlation between the relative expansion of MART-1-specific CD8 T cells and of regulatory T cells. Finally, although there were no confirmed responses as per RECIST criteria, a transient, 30-day partial response was observed in a patient from the IMP321 group. CONCLUSIONS: Vaccination with IMP321 as an adjuvant in combination with lymphodepleting chemotherapy and adoptive transfer of autologous PBMCs induced more robust and durable cellular antitumor immune responses, supporting further development of IMP321 as an adjuvant for future immunotherapeutic strategies.

Fusion of Multi-Atlas Segmentations with Spatial Distribution Modeling

In recent years, multi-atlas fusion methods have gainedsignificant attention in medical image segmentation. Inthis paper, we propose a general Markov Random Field(MRF) based framework that can perform edge-preservingsmoothing of the labels at the time of fusing the labelsitself. More specifically, we formulate the label fusionproblem with MRF-based neighborhood priors, as an energyminimization problem containing a unary data term and apairwise smoothness term. We present how the existingfusion methods like majority voting, global weightedvoting and local weighted voting methods can be reframedto profit from the proposed framework, for generatingmore accurate segmentations as well as more contiguoussegmentations by getting rid of holes and islands. Theproposed framework is evaluated for segmenting lymphnodes in 3D head and neck CT images. A comparison ofvarious fusion algorithms is also presented.

Dynamin-SNARE interactions control trans-SNARE formation in intracellular membrane fusion.

The fundamental processes of membrane fission and fusion determine size and copy numbers of intracellular organelles. Although SNARE proteins and tethering complexes mediate intracellular membrane fusion, fission requires the presence of dynamin or dynamin-related proteins. Here we study these reactions in native yeast vacuoles and find that the yeast dynamin homologue Vps1 is not only an essential part of the fission machinery, but also controls membrane fusion by generating an active Qa SNARE-tethering complex pool, which is essential for trans-SNARE formation. Our findings provide new insight into the role of dynamins in membrane fusion by directly acting on SNARE proteins.

Force-induced globule-coil transition in laminin binding protein and its role for viral-cell membrane fusion.

The specific interactions of the pairs laminin binding protein (LBP)-purified tick-borne encephalitis viral surface protein E and certain recombinant fragments of this protein, as well as West Nile viral surface protein E and certain recombinant fragments of that protein, are studied by combined methods of single-molecule dynamic force spectroscopy (SMDFS), enzyme immunoassay and optical surface waves-based biosensor measurements. The experiments were performed at neutral pH (7.4) and acid pH (5.3) conditions. The data obtained confirm the role of LBP as a cell receptor for two typical viral species of the Flavivirus genus. A comparison of these data with similar data obtained for another cell receptor of this family, namely human αVβ3 integrin, reveals that both these receptors are very important. Studying the specific interaction between the cell receptors in question and specially prepared monoclonal antibodies against them, we could show that both interaction sites involved in the process of virus-cell interaction remain intact at pH 5.3. At the same time, for these acid conditions characteristic for an endosome during flavivirus-cell membrane fusion, SMDFS data reveal the existence of a force-induced (effective already for forces as small as 30-70 pN) sharp globule-coil transition for LBP and LBP-fragments of protein E complexes. We argue that this conformational transformation, being an analog of abrupt first-order phase transition and having similarity with the famous Rayleigh hydrodynamic instability, might be indispensable for the flavivirus-cell membrane fusion process. Copyright © 2014 John Wiley & Sons, Ltd.

Sacred Music, Sacred Journeys : What Makes an Event Postcolonial?

Fanon, Senghor, and Ela took a radical stance in criticising the structures and mechanisms of power in hegemonic situations and relations between colonial subjects and colonial masters. They aimed to liberate African societies by decolonising the mind, culture and religion of colonial subjects. In this respect, we are concerned with the continuities and ruptures of the colonial encounter and its unequal relationships. Switzerland does not have an official colonial history and yet, Swiss companies and migrants were and are part of the world's colonies. In our contribution, we question what makes an event postcolonial : in other words, how are postcolonial relations negotiated in Switzerland? We discuss this question by analysing two annual sacred journeys in Switzerland that have been invented for and by African Christians (clerics and laity) together with the leaders of the Swiss Catholic church : one to the relics of African saints in St. Maurice, canton Valais and the other to the Black Madonna, the Virgin Mary of Einsiedeln, in the canton Schwyz. These events are empowered by the performance of African choirs - their music, dance, and costumes - but to which end and in which way?

Hyperventilation in anticipatory music performance anxiety

Objectives and Methods: Self-report studies have shown an association between music performance anxiety (MPA) and hyperventilation complaints. However, hyperventilation was never assessed physiologically in MPA. This study investigated the self-reported affective experience, self-reported physiological symptoms, and cardiorespiratory variables including partial pressure of end-tidal CO(2) (Petco(2)), which is an indicator for hyperventilation, in 67 music students before a private and a public performance. The response coherence between these response domains was also investigated.ResultsFrom the private to the public session, the intensity of all self-report variables increased (all p values < .001). As predicted, the higher the musician's usual MPA level, the larger were these increases (p values < .10). With the exception of Petco(2), the main cardiorespiratory variables also increased from the private to the public session (p values < .05). These increases were not modulated by the usual MPA level (p values > .10). Petco(2) showed a unique response pattern reflected by an MPA-by-session interaction (p < .01): it increased from the private to the public session for musicians with low MPA levels and decreased for musicians with high MPA levels. Self-reported physiological symptoms were related to the self-reported affective experience (p values < .05) rather than to physiological measures (p values > .17).ConclusionsThese findings show for the first time how respiration is stimulated before a public performance in music students with different MPA levels. The hypothesis of a hyperventilation tendency in high-performance-anxious musicians is supported. The response coherence between physiological symptoms and physiological activation is weak.

Music identification

L'evolució ens els últims decennis de les possibilitats relacionades amb les tecnologies de la informació han provocat l'aparició de diferents camps, entre ells l'anomenat “recuperació de música basant-se en el contingut”, que tracta de calcular la similitud entre diferents sons. En aquest projecte hem fet una recerca sobre els diferents mètodes que existeixen avui en dia, i posteriorment n'hem comparat tres, un basat en característiques del so, un basat en la transformada discreta del cosinus, i un que combina els dos anteriors. Els resultats han mostrat, que el basat en la transformada de Fourier és el més fiable.

On the writer identification in old handwritten music scores

Report for the scientific sojourn at the University of Bern, Swiss, from Mars until June 2008. Writer identification consists in determining the writer of a piece of handwriting from a set of writers. Even though an important amount of compositions contains handwritten text in the music scores, the aim of the work is to use only music notation to determine the author. It’s been developed two approaches for writer identification in old handwritten music scores. The methods proposed extract features from every music line, and also features from a texture image of music symbols. First of all, the music sheet is first preprocessed for obtaining a binarized music score without the staff lines. The classification is performed using a k-NN classifier based on Euclidean distance. The proposed method has been tested on a database of old music scores from the 17th to 19th centuries, achieving encouraging identification rates.

An mRNA region of the canine distemper virus fusion protein gene lacking AUG codons can promote protein expression.

Canine distemper virus (CDV) produces a glycosylated type I fusion protein (F) with an internal hydrophobic signal sequence beginning around 115 residues downstream of the first AUG used for translation initiation. Cleavage of the signal sequence yields the F0 molecule, which is cleaved into the F1 and F2 subunits. Surprisingly, when all in-frame AUGs located in the first third of the F gene were mutated a protein of the same molecular size as the F0 molecule was still expressed from both the Onderstepoort (OP) and A75/17-CDV F genes. We designated this protein, which is initiated from a non-AUG codon protein Fx. Site-directed mutagenesis allowed to identify codon 85, a GCC codon coding for alanine, as the most likely position from which translation initiation of Fx occurs in OP-CDV. Deletion analysis demonstrated that at least 60 nucleotides upstream of the GCC codon are required for efficient Fx translation. This sequence is GC-rich, suggesting extensive folding. Secondary structure may therefore be important for translation initiation at codon 85.

A multi-perspective approach to performance anxiety in music students

AbstractPerforming publicly has become increasingly important in a variety of professions. This condition is associated with performance anxiety in almost all performers. Whereas some performers successfully cope with this anxiety, for others it represents a major problem and even threatens their career. Musicians and especially music students were shown to be particularly affected by performance anxiety.Therefore, the goal of this PhD thesis was to gain a better understanding of performance anxiety in university music students. More precisely, the first part of this thesis aimed at increasing knowledge on the occurrence, the experience, and the management of performance anxiety (Article 1). The second part aimed at investigating the hypothesis that there is an underlying hyperventilation problem in musicians with a high level of anxiety before a performance. This hypothesis was addressed in two ways: firstly, by investigating the association between the negative affective dimension of music performance anxiety (MPA) and self-perceived physiological symptoms that are known to co-occur with hyperventilation (Article 2) and secondly, by analyzing this association on the physiological level before a private (audience-free) and a public performance (Article 3). Article 4 places some key variables of Article 3 in a larger context by jointly analyzing the phases before, during, and after performing.The main results of the self-report data show (a) that stage fright is experienced as a problem by one-third of the surveyed students, (b) that the students express a considerable need for more help to better cope with it, and (c) that there is a positive association between negative feelings of MPA and the self-reported hyperventilation complaints before performing. This latter finding was confirmed on the physiological level in a tendency of particularly high performance-anxious musicians to hyperventilate. Furthermore, the psycho-physiological activation increased from a private to a public performance, and was higher during the performances than before or after them. The physiological activation was mainly independent of the MPA score. Finally, there was a low response coherence between the actual physiological activation and the self-reports on the instantaneous anxiety, tension, and perceived physiological activation.Given the high proportion of music students who consider stage fright as a problem and given the need for more help to better cope with it, a better understanding of this phenomenon and its inclusion in the educational process is fundamental to prevent future occupational problems. On the physiological level, breathing exercises might be a good means to decrease - but also to increase - the arousal associated with a public performance in order to meet an optimal level of arousal needed for a good performance.

Surface registration from range image fusion

The registration of full 3-D models is an important task in computer vision. Range finders only reconstruct a partial view of the object. Many authors have proposed several techniques to register 3D surfaces from multiple views in which there are basically two aspects to consider. First, poor registration in which some sort of correspondences are established. Second, accurate registration in order to obtain a better solution. A survey of the most common techniques is presented and includes experimental results of some of them