Towards an emotion-driven interactive music system: ridging the gaps between affect, physiology and sound generation

Report for the scientific sojourn at the Stanford University from January until June 2007. Music is well known for affecting human emotional states, yet the relationship between specific musical parameters and emotional responses is still not clear. With the advent of new human-computer interaction (HCI) technologies, it is now possible to derive emotion-related information from physiological data and use it as an input to interactive music systems. Providing such implicit musical HCI will be highly relevant for a number of applications including music therapy, diagnosis, nteractive gaming, and physiologically-based musical instruments. A key question in such physiology-based compositions is how sound synthesis parameters can be mapped to emotional states of valence and arousal. We used both verbal and heart rate responses to evaluate the affective power of five musical parameters. Our results show that a significant correlation exists between heart rate and the subjective evaluation of well-defined musical parameters. Brightness and loudness showed to be arousing parameters on subjective scale while harmonicity and even partial attenuation factor resulted in heart rate changes typically associated to valence. This demonstrates that a rational approach to designing emotion-driven music systems for our public installations and music therapy applications is possible.

Long-term fluctuation of relative afferent pupillary defect in subjects with normal visual function.

PURPOSE: To determine whether the relative afferent pupillary defect (RAPD) remains constant over time in normal subjects. METHODS: Seventeen normal subjects were tested with infrared pupillography and automated perimetry in four sessions over 3 years. The changes in RAPD and visual field asymmetry between testing sessions were compared. RESULTS: The range of RAPD was 0.0 to 0.3 log unit, and the difference in the mean deviation between the eyes on automated static perimetry was 0 to 3 dB. Eight subjects repeatedly had an RAPD in the same eye. There was no correlation between the RAPD and the visual field asymmetry at the same visit. Changes in the magnitude of the RAPD between any two sessions were typically small (median, 0.08 log unit; 25th percentile, 0.04 log unit; 75th percentile, 0.15 log unit). CONCLUSIONS: Some normal subjects may show a persistent but small RAPD in the absence of detectable pathologic disease. Therefore, an isolated RAPD in the range of 0.3 log unit that is not associated with any other significant historical or clinical finding should probably be considered benign.

Accurate performance of a rat model of schizophrenia in the water maze depends on visual cue availability and stability: a distortion in cognitive mapping abilities?

Rats were treated postnatally (PND 5-16) with BSO (l-buthionine-(S,R)-sulfoximine) in an animal model of schizophrenia based on transient glutathione deficit. The BSO treated rats were impaired in patrolling a maze or a homing table when adult, yet demonstrated preserved escape learning, place discrimination and reversal in a water maze task [37]. In the present work, BSO rats' performance in the water maze was assessed in conditions controlling for the available visual cues. First, in a completely curtained environment with two salient controlled cues, BSO rats showed little accuracy compared to control rats. Secondly, pre-trained BSO rats were impaired in reaching the familiar spatial position when curtains partially occluded different portions of the room environment in successive sessions. The apparently preserved place learning in a classical water maze task thus appears to require the stability and the richness of visual landmarks from the surrounding environment. In other words, the accuracy of BSO rats in place and reversal learning is impaired in a minimal cue condition or when the visual panorama changes between trials. However, if the panorama remains rich and stable between trials, BSO rats are equally efficient in reaching a familiar position or in learning a new one. This suggests that the BSO accurate performance in the water maze does not satisfy all the criteria for a cognitive map based navigation on the integration of polymodal cues. It supports the general hypothesis of a binding deficit in BSO rats.

Visual binding abilities in the initial and advanced stages of schizophrenia

OBJECTIVE: The study tests the hypothesis that intramodal visual binding is disturbed in schizophrenia and should be detectable in all illness stages as a stable trait marker. METHOD: Three groups of patients (rehospitalized chronic schizophrenic, first admitted schizophrenic and schizotypal patients believed to be suffering from a pre-schizophrenic prodrome) and a group of normal control subjects were tested on three tasks targeting visual 'binding' abilities (Muller-Lyer's illusion and two figure detection tasks) in addition to control parameters such as reaction time, visual selective attention, Raven's test and two conventional cortical tasks of spatial working memory (SWM) and a global local test. RESULTS: Chronic patients had a decreased performance on the binding tests. Unexpectedly, the prodromal group exhibited an enhanced Gestalt extraction on these tests compared both to schizophrenic patients and to healthy subjects. Furthermore, chronic schizophrenia was associated with a poor performance on cortical tests of SWM, global local and on Raven. This association appears to be mediated by or linked to the chronicity of the illness. CONCLUSION: The study confirms a variety of neurocognitive deficits in schizophrenia which, however, in this sample seem to be linked to chronicity of illness. However, certain aspects of visual processing concerned with Gestalt extraction deserve attention as potential vulnerability- or prodrome- indicators. The initial hypothesis of the study is rejected.

Impacte visual aeri a Argentona

Treball de recerca realitzat per un alumne d'ensenyament secundari i guardonat amb un Premi CIRIT per fomentar l'esperit cientí­fic del Jovent l'any 2009. Aquest treball té com a finalitat millorar l'entorn aeri d'Argentona, un poble situat a la comarca del Maresme. Els elements que creen més impacte visual aeri són les antenes en desús i el cablejat no soterrat. S'han buscat propostes per canviar aquesta situació: la retirada de les antenes, aprofitant l'arribada de la TDT, i el soterrament del cablejat aeri. Donat que ambdues accions afectarien al municipi i a la seva població, s'ha considerat necessari incloure una enquesta, per a conèixer l'opinió dels argentonins, i dues entrevistes, a l'alcalde i a l'enginyer municipal, per conèixer la postura oficial.

The Visual Dysphagia Questionnaire: Piloting a New Tool for Assessing Food Consistency-Dependent Dysphagia in Eosinophilic Esophagitis

Background and Aims: The international EEsAI study group is currently developing the first activity index specific for Eosinophilic Esophagitis (EoE). None of the existing dysphagia questionnaires takes into account the consistency of the ingested food that considerably impacts the symptom presentation. Goal: To develop an EoE-specific questionnaire assessing dysphagia associated with different food consistencies. Methods: Based on patient chart reviews, an expert panel (EEsAI study group) identified internationally standardized food prototypes typically associated with EoE-related dysphagia. Food consistencies were correlated with EoE-related dysphagia, also considering potential food avoidance. This Visual Dysphagia Questionnaire (VDQ) was then tested, as a pilot, in 10 EoE patients. Results: The following 9 food consistency prototypes were identified: water, soft foods (pudding, jelly), grits, toast bread, French fries, dry rice, ground meat, raw fibrous foods (eg. apple, carrot), solid meat. Dysphagia was ranked on a 5-point Likert scale (0=no difficulties, 5=very severe difficulties, food will not pass). Severity of dysphagia in the 10 EoE patients was related to the eosinophil load and presence of esophageal strictures. Conclusions: The VDQ will be the first EoE-specific tool for assessing dysphagia related to internationally defined food consistencies. It performed well in a pilot study and will now be further evaluated in a cohort study including 100 adult and 100 pediatric EoE patients.

Impaired early visual response modulations to spatial information in chronic schizophrenia.

Early visual processing stages have been demonstrated to be impaired in schizophrenia patients and their first-degree relatives. The amplitude and topography of the P1 component of the visual evoked potential (VEP) are both affected; the latter of which indicates alterations in active brain networks between populations. At least two issues remain unresolved. First, the specificity of this deficit (and suitability as an endophenotype) has yet to be established, with evidence for impaired P1 responses in other clinical populations. Second, it remains unknown whether schizophrenia patients exhibit intact functional modulation of the P1 VEP component; an aspect that may assist in distinguishing effects specific to schizophrenia. We applied electrical neuroimaging analyses to VEPs from chronic schizophrenia patients and healthy controls in response to variation in the parafoveal spatial extent of stimuli. Healthy controls demonstrated robust modulation of the VEP strength and topography as a function of the spatial extent of stimuli during the P1 component. By contrast, no such modulations were evident at early latencies in the responses from patients with schizophrenia. Source estimations localized these deficits to the left precuneus and medial inferior parietal cortex. These findings provide insights on potential underlying low-level impairments in schizophrenia.

Sacred Music, Sacred Journeys : What Makes an Event Postcolonial?

Fanon, Senghor, and Ela took a radical stance in criticising the structures and mechanisms of power in hegemonic situations and relations between colonial subjects and colonial masters. They aimed to liberate African societies by decolonising the mind, culture and religion of colonial subjects. In this respect, we are concerned with the continuities and ruptures of the colonial encounter and its unequal relationships. Switzerland does not have an official colonial history and yet, Swiss companies and migrants were and are part of the world's colonies. In our contribution, we question what makes an event postcolonial : in other words, how are postcolonial relations negotiated in Switzerland? We discuss this question by analysing two annual sacred journeys in Switzerland that have been invented for and by African Christians (clerics and laity) together with the leaders of the Swiss Catholic church : one to the relics of African saints in St. Maurice, canton Valais and the other to the Black Madonna, the Virgin Mary of Einsiedeln, in the canton Schwyz. These events are empowered by the performance of African choirs - their music, dance, and costumes - but to which end and in which way?

Imaginarios visuales. Espacios de representación en la comunicación visual: el cartelismo en sus orígenes

El present treball de recerca estudia l'evolució del cartell com a mitjà de comunicació des de finals del segle XIX fins a mitjans del XX. En el transcurs d'aquest anàlisi es posa de manifest la importància que va tenir aquest mitjà per a la transmissió ideològica en els nivells artístic, publicitari i de propaganda política. Considerarem els múltiples moviments artístics apareguts en aquest període històric, que van constituir innovadores fonts d'inspiració, una influència que s'estén fins als nostres dies. El cartell treu a l'art dels museus i el converteix en un producte de consum quotidià al voltant del món, gràcies a múltiples artistes, tant coneguts com desconeguts, i la seva creativitat impregna tots els objectes que ens envolten. És a través del recorregut històric que proposem, quan ens descobrim com a espectadors i protagonistes de la major revolució artística que ha existit en els dos últims segles.

Hyperventilation in anticipatory music performance anxiety

Objectives and Methods: Self-report studies have shown an association between music performance anxiety (MPA) and hyperventilation complaints. However, hyperventilation was never assessed physiologically in MPA. This study investigated the self-reported affective experience, self-reported physiological symptoms, and cardiorespiratory variables including partial pressure of end-tidal CO(2) (Petco(2)), which is an indicator for hyperventilation, in 67 music students before a private and a public performance. The response coherence between these response domains was also investigated.ResultsFrom the private to the public session, the intensity of all self-report variables increased (all p values < .001). As predicted, the higher the musician's usual MPA level, the larger were these increases (p values < .10). With the exception of Petco(2), the main cardiorespiratory variables also increased from the private to the public session (p values < .05). These increases were not modulated by the usual MPA level (p values > .10). Petco(2) showed a unique response pattern reflected by an MPA-by-session interaction (p < .01): it increased from the private to the public session for musicians with low MPA levels and decreased for musicians with high MPA levels. Self-reported physiological symptoms were related to the self-reported affective experience (p values < .05) rather than to physiological measures (p values > .17).ConclusionsThese findings show for the first time how respiration is stimulated before a public performance in music students with different MPA levels. The hypothesis of a hyperventilation tendency in high-performance-anxious musicians is supported. The response coherence between physiological symptoms and physiological activation is weak.

Functional mapping of the human visual cortex with intravoxel incoherent motion MRI.

Functional imaging with intravoxel incoherent motion (IVIM) magnetic resonance imaging (MRI) is demonstrated. Images were acquired at 3 Tesla using a standard Stejskal-Tanner diffusion-weighted echo-planar imaging sequence with multiple b-values. Cerebro-spinal fluid signal, which is highly incoherent, was suppressed with an inversion recovery preparation pulse. IVIM microvascular perfusion parameters were calculated according to a two-compartment (vascular and non-vascular) diffusion model. The results obtained in 8 healthy human volunteers during visual stimulation are presented. The IVIM blood flow related parameter fD* increased 170% during stimulation in the visual cortex, and 70% in the underlying white matter.

ATiPAP : desenvolupament de materials docents amb suport multimedia pels continguts d'Atenció, Percepció Auditiva i de la Parla adaptats als crédits ECTS i a l'EEES dins l'ensenyament de Psicologia

El projecte ha permès finançar el suport tècnic necessari per a poder desenvolupar materials informatitzats corresponents a activitats teòrico-pràctiques de l’assignatura troncal de la llicenciatura de Psicologia (actualment també en el Grau) “Percepció i Atenció”. Els materials desenvolupats corresponen a diferents punts del programa de l’assignatura i són els següents: demostració de la tècnica d’ombrejat per l’anàlisi de l’atenció focalitzada; parpelleig atencional en sèries de presentacions ràpides d’informació visual (RSVP); canvis encoberts de l’atenció i el mecanisme d’inhibició de retorn; efectes dels filtrats sobre la percepció de la parla i la música; il·lusions auditives i els principis d’organització de la informació sonora complexa; la percepció categòrica dels sons de la parla i la naturalesa continua del processament lèxic (paradigma d’obertura successiva o gating). Per totes aquelles activitats amb continguts de llenguatge, s’han desenvolupat dues versions equivalents, catalana i castellana, per permetre que els estudiants fessin la pràctica en la seva llengua dominant. A la primera fase del projecte, al llarg del curs 2006-07, es van preparar els materials i la programació de les diferents pràctiques i es van poder identificar alguns problemes que es van solucionar posteriorment. En el curs 2007-08 totes les activitats de pràctiques ja es van fer accessibles als estudiants (Plataforma Moodle, Campus Virtual) i la valoració sobre el seu funcionament, feta pels estudiants mitjançant qüestionaris, va ser satisfactòria en més d’un 95% dels casos (els únics problemes detectats estaven relacionats amb les característiques dels ordinadors del usuaris i del navegador utilitzat per accedir als materials). La valoració de les activitats per part dels estudiants va ser globalment positiva i, en el seu ús continuat al llarg dels cursos 2008-09 i 2009-10, s’ha observat una participació creixent (accés voluntari a les activitats) i un aprofitament millor de la informació presentada, que es tradueix en millores en les puntuacions obtingudes en les avaluacions de l'assignatura.