One’s own soundtrack: affective music synthesis

Computer music usually sounds mechanical; hence, if musicality and music expression of virtual actors could be enhanced according to the user’s mood, the quality of experience would be amplified. We present a solution that is based on improvisation using cognitive models, case based reasoning (CBR) and fuzzy values acting on close-to-affect-target musical notes as retrieved from CBR per context. It modifies music pieces according to the interpretation of the user’s emotive state as computed by the emotive input acquisition componential of the CALLAS framework. The CALLAS framework incorporates the Pleasure-Arousal-Dominance (PAD) model that reflects emotive state of the user and represents the criteria for the music affectivisation process. Using combinations of positive and negative states for affective dynamics, the octants of temperament space as specified by this model are stored as base reference emotive states in the case repository, each case including a configurable mapping of affectivisation parameters. Suitable previous cases are selected and retrieved by the CBR subsystem to compute solutions for new cases, affect values from which control the music synthesis process allowing for a level of interactivity that makes way for an interesting environment to experiment and learn about expression in music.

Use of auditory cues for wayfinding assistance in virtual environment: music aids route decision

This paper addresses the crucial problem of wayfinding assistance in the Virtual Environments (VEs). A number of navigation aids such as maps, agents, trails and acoustic landmarks are available to support the user for navigation in VEs, however it is evident that most of the aids are visually dominated. This work-in-progress describes a sound based approach that intends to assist the task of 'route decision' during navigation in a VE using music. Furthermore, with use of musical sounds it aims to reduce the cognitive load associated with other visually as well as physically dominated tasks. To achieve these goals, the approach exploits the benefits provided by music to ease and enhance the task of wayfinding, whilst making the user experience in the VE smooth and enjoyable.

An analysis of verbal responses to music in a group of adult non-specialists

In a workshop setting, two pieces of recorded music were presented to a group of adult non-specialists; a key feature was to set up structured discussion within which the respondents considered each piece of music as a whole and not in its constituent parts. There were two areas of interest, namely to explore whether the respondents were likely to identify the musical features or to make extra-musical associations and, to establish the extent to which there would be commonality and difference in their approach to formulating the verbal responses. An inductive approach was used in the analysis of data to reveal some of the working theories underpinning the intuitive musicianship of the adult non-specialist listener. Findings have shown that, when unprompted by forced choice responses, the listeners generated responses that could be said to be information-poor in terms of musical features but rich in terms of the level of personal investment they made in formulating their responses. This is evidenced in a number of connections they made between the discursive and the non-discursive, including those which are relational and mediated by their experiences. Implications for music education are considered.