Using virtual environments for trigger identification in addiction treatment

This paper presents a novel application of virtual environments to assist in encouraging behavior change in individuals who misuse drugs or alcohol. We describe the user-centered design of a series of scenes to engage users in the identification of triggers and to encourage discussions about relevant coping skills. Results from the initial testing of this application with six service users showed variation in user responses. Results also suggested that the system should encourage group discussion and that it was linked to a small improvement in users’ confidence in understanding and identifying triggers.

Investigating music tempo as a feedback mechanism for closed-loop BCI control

The feedback mechanism used in a brain-computer interface (BCI) forms an integral part of the closed-loop learning process required for successful operation of a BCI. However, ultimate success of the BCI may be dependent upon the modality of the feedback used. This study explores the use of music tempo as a feedback mechanism in BCI and compares it to the more commonly used visual feedback mechanism. Three different feedback modalities are compared for a kinaesthetic motor imagery BCI: visual, auditory via music tempo, and a combined visual and auditory feedback modality. Visual feedback is provided via the position, on the y-axis, of a moving ball. In the music feedback condition, the tempo of a piece of continuously generated music is dynamically adjusted via a novel music-generation method. All the feedback mechanisms allowed users to learn to control the BCI. However, users were not able to maintain as stable control with the music tempo feedback condition as they could in the visual feedback and combined conditions. Additionally, the combined condition exhibited significantly less inter-user variability, suggesting that multi-modal feedback may lead to more robust results. Finally, common spatial patterns are used to identify participant-specific spatial filters for each of the feedback modalities. The mean optimal spatial filter obtained for the music feedback condition is observed to be more diffuse and weaker than the mean spatial filters obtained for the visual and combined feedback conditions.

Automated identification of neural correlates of continuous variables

Background: The electroencephalogram (EEG) may be described by a large number of different feature types and automated feature selection methods are needed in order to reliably identify features which correlate with continuous independent variables. New method: A method is presented for the automated identification of features that differentiate two or more groups inneurologicaldatasets basedupona spectraldecompositionofthe feature set. Furthermore, the method is able to identify features that relate to continuous independent variables. Results: The proposed method is first evaluated on synthetic EEG datasets and observed to reliably identify the correct features. The method is then applied to EEG recorded during a music listening task and is observed to automatically identify neural correlates of music tempo changes similar to neural correlates identified in a previous study. Finally,the method is applied to identify neural correlates of music-induced affective states. The identified neural correlates reside primarily over the frontal cortex and are consistent with widely reported neural correlates of emotions. Comparison with existing methods: The proposed method is compared to the state-of-the-art methods of canonical correlation analysis and common spatial patterns, in order to identify features differentiating synthetic event-related potentials of different amplitudes and is observed to exhibit greater performance as the number of unique groups in the dataset increases. Conclusions: The proposed method is able to identify neural correlates of continuous variables in EEG datasets and is shown to outperform canonical correlation analysis and common spatial patterns.

Neural correlates of emotional responses to music: an EEG study

This paper presents an EEG study into the neural correlates of music-induced emotions. We presented participants with a large dataset containing musical pieces in different styles, and asked them to report on their induced emotional responses. We found neural correlates of music-induced emotion in a number of frequencies over the pre-frontal cortex. Additionally, we found a set of patterns of functional connectivity, defined by inter-channel coherence measures,to be significantly different between groups of music-induced emotional responses.

Design of a computerised treatment for short-term memory deficits in aphasia

The treatment of auditory-verbal short-term memory (STM) deficits in aphasia is a growing avenue of research (Martin & Reilly, 2012; Murray, 2012). STM treatment requires time precision, which is suited to computerised delivery. We have designed software, which provides STM treatment for aphasia. The treatment is based on matching listening span tasks (Howard & Franklin, 1990), aiming to improve the temporal maintenance of multi-word sequences (Salis, 2012). The person listens to pairs of word-lists that differ in word-order and decides if the pairs are the same or different. This approach does not require speech output and is suitable for persons with aphasia who have limited or no output. We describe the software and how its review from clinicians shaped its design.

Changes in music tempo entrain movement related brain activity

The neural mechanisms of music listening and appreciation are not yet completely understood. Based on the apparent relationship between the beats per minute (tempo) of music and the desire to move (for example feet tapping) induced while listening to that music it is hypothesised that musical tempo may evoke movement related activity in the brain. Participants are instructed to listen, without moving, to a large range of musical pieces spanning a range of styles and tempos during an electroencephalogram (EEG) experiment. Event-related desynchronisation (ERD) in the EEG is observed to correlate significantly with the variance of the tempo of the musical stimuli. This suggests that the dynamics of the beat of the music may induce movement related brain activity in the motor cortex. Furthermore, significant correlations are observed between EEG activity in the alpha band over the motor cortex and the bandpower of the music in the same frequency band over time. This relationship is observed to correlate with the strength of the ERD, suggesting entrainment of motor cortical activity relates to increased ERD strength

Memo test: standardisation of computerised assessment of auditory verbal short-term memory

Short-term memory (STM) impairments are prevalent in adults with acquired brain injuries. While there are several published tests to assess these impairments, the majority require speech production, e.g. digit span (Wechsler, 1987). This feature may make them unsuitable for people with aphasia and motor speech disorders because of word finding difficulties and speech demands respectively. If patients perceive the speech demands of the test to be high, the may not engage with testing. Furthermore, existing STM tests are mainly ‘pen-and-paper’ tests, which can jeopardise accuracy. To address these shortcomings, we designed and standardised a novel computerised test that does not require speech output and because of the computerised delivery it would enable clinicians identify STM impairments with greater precision than current tests. The matching listening span tasks, similar to the non-normed PALPA 13 (Kay, Lesser & Coltheart, 1992) is used to test short-term memory for serial order of spoken items. Sequences of digits are presented in pairs. The person hears the first sequence, followed by the second sequence and s/he decides whether the two sequences are the same or different. In the computerised test, the sequences are presented in live voice recordings on a portable computer through a software application (Molero Martin, Laird, Hwang & Salis 2013). We collected normative data from healthy older adults (N=22-24) using digits, real words (one- and two-syllables) and non-words (one- and two- syllables). Their performance was scored following two systems. The Highest Span system was the highest span length (e.g. 2-8) at which a participant correctly responded to over 7 out of 10 trials at the highest sequence length. Test re-test reliability was also tested in a subgroup of participants. The test will be available as free of charge for clinicians and researchers to use.

Brain-computer music interfacing for continuous control of musical tempo

A Brain-computer music interface (BCMI) is developed to allow for continuous modification of the tempo of dynamically generated music. Six out of seven participants are able to control the BCMI at significant accuracies and their performance is observed to increase over time.

Dynamic game soundtrack generation in response to a continously varying emotional trajectory

Dynamic soundtracking presents various practical and aesthetic challenges to composers working with games. This paper presents an implementation of a system addressing some of these challenges with an affectively-driven music generation algorithm based on a second order Markov-model. The system can respond in real-time to emotional trajectories derived from 2-dimensions of affect on the circumplex model (arousal and valence), which are mapped to five musical parameters. A transition matrix is employed to vary the generated output in continuous response to the affective state intended by the gameplay.

Sensory stories

Sensory Objects researchers and co-researchers, people with learning disabilities from Liverpool Mencap Access to Heritage Group presented thier interactive sensory objects made for the National Trust Speke Hall.

Seminar: sensory stories retold

The Sensory Stories Retold seminar showcased the first year of the Sensory Objects project, which was based at Speke Hall, a National Trust house in Liverpool. The research team presented their work with interactive demonstrations of their sensory objects and a hands-on workshop for attendees to try making their own. The day featured a discussion led by Marcus Weisen (Jodi Mattes Trust), and a presentation by Ticky Lowe (Access to Heritage) about the Jodi Award Winning Touch Pods project. The event provided an opportunity for 65 museum curators, researchers and disability professionals to discuss and explore museum and heritage engagement, the potential of sensory art-based workshops, the use of electronics in museum interpretation, and multimedia advocacy.

Buckets, baskets and boots: exhibition event at MERL

Launch event part of Universities Week on Monday 9th Co-researchers from Reading College Learners with Learning Difficulties/Disabilities dept will present their Sensory Objects research in the Museum of English Rural Life (MERL)

Seminar: sensory objects in progress

Researchers and Co-researchers present talks and demonstrations about the Sensory Objects project to 65 people on Tuesday 10th of June, the Seminar is part of Universities Week.

Interactive sensory objects for and by people with learning disabilities

This project engages people with learning disabilities to participate as co-researchers and explore museum interpretation through multisensory workshops using microcontrollers and sensors to enable alternative interactive visitor experiences in museums and heritage sites. This article describes how the project brings together artists, engineers, and experts in multimedia advocacy, as well as people with learning disabilities in the co-design of interactive multisensory objects that replicate or respond to objects of cultural significance in our national collections. Through a series of staged multi-sensory art and electronics workshops, people with learning disabilities explore how the different senses could be utilised to augment existing artefacts or create entirely new ones. The co-researchers employ multimedia advocacy tools to reflect on and to communicate their experiences and findings.

Sensory objects at the British Museum

The Sensory Objects project creates multisensory interactive artworks that respond to museum collections and generate alternative ideas for museum interpretation.