Changes in music tempo entrain movement related brain activity

The neural mechanisms of music listening and appreciation are not yet completely understood. Based on the apparent relationship between the beats per minute (tempo) of music and the desire to move (for example feet tapping) induced while listening to that music it is hypothesised that musical tempo may evoke movement related activity in the brain. Participants are instructed to listen, without moving, to a large range of musical pieces spanning a range of styles and tempos during an electroencephalogram (EEG) experiment. Event-related desynchronisation (ERD) in the EEG is observed to correlate significantly with the variance of the tempo of the musical stimuli. This suggests that the dynamics of the beat of the music may induce movement related brain activity in the motor cortex. Furthermore, significant correlations are observed between EEG activity in the alpha band over the motor cortex and the bandpower of the music in the same frequency band over time. This relationship is observed to correlate with the strength of the ERD, suggesting entrainment of motor cortical activity relates to increased ERD strength

Memo test: standardisation of computerised assessment of auditory verbal short-term memory

Short-term memory (STM) impairments are prevalent in adults with acquired brain injuries. While there are several published tests to assess these impairments, the majority require speech production, e.g. digit span (Wechsler, 1987). This feature may make them unsuitable for people with aphasia and motor speech disorders because of word finding difficulties and speech demands respectively. If patients perceive the speech demands of the test to be high, the may not engage with testing. Furthermore, existing STM tests are mainly ‘pen-and-paper’ tests, which can jeopardise accuracy. To address these shortcomings, we designed and standardised a novel computerised test that does not require speech output and because of the computerised delivery it would enable clinicians identify STM impairments with greater precision than current tests. The matching listening span tasks, similar to the non-normed PALPA 13 (Kay, Lesser & Coltheart, 1992) is used to test short-term memory for serial order of spoken items. Sequences of digits are presented in pairs. The person hears the first sequence, followed by the second sequence and s/he decides whether the two sequences are the same or different. In the computerised test, the sequences are presented in live voice recordings on a portable computer through a software application (Molero Martin, Laird, Hwang & Salis 2013). We collected normative data from healthy older adults (N=22-24) using digits, real words (one- and two-syllables) and non-words (one- and two- syllables). Their performance was scored following two systems. The Highest Span system was the highest span length (e.g. 2-8) at which a participant correctly responded to over 7 out of 10 trials at the highest sequence length. Test re-test reliability was also tested in a subgroup of participants. The test will be available as free of charge for clinicians and researchers to use.

Brain-computer music interfacing for continuous control of musical tempo

A Brain-computer music interface (BCMI) is developed to allow for continuous modification of the tempo of dynamically generated music. Six out of seven participants are able to control the BCMI at significant accuracies and their performance is observed to increase over time.

Dynamic game soundtrack generation in response to a continously varying emotional trajectory

Dynamic soundtracking presents various practical and aesthetic challenges to composers working with games. This paper presents an implementation of a system addressing some of these challenges with an affectively-driven music generation algorithm based on a second order Markov-model. The system can respond in real-time to emotional trajectories derived from 2-dimensions of affect on the circumplex model (arousal and valence), which are mapped to five musical parameters. A transition matrix is employed to vary the generated output in continuous response to the affective state intended by the gameplay.

Sensory stories

Sensory Objects researchers and co-researchers, people with learning disabilities from Liverpool Mencap Access to Heritage Group presented thier interactive sensory objects made for the National Trust Speke Hall.

Seminar: sensory stories retold

The Sensory Stories Retold seminar showcased the first year of the Sensory Objects project, which was based at Speke Hall, a National Trust house in Liverpool. The research team presented their work with interactive demonstrations of their sensory objects and a hands-on workshop for attendees to try making their own. The day featured a discussion led by Marcus Weisen (Jodi Mattes Trust), and a presentation by Ticky Lowe (Access to Heritage) about the Jodi Award Winning Touch Pods project. The event provided an opportunity for 65 museum curators, researchers and disability professionals to discuss and explore museum and heritage engagement, the potential of sensory art-based workshops, the use of electronics in museum interpretation, and multimedia advocacy.

Buckets, baskets and boots: exhibition event at MERL

Launch event part of Universities Week on Monday 9th Co-researchers from Reading College Learners with Learning Difficulties/Disabilities dept will present their Sensory Objects research in the Museum of English Rural Life (MERL)

Seminar: sensory objects in progress

Researchers and Co-researchers present talks and demonstrations about the Sensory Objects project to 65 people on Tuesday 10th of June, the Seminar is part of Universities Week.

Interactive sensory objects for and by people with learning disabilities

This project engages people with learning disabilities to participate as co-researchers and explore museum interpretation through multisensory workshops using microcontrollers and sensors to enable alternative interactive visitor experiences in museums and heritage sites. This article describes how the project brings together artists, engineers, and experts in multimedia advocacy, as well as people with learning disabilities in the co-design of interactive multisensory objects that replicate or respond to objects of cultural significance in our national collections. Through a series of staged multi-sensory art and electronics workshops, people with learning disabilities explore how the different senses could be utilised to augment existing artefacts or create entirely new ones. The co-researchers employ multimedia advocacy tools to reflect on and to communicate their experiences and findings.

Sensory objects at the British Museum

The Sensory Objects project creates multisensory interactive artworks that respond to museum collections and generate alternative ideas for museum interpretation.

Seminar: sensory objects

Seminar exploring the Sensory Objects Project at the British Museum for 65 delegates.

Workshop: sensory objects

The Sensory Objects project was represented by co-researchers Judith Appiah and Tim Elson supported by Beverley Agard from the Tower Project, who co-presented with Nic and Kate at ENGAGE 2014 conference in Bristol.

Seminar: access all areas

Sensory Objects presented their research and their Sensory Labels for the British Museum at a seminar called Access All Areas organised by the Visitor Users Group.

Interactive sensory objects for and by people with learning disabilities

This project engages people with learning disabilities to participate as co-researchers and explore museum interpretation through multisensory workshops using microcontrollers and sensors to enable alternative interactive visitor experiences in museums and heritage sites. This article describes how the project brings together artists, engineers, and experts in multimedia advocacy, as well as people with learning disabilities in the co-design of interactive multisensory objects that replicate or respond to objects of cultural significance in our national collections. Through a series of staged multi-sensory art and electronics workshops, people with learning disabilities explore how the different senses could be utilised to augment existing artefacts or create entirely new ones. The co-researchers employ multimedia advocacy tools to reflect on and to communicate their experiences and findings.