Inhabiting Sound: Tactile-sonic links in musical meaning

Connections can be suggested between music’s occupation of physical space, its relative ‘presence’ (using Edward Hall’s notion of proxemics), and the various senses of movement which pervade it. Movement might be seen to operate with respect to music at a variety of levels of metaphorisation – as increasingly complex chains of analogy which point back to our early physical experience of the world. But of course music is, fundamentally, action. Humans put energy into systems - external or internal to themselves - which transduce that energy into the movement of air. At the acoustic level music is, emphatically and unmetaphorically, movement. Perhaps such simple physical perceptions form one route through which we might understand and explore shared senses of meaning and their capacity for ‘transduction’ between multiple individuals. Our (developmentally) early sensory models of the world, built from encounters with its physical resistances and affordances, might be a route to understanding our more clearly encultured and abstracted ('higher' level) understandings of music.

Sound Art in Urban Architecture and Planning: An Introduction

This article will introduce a specially-commissioned edition of the JSS centering on articles developed from the International Symposium May 2014 by the Recomposing the City project.

Movement and Perceptual Strategies to Intercept Virtual Sound Sources

To intercept a moving object, one needs to be in the right place at the right time. In order to do this, it is necessary to pick up and use perceptual information that specifies the time to arrival of an object at an interception point. In the present study, we examined the ability to intercept a laterally moving virtual sound object by controlling the displacement of a sliding handle and tested whether and how the interaural time difference (ITD) could be the main source of perceptual information for successfully intercepting the virtual object. The results revealed that in order to accomplish the task, one might need to vary the duration of the movement, control the hand velocity and time to reach the peak velocity (speed coupling), while the adjustment of movement initiation did not facilitate performance. Furthermore, the overall performance was more successful when subjects employed a time-to-contact (tau) coupling strategy. This result shows that prospective information is available in sound for guiding goal-directed actions.

Participatory Sonic Arts: towards a socially engaged art of sound in the everyday (The Som da Maré Project)

Participatory and socially engaged art practices have, for a couple of decades, emerged a myriad of aesthetic and methodological strategies across different media. These are artistic practices that have a primary interest in participation, affecting social dynamics, dialogue and at times political activism. Nato Thompson in “Living Form: Socially Engaged Art from 1991-2011” surveys these
practices, which range from theatre to urban planning, visual art to healthcare. Linked to notions such as relational aesthetics (Bourriaud, 1998), community art and public art, socially engaged art often focuses on the development of a sense of ownership by the part of participants. If an artist is working truly collaboratively with participants and addressing the reality of a particular community, the long-term effect of a project lies in the process of engagement as well as in the artwork itself. Projects by New York based artist Pablo Helguera, for example, use different media to engage with social inequalities through participative action while rejecting the notion of art for art sake.

“Socially engaged art functions by attaching itself to subjects and problems that normally belong to other disciplines, moving them temporarily into a space of ambiguity. It is this temporary snatching away of subjects into the realm of art-making that brings new insights to a particular problem or condition and in turn makes it visible to other disciplines.” (Helguera, 2011)

Socially engaged practices develop the notion of artwork about or by a community, to work of a community. In this chapter we address how socially engaged, participatory approaches can form a context for the sonic arts, arguably less explored than practices such as theatre and performance art. The use of sound is clearly present in a wide range of socially engaged work (e.g. Helguera’s “Aelia Media” enabling a nomadic radio station in Bologna or Maria Andueza “Immigrant Sounds – Res(on)Art (Stockholm)” exploring ways of sonically resonating a city, or Sue MacCauley’s “The Housing Project” addressing ways of representing the views of urban dwellers on public scape through sound art. It is nevertheless rare to encounter projects which take our experience of sound in the everyday as a trigger for community social engagement in a participatory context.
We address concepts and methodologies behind the project Som da Maré, a participatory sonic arts project in the favelas of Maré, Rio de Janeiro.

Sound Art and Spatial Practices: Situating Sound Installation Art Since 1958

This dissertation examines the emergence and development of sound installation art, an under-recognized tradition that has developed between music, architecture, and media art practices since the late 1950s. Unlike many musical works, which are concerned with organizing sounds in time, sound installations organize sounds in space; they thus necessitate new theoretical and analytical models that take into consideration the spatial situated-ness of sound. Existing discourses on “spatial sound” privilege technical descriptions of sound localization. By contrast, this dissertation examines the ways in which concepts of space are socially, culturally, and politically construed, and how spatially-organized sound works reflect and resist these different constructions. Using an interdisciplinary methodology of critical spatial analysis and critical studies in music, this dissertation explores such topics as: conceptions of acoustic space in postwar Western art music, architecture, and media theory; the development of sound installation art in relation to philosophies of everyday life and social space; the historical links between musical performance, conceptual art, and sound sculpture; the body as a site for sound installations; and sonicspatial strategies that confront politics of race and gender. Through these different investigations, this dissertation proposes an “ontopological” model for considering sound: a critical model of analysis and reception that privileges an understanding of sound in relation to ontologies of space and place.

Stowaway City:Sound Walk

A 20 minute sound walk produced by Emily DeDakis, Isobel Anderson and Garrett Carr. £7000 funding award for this project came from the BBC Legacy Grants 2015. I was CI on this application.

Spatial hearing and sound perception in musical composition

This thesis explores the possibilities of spatial hearing in relation to sound perception, and presents three acousmatic compositions based on a musical aesthetic that emphasizes this relation in musical discourse. The first important characteristic of these compositions is the exclusive use of sine waves and other time invariant sound signals. Even though these types of sound signals present no variations in time, it is possible to perceive pitch, loudness, and tone color variations as soon as they move in space due to acoustic processes involved in spatial hearing. To emphasize the perception of such variations, this thesis proposes to divide a tone in multiple sound units and spread them in space using several loudspeakers arranged around the listener. In addition to the perception of sound attribute variations, it is also possible to create rhythm and texture variations that depend on how sound units are arranged in space. This strategy permits to overcome the so called "sound surrogacy" implicit in acousmatic music, as it is possible to establish cause-effect relations between sound movement and the perception of sound attribute, rhythm, and texture variations. Another important consequence of using sound fragmentation together with sound spatialization is the possibility to produce diffuse sound fields independently from the levels of reverberation of the room, and to create sound spaces with a certain spatial depth without using any kind of artificial sound delay or reverberation.

A Spiking Neural Network Model of the Medial Superior Olive using Spike Timing Dependent Plasticity for Sound Localisation

Sound localization can be defined as the ability to identify the position of an input sound source and is considered a powerful aspect of mammalian perception. For low frequency sounds, i.e., in the range 270 Hz-1.5 KHz, the mammalian auditory pathway achieves this by extracting the Interaural Time Difference between sound signals being received by the left and right ear. This processing is performed in a region of the brain known as the Medial Superior Olive (MSO). This paper presents a Spiking Neural Network (SNN) based model of the MSO. The network model is trained using the Spike Timing Dependent Plasticity learning rule using experimentally observed Head Related Transfer Function data in an adult domestic cat. The results presented demonstrate how the proposed SNN model is able to perform sound localization with an accuracy of 91.82% when an error tolerance of +/-10 degrees is used. For angular resolutions down to 2.5 degrees , it will be demonstrated how software based simulations of the model incur significant computation times. The paper thus also addresses preliminary implementation on a Field Programmable Gate Array based hardware platform to accelerate system performance.

Spiking neural network model of sound localisation using the interaural intensity difference

In this paper, a spiking neural network (SNN) architecture to simulate the sound localization ability of the mammalian auditory pathways using the interaural intensity difference cue is presented. The lateral superior olive was the inspiration for the architecture, which required the integration of an auditory periphery (cochlea) model and a model of the medial nucleus of the trapezoid body. The SNN uses leaky integrateand-fire excitatory and inhibitory spiking neurons, facilitating synapses and receptive fields. Experimentally derived headrelated transfer function (HRTF) acoustical data from adult domestic cats were employed to train and validate the localization ability of the architecture, training used the supervised learning algorithm called the remote supervision method to determine the azimuthal angles. The experimental results demonstrate that the architecture performs best when it is localizing high-frequency sound data in agreement with the biology, and also shows a high degree of robustness when the HRTF acoustical data is corrupted by noise.

Sound Seam

A moving image work based on research with neurologists and audiologists, collectors and archivists. The film gives voice to the idea that every surface, in particular parts of our anatomy, is potentially inscribed with an unheard sound or echoes of voices from the past. The soundtrack’s musical composition is interlaced with a voice-over which draws on Rainer Maria Rilke’s text 'Primal Sound', where he reflects on the possibility of playing the coronal suture of a skull with a phonograph needle. The film uses microscopic photography, scanning electron microscopy, and sounds of otoacoustic emissions to uncover haunting aural bonescapes. The voiceovers too are recorded using old sound technology as a filter - writing and over-writing of wax cylinder to create unexpected scratches, glitches, loops and echoes. Exhibitions: shown as multi-channel sound/film installation AV festival (Newcastle 2010); solo exhibition at Wellcome Collection (London 2010-11); group exhibition ‘Samsung Art+ Prize’ BFI Southbank (London 2012); group exhibition ‘Transcendence’, Gertrude Contemporary, Melbourne (2014); solo exhibition as part of the International Rotterdam Film Festival (2013); group exhibition ‘The Sight of Sound’, Deutsche Bank VIP Lounge, Frieze Art Fair, NY (2012). Screenings: mini-retrospective at the Lincoln Centre, NY, as part of the New York Film Festival (2013); Jarman Award Tour screenings (2012, venues included Whitechapel Gallery, London; FACT, Liverpool; CCA, Glasgow; The Northern Charter in partnership with CIRCA projects; Nottingham Contemporary, Nottingham; Watershed, Bristol; Duke of York Cinema, Brighton), Whitechapel Gallery, London; FACT, Liverpool; CCA, Glasgow; The Northern Charter in partnership with CIRCA projects, Newcastle (special Q&A Aura Satz with Rebecca Shatwell, director of AV festival); Nottingham Contemporary, Nottingham; Watershed, Bristol; Duke of York Cinema, Brighton; Mini-retrospective at Tate Britain (London 2014); Mini-retrospective screening, DIM Cinema, The Cinematheque (Vancouver 2015); Mini-retrospective at Whitechapel Gallery (London 2016). Publications: ‘Sound Seam’ booklet with contributions by Steven Connor and Tom McCarthy (2010).