Digital Musical Interactions: Performer-System Relationships and their Perception by Spectators

This article adopts an ecological view of digital musical interactions, first considering the relationship between performers and digital systems, and then spectators’ perception of these interactions. We provide evidence that the relationships between performers and digital music systems are not necessarily instrumental in the same was as they are with acoustic systems, and nor should they always strive to be. Furthermore, we report results of a study suggesting that spectators may not perceive such interactions in the same way as performances with musical instruments. We present implications for the design of digital musical interactions, suggesting that designers should embrace the reality that digital systems are malleable and dynamic, and may engage performers and spectators in different modalities, sometimes simultaneously.

Haptic Aurality: Listening in a Digital World

I will question modes of listening in network music performance environments, drawing on my experience as a performer listening in these scenarios. I will situate network listening, which I have previously examined as ‘haptic aurality’ (Schroeder, 2009, 2012, 2013) within the context of current music making, and will refer to changes in compositional practices that draw specific attention to listening. I will show that some of these compositional developments play a determining role in articulating a new discourse of listening. French composer Eric Satie’s concept of Furniture Music (in Duckworth, 2005), Pierre Schaeffer’s ideas on reduced listening (1966), Pauline Oliveros’ deep listening practices (2005) as well as digital music platforms all serve to show a development towards a proliferation in listening experiences. I expand this narrative to listening practices in network performance environments, and identify a specific bodily fragility in listening in and to the network. This fragile state of listening and de-centered kind of performative being allow me to draw parallels to the Japanese art form Butoh (Kasai, 1999, 2000; Kasai and Parsons, 2003) and Elaine Scarry’s metaphor of beauty (Scarry, 2001). My own performance experiences, set within the context of several critical texts, allow me to understand network[ed] listening as an ideal corporeal state, which offers a rethinking of linear conceptions of the other and a subject’s own relation with her world. Ultimately, network[ed] listening posits listening as a corporeal and multi-dimensional experience that is continuously being re-shaped by technological, socio-political and cultural concerns.

Network[ed] Listening – towards a de-centering of beings

In this paper, I question modes of listening in network music performance environments, and specifically draw on my experience as a performer listening in these scenarios. I situate network listening within the context of current music making, and refer to changes in compositional practices that draw specific attention to listening. I argue that some of these compositional developments play a determining role in articulating a new discourse of listening. Eric Satie's concept of Furniture Music, Schaeffer's ideas on reduced listening, Oliveros' deep listening practices as well as digital music platforms all serve to show a development towards a proliferation in listening experiences. I expand this narrative to listening practices in network performance environments, and identify a specific bodily fragility in listening in and to the network. This fragile state of listening and de-centered kind of performative being allow me to draw parallels to the Japanese art form Butoh and Elaine Scarry's metaphor of beauty. My own performance experiences, set within the context of several critical texts, allow me to see network[ed] listening as an ideal corporeal state, which offers a rethinking of linear conceptions of the other and a subject's own relation with her world. Ultimately, network[ed] listening posits listening as a corporeal and multi-dimensional experience that is continuously being re-shaped by technological, socio-political and cultural concerns.

Mushroom: An Oracular Sound Processor

Composers of digital music today have a bewildering variety of sound-processing tools and techniques at their disposal. At their best, these tools allow composers to hone a sound to perfection. However, they can also lead us into a routine which bypasses avenues of experimentation, simply because the known tools work so well and their sonic output is so attractive. An alternative strategy is oracular sound processing. An oracular sound processor creates a derived version of its input whose characteristics could not have been fully predicted, while affording the user little or no parametric control over the process.

A Framework for the Evaluation of Digital Musical Instruments

At the outset of a discussion of evaluating digital musical instruments, that is to say instruments whose sound generators are digital and separable though not necessarily separate from their control interfaces (Malloch, 2006), it is reasonable to ask what the term evaluation in this context really means. After all, there may be many perspectives from which to view the effectiveness or otherwise of the instruments we build. For most performers, performance on an instrument becomes a means of evaluating how well it functions in the context of live music making, and their measure of success is the response of the audience to their performance. Audiences evaluate performances on the basis of how engaged they feel they have been by what they have seen and heard. When questioned, they are likely to describe good performances as “exciting,” “skillful,” “musical.” Bad performances are “boring,” and those which are marred by technical malfunction are often dismissed out of hand. If performance is considered to be a valid means of evaluating a musical instrument, then it follows that, for the field of DMI design, a much broader definition of the term “evaluation” than that typically used in human-computer interaction (HCI) is required to reflect the fact that there are a number of stakeholders involved in the design and evaluation of DMIs. In addition to players and audiences, there are also composers, instrument builders, component manufacturers, and perhaps even customers, each of whom will have a different concept of what is meant by “evaluation.”

A Computer Music Retrospective

A composer who has worked in the field of computer music for the last 25 years reflects on how technological developments during that time have affected his work in computer music, instrumental music and hybrid combinations of the two. The compositional trajectories traced here often run parallel to opportunities afforded by the evolution of computer technology suitable for the generation of digital audio.

The Absent Image in Electronic Music

A survey of the after-effects of recording technology on media arts, particularly in the digital age. The article covers a wide variety of sound artists, including work by the author.

HIGH-FIDELITY MUSIC CODING AT 4 BITS.

A very high-quality sub-band ADPCM music coding scheme which compresses high-fidelity music signals, bandlimited to 15kHz, to an equivalent PCM representation of only 4 bits per sample, is described. By processing music sampled at 32 kHz, this coder exhibits a total bit rate of only 128kbit/s and is consequently applicable to the ISDN. Subjective tests conducted with this coder have shown that music recovered from the compression scheme is essentially indistinguishable from the original material. The results obtained are of major importance, not only for ISDN and broadcasting, but also for other digital audio technology such as compact disc (CD) and digital audio tape.

Designing Digital Musical Interactions in Experimental Contexts

As NIME's focus has expanded beyond the design reports which were pervasive in the early days to include studies and experiments involving music control devices, we report on a particular area of activity that has been overlooked: designs of music devices in experimental contexts. We demonstrate this is distinct from designing for artistic performances, with a unique set of novel challenges. A survey of methodological approaches to experiments in NIME reveals a tendency to rely on existing instruments or evaluations of new devices designed for broader creative application. We present two examples from our own studies that reveal the merits of designing purpose-built devices for experimental contexts.

Compositional and Performance Mapping in Computer Chamber Music: A Case Study

The mapping problem is inherent to digital musical instruments (DMIs), which require, at the very least, an association between physical gestures and digital synthesis algorithms to transform human bodily performance into sound. This article considers the DMI mapping problem in the context of the creation and performance of a heterogeneous computer chamber music piece, a trio for violin, biosensors, and computer. Our discussion situates the DMI mapping problem within the broader set of interdependent musical interaction issues that surfaced during the composition and rehearsal of the trio. Through descriptions of the development of the piece, development of the hardware and software interfaces, lessons learned through rehearsal, and self-reporting by the participants, the rich musical possibilities and technical challenges of the integration of digital musical instruments into computer chamber music are demonstrated.

Improvisation, Indeterminacy and Game-Mediated Participation in Network Music Performance

This chapter focuses on the relationship between improvisation and indeterminacy. We discuss the two practices by referring to play theory and game studies and situate it in recent network music performance. We will develop a parallel with game theory in which indeterminacy is seen as a way of articulating situations where structural decisions are left to the discernment of the performers and discuss improvisation as a method of play. The improvisation-indeterminacy relationship is discussed in the context of network music performance, which employs digital networks in the exchange of data between performers and hence relies on topological structures with varying degrees of openness and flexibility. Artists such as Max Neuhaus and The League of Automatic Music Composers initiated the development of a multitude of practices and technologies exploring the network as an environment for music making. Even though the technologies behind “the network” have shifted dramatically since Neuhaus’ use of radio in the 1960’s, a preoccupation with distribution and sharing of artistic agency has remained at the centre of networked practices. Gollo Föllmer, after undertaking an extensive review of network music initiatives, produced a typology that comprises categories as diverse as remix lists, sound toys, real/virtual space installations and network performances. For Föllmer, “the term ‘Net music’ comprises all formal and stylistic kinds of music upon which the specifics of electronic networks leave considerable traces, whereby the electronic networks strongly influence the process of musical production, the musical aesthetic, or the way music is received” (2005: 185).