Energy conserving schemes for the simulation of musical instrument contact dynamics

Collisions are an innate part of the function of many musical instruments. Due to the nonlinear nature of contact forces, special care has to be taken in the construction of numerical schemes for simulation and sound synthesis. Finite difference schemes and other time-stepping algorithms used for musical instrument modelling purposes are normally arrived at by discretising a Newtonian description of the system. However because impact forces are non-analytic functions of the phase space variables, algorithm stability can rarely be established this way. This paper presents a systematic approach to deriving energy conserving schemes for frictionless impact modelling. The proposed numerical formulations follow from discretising Hamilton׳s equations of motion, generally leading to an implicit system of nonlinear equations that can be solved with Newton׳s method. The approach is first outlined for point mass collisions and then extended to distributed settings, such as vibrating strings and beams colliding with rigid obstacles. Stability and other relevant properties of the proposed approach are discussed and further demonstrated with simulation examples. The methodology is exemplified through a case study on tanpura string vibration, with the results confirming the main findings of previous studies on the role of the bridge in sound generation with this type of string instrument.

Language Experience Affects Grouping of Musical Instrument Sounds

Language experience clearly affects the perception of speech, but little is known about whether these differences in perception extend to non-speech sounds. In this study, we investigated rhythmic perception of non-linguistic sounds in speakers of French and German using a grouping task, in which complexity (variability in sounds, presence of pauses) was manipulated. In this task, participants grouped sequences of auditory chimeras formed from musical instruments. These chimeras mimic the complexity of speech without being speech. We found that, while showing the same overall grouping preferences, the German speakers showed stronger biases than the French speakers in grouping complex sequences. Sound variability reduced all participants' biases, resulting in the French group showing no grouping preference for the most variable sequences, though this reduction was attenuated by musical experience. In sum, this study demonstrates that linguistic experience, musical experience, and complexity affect rhythmic grouping of non-linguistic sounds and suggests that experience with acoustic cues in a meaningful context (language or music) is necessary for developing a robust grouping preference that survives acoustic variability.

The Voice as Transcursive Inscriber: The Relation of Body and Instrument Understood through the Workings of a Machine

This article examines the relationship of the body with a musical instrument; specifically it looks at the vital threshold conditions that occur during the interplay of voice and instrument. By examining the work ‘IKAS’ (1982) for solo saxophone by German composer Hans-Joachim Hespos, the unusual timbral relationships created between vocal and instrumental sounds are exposed. I argue that this particular work highlights the performer/instrument relation as one marked by Gilles Deleuze’s notion of the workings of a machine and a machine’s relation to a ‘flow’, in particular a machine’s function with view to the break in the flow. By turning towards Deleuze’s concept of the machine, this article offers a slightly different vocabulary for music analysis, one that more easily encompasses certain works of the twentieth century, specifically those that are more timbre- than pitch-based.

Playing with Constraints: Stylistic Variation with a Simple Electronic Instrument

A study was conducted by researchers to address the individuation of performance with electronic instruments. The researchers derived a working concept of style as distinct from structure in an activity, which was proposed as a useful framework for considering virtuosity and individuality in interactions with technology, including musical ones. The researchers proposed an alliance between constraint and the development of style. Another study was described, which explored the emergence of personal performance styles in experienced performers with a novel, constrained electronic musical instrument. The study aimed to represent aspects of a realistic situation within the new interfaces for musical expression (NIME) community where a performer needed to determine how to perform with a new instrument for which there was no established performance practice and instruction manual.

A Framework for the Evaluation of Digital Musical Instruments

At the outset of a discussion of evaluating digital musical instruments, that is to say instruments whose sound generators are digital and separable though not necessarily separate from their control interfaces (Malloch, 2006), it is reasonable to ask what the term evaluation in this context really means. After all, there may be many perspectives from which to view the effectiveness or otherwise of the instruments we build. For most performers, performance on an instrument becomes a means of evaluating how well it functions in the context of live music making, and their measure of success is the response of the audience to their performance. Audiences evaluate performances on the basis of how engaged they feel they have been by what they have seen and heard. When questioned, they are likely to describe good performances as “exciting,” “skillful,” “musical.” Bad performances are “boring,” and those which are marred by technical malfunction are often dismissed out of hand. If performance is considered to be a valid means of evaluating a musical instrument, then it follows that, for the field of DMI design, a much broader definition of the term “evaluation” than that typically used in human-computer interaction (HCI) is required to reflect the fact that there are a number of stakeholders involved in the design and evaluation of DMIs. In addition to players and audiences, there are also composers, instrument builders, component manufacturers, and perhaps even customers, each of whom will have a different concept of what is meant by “evaluation.”

Haptic Sensation and Instrumental Transgression

Anyone who has ever played a musical instrument will certify the development of a particular type of relationship between the instrument and the performer. This relationship goes beyond a convenient coupling that is optimized for sound production. Every musical instrument defines ways in which to be touched, felt, activated. Music performance is dependent on bodily involvement that goes beyond the auditory and the sense of hearing. This article investigates the role of haptic sensation in the context of the performer-instrument relationship and draws on the writings of Georges Bataille to illuminate a discussion of the erotic in performance.

Cutaneous Grooves: Composing for the Sense of Touch

What if the traditional relationship between touch and music was essentially turned upside down, making the tactile sensation the aesthetic end? This paper presents a novel coupling of haptics technology and music, introducing the notion of tactile composition or aesthetic composition for the sense of touch. A system that facilitates the composition and perception of intricate, musically structured spatio-temporal patterns of vibration on the surface of the body is described. Relevant work from disciplines including sensory substitution, electronic musical instrument design, simulation design, entertainment technology, and visual music is considered. The psychophysical parameter space for our sense of touch is summarized and the building blocks of a compositional language for touch are explored. A series of concerts held for the skin and ears is described, as well as some of the lessons learned along the way. In conclusion, some potential evolutionary branches of tactile composition are posited.

Design Methodology for Real-Time FPGA-Based Sound Synthesis

Explicit finite difference (FD) schemes can realise highly realistic physical models of musical instruments but are computationally complex. A design methodology is presented for the creation of FPGA-based micro-architectures for FD schemes which can be applied to a range of applications with varying computational requirements, excitation and output patterns and boundary conditions. It has been applied to membrane and plate-based sound producing models, resulting in faster than real-time performance on a Xilinx XC2VP50 device which is 10 to 35 times faster than general purpose and DSP processors. The models have developed in such a way to allow a wide range of interaction (by a musician) thereby leading to the possibility of creating a highly realistic digital musical instrument.

Touching at a Distance: Resistance, Tactility, Proxemics and the Development of a Hybrid Virtual/Physical Performance System

This is a paper about resistance and affordance as they relate to music-making in the most extended sense, and perhaps about empathy if this is understood as a capacity to ‘read’ the resistances and affordances of objects, bodies, people and environments. It proceeds from a set of broad working assumptions which inform one individual’s musical practice, via a description a musical-instrument making project which is a hybrid of physical and virtual elements and is designed to test those assumptions, to a speculative finale in which it is suggested that musicking might, in some circumstances, be regarded in itself as a form of resistance. It moves from the intimate and personal, through what might be regarded as local concerns to more global observation, prefiguring the structure of the performance system it describes: the Virtual-Physical Feedback flute

Ambiguous Devices

Developed and performed in collaboration with Tom Davis (Bournemouth University), the work explores notions of presence and absence, technologically mediated communication and audience perception through the staging of ambiguous but repeatable performative interactions taking place on a co-located but distributed musical instrument. Public performances and installations include: CCRMA, Stanford University (2012); NIME conference, University of Michigan (2012); SARC, Queen's University Belfast (2013); INTIME symposium, Coventry University (2013); RE-NEW digital arts festival, Copenhagen (2013).

Categorizations of physical gesture in piano teaching: A preliminary enquiry

The significance of the “physicality” involved in learning to play a musical instrument and the essential role of teachers are areas in need of research. This article explores the role of gesture within teacher–student communicative interaction in one-to-one piano lessons. Three teachers were required to teach a pre-selected repertoire of two contrasting pieces to three students studying piano grade 1. The data was collected by video recordings of piano lessons and analysis based on the type and frequency of gestures employed by teachers in association to teaching behaviours specifying where gestures fit under (or evade) predefined classifications. Spontaneous co-musical gestures were observed in the process of piano tuition emerging with similar general communicative purposes as spontaneous co-verbal gestures and were essential for the process of musical communication between teachers and students. Observed frequencies of categorized gestures varied significantly between different teaching behaviours and between the three teachers. Parallels established between co-verbal and co-musical spontaneous gestures lead to an argument for extension of McNeill’s (2005) ideas of imagery–language–dialectic to imagery–music–dialectic with relevant implications for piano pedagogy and fields of study invested in musical communication.

A Spherical Array Approach for Simulation of Binaural Impulse Responses using the Finite Difference Time Domain Method

The finite difference time domain (FDTD) method has direct applications in musical instrument modeling, simulation of environmental acoustics, room acoustics and sound reproduction paradigms, all of which benefit from auralization. However, rendering binaural impulse responses from simulated
data is not straightforward to accomplish as the calculated pressure at FDTD grid nodes does not contain any directional information. This paper addresses this issue by introducing a spherical array to capture sound pressure on a finite difference grid, and decomposing it into a plane-wave density
function. Binaural impulse responses are then constructed in the spherical harmonics domain by combining the decomposed grid data with free field head-related transfer functions. The effects of designing a spherical array in a Cartesian grid are studied, and emphasis is given to the relationships
between array sampling and the spatial and spectral design parameters of several finite-difference
schemes.

Characteristics of Corticospinal Projections to the Intrinsic Hand Muscles in Skilled Harpists.

The process of learning to play a musical instrument necessarily alters the functional organisation of the cortical motor areas that are involved in generating the required movements. In the case of the harp, the demands placed on the motor system are quite specific. During performance, all digits with the sole exception of the little finger are used to pluck the strings. With a view to elucidating the impact of having acquired this highly specialized musical skill on the characteristics of corticospinal projections to the intrinsic hand muscles, focal transcranial magnetic stimulation (TMS) was used to elicit motor evoked potentials (MEPs) in three muscles (of the left hand): abductor pollicis brevis (APB); first dorsal interosseous (FDI); and abductor digiti minimi (ADM) in seven harpists. Seven non-musicians served as controls. With respect to the FDI muscle–which moves the index finger, the harpists exhibited reliably larger MEP amplitudes than those in the control group. In contrast, MEPs evoked in the ADM muscle–which activates the little finger, were smaller in the harpists than in the non-musicians. The locations on the scalp over which magnetic stimulation elicited discriminable responses in ADM also differed between the harpists and the non-musicians. This specific pattern of variation in the excitability of corticospinal projections to these intrinsic hand muscles exhibited by harpists is in accordance with the idiosyncratic functional demands that are imposed in playing this instrument.

An Enactive Approach to the Design of New Tangible Musical Instruments

In this paper, we propose a theoretical framework for the design of tangible interfaces for musical expression. The main insight for the proposed approach is the importance and utility of familiar sensorimotor experiences for the creation of engaging and playable new musical instruments. In particular, we suggest exploiting the commonalities between different natural interactions by varying the auditory response or tactile details of the instrument within certain limits. Using this principle, devices for classes of sounds such as coarse grain collision interactions or friction interactions can be designed. The designs we propose retain the familiar tactile aspect of the interaction so that the performer can take advantage of tacit knowledge gained through experiences with such phenomena in the real world.