Visualizing digital media interactions : providing feedback on jam2jam AV performances

Instrumental music performance is a well-established case of real-time interaction with technology and, when extended to ensembles, of interaction with others. However, these interactions are fleeting and the opportunities to reflect on action is limited, even though audio and video recording has recently provided important opportunities in this regard. In this paper we report on research to further extend these reflective opportunities through the capture and visualization of gestural data collected during collaborative virtual performances; specifically using the digital media instrument Jam2jam AV and the specifically-developed visualization software Jam2jam AV Visualize. We discusses how such visualization may assist performance development and understanding. The discussion engages with issues of representation, authenticity of virtual experiences, intersubjectivity and wordless collaboration, and creativity support. Two usage scenarios are described showing that collaborative intent is evident in the data visualizations more clearly than in audio-visual recordings alone, indicating that the visualization of performance gestures can be an efficient way of identifying deliberate and co-operative performance behaviours.

DIScoveringABILITIES : creating interactive performances over the Internet

This article presents a case study that shows how a creative music educator uses the internet to enable participatory performance.

Note sequence morphing algorithms for performance of electronic dance music

This paper describes algorithms that can musically augment the realtime performance of electronic dance music by generating new musical material by morphing. Note sequence morphing involves the algorithmic generation of music that smoothly transitions between two existing musical segments. The potential of musical morphing in electronic dance music is outlined and previous research is summarised; including discussions of relevant music theoretic and algorithmic concepts. An outline and explanation is provided of a novel Markov morphing process that uses similarity measures to construct transition matrices. The paper reports on a ‘focus-concert’ study used to evaluate this morphing algorithm and to compare its output with performances from a professional DJ. Discussions of this trial include reflections on some of the aesthetic characteristics of note sequence morphing. The research suggests that the proposed morphing technique could be effectively used in some electronic dance music contexts.

Manufacturing practices and performances: A Malaysian study

The purpose of this study is to identify the most common manufacturing practices adopted by the Malaysian manufacturers, company performance factors and relationship between practices and performances. To fulfil the study objectives, 400 manufacturers were surveyed by a standard 400 questionnaire. Three research methodologies such as descriptive analysis, ANOVA and regression analysis have been employed in this study. The analysis revealed that Malaysian manufacturers focus on optimizing three critical performance factors: product development, less customer return rate and on time delivery (OTD). The most important competitive factor was found to be company reputation and design and manufacturing capacity is the least important factor. The findings also proved that manufacturing practices significantly influence company performances

Choreographic approaches to music composition for a new musical interface : the eMic

Gesture in performance is widely acknowledged in the literature as an important element in making a performance expressive and meaningful. The body has been shown to play an important role in the production and perception of vocal performance in particular. This paper is interested in the role of gesture in creative works that seek to extend vocal performance via technology. A creative work for vocal performer, laptop computer and a Human Computer Interface called the eMic (Extended Microphone Stand Interface controller) is presented as a case study, to explore the relationships between movement, voice production, and musical expression. The eMic is an interface for live vocal performance that allows the singers’ gestures and interactions with a sensor based microphone stand to be captured and mapped to musical parameters. The creative work discussed in this paper presents a new compositional approach for the eMic by working with movement as a starting point for the composition and thus using choreographed gesture as the basis for musical structures. By foregrounding the body and movement in the creative process, the aim is to create a more visually engaging performance where the performer is able to more effectively use the body to express their musical objectives.

Performance recordivity : studio music in a live context

A broad range of positions is articulated in the academic literature around the relationship between recordings and live performance. Auslander (2008) argues that “live performance ceased long ago to be the primary experience of popular music, with the result that most live performances of popular music now seek to replicate the music on the recording”. Elliott (1995) suggests that “hit songs are often conceived and produced as unambiguous and meticulously recorded performances that their originators often duplicate exactly in live performances”. Wurtzler (1992) argues that “as socially and historically produced, the categories of the live and the recorded are defined in a mutually exclusive relationship, in that the notion of the live is premised on the absence of recording and the defining fact of the recorded is the absence of the live”. Yet many artists perform in ways that fundamentally challenge such positions. Whilst it is common practice for musicians across many musical genres to compose and construct their musical works in the studio such that the recording is, in Auslander’s words, the ‘original performance’, the live version is not simply an attempt to replicate the recorded version. Indeed in some cases, such replication is impossible. There are well known historical examples. Queen, for example, never performed the a cappella sections of Bohemian Rhapsody because it they were too complex to perform live. A 1966 recording of the Beach Boys studio creation Good Vibrations shows them struggling through the song prior to its release. This paper argues that as technology develops, the lines between the recording studio and live performance change and become more blurred. New models for performance emerge. In a 2010 live performance given by Grammy Award winning artist Imogen Heap in New York, the artist undertakes a live, improvised construction of a piece as a performative act. She invites the audience to choose the key for the track and proceeds to layer up the various parts in front of the audience as a live performance act. Her recording process is thus revealed on stage in real time and she performs a process that what would have once been confined to the recording studio. So how do artists bring studio production processes into the live context? What aspects of studio production are now performable and what consistent models can be identified amongst the various approaches now seen? This paper will present an overview of approaches to performative realisations of studio produced tracks and will illuminate some emerging relationships between recorded music and performance across a range of contexts.

Improvisation in interactive music systems

This project investigates machine listening and improvisation in interactive music systems with the goal of improvising musically appropriate accompaniment to an audio stream in real-time. The input audio may be from a live musical ensemble, or playback of a recording for use by a DJ. I present a collection of robust techniques for machine listening in the context of Western popular dance music genres, and strategies of improvisation to allow for intuitive and musically salient interaction in live performance. The findings are embodied in a computational agent – the Jambot – capable of real-time musical improvisation in an ensemble setting. Conceptually the agent’s functionality is split into three domains: reception, analysis and generation. The project has resulted in novel techniques for addressing a range of issues in each of these domains. In the reception domain I present a novel suite of onset detection algorithms for real-time detection and classification of percussive onsets. This suite achieves reasonable discrimination between the kick, snare and hi-hat attacks of a standard drum-kit, with sufficiently low-latency to allow perceptually simultaneous triggering of accompaniment notes. The onset detection algorithms are designed to operate in the context of complex polyphonic audio. In the analysis domain I present novel beat-tracking and metre-induction algorithms that operate in real-time and are responsive to change in a live setting. I also present a novel analytic model of rhythm, based on musically salient features. This model informs the generation process, affording intuitive parametric control and allowing for the creation of a broad range of interesting rhythms. In the generation domain I present a novel improvisatory architecture drawing on theories of music perception, which provides a mechanism for the real-time generation of complementary accompaniment in an ensemble setting. All of these innovations have been combined into a computational agent – the Jambot, which is capable of producing improvised percussive musical accompaniment to an audio stream in real-time. I situate the architectural philosophy of the Jambot within contemporary debate regarding the nature of cognition and artificial intelligence, and argue for an approach to algorithmic improvisation that privileges the minimisation of cognitive dissonance in human-computer interaction. This thesis contains extensive written discussions of the Jambot and its component algorithms, along with some comparative analyses of aspects of its operation and aesthetic evaluations of its output. The accompanying CD contains the Jambot software, along with video documentation of experiments and performances conducted during the project.

Meaningful musical engagement : the potential impact of generative music systems on learning experiences

In order to create music, the student must establish a relationship with the musical materials. In this thesis, I examine the capacity of a generative music system called jam2jam to offer individuals a virtual musical play-space to explore. I outline the development of an iteration of software development named jam2jam blue and the evolution of a games-like user interface in the research design that jointly revealed the nature of this musical exploration. The findings suggest that the jam2jam blue interface provided an expressive gestural instrument to jam and experience musicmaking. By using the computer as an instrument, participants in this study were given access to meaningful musical experiences in both solo and ensemble situations and the researcher is allowed a view of their development of a relationship with the musical materials from the perspective of the individual participants. Through an iterative software development methodology, pedagogy and experience design were created simultaneously. The research reveals the potential for the jam2jam software to be used as a reflective tool for feedback and assessment purposes. The power of access to ensemble music making is realised though the participants’ virtual experiences which are brought into their physical space by sharing their experience with others. It is suggested that this interaction creates an environment conducive to self-initiated learning in which music is the language of interaction. The research concludes that the development of a relationship between the explorer and the musical materials is subject to the collaborative nature of the interaction through which the music is experienced.

Things that fall over : Women's playwriting, poetics and the (anti-)musical

Abstract: This study explores the contradictions and ambivalences experienced by a working artist at a time when her age, her gender, and broader cultural shifts are all potential obstacles or liabilities to creative flourishing. It is the product of practice-led research into the creative process from the perspective of the female "late bloomer". In this phrase, I have in mind the mature-aged woman who is, in mid-life, suddenly seized with inspiration and fired with creative energy. At its heart is the question: If an Elizabeth Jolley were in our midst today, would we hear from her? The result is a full-length libretto and accompanying exegetical binoculars in the form of a Preface and an Afterword. The creative work, Things That Fall Over (TTFO) is conceived in two parts: a libretto and oratorio for performance. It begins as a play, but over three acts and into a coda, the work becomes something entirely other - an (anti-) musical. The work grew from a personal interest in the nexus between women, ageing and creative practice, via investigation into the oeuvre of two Australian artists, Elizabeth Jolley, author, first published at age 53, and Rosalie Gascoigne, sculptor, first exhibited at 58. A second strand of the research grew from a fascination for the stage musical, especially in its more alternative modes as in the hands of Stephen Sondheim, or in more provocative manifestations as witnessed in recent Tony Award winners Avenue Q and The Book of Mormon. Contextually, this research is conducted at a time when anecdotal evidence suggests that women’s work in the performing arts and in literature is being pushed to the margins after a late twentieth century Golden Age on page and stage. Using hybrid practice-led methodologies - bricolage, log-keeping - and working within queer and feminist paradigms, this study seeks to counter that push with a new work that is all-female, part-pantomime, part monstrous allegory. In illuminating the creative process of a mature-aged playwright it concludes that hybrid and interstitial forms still offer an inclusive and democratic space in which voices that may otherwise be muted will continue to be heard.

Digital technologies and musical participation for people with intellectual disabilities

Research on the aspirations of people with intellectual disabilities documents the importance of alternative zones of inclusion where they can assert their own definitions of ability and normality. This stands in contrast to assumptions concerning technology and disability that position technology as ‘normalising’ the disabled body. This paper reports on the role of a digital music jamming tool in providing access to creative practice by people with intellectual disabilities. The tool contributed to the development of a spatio-temporal zone to enable aesthetic agency within and beyond the contexts of deinstitutionalised care. The research identifies the interactions among tools, individuals and groups that facilitated participants’ agency in shaping the form of musical practice. Further, we document the properties of emergent interaction - supported by a tool oriented to enabling music improvisation - as potentially resisting assumptions regarding normalisation.

Metrological performances of a diffusion charger particle counter for personal monitoring

Airborne particles have been shown to be associated with a wide range of adverse health effects, which has led to a recent increase in medical research to gain better insight into their health effects. However, accurate evaluation of the exposure-dose-response relationship is highly dependent on the ability to track actual exposure levels of people to airborne particles. This is quite a complex task, particularly in relation to submicrometer and ultrafine particles, which can vary quite significantly in terms of particle surface area and number concentrations. Therefore, suitable monitors that can be worn for measuring personal exposure to these particles are needed. This paper presents an evaluation of the metrological performance of six diffusion charger sensors, NanoTracer (Philips Aerasense) monitors, when measuring particle number and surface area concentrations, as well as particle number distribution mean when compared to reference instruments. Tests in the laboratory (by generating monodisperse and polydisperse aerosols) and in the field (using natural ambient particles) were designed to evaluate the response of these devices under both steady-state and dynamics conditions. Results showed that the NanoTracers performed well when measuring steady state aerosols, however they strongly underestimated actual concentrations during dynamic response testing. The field experiments also showed that, when the majority of the particles were smaller than 20 nm, which occurs during particle formation events in the atmosphere, the NanoTracer underestimated number concentration quite significantly. Even though the NanoTracer can be used for personal monitoring of exposure to ultrafine particles, it also has limitations which need to be considered in order to provide meaningful results.

Translations of industry-based student learning and academic performances

We hypothesized that Industry based learning and teaching, especially through industry assigned student projects or training programs, is an integral part of science, technology, engineering and mathematics (STEM) education. In this paper we show that industry-based student training and experience increases students’ academic performances independent to the organizational parameters and contexts. The literature on industry-based student training focuses on employability and the industry dimension, and neglects in many ways the academic dimension. We observed that the association factors between academic attributes and contributions of industry-based student training are central and vital to the technological learning experiences. We explore international initiatives and statistics collected of student projects in two categories: Industry based learning performances and on campus performances. The data collected were correlated to five (5) universities in different industrialized countries, e.g., Australia N=545, Norway N=279, Germany N=74, France N=107 and Spain N=802 respectively. We analyzed industry-based student training along with company assigned student projects compared with in comparisons to campus performance. The data that suggests a strong correlation between industry-based student training per se and improved performance profiles or increasing motivation shows that industry-based student training increases student academic performance independent of organizational parameters and contexts. The programs we augmented were orthogonal to each other however, the trend of the students’ academic performances are identical. An isolated cohort for the reported countries that opposed our hypothesis warrants further investigation.

Tristate

"This work forms part of a much larger collaborative album project in progress between Tim Bruniges, Julian Knowles and David Trumpmanis which explores the intersections between traditional rock instrumentation and analogue and digital media. All of the creative team are performers, composers and producers. The material for the album was thus generated by a series of in studio improvisations and performances with each collaborator assuming a range of different and alternating roles – guitars, electronics, drums, percussion, bass, keyboards production. Thematically the work explores the intersection of instrumental (post) rock, ambient music, and historical electro-acoustic tape composition traditions. Over the past 10 years, musical practice has become increasingly hybrid, with the traditional boundaries between genre becoming progressively eroded. At the same time, digital tools have replaced many of the major analogue technologies that dominated music production and performance in the 20th century. The disappearance of analogue media in mainstream musical practice has had a profound effect on the sonic characteristics of contemporary music and the gestural basis for its production. Despite the increasing power of digital technologies, a small but dedicated group of practitioners has continued to prize and use analogue technology for its unique sounds and the non-linearity of the media, aestheticising its inherent limitations and flaws. At the most radical end of this spectrum lie glitch and lo-fi musical forms, seen in part as reactions to the clinical nature of digital media and the perceived lack of character associated with its transparency. Such developments have also problematised the traditional relationships between media and genre, where specific techniques and their associated sounds have become genre markers. Tristate is an investigation into this emerging set of dialogues between analogue and digital media across composition, production and performance. It employs analogue tape loops in performance, where a tape machine ‘performer’ records and hand manipulates loops of an electric guitar performer on ‘destroyed’ tape stock (intentionally damaged tape), processing the output of this analogue system in the digital domain with contemporary sound processors. In doing so it investigates how the most extreme sonic signatures of analogue media – tape dropout and noise – can be employed alongside contemporary digital sound gestures in both compositional and performance contexts and how the extremes of the two media signatures can brought together both compositionally and performatively. In respect of genre, the work established strategies for merging compositional techniques from the early musique concrete tradition of the 1940s with late 60s popular music experimentalism and the laptop glitch electronica movement of the early 2000s. Lastly, the work explores how analogue recording studio technologies can be used as performance tools, thus illuminating and foregrounding the performative/gestural dimensions of traditional analogue studio tools in use."

Performances of socially responsible investment and environmentally friendly funds

The socially responsible investment (SRI) funds performances remain inconclusive. Hence, more studies need to be conducted to determine if SRI funds systematically underperform or outperform conventional funds. This paper has employed dynamic mean-variance model using shortage function approach to evaluate the performance of SRI and Environmentally friendly funds (EF). Unlike the traditional methods, this approach estimates fund performance considering both the return and risk at the same time. The empirical results show that SRI funds outperformed conventional funds in EU and US. In addition, the results of EU are among the top-performing categories. EF do not perform as well as SRI, but perform in manners equal or superior to conventional funds. These results show statistically significant in some cases.

Durability performances of concrete with nano-silica

This study investigated the durability properties of concrete containing nano-silica at dosages of 0.3% and 0.9%, respectively. Due to the nano-filler effect and the pozzolanic reaction, the microstructure became more homogeneous and less porous, especially at the interfacial transition zone (ITZ), which led to reduced permeability. Tests on the durability properties verified the beneficial effects of nano-silica. The channels for harmful agents through the cement composites were partially filled and blocked. The pore size distribution also indicated that the large capillary pores were refined by the nano-silica, due to the combined contribution of the nano-filler effect and the pozzolanic reaction.