The use of acoustic indices to determine avian species richness in audio-recordings of the environment

Interpreting acoustic recordings of the natural environment is an increasingly important technique for ecologists wishing to monitor terrestrial ecosystems. Technological advances make it possible to accumulate many more recordings than can be listened to or interpreted, thereby necessitating automated assistance to identify elements in the soundscape. In this paper we examine the problem of estimating avian species richness by sampling from very long acoustic recordings. We work with data recorded under natural conditions and with all the attendant problems of undefined and unconstrained acoustic content (such as wind, rain, traffic, etc.) which can mask content of interest (in our case, bird calls). We describe 14 acoustic indices calculated at one minute resolution for the duration of a 24 hour recording. An acoustic index is a statistic that summarizes some aspect of the structure and distribution of acoustic energy and information in a recording. Some of the indices we calculate are standard (e.g. signal-to-noise ratio), some have been reported useful for the detection of bioacoustic activity (e.g. temporal and spectral entropies) and some are directed to avian sources (spectral persistence of whistles). We rank the one minute segments of a 24 hour recording in descending order according to an "acoustic richness" score which is derived from a single index or a weighted combination of two or more. We describe combinations of indices which lead to more efficient estimates of species richness than random sampling from the same recording, where efficiency is defined as total species identified for given listening effort. Using random sampling, we achieve a 53% increase in species recognized over traditional field surveys and an increase of 87% using combinations of indices to direct the sampling. We also demonstrate how combinations of the same indices can be used to detect long duration acoustic events (such as heavy rain and cicada chorus) and to construct long duration (24 h) spectrograms.

The sound of silence : the absence of voice in determining flexible working arrangements

In the context of a dramatically reconfigured labour market characterized by an individualistic culture and increasingly enmeshed life domains of employees, there is raised awareness of how employees may shape or modify their work arrangements. A small component of broader scholarship addressing issues that affect the social context in which individuals work, has focused on the role of ‘employee voice' in determining flexible-work outcomes (Donnelly et al., 2012). Employee voice is a broad term incorporating a spectrum of different practices designed to give employees a say in organisational issues and decisions (Dundon et al., 2004). This article extends work on voice and workplace flexibility by focusing not simply on ‘voice' but on its antithesis: employee silence. Silence is defined here, (following Van Dyne et al., 2003), as the intentional withholding of ideas, information and opinions. The consequences of employee silence in achieving work-life preferences are likely to be significant for both individuals and organizations, in achieving for example, the goals of business efficiency and facilitating employees' needs to fulfill multiple roles and minimize work-life interference.

False-colour spectrograms of long duration acoustic recordings

Acoustic recordings of the environment are an important aid to ecologists monitoring biodiversity and environmental health. However, rapid advances in recording technology, storage and computing make it possible to accumulate thousands of hours of recordings, of which, ecologists can only listen to a small fraction. The big-data challenge is to visualize the content of long-duration audio recordings on multiple scales, from hours, days, months to years. The visualization should facilitate navigation and yield ecologically meaningful information. Our approach is to extract (at one minute resolution) acoustic indices which reflect content of ecological interest. An acoustic index is a statistic that summarizes some aspect of the distribution of acoustic energy in a recording. We combine indices to produce false-colour images that reveal acoustic content and facilitate navigation through recordings that are months or even years in duration.

Dark Cartographies

‘Dark Cartographies’ is a slowly evolving meditation upon seasonal change, life after light and the occluding shadows of human influence. Through creating experiences of the many ‘times of a night’ the work allows participants to experience deep engagement with rich spectras of hidden place and sound. By amplifying and shining light upon a myriad of lives lived in blackness, ‘Dark Cartographies’ tempts us to re-understand seasonal change as actively-embodied temporality, inflected by our climate-changing disturbances. ‘Dark Cartographies’ uses custom interactive systems, illusionary techniques and real time spatial audio that draw upon a rich array of media, including seasonal, nocturnal field recordings sourced in the Far North Queensland region and detailed observations of foliage & flowering phases. By drawing inspiration from the subtle transitions between what Europeans named ‘Summer’ and ‘Autumn’, and by including the body and its temporal disturbances within the work, ‘Dark Cartographies’ creates compellingly immersive environments that wrap us in atmospheres beyond sight and hearing. ‘Dark Cartographies’ is a dynamic new installation directed & choreographed by environmental cycles; alluding to a new framework for making works that we call ‘Seasonal’. This powerful, responsive & experiential work draws attention to that which will disappear when biodiverse worlds have descended into an era of permanent darkness – an ‘extinction of human experience’. By tapping into the deeply interlocking seasonal cycles of environments that are themselves intimately linked with social, geographical & political concerns, participating audiences are therefore challenged to see the night, their locality & ecologies in new ways through extending their personal limits of perception, imagery & comprehension.

Night Rage/ Night Fall

A new form of media installation combining image, multi-channel sound and internally lit objects into a mysterious, deep image plane. Staged on the very edge of spectrum blackout, and moving into the deep of night, Version 1 (Night Rage) for ISEA 2013 examined the many shades of 'nocturnal', threats to night biodiversity and the myriad myths and stories that have shaped our cultural understandings of life after light. Barely recognisable images float within landscapes of media, noise and sound as the work asserts a profound resistance to today's all consuming media mesh. Version 2 (Night Fall) for the Queensland State Museum examined contemporary ideas around the ‘night’ and the 'nocturnal'. Beginning with the dark myths and stories that have long shaped our cultural understandings of life after light, NIGHT FALL considers how fearful ideas have often underpinned actions that continue to reduce Australia’s extraordinary night biodiversity. Today’s growing hostility towards Australia’s ancient, iconic flying foxes - who have been quietly pollinating our forests for millennia - hints at just how far we have yet to travel in our thinking. Enter the darkened tunnel to experience mysterious, edge-of-perception 3D forms, enhanced by a range of cinematic, illusionary and animatronic techniques, and become immersed in a strangely familiar sound track based upon seasonal field recordings made after dark, sourced from across the eastern coast of Queensland.

Pitfall (An Opportunistic Cultural Survey)

A pitfall is an unapparent source of trouble or danger; a hidden hazard: Today we all face, or will soon be facing ecological pitfalls of many kinds. ‘Pitfall’ is a continually-evolving artwork built from multiple screens, a tabletop landscape mapped with projections, fibre optics, 3D spatial sound and infrared night imagery. It builds upon ideas, recordings and cross-disciplinary processes developed during my 2012-13 ANAT Synapse Art-Science residency, with the Australian Wildlife Conservancy (AWC), Australia’s largest private-sector conservation organisation.

Automated species recognition in environmental recordings

Faunal vocalisations are vital indicators for environmental change and faunal vocalisation analysis can provide information for answering ecological questions. Therefore, automated species recognition in environmental recordings has become a critical research area. This thesis presents an automated species recognition approach named Timed and Probabilistic Automata. A small lexicon for describing animal calls is defined, six algorithms for acoustic component detection are developed, and a series of species recognisers are built and evaluated.The presented automated species recognition approach yields significant improvement on the analysis performance over a real world dataset, and may be transferred to commercial software in the future.

NESSTI : norms for environmental sound stimuli

In this paper we provide normative data along multiple cognitive and affective variable dimensions for a set of 110 sounds, including living and manmade stimuli. Environmental sounds are being increasingly utilized as stimuli in the cognitive, neuropsychological and neuroimaging fields, yet there is no comprehensive set of normative information for these type of stimuli available for use across these experimental domains. Experiment 1 collected data from 162 participants in an on-line questionnaire, which included measures of identification and categorization as well as cognitive and affective variables. A subsequent experiment collected response times to these sounds. Sounds were normalized to the same length (1 second) in order to maximize usage across multiple paradigms and experimental fields. These sounds can be freely downloaded for use, and all response data have also been made available in order that researchers can choose one or many of the cognitive and affective dimensions along which they would like to control their stimuli. Our hope is that the availability of such information will assist researchers in the fields of cognitive and clinical psychology and the neuroimaging community in choosing well-controlled environmental sound stimuli, and allow comparison across multiple studies.

The influence of colour and sound on neuronal activation during visual object naming

This paper investigates how neuronal activation for naming photographs of objects is influenced by the addition of appropriate colour or sound. Behaviourally, both colour and sound are known to facilitate object recognition from visual form. However, previous functional imaging studies have shown inconsistent effects. For example, the addition of appropriate colour has been shown to reduce antero-medial temporal activation whereas the addition of sound has been shown to increase posterior superior temporal activation. Here we compared the effect of adding colour or sound cues in the same experiment. We found that the addition of either the appropriate colour or sound increased activation for naming photographs of objects in bilateral occipital regions and the right anterior fusiform. Moreover, the addition of colour reduced left antero-medial temporal activation but this effect was not observed for the addition of object sound. We propose that activation in bilateral occipital and right fusiform areas precedes the integration of visual form with either its colour or associated sound. In contrast, left antero-medial temporal activation is reduced because object recognition is facilitated after colour and form have been integrated.

Visualization of long-duration acoustic recordings of the environment

Acoustic recordings of the environment are an important aid to ecologists monitoring biodiversity and environmental health. However, rapid advances in recording technology, storage and computing make it possible to accumulate thousands of hours of recordings, of which, ecologists can only listen to a small fraction. The big-data challenge addressed in this paper is to visualize the content of long-duration audio recordings on multiple scales, from hours, days, months to years. The visualization should facilitate navigation and yield ecologically meaningful information. Our approach is to extract (at one minute resolution) acoustic indices which reflect content of ecological interest. An acoustic index is a statistic that summarizes some aspect of the distribution of acoustic energy in a recording. We combine indices to produce false-color images that reveal acoustic content and facilitate navigation through recordings that are months or even years in duration.

Building communities through co-creative storytelling : sound walking in New England

The Story Project is a small, not-for-profit community media arts company based on the Sunshine Coast hinterland. It specialises in facilitating first-person storytelling. Since 2012 The Story Project has been collaborating with a small community arts organisation based in northern NSW, Uralla Arts, to record local heritage in first-person story form and to curate and present it ways that will appeal to new generations of listeners. The initial collaboration was funded by a Federal government Community Heritage program. The project successfully adapted a participatory method of life storytelling to this regional context and some 40 stories were contributed to a collection. A more ambitious suite of projects to develop soundwalks in a number of towns across the New England region has since grown from this initial collaboration. The soundwalks seek to combine local creative works in oral story, music and visual forms, and make them accessible through an application that can be downloaded to GPS-enabled mobile devices. While soundwalks are not new, the needs and challenges of creative community-building that New England soundwalks attempt to solve in this regional setting hold value for a broader range of interests than just those of the immediate project stakeholders. This paper reports on a research collaboration between The Story Project and QUT researchers that looked at The Story Project’s engagement with Uralla Arts and other New England community-based networks and organisations. It considers how this instance of story-centred, participatory media arts practice contributes to building population-wide capacity for creative expression.

Twelve : the best Of IMP's 100 Songs Project 2011

12 Original recordings curated by leading national industry figures. It’s a 12 track album full of remixed, rerecorded and rejigged tracks from the project that were shortlisted by our friends at MGM Distribution, Music Sales, and EMI Music Australia. The TWELVE album is already receiving critical acclaim from Australia's music industry.

Eleven : best of 100 Songs Project 2012

Eleven original recordings curated by leading industry figures. This is a compilation album from QUT's 2012 100 Songs project. It's called Eleven: Best of 100 Songs Project 2012 and was released in May 2013. It’s an 11 track album with a bonus track, full of remixed, rerecorded and rejigged tracks from the project that were shortlisted by our friends at MGM Distribution, Mushroom Music, Island Records and Music Sales Australia. The Eleven album is already receiving critical acclaim from Australia's music industry.

Burley! (sound design)

A young tetra fish, one of a million in her school, just wants some attention. Feeling lonely and bored, she is attracted by the manic antics of a gang of older fish who spend the hours inventing new extreme sports. She begins a quest to gain their acceptance, but at what cost?