A Prototype for a Multimodal Biometric Security system based on Face and Audio Signatures

Any automatically measurable, robust and distinctive physical characteristic or personal trait that can be used to identify an individual or verify the claimed identity of an individual, referred to as biometrics, has gained significant interest in the wake of heightened concerns about security and rapid advancements in networking, communication and mobility. Multimodal biometrics is expected to be ultra-secure and reliable, due to the presence of multiple and independent—verification clues. In this study, a multimodal biometric system utilising audio and facial signatures has been implemented and error analysis has been carried out. A total of one thousand face images and 250 sound tracks of 50 users are used for training the proposed system. To account for the attempts of the unregistered signatures data of 25 new users are tested. The short term spectral features were extracted from the sound data and Vector Quantization was done using K-means algorithm. Face images are identified based on Eigen face approach using Principal Component Analysis. The success rate of multimodal system using speech and face is higher when compared to individual unimodal recognition systems

Detecting indexical signs in film audio for scene interpretation

In this paper, we study the sound tracks in films and their indexical semiotic usage by developing a classification system that detects complex sound scenes and their constituent sound events in cinema. We investigate two main issues in this paper: Determination of what constitutes the presence of a high level sound scene and inferences about the thematic content of the scene that can be drawn from this presence, and classification of environmental sounds in the audio track of the scene, to assist in the automatic detection of the high level scene. Experiments with our classification system on pure sounds resulted in a correct event classification rate of 88.9%. When the audio content of a number of film scenes was examined, though a lower accuracy resulted with sound event detection due to the presence of mixed sounds, the film audio samples were generally classified with the correct high-level sound scene label, enabling correct inferences about the story content of the scenes.

Affect computing in film through sound energy dynamics

We develop an algorithm for the detection and classification of affective sound events underscored by specific patterns of sound energy dynamics. We relate the portrayal of these events to proposed high level affect or emotional coloring of the events. In this paper, four possible characteristic sound energy events are identified that convey well established meanings through their dynamics to portray and deliver certain affect, sentiment related to the horror film genre. Our algorithm is developed with the ultimate aim of automatically structuring sections of films that contain distinct shades of emotion related to horror themes for nonlinear media access and navigation. An average of 82% of the energy events, obtained from the analysis of the audio tracks of sections of four sample films corresponded correctly to the proposed affect. While the discrimination between certain sound energy event types was low, the algorithm correctly detected 71% of the occurrences of the sound energy events within audio tracks of the films analyzed, and thus forms a useful basis for determining affective scenes characteristic of horror in movies.

Beyond narrative: sound design as dramaturgy in contemporary performance

Autobiographical performance is often characterised by a linguistic approach to storytelling. This paper presents discoveries from a practice-led research inquiry into the mediated translation of narrative elements within the making of autobiographical performance Train Tracks and Rooftops. Specifically, it presents the way sonic texts emerged within the process of translating away from narrative form. The paper sets out the technical aspects of the process and critiques the shift in meaning that comes from an understanding of sound dramaturgy and sound as performance architecture. The experience of the maker/performers' relationship to their live and mediated voice is discussed.

Sounds of the suburb

Sounds of the Suburb was a commissioned public art proposal based upon a brief set by Queensland Rail for the major redevelopment at their Brunswick Street Railway Station, Fortitude Valley, Brisbane. I proposed a large scale, electronic artwork to be distributed across the glass fronted structure of their station’s new concourse building. It was designed as a network of LED based ‘tracking’ - along which would travel electronically animated, ‘trains’ of text synchronised to the actual train timetables. Each message packet moved endlessly through a complex spatial network of ‘tracks’ and ‘stations’ set both inside, outside and via the concourse. The design was underpinned by large scale image of sound waves etched onto the architecture’s glass and was accompanied by two inset monitors each presenting ghosted images of passenger movements within the concourse, time-delay recorded and then cross-combined in realtime to form new composites.----- Each moving, reprogrammable phrase was conceived as a ‘train of thought’ and ostensibly contained an idea or concept about popular cultures surrounding contemporary music – thereby meeting the brief that the work should speak to the diverse musical cultures central to Fortitude Valley’s image as an entertainment hub. These cultural ‘memes’, gathered from both passengers and the music press were situated alongside quotes from philosophies of networking, speed and digital ecologies. These texts would continually propagate, replicate and cross fertlise as they moved throughout the ‘network’, thereby writing a constantly evolving ‘textual soundcape’ of that place. This idea was further cemented through the pace, scale and rhythm of passenger movements continually recorded and re-presented on the smaller screens.

Sound radiation characteristics of a box-type structure

The finite element and boundary element methods are employed in this study to investigate the sound radiation characteristics of a box-type structure. It has been shown [T.R. Lin, J. Pan, Vibration characteristics of a box-type structure, Journal of Vibration and Acoustics, Transactions of ASME 131 (2009) 031004-1–031004-9] that modes of natural vibration of a box-type structure can be classified into six groups according to the symmetry properties of the three panel pairs forming the box. In this paper, we demonstrate that such properties also reveal information about sound radiation effectiveness of each group of modes. The changes of radiation efficiencies and directivity patterns with the wavenumber ratio (the ratio between the acoustic and the plate bending wavenumbers) are examined for typical modes from each group. Similar characteristics of modal radiation efficiencies between a box structure and a corresponding simply supported panel are observed. The change of sound radiation patterns as a function of the wavenumber ratio is also illustrated. It is found that the sound radiation directivity of each box mode can be correlated to that of elementary sound sources (monopole, dipole, etc.) at frequencies well below the critical frequency of the plates of the box. The sound radiation pattern on the box surface also closely related to the vibration amplitude distribution of the box structure at frequencies above the critical frequency. In the medium frequency range, the radiated sound field is dominated by the edge vibration pattern of the box. The radiation efficiency of all box modes reaches a peak at frequencies above the critical frequency, and gradually approaches unity at higher frequencies.

Beyond the sound barrier

Freeway barriers used to be just great slabs of concrete that lined the road to tr and protect nearby residents from the constant rumble of the traffic. But in recent years, their visual appeal has become as important as their practical purpose with architects and designers clamouring to show off their ideas to the vast traveling public. Melbourne's Craigieburn Bypass is the latest to be recognised for its dual appeal winning the Urban Design Award at the recent Victorian Architecture Awards.

Aural auteur : sound in the films of Rolf de Heer

An interpretative methodology for understanding meaning in cinema since the 1950s, auteur analysis is an approach to film studies in which an individual, usually the director, is studied as the author of her or his films. The principal argument of this thesis is that proponents of auteurism have privileged examination of the visual components in a film-maker’s body of work, neglecting the potentially significant role played by sound. The thesis seeks to address this problematic imbalance by interrogating the creative use of sound in the films written and directed by Rolf de Heer, asking the question, “Does his use of sound make Rolf de Heer an aural auteur?” In so far as the term ‘aural’ encompasses everything in the film that is heard by the audience, the analysis seeks to discover if de Heer has, as Peter Wollen suggests of the auteur and her or his directing of the visual components (1968, 1972 and 1998), unconsciously left a detectable aural signature on his films. The thesis delivers an innovative outcome by demonstrating that auteur analysis that goes beyond the mise-en-scène (i.e. visuals) is productive and worthwhile as an interpretive response to film. De Heer’s use of the aural point of view and binaural sound recording, his interest in providing a ‘voice’ for marginalised people, his self-penned song lyrics, his close and early collaboration with composer Graham Tardif and sound designer Jim Currie, his ‘hands-on’ approach to sound recording and sound editing and his predilection for making films about sound are all shown to be examples of de Heer’s aural auteurism. As well as the three published (or accepted for publication) interviews with de Heer, Tardif and Currie, the dissertation consists of seven papers refereed and published (or accepted for publication) in journals and international conference proceedings, a literature review and a unifying essay. The papers presented are close textual analyses of de Heer’s films which, when considered as a whole, support the thesis’ overall argument and serve as a comprehensive auteur analysis, the first such sustained study of his work, and the first with an emphasis on the aural.

Predictions of angle dependent tortuosity and elasticity effects on sound propagation in cancellous bone

The anisotropic pore structure and elasticity of cancellous bone cause wave speeds and attenuation in cancellous bone to vary with angle. Previously published predictions of the variation in wave speed with angle are reviewed. Predictions that allow tortuosity to be angle dependent but assume isotropic elasticity compare well with available data on wave speeds at large angles but less well for small angles near the normal to the trabeculae. Claims for predictions that only include angle-dependence in elasticity are found to be misleading. Audio-frequency data obtained at audio-frequencies in air-filled bone replicas are used to derive an empirical expression for the angle-and porosity-dependence of tortuosity. Predictions that allow for either angle dependent tortuosity or angle dependent elasticity or both are compared with existing data for all angles and porosities.

Soundcipher : a music and sound library for processing

SoundCipher is a software library written in the Java language that adds important music and sound features to the Processing environment that is widely used by media artists and otherwise has an orientation toward computational graphics. This article introduces the SoundCipher library and its features, describes its influences and design intentions, and positions it within the field of computer music programming tools. SoundCipher enables the rich history of algorithmic music techniques to be accessible within one of today’s most popular media art platforms. It also provides an accessible means for learning to create algorithmic music and sound programs.