Can audio-visual speech recognition outperform acoustically enhanced speech recognition in automotive environment?

The use of visual features in the form of lip movements to improve the performance of acoustic speech recognition has been shown to work well, particularly in noisy acoustic conditions. However, whether this technique can outperform speech recognition incorporating well-known acoustic enhancement techniques, such as spectral subtraction, or multi-channel beamforming is not known. This is an important question to be answered especially in an automotive environment, for the design of an efficient human-vehicle computer interface. We perform a variety of speech recognition experiments on a challenging automotive speech dataset and results show that synchronous HMM-based audio-visual fusion can outperform traditional single as well as multi-channel acoustic speech enhancement techniques. We also show that further improvement in recognition performance can be obtained by fusing speech-enhanced audio with the visual modality, demonstrating the complementary nature of the two robust speech recognition approaches.

Night Rage/ Night Fall

A new form of media installation combining image, multi-channel sound and internally lit objects into a mysterious, deep image plane. Staged on the very edge of spectrum blackout, and moving into the deep of night, Version 1 (Night Rage) for ISEA 2013 examined the many shades of 'nocturnal', threats to night biodiversity and the myriad myths and stories that have shaped our cultural understandings of life after light. Barely recognisable images float within landscapes of media, noise and sound as the work asserts a profound resistance to today's all consuming media mesh. Version 2 (Night Fall) for the Queensland State Museum examined contemporary ideas around the ‘night’ and the 'nocturnal'. Beginning with the dark myths and stories that have long shaped our cultural understandings of life after light, NIGHT FALL considers how fearful ideas have often underpinned actions that continue to reduce Australia’s extraordinary night biodiversity. Today’s growing hostility towards Australia’s ancient, iconic flying foxes - who have been quietly pollinating our forests for millennia - hints at just how far we have yet to travel in our thinking. Enter the darkened tunnel to experience mysterious, edge-of-perception 3D forms, enhanced by a range of cinematic, illusionary and animatronic techniques, and become immersed in a strangely familiar sound track based upon seasonal field recordings made after dark, sourced from across the eastern coast of Queensland.

Designing channels for brand value : four meta-models

Channels are becoming an increasingly important area for companies to innovate, specifically as they provide direct points of contact with their customers. However, little is known in regards to multi-channel strategies that embody strategic brand values and how customers experience these channels collectively. The purpose of this paper is to investigate how organisations configure multi- channel strategies to communicate their brand value and experience to their customers. Data was collated from sixty companies through a content analysis methodology within the retail sector. Results uncovered commonalities through the identification of four meta-models surrounding common brand values, intended emotive experience, individual channels and the customer segment. These meta-models are titled: High Quality, Trust, Convenience and Community. This research also presents implications of a multi-channel design tool based on findings from this study to help reinforce company brand values and design an overall connected customer experience.

Silver palace

Silver palace is a multi-channel screen-based installation that explores the part that the landscape and narration play in cinematic constructions of gendered identity. The exhibition examines the ways in which our experience as a viewer of cinematic imagery can be both constructed and expanded within a gallery context.

across the sea

'Across the sea' is a multi-channel screen-based installation that explores the part that the landscape and narration play in cinematic constructions of gendered identity. The work is informed by new wave cinema, feminist film theory and emergent ideas of a female gaze. across the sea considers both the role of the artist, as well as the auteur in cinema, to question how the outcomes differ when a female rather than a male gaze is writing, directing and filming the imagery. The screen-based installation of 'across the sea' seeks to further examine the ways in which our experience as a viewer of cinematic imagery can be both constructed and expanded within a gallery context. across the sea investigates the spaces that exist between the gallery and the cinema, in an effort to consider notions of femininity that exist between and throughout the varied spaces of film and art.

The elaboration likelihood model : review, critique and research agenda

Purpose: The purpose of this paper is to review, critique and develop a research agenda for the Elaboration Likelihood Model (ELM). The model was introduced by Petty and Cacioppo over three decades ago and has been modified, revised and extended. Given modern communication contexts, it is appropriate to question the model’s validity and relevance. Design/methodology/approach: The authors develop a conceptual approach, based on a fully comprehensive and extensive review and critique of ELM and its development since its inception. Findings: This paper focuses on major issues concerning the ELM. These include model assumptions and its descriptive nature; continuum questions, multi-channel processing and mediating variables before turning to the need to replicate the ELM and to offer recommendations for its future development. Research limitations/implications: This paper offers a series of questions in terms of research implications. These include whether ELM could or should be replicated, its extension, a greater conceptualization of argument quality, an explanation of movement along the continuum and between central and peripheral routes to persuasion, or to use new methodologies and technologies to help better understanding consume thinking and behaviour? All these relate to the current need to explore the relevance of ELM in a more modern context. Practical implications: It is time to question the validity and relevance of the ELM. The diversity of on- and off-line media options and the variants of consumer choice raise significant issues. Originality/value: While the ELM model continues to be widely cited and taught as one of the major cornerstones of persuasion, questions are raised concerning its relevance and validity in 21st century communication contexts.

Online grocery shopping: The impact of shopping frequency on perceived risk

Online grocery shopping has enjoyed strong growth and it is predicted this channel will continue to grow exponentially in the coming years. While online shopping has attracted an abundance of research interest, examinations of online grocery shopping behaviour are only now emerging. Shopping online for groceries differs considerably from general online shopping due to the perishability and variability of the product, and frequency of the shopping activity. Two salient gaps underpin this research into online grocery shopping. This study responds to calls to investigate the online shoppers’ experience in the context of online purchasing frequency. Second, this study examines the mediating effect of perceived risk between trust and online repurchase intention of groceries. An online survey was employed to collect data from shoppers who were recruited from a multi-channel grocery e-retailer’s database. The online survey, comprising 16 reflective validated scale items, was sent to 555 frequent and infrequent online grocery shoppers. Results find that while customer satisfaction predicts trust for both infrequent and frequent online grocery shoppers, perceived risk fully mediates the effect of trust on repurchase intentions for infrequent online grocery shoppers. Furthermore path analysis reveals that the developed behavioural model is variant across both groups of shoppers. Theoretically, we provide a deeper understanding of the online customer experience, while gaining insight into two shopper segments identified as being important to grocery e-retailers. For managers, this study tests an online customer behavioural model with actual purchasing behaviour and identifies the continued presence of perceived risk in grocery e-retailing regardless of purchase frequency or experience.

Animal Spirits

Animal Spirits is multi-channel video portrait of key personalities involved in the Global Financial Crisis. The four-screen installation displays these twelve decapitated apostles of free-market economic theory in a tableau of droning pontification. Trapped in a purgatorial loop, they endlessly spout vague and obfuscating explanations and defenses of their ideologies and (in)actions. The work takes a creatively quotidian approach to understanding the language of economics and the financial services industry. Through its endless loop of sound, image, and spoken text, the installation examines some of the ideas, narratives and power dynamics that foster and reward hubris and greed.

Audio signalling as a backup communication channel for multi-robot systems

This paper presents a low-bandwidth multi-robot communication system designed to serve as a backup communication channel in the event a robot suffers a network device fault. While much research has been performed in the area of distributing network communication across multiple robots within a system, individual robots are still susceptible to hardware failure. In the past, such robots would simply be removed from service, and their tasks re-allocated to other members. However, there are times when a faulty robot might be crucial to a mission, or be able to contribute in a less communication intensive area. By allowing robots to encode and decode messages into unique sequences of DTMF symbols, called words, our system is able to facilitate continued low-bandwidth communication between robots without access to network communication. Our results have shown that the system is capable of permitting robots to negotiate task initiation and termination, and is flexible enough to permit a pair of robots to perform a simple turn taking task.

Network interactions and performance of a multi-function IEC 61850 process bus

New substation technology, such as non-conventional instrument transformers,and a need to reduce design and construction costs, are driving the adoption of Ethernet based digital process bus networks for high voltage substations. Protection and control applications can share a process bus, making more efficient use of the network infrastructure. This paper classifies and defines performance requirements for the protocols used in a process bus on the basis of application. These include GOOSE, SNMP and IEC 61850-9-2 sampled values. A method, based on the Multiple Spanning Tree Protocol (MSTP) and virtual local area networks, is presented that separates management and monitoring traffic from the rest of the process bus. A quantitative investigation of the interaction between various protocols used in a process bus is described. These tests also validate the effectiveness of the MSTP based traffic segregation method. While this paper focusses on a substation automation network, the results are applicable to other real-time industrial networks that implement multiple protocols. High volume sampled value data and time-critical circuit breaker tripping commands do not interact on a full duplex switched Ethernet network, even under very high network load conditions. This enables an efficient digital network to replace a large number of conventional analog connections between control rooms and high voltage switchyards.

Measurement, modelling and capacity analysis for novel, fixed multi-user single-antenna MIMO-OFDM system, in rural environments

High-speed broadband internet access is widely recognised as a catalyst to social and economic development. However, the provision of broadband Internet services with the existing solutions to rural population, scattered over an extensive geographical area, remains both an economic and technical challenge. As a feasible solution, the Commonwealth Scientific and Industrial Research Organization (CSIRO) proposed a highly spectrally efficient, innovative and cost-effective fixed wireless broadband access technology, which uses analogue TV frequency spectrum and Multi-User MIMO (MUMIMO) technology with Orthogonal-Frequency-Division-Multiplexing (OFDM). MIMO systems have emerged as a promising solution for the increasing demand of higher data rates, better quality of service, and higher network capacity. However, the performance of MIMO systems can be significantly affected by different types of propagation environments e.g., indoor, outdoor urban, or outdoor rural and operating frequencies. For instance, large spectral efficiencies associated with MIMO systems, which assume a rich scattering environment in urban environments, may not be valid for all propagation environments, such as outdoor rural environments, due to the presence of less scatterer densities. Since this is the first time a MU-MIMO-OFDM fixed broadband wireless access solution is deployed in a rural environment, questions from both theoretical and practical standpoints arise; For example, what capacity gains are available for the proposed solution under realistic rural propagation conditions?. Currently, no comprehensive channel measurement and capacity analysis results are available for MU-MIMO-OFDM fixed broadband wireless access systems which employ large scale multiple antennas at the Access Point (AP) and analogue TV frequency spectrum in rural environments. Moreover, according to the literature, no deterministic MU-MIMO channel models exist that define rural wireless channels by accounting for terrain effects. This thesis fills the aforementioned knowledge gaps with channel measurements, channel modeling and comprehensive capacity analysis for MU-MIMO-OFDM fixed wireless broadband access systems in rural environments. For the first time, channel measurements were conducted in a rural farmland near Smithton, Tasmania using CSIRO's broadband wireless access solution. A novel deterministic MU-MIMO-OFDM channel model, which can be used for accurate performance prediction of rural MUMIMO channels with dominant Line-of-Sight (LoS) paths, was developed under this research. Results show that the proposed solution can achieve 43.7 bits/s/Hz at a Signal-to- Noise Ratio (SNR) of 20 dB in rural environments. Based on channel measurement results, this thesis verifies that the deterministic channel model accurately predicts channel capacity in rural environments with a Root Mean Square (RMS) error of 0.18 bits/s/Hz. Moreover, this study presents a comprehensive capacity analysis of rural MU-MIMOOFDM channels using experimental, simulated and theoretical models. Based on the validated deterministic model, further investigations on channel capacity and the eects of capacity variation, with different user distribution angles (θ) around the AP, were analysed. For instance, when SNR = 20dB, the capacity increases from 15.5 bits/s/Hz to 43.7 bits/s/Hz as θ increases from 10° to 360°. Strategies to mitigate these capacity degradation effects are also presented by employing a suitable user grouping method. Outcomes of this thesis have already been used by CSIRO scientists to determine optimum user distribution angles around the AP, and are of great significance for researchers and MU-MUMO-OFDM system developers to understand the advantages and potential capacity gains of MU-MIMO systems in rural environments. Also, results of this study are useful to further improve the performance of MU-MIMO-OFDM systems in rural environments. Ultimately, this knowledge contribution will be useful in delivering efficient, cost-effective high-speed wireless broadband systems that are tailor-made for rural environments, thus, improving the quality of life and economic prosperity of rural populations.

Channel tracking in SDMA-based multi-user MIMO-OFDM communications systems

Capacity of current and future high data rate wireless communications depend significantly on how well changes in the wireless channel are predicted and tracked. Generally, this can be estimated by transmitting known symbols. However, this increases overheads if the channel varies over time. Given today’s bandwidth demand and the increased necessity for mobile wireless devices, the contributions of this research are very significant. This study has developed a novel and efficient channel tracking algorithm that can recursively update the channel estimation for wireless broadband communications reducing overheads, therefore increasing the speed of wireless communication systems.

Effects of wireless sensor network uncertainties on output-only modal analysis employing merged data of multiple tests

The use of Wireless Sensor Networks (WSNs) for vibration-based Structural Health Monitoring (SHM) has become a promising approach due to many advantages such as low cost, fast and flexible deployment. However, inherent technical issues such as data asynchronicity and data loss have prevented these distinct systems from being extensively used. Recently, several SHM-oriented WSNs have been proposed and believed to be able to overcome a large number of technical uncertainties. Nevertheless, there is limited research verifying the applicability of those WSNs with respect to demanding SHM applications like modal analysis and damage identification. Based on a brief review, this paper first reveals that Data Synchronization Error (DSE) is the most inherent factor amongst uncertainties of SHM-oriented WSNs. Effects of this factor are then investigated on outcomes and performance of the most robust Output-only Modal Analysis (OMA) techniques when merging data from multiple sensor setups. The two OMA families selected for this investigation are Frequency Domain Decomposition (FDD) and data-driven Stochastic Subspace Identification (SSI-data) due to the fact that they both have been widely applied in the past decade. Accelerations collected by a wired sensory system on a large-scale laboratory bridge model are initially used as benchmark data after being added with a certain level of noise to account for the higher presence of this factor in SHM-oriented WSNs. From this source, a large number of simulations have been made to generate multiple DSE-corrupted datasets to facilitate statistical analyses. The results of this study show the robustness of FDD and the precautions needed for SSI-data family when dealing with DSE at a relaxed level. Finally, the combination of preferred OMA techniques and the use of the channel projection for the time-domain OMA technique to cope with DSE are recommended.