Visual voice activity detection using frontal versus profile views

Visual activity detection of lip movements can be used to overcome the poor performance of voice activity detection based solely in the audio domain, particularly in noisy acoustic conditions. However, most of the research conducted in visual voice activity detection (VVAD) has neglected addressing variabilities in the visual domain such as viewpoint variation. In this paper we investigate the effectiveness of the visual information from the speaker’s frontal and profile views (i.e left and right side views) for the task of VVAD. As far as we are aware, our work constitutes the first real attempt to study this problem. We describe our visual front end approach and the Gaussian mixture model (GMM) based VVAD framework, and report the experimental results using the freely available CUAVE database. The experimental results show that VVAD is indeed possible from profile views and we give a quantitative comparison of VVAD based on frontal and profile views The results presented are useful in the development of multi-modal Human Machine Interaction (HMI) using a single camera, where the speaker’s face may not always be frontal.

Reflection of My Digital Mind

This artwork visualised my digital mind which is built on my technology experience. The contemporary technologies make available many small pieces of factual information that have affected the formation of my identity. This results that multiple identities can exist in a rhizomatic form through a vertical gene transfer. This does not refer to schizophrenia, but an ongoing transformation of digital mind.

Regimes and rebels

The end of the recent Communist occupation of the many countries bordering Russia marked an end to the tyranny of illegal and forced annexation. Amid these countries are my parents’ homelands, the small Baltic nations of Latvia and Estonia. Their occupation contravenes many of the numerous Articles listed by The Office of the High Commissioner for Human Rights in The Universal Declaration of Human Rights (2008), constituting many acts of violation. As a filmmaker, I was unusually incognizant of these events, despite my relationship to them. My parents never discussed the war, while during the ensuing Communist era, information was conspicuously absent. However, this lack of knowledge provided the incentive that compelled a journey of discovery that resulted in the making of Regimes and Rebels. This Masters project is presented is two parts. The film equates to 70% of the project (52 minutes in length), whilst the exegesis represents the remaining 30%. The film is a ‘human rights’, ‘video diary’ styled documentary film about the Communist occupation of my parents’ homelands, Latvia and Estonia, and the resonating effect of the occupation on our family living in Australia and family still living in the homelands. The production of the video diary is contextualised by this exegesis, which concurrently discusses the burgeoning video diary format as the basis for making a ‘human rights’ documentary film. A discussion about the latter genre of documentary film ensues, encompassing modes of representation, followed by various issues related to production including: issues of aesthetics, styles, digital media, lack of evidence and subjectivity analogous with both filmmaker and audience. Next, work by other filmmakers in the ‘human rights’ genre, linked to the proliferation of Communism in Europe, is discussed and analysed in terms of production and modes of representation. The exegesis ends with my experience as filmmaker and an analysis of factors that arose in making Regimes and Rebels.

Competition and innovation : independent production in the Chinese TV industry

Independent television production is recognised for its capacity to generate new kinds of program content, as well as deliver innovation in formats. Globally, the television industry is entering into the post-broadcasting era where audiences are fragmented and content is distributed across multiple platforms. The effects of this convergence are now being felt in China, as it both challenges old statist models and presents new opportunities for content innovation. This thesis discusses the status of independent production in China, making relevant comparisons with independent production in other countries. Independent television production has become an important element in the reform of broadcasting in China in the past decade. The first independent TV production company was registered officially in 1994. While there are now over 4000 independent companies, the term „independent. does not necessarily constitute autonomy. The question the thesis addresses is: what is the status and nature of independence in China? Is it an appropriate term to use to describe the changing environment, or is it a misnomer? The thesis argues that Chinese independents operate alongside the mainstream state-owned system; they are „dependent. on the mainstream. Therefore independent television in China is a relative term. By looking at several companies in Beijing, mainly in entertainment, TV drama and animation, the thesis shows how the sector is injecting fresh ideas into the marketplace and how it plays an important role in improving innovation in many aspects of the television industry. The thesis shows how independent television companies in China are looking to protect their property rights. It demonstrates that far from being at the cutting edge, independents are reliant on a system that has many inbuilt structural problems. The thesis outlines many of the challenges facing 'independents'.

Developing a digital image watermarking model

This paper presents a key based generic model for digital image watermarking. The model aims at addressing an identified gap in the literature by providing a basis for assessing different watermarking requirements in various digital image applications. We start with a formulation of a basic watermarking system, and define system inputs and outputs. We then proceed to incorporate the use of keys in the design of various system components. Using the model, we also define a few fundamental design and evaluation parameters. To demonstrate the significance of the proposed model, we provide an example of how it can be applied to formally define common attacks.

Andrzej Zielinski : pulp digital fictions

This is a review of painter Andrzej Zielinski's exhibition at gallery 9 in Sydney. It highlights the artist's expressionistic style and strong colour sense as well as his association with American painterly traditions. The artist application of acrylic modelling paste and his paintings also gives them a sculptural and architectural dimension, and on a conceptual level play with notions of mimesis and material form.

Analysis of productive performance of crop and animal production systems : an integrated analytical framework

This article presents a two-stage analytical framework that integrates ecological crop (animal) growth and economic frontier production models to analyse the productive efficiency of crop (animal) production systems. The ecological crop (animal) growth model estimates "potential" output levels given the genetic characteristics of crops (animals) and the physical conditions of locations where the crops (animals) are grown (reared). The economic frontier production model estimates "best practice" production levels, taking into account economic, institutional and social factors that cause farm and spatial heterogeneity. In the first stage, both ecological crop growth and economic frontier production models are estimated to calculate three measures of productive efficiency: (1) technical efficiency, as the ratio of actual to "best practice" output levels; (2) agronomic efficiency, as the ratio of actual to "potential" output levels; and (3) agro-economic efficiency, as the ratio of "best practice" to "potential" output levels. Also in the first stage, the economic frontier production model identifies factors that determine technical efficiency. In the second stage, agro-economic efficiency is analysed econometrically in relation to economic, institutional and social factors that cause farm and spatial heterogeneity. The proposed framework has several important advantages in comparison with existing proposals. Firstly, it allows the systematic incorporation of all physical, economic, institutional and social factors that cause farm and spatial heterogeneity in analysing the productive performance of crop and animal production systems. Secondly, the location-specific physical factors are not modelled symmetrically as other economic inputs of production. Thirdly, climate change and technological advancements in crop and animal sciences can be modelled in a "forward-looking" manner. Fourthly, knowledge in agronomy and data from experimental studies can be utilised for socio-economic policy analysis. The proposed framework can be easily applied in empirical studies due to the current availability of ecological crop (animal) growth models, farm or secondary data, and econometric software packages. The article highlights several directions of empirical studies that researchers may pursue in the future.

It’s not me, it’s you : a participant observation case study of the self-publishing musician in the 21st century

This thesis explores the business environment for self-publishing musicians at the end of the 20th century and the start of the 21st century from theoretical and empirical standpoints. The exploration begins by asking three research questions: what are the factors affecting the sustainability of an Independent music business; how many of those factors can be directly influenced by an Independent musician in the day-to-day operations of their musical enterprise; and how can those factors be best manipulated to maximise the benefit generated from digital music assets? It answers these questions by considering the nature of value in the music business in light of theories of political economy, then quantitative and qualitative examinations of the nature of participation in the music business, and then auto-ethnographic approaches to the application of two technologically enabled tools available to Independent musicians. By analyzing the results of five different examinations of the topic it answers each research question with reference to four sets of recurring issues that affect the operations of a 21st century music business: the musicians’ personal characteristics, their ability to address their business’s informational needs; their ability to manage the relationships upon which their business depends; and their ability to resolve the remaining technological problems that confront them. It discusses ways in which Independent self-publishing musicians can and cannot deal with these four issues on a day-to-day basis and highlights aspects for which technological solutions do not exist as well as ways in which technology is not as effective as has been claimed. It then presents a self-critique and proposes some directions for further study before concluding by suggesting some common features of 21st century Independent music businesses. This thesis makes three contributions to knowledge. First, it provides a new understanding of the sources of musical value, shows how this explains changes in the music industries over the past 30 years, and provides a framework for predicting future developments in those industries. Second, it shows how the technological discontinuity that has occurred around the start of the 21st century has and has not affected the production and distribution of digital cultural artefacts and thus the attitudes, approaches, and business prospects of Independent musicians. Third, it argues for new understandings of two methods by which self-publishing musicians can grow a business using production methods that are only beginning to be more broadly understood: home studio recording and fan-sourced production. Developed from the perspective of working musicians themselves, this thesis identifies four sets of issues that determine the probable success of musicians’ efforts to adopt new technologies to capture the value of the musicians’ creativity and thereby foster growth that will sustain an Independent music business in the 21st century.

The moral economy of social media

In this chapter we take a high-level view of social media, focusing not on specific applications, domains, websites, or technologies, but instead our interest is in the forms of engagement that social media engender. This is not to suggest that all social media are the same, or even that everyone’s experience with any particular medium or technology is the same. However, we argue common issues arise that characterize social media in a broad sense, and provide a different analytic perspective than we would gain from looking at particular systems or applications. We do not take the perspective that social life merely happens “within” such systems, nor that social life “shapes” such systems, but rather these systems provide a site for the production of social and cultural reality – that media are always already social and the engagement with, in, and through media of all sorts is a thoroughly social phenomenon. Accordingly, in this chapter, we examine two phenomena concurrently: social life seen through the lens of social media, and social media seen through the lens of social life. In particular, we want to understand the ways that a set of broad phenomena concerning forms of participation in social life is articulated in the domain of social media. As a conceptual entry-point, we use the notion of the “moral economy” as a means to open up the domain of inquiry. We first discuss the notion of the “moral economy” as it has been used by a number of social theorists, and then identify a particular set of conceptual concerns that we suggest link it to the phenomena of social networking in general. We then discuss a series of examples drawn from a range of studies to elaborate and ground this conceptual framework in empirical data. This leads us to a broader consideration of audiences and publics in social media that, we suggest, holds important lessons for how we treat social media analytically.

Journeys with friends

Journeys with Friends Truna aka J. Turner, Giselle Rosman and Matt Ditton Panel Session description: We are no longer an industry (alone) we are a sector. Where the model once consisted of industry making games, we now see the rise of a cultural sector playing in the game space – industry, indies (for whatever that distinction implies) artists (another odd distinction), individuals and well … everyone and their mums. This evolution has an affect – on audiences and who they are, what they expect and want, and how they understand the purpose and language of these “digital game forms’; how we talk about our worlds and the kinds of issues that are raised; on what we create and how we create it and on our communities and who we are. This evolution has an affect on how these works are understood within the wider social context and how we present this understanding to the next generation of makers and players. We can see the potential of this evolution from industry to sector in the rise of the Australian indie. We can see the potential fractures created by this evolution in the new voices that ask questions about diversity and social justice. And yet, we still see a ‘solution’ type reaction to the current changing state of our sector which announces the monolithic, Fordist model as desirable (albeit in smaller form) – with the subsequent ramifications for ‘training’ and production of local talent. Experts talk about a mismatch of graduate skills and industry needs, insufficient linkages between industry and education providers and the need to explore opportunity for the now passing model in new spaces such as adver-games and serious games. Head counts of Australian industry don’t recognise trans media producers as being part of their purview or opportunity, they don’t count the rise of the cultural playful game inspired creative works as one of thier team. Such perspectives are indeed relevant to the Australian Games Industry, but what about the emerging Australian Games Sector? How do we enable a future in such a space? This emerging sector is perhaps best represented by Melbourne’s Freeplay audience: a heady mix of indie developers, players, artists, critical thinkers and industry. Such audiences are no longer content with an ‘industry’ alone; they are the community who already see themselves as an important, vibrant cultural sector. Part of the discussion presented here seeks to identify and understand the resources, primarily in the context of community and educational opportunities, available to the evolving sector now relying more on the creative processes. This creative process and community building is already visibly growing within the context of smaller development studios, often involving more multiskilling production methodologies where the definition of ‘game’ clearly evolves beyond the traditional one.

YouTube and the formalisation of amateur media

This chapter describes how, as YouTube has scaled up both as a platform and as a company, its business model and the consequences for its copyright regulation strategies have co-evolved, and so too the boundaries between amateur and professional media have shifted and blurred in particular ways. As YouTube, Inc moves to more profitably arrange and stabilise the historically contentious relations among rights-holders, uploaders, advertisers and audiences, some forms of amateur video production have become institutionalised and professionalised, while others have been further marginalised and driven underground or to other, more forgiving, platforms.

The promise and possibilities of music, digital media and National Broadband Network

In this article I would like to examine the promise and possibilities of music, digital media and National Broadband Network. I will do this based on concepts that have emerged from a study undertaken by Professor Andrew Brown and I that categorise technologies into what we term representational technologies and technologies with agency

QUT Design Lecture Series

The QUT Design Lecture Series 2010 was a partnered event between QUT School of Design and the State Library of Queensland. The series, spanning from July to September 2010, involved 10 lectures delivered by international, national and local academics, researchers and practitioners. The QUT Design Lecture series 2010 was a public event which examined the cross over between design, digital technologies and artistic practices focusing upon research themes of intangible media, experimental eco-technologies and artistic-design production. Gold Medal Australian Institute of Architects, Clare Design opened the series, whilst internationally awarded and recognised Spanish design group Cloud 9 concluded the series, both focusing on new eco-technologies in the development of contemporary architecture.

Digital economy future directions

Advances in information and communication technologies have brought about an information revolution, leading to fundamental changes in the way information is collected or generated, shared and distributed. The internet and digital technologies are re-shaping research, innovation and creativity. Economic research has highlighted the importance of information flows and the availability of information for access and re-use. Information is crucial to the efficiency of markets and enhanced information flows promote creativity, innovation and productivity. There is a rapidly expanding body of literature which supports the economic and social benefits of enabling access to and re-use of public sector information.1 (Note that a substantial research project associated with QUT’s Intellectual Property: Knowledge, Culture and Economy (IPKCE) Research Program is engaged in a comprehensive study and analysis of the literature on the economics of access to public sector information.)