Computational approaches to the visual validation of 3D virtual environments

Virtual environments can provide, through digital games and online social interfaces, extremely exciting forms of interactive entertainment. Because of their capability in displaying and manipulating information in natural and intuitive ways, such environments have found extensive applications in decision support, education and training in the health and science domains amongst others. Currently, the burden of validating both the interactive functionality and visual consistency of a virtual environment content is entirely carried out by developers and play-testers. While considerable research has been conducted in assisting the design of virtual world content and mechanics, to date, only limited contributions have been made regarding the automatic testing of the underpinning graphics software and hardware. The aim of this thesis is to determine whether the correctness of the images generated by a virtual environment can be quantitatively defined, and automatically measured, in order to facilitate the validation of the content. In an attempt to provide an environment-independent definition of visual consistency, a number of classification approaches were developed. First, a novel model-based object description was proposed in order to enable reasoning about the color and geometry change of virtual entities during a play-session. From such an analysis, two view-based connectionist approaches were developed to map from geometry and color spaces to a single, environment-independent, geometric transformation space; we used such a mapping to predict the correct visualization of the scene. Finally, an appearance-based aliasing detector was developed to show how incorrectness too, can be quantified for debugging purposes. Since computer games heavily rely on the use of highly complex and interactive virtual worlds, they provide an excellent test bed against which to develop, calibrate and validate our techniques. Experiments were conducted on a game engine and other virtual worlds prototypes to determine the applicability and effectiveness of our algorithms. The results show that quantifying visual correctness in virtual scenes is a feasible enterprise, and that effective automatic bug detection can be performed through the techniques we have developed. We expect these techniques to find application in large 3D games and virtual world studios that require a scalable solution to testing their virtual world software and digital content.

Performance recordivity : studio music in a live context

A broad range of positions is articulated in the academic literature around the relationship between recordings and live performance. Auslander (2008) argues that “live performance ceased long ago to be the primary experience of popular music, with the result that most live performances of popular music now seek to replicate the music on the recording”. Elliott (1995) suggests that “hit songs are often conceived and produced as unambiguous and meticulously recorded performances that their originators often duplicate exactly in live performances”. Wurtzler (1992) argues that “as socially and historically produced, the categories of the live and the recorded are defined in a mutually exclusive relationship, in that the notion of the live is premised on the absence of recording and the defining fact of the recorded is the absence of the live”. Yet many artists perform in ways that fundamentally challenge such positions. Whilst it is common practice for musicians across many musical genres to compose and construct their musical works in the studio such that the recording is, in Auslander’s words, the ‘original performance’, the live version is not simply an attempt to replicate the recorded version. Indeed in some cases, such replication is impossible. There are well known historical examples. Queen, for example, never performed the a cappella sections of Bohemian Rhapsody because it they were too complex to perform live. A 1966 recording of the Beach Boys studio creation Good Vibrations shows them struggling through the song prior to its release. This paper argues that as technology develops, the lines between the recording studio and live performance change and become more blurred. New models for performance emerge. In a 2010 live performance given by Grammy Award winning artist Imogen Heap in New York, the artist undertakes a live, improvised construction of a piece as a performative act. She invites the audience to choose the key for the track and proceeds to layer up the various parts in front of the audience as a live performance act. Her recording process is thus revealed on stage in real time and she performs a process that what would have once been confined to the recording studio. So how do artists bring studio production processes into the live context? What aspects of studio production are now performable and what consistent models can be identified amongst the various approaches now seen? This paper will present an overview of approaches to performative realisations of studio produced tracks and will illuminate some emerging relationships between recorded music and performance across a range of contexts.

Sound thinking : tips and tools for understanding popular music

Sound Thinking provides techniques and approaches to critically listen, think, talk and write about music you hear or make. It provides tips on making music and it encourages regular and deep thinking about music activities, which helps build a musical dialog that leads to deeper understanding.

Restrung new chamber festival : an exploration of contemporary string practice

The Restrung New Chamber Festival was a practice-led research project which explored the intricacies of musical relationships. Specifically, it investigated the nature of contemporary string practice, with "New music" at its core. For the purposes of this project, "New music" will be defined in terms of representing a "global sonorous space" (Nancy 2007:12), which Hulse describes as "a spectacular comingling of styles and an unprecedented explosion of creative possibilities" (Hulse n.d.:2). Approaches to staging such an event are contextualised through a comparative analysis with relevant Australian and European festivals. The Restrung model derived inspiration from both art music and popular music festival models, in several aspects. One strategy was to engage audiences through combinations of musical, visual and spatial features. Another strategy was to encourage interaction by audiences with installations, workshops and forums. Restrung represents a new and distinctive model which presented art music within an immersive environment. This exegesis presents an evaluation framework which investigates the relationship between curatorial input and the experiential qualities of the festival. The context of an overview of trends in arts festival curation informs the discussion, as well as approaches to identifying new and receptive audiences. It is expected that the evaluation framework will provide a useful and practical guide for curators working in contemporary string practice, hybrid arts, experimental and cross-art form festival design.

When There's Love

This work is an installation featuring three video projections, music and mirror balls. The three projections fill the walls with scrolling text borrowed from love song lyrics. Headphones in the gallery space allow you to hear a male voice sing the same words to an impromptu tune. Mirror balls send fragments of light spinning around the room while The Righteous Brothers’ Unchained Melody plays on repeat. This work emphasizes fragmentary, repetitious and spatio-temporal experiences of language in order to question the symbolic conventions of romance. By exaggerating and mixing hackneyed symbolic elements, this work extends on some of Nicolas Bourriaud’s theoretical insights into the creative and critical strategies of ‘postproduction’. In particular, it toys with the intersections between popular culture and inter-subjective experiences.

The feeling

In this video, a thumping house-music track is accompanied by lines of rotating text, which resemble computer screen-savers. The text is sourced from websites offering tips for dating and seducing potential lovers. This work engages with the language of online forums. It reworks text from online advice forums and mixes them with visual codes of computer graphics. By extending on some of Nicolas Bourriaud’s ideas around ‘postproduction’ and the creative and critical strategies of ‘editing’, it offers new speculative perspectives on the relationship between screen realities, desire and romance.

The story of the sixties...a pile-up on the freeway of advanced art

When does 1960s art begin and end? Certainly, aside from a few affinities, the decade’s artistic output does not exactly correspond to its popular conception as the ‘Swinging Sixties’. While it was rare that psychedelic art was truly challenging, the decade saw a number of perceptions change regarding the aims, boundaries and possibilities of experiencing art. Thus, this era has come to represent a watershed or crisis in modernist art. While in the Australian context many of these nascent trends were properly realised in the 1970s – with the full force and impact of post-object art – other challenges were first articulated in the 1950s. So, like any other demarcation of a decade, its limits and boundaries are porous.

The switch

In this video, text types across the screen one line at a time set to an emotive stock music soundtrack. The text combines two teen film plot descriptions into one story. This work engages with the language of Hollywood narratives. By emphasizing the potentially abstract and convoluted qualities of linguistic communication, it challenges our capacity to assimilate information into conventional narratives. It draws specific attention to the conventions of Hollywood plot development, and questions the mechanisms by which they construct and communicate meaning.

Peace unknown

In this freestanding sculpture, domestic ‘in-wall’ speakers are mounted in custom-built cabinets. The speakers play a calming stock music soundtrack. The cabinets are faced with photographic mural wallpaper of a stereotypical waterfall scene. This work examines how we construct, represent and deploy notions of nature in our contemporary lives. It mixes the languages of furniture design, landscape photography and sculpture. Drawing on Zygmunt Bauman’s theoretical work on “liquid modernity”, this work questions how and where we find space for contemplation and reflection in a contemporary context increasingly defined by temporary social bonds and consumer choices.

It will be tonight

In this wall-mounted sculpture, speakers are mounted into a shelf-like object finished with timber veneer. The speakers play a corny groove stock music soundtrack. On top of the shelf sits a digital photographic image approximating a fireplace floating against a colour-gradient background. This work examines how we construct, represent and deploy notions of nature in our contemporary lives. It mixes the languages of furniture design, landscape photography, digital graphics and sculpture. Drawing on Zygmunt Bauman’s theoretical work on “liquid modernity”, this work questions how and where we find space for contemplation and reflection in a contemporary context increasingly defined by temporary social bonds and consumer choices.

Kiss

In an age of mobile phones, Facebook, Twitter and online dating, interactions in mediated environments often outnumber face to face encounters. Kiss is an interactive light artwork by artists Priscilla Bracks & Gavin Sade. Kiss reacts to people standing in front of the artwork looking at each other - the moment before kissing. Without interaction the work generates a seductive, ambient, red lighting display, that creates the restful sense of staring into a fire. A fleeting response of white light – like sparks flying in the air – occurs the moment before two faces touch. These sparks are visible in peripheral vision, but fade when the kissing couple turns to look at the work. This moment - as two people look at each other - is a primal moment when two people recognise each other. Face to face encounters with another person are a privileged phenomenon in which the other person's presence and proximity are strongly felt. Kiss does not respond to every instance of a kiss or a look. Its recognition algorithms are fussy, selecting some faces and not others. As in life it’s difficult to tell why sparks fly with some people but not with others. For some this will be felt as a glitch. “This machine should be part of my social life!” But it does promote trial and error, asking viewers to be intimate in public and look at each other for longer than otherwise socially normal. 10 minutes continuous eye contact is said in most cases to arouse sexual feelings in both parties. But even if we don’t look that long, a short time may be all that is needed to explore the face of the person we are looking at. We see that they are human like us. We experience beauty, difference, discomfort, perhaps even nervous laughing, before turning to a more intimate moment of recognition.

Practices of interactive courseware at Malaysia primary smart school : usage standing and causes attributing

Malaysian teachers are now using interactive courseware in their teaching practices as part of teaching activity in classroom, to teach some subjects such as languages, mathematics, and science. Towards this, there is some debate going on the effectiveness of interactive courseware used in classroom. This paper reports data from interviews conducted with school principals and teachers from six selected primary Smart Schools across Malaysia.The interview conducted is looked on their current school practices and challenges in the implementation of interactive courseware in the classroom. The interview covers several aspects of their school facilities, the causes attributed and their concerns. However, the findings revealed that these six schools generally need more supports in the physical and technical form, in order to utilize the interactive courseware. Initially, the current support from the Malaysian Ministry of Education in physical form has proved that not very helpful. Thus, the respondents suggested that supports should be both: physical and technical. Therefore, this preliminary findings could be used as a pointer to the Malaysian government and other stakeholders to the improvement of interface design for future interactive courseware.

Visual acuity is not what it seems : on Ian Burn's 'Late' reflections

A whole tradition is said to be based on the hierarchical distinction between the perceptual and conceptual. In art, Niklas Luhmann argues, this schism is played out and repeated in conceptual art. This paper complicates this depiction by examining Ian Burn's last writings in which I argue the artist-writer reviews the challenge of minimal-conceptual art in terms of its perceptual pre-occupations. Burn revisits his own work and the legacy of minimal-conceptual by moving away from the kind of ideology critique he is best known for internationally in order to reassert the long overlooked visual-perceptual preoccupations of the conceptual in art.

The drift

In this video, text floats on screen amidst a field of swirling coloured orbs and a stock music soundtrack. The text is sourced from Internet dating websites and combine into a single animated portrait charting an array of likes, dislikes, influences, beliefs and hobbies. This work examines the nature of consciousness and identity in a contemporary context. It reworks the languages of Internet dating websites to question how we construct and communicate our sense of self. Drawing on Zygmunt Bauman’s theoretical work on “liquid modernity”, this work presents an exaggerated take on contemporary identity that emphasizes its construction through consumer tastes, lifestyle choices and relationships with popular culture.

Threshold

In this video, the words of a translated poem fade in and out above an abstract, moving horizon line. The animated words are set to an emotive stock music track. This work examines processes of signification. It emphasizes abstraction and disconnection as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work questions the signifying processes of translation and metaphor. By emphasizing the abstract qualities of a translated love poem, it questions the sites and mechanisms of signification.