Robust recognition of human behaviour in challenging environments

Novel techniques have been developed for the automatic recognition of human behaviour in challenging environments using information from visual and infra-red camera feeds. The techniques have been applied to two interesting scenarios: Recognise drivers' speech using lip movements and recognising audience behaviour, while watching a movie, using facial features and body movements. Outcome of the research in these two areas will be useful in the improving the performance of voice recognition in automobiles for voice based control and for obtaining accurate movie interest ratings based on live audience response analysis.

Theatre, social media and spectatorship : translating commentary, critique and controversy across media

The occasional ArtsHub article asking spectators to show respect for stage by switching all devices off notwithstanding, in the last few years we have witnessed an clear push to make more use of social media as a means by which spectators might respond to a performance across most theatre companies. Mainstage companies, as well as contemporary companies are asking us to turn on, tune in and tweet our impressions of a show to them, to each other, and to the masses – sometimes during the show, sometimes after the show, and sometimes without having seen the show. In this paper, I investigate the relationship between theatre, spectatorship and social media, tracing the transition from print platforms in which expert critics were responsible for determining audience response to today’s online platforms in which everybody is responsible for debating responses. Is the tendency to invite spectators to comment via social media before, during, or after a show the advance in audience engagement, entertainment and empowerment many hail it to be? Is it a return to a more democratised past in which theatres were active, interactive and at times downright rowdy, and the word of the published critic had yet to take over from the word of the average punter? Is it delivering distinctive shifts in theatre and theatrical meaning making? Or is it simply a good way to get spectators to write about a work they are no longer watching? An advance in the marketing of the work rather than an advance in the active, interactive aesthetic of the work? In this paper, I consider what the performance of spectatorship on social media tells us about theatre, spectatorship and meaning-making. I use initial findings about the distinctive dramaturgies, conflicts and powerplays that characterise debates about performance and performance culture on social media to reflect on the potentially productive relationship between theatre, social media, spectatorship, and meaning making. I suggest that the distinctive patterns of engagement displayed on social media platforms – including, in many cases, remediation rather than translation, adaptation or transformation of prior engagement practices – have a lot to tell us about how spectators and spectator groups negotiate for the power to provide the dominant interpretation of a work.

Interactive music formats : will audiences interact?

The purpose of this research was to conduct a pilot study of a prototype interactive music release format which sought to investigate the readiness of audiences to interact with an interactive alternative to a fixed recorded work. A prototype music interface was created for testing. The prototype was then tested on a sample of users to understand what factors might be critical to audience engagement. The research further investigated the potential implications of the interactive release format on musicians' creative process.

"Rebirth: Combined art performance"--Shirin Madg & Sweet Sound Ensemble

Vanessa Mafe-Keane was invited to participate as choreographer in Iranian singer Shirin Madg 's project, Rebirth: Combined art performance. This project integrated singing, music, visual-art, film, dance and is based on the dissident poetry of female Iranian poet, Forough Farrokhzad. The choreographic dance movement focused on simple, lyrical, flowing classical dance forms that also incorporated everyday gestures and actions performed by two Queensland dancers, Caitlin MacKenzie and Abby Johnson. The choreographic intention was not to attempt to re-create Iranian dance practices instead, to draw inspiration and reference specific movement qualities. This was achieved through the subtle inclusion of spinning movements and focusing attention on the dancers’ arms and upper torso. This fusion became an underlying theme reflected throughout the choreographic component. Additionally, this project presented an opportunity to draw on past experiences and problem-solve ways to construct choreographic work where the dancers and the musical assemble group could be staged side by side. This experience highlighted differing approaches to rehearsal protocols within disciplines, the practicalities of staging different artists, understanding musical cues and the diversity of audience engagement. Performances: BEMAC Multicultural Centre, Brisbane 06 February 2015 and Helensvale Cultural Centre, Gold Coast 07 February 2015

Mapping the experiential in contemporary dance

The research questions how a ‘lived experience’ of contemporary dance could be deepened for the audience. It presents a series of choreographic ‘tools’ to create alternative frameworks of presentation that challenge the dominant modes of creation, presentation and meaning making in contemporary dance. The five tools established and applied in this research are: variations of site, liminality, audience agency, audience-performer proximity and performer qualities. These tools are framed as a series of calibrated scales that allow choreographers to map decisions made in the studio in relation to potential audience engagement. The research houses multiple presentation formats from the traditional to the avant-garde and opens up possibilities for analysis of a wide range of artistic dance works. This research presents options for choreographers to map how audiences experience their work and offers opportunities to engage audiences in new and exciting ways.

'Insider-other': spectator-dancer relationships fostered through open rehearsals

This thesis addresses audience engagement challenges during professional mainstream ballet and contemporary dance company performances by examining spectator-dancer relationships. Focusing on the open rehearsal as an audience engagement tool, this project presents a new line of enquiry in dance reception studies. The findings signify that open rehearsal attendance can contribute to more meaningful and enjoyable performance experiences for audience members by opening up the possibility of different relationships with dancers.

Comoção : os ritmos afectivos do acontecimento teatral

Tese de doutoramento, Estudos Artísticos (Estudos de Teatro), Universidade de Lisboa, Faculdade de Letras, 2014

Le Théâtre-forum : pour une délibération sous le signe de la reconnaissance?

Cette recherche explore le Théâtre-forum comme support méthodologie d’un espace délibératif pour discuter des tensions sociales liées à la coprésence au centre-ville de Montréal entre des personnes en situation de rue et leurs voisins domiciliés. L’argument au cœur de la problématique repose sur les taches aveugles de la délibération: dans les forums de quartier, les inégalités sociales se traduisent par des inégalités délibératives au désavantage des personnes sans adresse en défaut d’autorité épistémologique en raison de leur statut; ces inégalités délibératives reproduisent le déni de reconnaissance qui traverse l’expérience relationnelle de ces personnes. Le Théâtre-forum est issu du Théâtre de l’opprimé : une pratique d’intervention théâtrale conçue par Augusto Boal durant la dictature au Brésil comme dispositif émancipateur pour les groupes opprimés. Le Joker incite les membres de l’auditoire à devenir Spect-acteurs par les remplacements du protagoniste, et ce, afin de surmonter son oppression. Ainsi, cette projection dans les chaussures du protagoniste-itinérant facilite-t-elle ce passage de l’indignité à la reconnaissance pour les personnes en situation de rue? L’échange théâtral peut-il ouvrir la voie vers la reconstruction d’un lien intersubjectif entre personnes sans adresse et domiciliés, intersubjectivité qui au cœur-même des vertus délibératives et des principes fondateurs défendus par les théoriciens de la reconnaissance comme Honneth et Renault?

A Worldwide History Spanning Genocide for the Sake of Corporate Profit

A Worldwide History Spanning Genocide for the Sake of Corporate Profit is the title of a thesis consisting of four stories. Crosky’s Knife is presented first for the sake of allowing potential readers to embrace a sense of amiable audience engagement and is based on a true story of a veteran of one of the many global conflicts currently raged on behalf of freedom. The three pieces following this feint are reworked versions of stories written from the heart and delivered to machines. As it presents numerous aspects of reality that the average person may not wish to consider, doing so with shockingly casual acceptance of such horror and/or banality, the conscious reception of the duty of engagement and possible appreciation of the text is not advised. Knives, rabid dogs, severed tongues, and a downpour of malnourished Iraqi babies are components intrinsic to the direction of this thesis.

Creating new narratives through shared time and space : the performer/audience connection in multi-site dance events

Site-specific performance provides choices in audience experience via degrees of scale, proximity, levels of immersion and viewing perspectives. Beyond these choices, multi-site promenade events also form a connected audience/performer relationship in which moving together in time and space can produce a shared narrative and aesthetic sensibility of collective, yet individuated and shifting meanings. This paper interrogates this notion through audience/performer experiences in two separate multi-site, dance-led events. here/there/then/now occurred in four intimate sites within the Brisbane Powerhouse, providing a theatricalised platform for audiences to create linked narratives through open-ended and fragmented intertextuality. Accented Body, based on the concept of “the body as site and in site” and notions of connectivity, provided a more expansive platform for a similar, but heightened, shared engagement. Audiences traversed 6 outdoor and 2 indoor Brisbane sites moving to varying levels of a large complex. Eleven, predominantly interactive, screens provided links to other sites as well as to distributed presences in Seoul and London. The differentiation in scale and travel time between sites deepened the immersive experiences of audiences who reported transformative engagements with both site and architecture, accompanied by a sense of extended and yet quickened time.

Re-engaging marginalized youth through digital music production: performance, audience and evaluation

This paper presents two case studies of marginalised youth experimenting with digital music production in flexible education settings. The cases were drawn from a three-year study of alternative assessment in flexible learning centres that enrol 650+ students who have left formal schooling in Queensland, Australia. The cases are framed in reference to the literature on cultural studies approaches to education and the digital arts. Each case describes the student’s histories, cultural background and experiences, music productions, evidence of learning and re-engagement with education. Findings document how digital music production can re-engage and extend participation among students who have left formal education. They do so by theorising the online judgements and blog comments about the digital music production as a social field of exchange. It also raises critical questions about the adequacy of current approaches to evaluating and accounting for the learning and development of such youth, especially where this has occurred through creative arts and digital production.

The multi-platform user engagement and data visualisation tool

The ability to identify and assess user engagement with transmedia productions is vital to the success of individual projects and the sustainability of this mode of media production as a whole. It is essential that industry players have access to tools and methodologies that offer the most complete and accurate picture of how audiences/users engage with their productions and which assets generate the most valuable returns of investment. Drawing upon research conducted with Hoodlum Entertainment, a Brisbane-based transmedia producer, this project involved an initial assessment of the way engagement tends to be understood, why standard web analytics tools are ill-suited to measuring it, how a customised tool could offer solutions, and why this question of measuring engagement is so vital to the future of transmedia as a sustainable industry. Working with data provided by Hoodlum Entertainment and Foxtel Marketing, the outcome of the study was a prototype for a custom data visualisation tool that allowed access, manipulation and presentation of user engagement data, both historic and predictive. The prototyped interfaces demonstrate how the visualization tool would collect and organise data specific to multiplatform projects by aggregating data across a number of platform reporting tools. Such a tool is designed to encompass not only platforms developed by the transmedia producer but also sites developed by fans. This visualisation tool accounted for multiplatform experience projects whose top level is comprised of people, platforms and content. People include characters, actors, audience, distributors and creators. Platforms include television, Facebook and other relevant social networks, literature, cinema and other media that might be included in the multiplatform experience. Content refers to discreet media texts employed within the platform, such as tweet, a You Tube video, a Facebook post, an email, a television episode, etc. Core content is produced by the creators’ multiplatform experiences to advance the narrative, while complimentary content generated by audience members offers further contributions to the experience. Equally important is the timing with which the components of the experience are introduced and how they interact with and impact upon each other. Being able to combine, filter and sort these elements in multiple ways we can better understand the value of certain components of a project. It also offers insights into the relationship between the timing of the release of components and user activity associated with them, which further highlights the efficacy (or, indeed, failure) of assets as catalysts for engagement. In collaboration with Hoodlum we have developed a number of design scenarios experimenting with the ways in which data can be visualised and manipulated to tell a more refined story about the value of user engagement with certain project components and activities. This experimentation will serve as the basis for future research.

Community engagement or community conversation?: Boomtown, a large-scale regional, outdoor community theatrical event

On the 18th of July 2013, three hundred local members of Gladstone, Queensland erupted into song and dance performing the fraught history of their community harbourside through tug boat ballets, taiko drumming, German bell ringing and BMX bike riding. Over 17,500 people attended the four performances of Boomtown, a Queensland Music Festival event. This was the largest regional, outdoor community-engaged musical performance staged in Australia. The narrative moved beyond the dominant, pejorative view of Gladstone as an industrial town to include the community members’ sense of purpose and aspirations. It was a celebratory, contentious and ambitious project that sought to disrupt the traditional conventions of performance-making through working in artistically democratic ways. This article explores the potential for Australian Community Engaged Arts (CEA) projects such as Boomtown to democratically engage community members and co-create culturally meaningful work within a community. Research into CEA projects rarely consider how the often delicate conversations between practitioners and the community work. The complex processes of finding and co-writing the narrative, casting, and rehearsing Boomtown are discussed with reference to artistic director/dramaturge Sean Mee’s innovative approaches. Boomtown began with and concluded with community conversations. Skilful negotiation ensured congruence between the townspeople’s stories and the “community story” presented on stage, abrogating potential problems of narrative ownership. To supplement the research, twenty-one personal interviews were undertaken with Gladstone community members invested in the production before, during and after the project: performers, audience members and local professionals. The stories shared and emphasised in the theatricalised story were based on propitious, meaningful, local stories from lived experiences rather than preconceived, trivial or tokenistic matters, and were underpinned by a consensus formed on what was in the best interests of the majority of community members. Boomtown exposed hidden issues in the community and gave voice to thoughts, feelings and concerns which triggered not just engagement, but honest conversation within the community.

Audience response systems can facilitate communal course feedback

Background At Queensland University of Technology (QUT), the Bachelor of Radiation Therapy course evaluation has previously suffered from low online survey participation rates. A communal instantaneous feedback event using an audience response system (ARS) was evaluated as a potential solution to this problem. The aims of the project were to determine the extent to which this feedback event could be facilitated by ARS technology and to evaluate the impact the technology made on student satisfaction and engagement. Methods Students were invited to a timetabled session to provide feedback on individual study units and the course overall. They provided quantitative Likert-style responses to prompts for each unit and the course using an ARS as well as anonymous typed qualitative comments. Data collection was performed live so students were able to view collective class responses. This prompted further discussion and enabled a prospective action plan to be developed. To inform future ARS use, students were asked for their opinions on the feedback method. Results Despite technological difficulties, student evaluation indicated that all responders enjoyed the session and the opportunity to view the combined responses. All students felt that useful feedback was generated and that this method should be used in the future. The student attendance and response rates were high, and it was clear that the session had led to the development of some insightful qualitative feedback comments. Conclusions: An ARS contributed well to the collection of course feedback in a communal and interactive environment. Students found it enjoyable to use, and it helped to stimulate useful qualitative comments

How Video Lecture Capture affects Student Engagement in a University Computer Programming Course: Attendance, Video Viewing Behaviours and Student Attitudes

Introduction
The use of video capture of lectures in Higher Education is not a recent occurrence with web based learning technologies including digital recording of live lectures becoming increasing commonly offered by universities throughout the world (Holliman and Scanlon, 2004). However in the past decade the increase in technical infrastructural provision including the availability of high speed broadband has increased the potential and use of videoed lecture capture. This had led to a variety of lecture capture formats including pod casting, live streaming or delayed broadcasting of whole or part of lectures.
Additionally in the past five years there has been a significant increase in the popularity of online learning, specifically via Massive Open Online Courses (MOOCs) (Vardi, 2014). One of the key aspects of MOOCs is the simulated recording of lecture like activities. There has been and continues to be much debate on the consequences of the popularity of MOOCs, especially in relation to its potential uses within established University programmes.
There have been a number of studies dedicated to the effects of videoing lectures.
The clustered areas of research in video lecture capture have the following main themes:
• Staff perceptions including attendance, performance of students and staff workload
• Reinforcement versus replacement of lectures
• Improved flexibility of learning
• Facilitating engaging and effective learning experiences
• Student usage, perception and satisfaction
• Facilitating students learning at their own pace
Most of the body of the research has concentrated on student and faculty perceptions, including academic achievement, student attendance and engagement (Johnston et al, 2012).
Generally the research has been positive in review of the benefits of lecture capture for both students and faculty. This perception coupled with technical infrastructure improvements and student demand may well mean that the use of video lecture capture will continue to increase in frequency in the next number of years in tertiary education. However there is a relatively limited amount of research in the effects of lecture capture specifically in the area of computer programming with Watkins 2007 being one of few studies . Video delivery of programming solutions is particularly useful for enabling a lecturer to illustrate the complex decision making processes and iterative nature of the actual code development process (Watkins et al 2007). As such research in this area would appear to be particularly appropriate to help inform debate and future decisions made by policy makers.
Research questions and objectives
The purpose of the research was to investigate how a series of lecture captures (in which the audio of lectures and video of on-screen projected content were recorded) impacted on the delivery and learning of a programme of study in an MSc Software Development course in Queen’s University, Belfast, Northern Ireland. The MSc is conversion programme, intended to take graduates from non-computing primary degrees and upskill them in this area. The research specifically targeted the Java programming module within the course. It also analyses and reports on the empirical data from attendances and various video viewing statistics. In addition, qualitative data was collected from staff and student feedback to help contextualise the quantitative results.
Methodology, Methods and Research Instruments Used
The study was conducted with a cohort of 85 post graduate students taking a compulsory module in Java programming in the first semester of a one year MSc in Software Development. A pre-course survey of students found that 58% preferred to have available videos of “key moments” of lectures rather than whole lectures. A large scale study carried out by Guo concluded that “shorter videos are much more engaging” (Guo 2013). Of concern was the potential for low audience retention for videos of whole lectures.
The lecturers recorded snippets of the lecture directly before or after the actual physical delivery of the lecture, in a quiet environment and then upload the video directly to a closed YouTube channel. These snippets generally concentrated on significant parts of the theory followed by theory related coding demonstration activities and were faithful in replication of the face to face lecture. Generally each lecture was supported by two to three videos of durations ranging from 20 – 30 minutes.
Attendance
The MSc programme has several attendance based modules of which Java Programming was one element. In order to assess the consequence on attendance for the Programming module a control was established. The control used was a Database module which is taken by the same students and runs in the same semester.
Access engagement
The videos were hosted on a closed YouTube channel made available only to the students in the class. The channel had enabled analytics which reported on the following areas for all and for each individual video; views (hits), audience retention, viewing devices / operating systems used and minutes watched.
Student attitudes
Three surveys were taken in regard to investigating student attitudes towards the videoing of lectures. The first was before the start of the programming module, then at the mid-point and subsequently after the programme was complete.
The questions in the first survey were targeted at eliciting student attitudes towards lecture capture before they had experienced it in the programme. The midpoint survey gathered data in relation to how the students were individually using the system up to that point. This included feedback on how many videos an individual had watched, viewing duration, primary reasons for watching and the result on attendance, in addition to probing for comments or suggestions. The final survey on course completion contained questions similar to the midpoint survey but in summative view of the whole video programme.
Conclusions and Outcomes
The study confirmed findings of other such investigations illustrating that there is little or no effect on attendance at lectures. The use of the videos appears to help promote continual learning but they are particularly accessed by students at assessment periods. Students respond positively to the ability to access lectures digitally, as a means of reinforcing learning experiences rather than replacing them. Feedback from students was overwhelmingly positive indicating that the videos benefited their learning. Also there are significant benefits to part recording of lectures rather than recording whole lectures. The behaviour viewing trends analytics suggest that despite the increase in the popularity of online learning via MOOCs and the promotion of video learning on mobile devices in fact in this study the vast majority of students accessed the online videos at home on laptops or desktops However, in part, this is likely due to the nature of the taught subject, that being programming.
The research involved prerecording the lecture in smaller timed units and then uploading for distribution to counteract existing quality issues with recording entire live lectures. However the advancement and consequential improvement in quality of in situ lecture capture equipment may well help negate the need to record elsewhere. The research has also highlighted an area of potentially very significant use for performance analysis and improvement that could have major implications for the quality of teaching. A study of the analytics of the viewings of the videos could well provide a quick response formative feedback mechanism for the lecturer. If a videoed lecture either recorded live or later is a true reflection of the face to face lecture an analysis of the viewing patterns for the video may well reveal trends that correspond with the live delivery.