Animated Kolam Patterns

The brief for the creative work was to produce a digital backdrop that would be projected behind and enhance a dance performance. The animation needed to display a static kolam pattern that would then dissolve at a choreographed point in the performance. The dissolving mimics the fragmentation that occurs to physical kolam patterns throughout the day as people interact with the drawings. The final animated work was incorporated into Vanessa Mafe-Keane’s performance titled “Paired Back” performed at the Judith Wright Centre, Brisbane 2013 as part of “Dance. Indie Dance. Through the use of motion capture technology the process of dissolving the pattern is a direct result of the performer’s movements allowing visual and temporal connection between motion of performer and digital graphic to be observed. This creative work presented an opportunity to expand upon experiments conducted in the production of experimental visual forms undertaken at QUT using the Xsens MVN Inertial Motion Capture System. The project took on the form of an investigation into practice with a focus on the additional complexities of capturing, then applying multiple data sources into the production of animated visuals along with bringing to light the considerations taken into account when producing this type of generative art work for live performance. The reported outcomes from this investigation have contributed to a larger study on the use of motion capture in the generative arts, furthering the understanding of and generating theories on practice.

Integrating collaborative filtering and matching-based search for product recommendations

Currently, recommender systems (RS) have been widely applied in many commercial e-commerce sites to help users deal with the information overload problem. Recommender systems provide personalized recommendations to users and, thus, help in making good decisions about which product to buy from the vast amount of product choices. Many of the current recommender systems are developed for simple and frequently purchased products like books and videos, by using collaborative-filtering and content-based approaches. These approaches are not directly applicable for recommending infrequently purchased products such as cars and houses as it is difficult to collect a large number of ratings data from users for such products. Many of the ecommerce sites for infrequently purchased products are still using basic search-based techniques whereby the products that match with the attributes given in the target user’s query are retrieved and recommended. However, search-based recommenders cannot provide personalized recommendations. For different users, the recommendations will be the same if they provide the same query regardless of any difference in their interest. In this article, a simple user profiling approach is proposed to generate user’s preferences to product attributes (i.e., user profiles) based on user product click stream data. The user profiles can be used to find similarminded users (i.e., neighbours) accurately. Two recommendation approaches are proposed, namely Round- Robin fusion algorithm (CFRRobin) and Collaborative Filtering-based Aggregated Query algorithm (CFAgQuery), to generate personalized recommendations based on the user profiles. Instead of using the target user’s query to search for products as normal search based systems do, the CFRRobin technique uses the attributes of the products in which the target user’s neighbours have shown interest as queries to retrieve relevant products, and then recommends to the target user a list of products by merging and ranking the returned products using the Round Robin method. The CFAgQuery technique uses the attributes of the products that the user’s neighbours have shown interest in to derive an aggregated query, which is then used to retrieve products to recommend to the target user. Experiments conducted on a real e-commerce dataset show that both the proposed techniques CFRRobin and CFAgQuery perform better than the standard Collaborative Filtering and the Basic Search approaches, which are widely applied by the current e-commerce applications.

How digital technologies have changed the way we “teach”

Proud suggested that the biggest and most obvious impact of the digital world felt by academics, was in the area of teaching. He demonstrated a number of the initiatives which have been by developed by outside organizations and within various universities. Those include larger classrooms, online teaching and Blackboard. All of these were believed to provide improved learning by students, but, most commonly also expanded the faculty workload. He then discussed a number of the newer technologies which are becoming available such as the virtual classroom, Google Glass, Adobe online, Skype and others. All of these tools, he argued were in response to increasing economic pressures on the University, the result of which is that entire courses have migrated online. The reason for university interest in these new technologies were listed as reduced need for classrooms and classroom space, less need for on-campus facilities and even a decline in need for weekly in-class lectures. Thus, it has been argued that these new tools and technologies liberate the faculty from the tyranny of geography through the introduction of blogs, online videos, discussion forums and communication tools such as wikis, Facebook sites and Yammer, all of which seem to have specific advantages. The question raised, however, is: How successful have these new digital innovations been? As an example, he cited his own experience in teaching distance learning programs in Thailand and elsewhere. Those results are still being reviewed, with no definitive view developed.

Motion capture and the future of virtual production

Motion capture continues to be adopted across a range of creative fields including, animation, games, visual effects, dance, live theatre and the visual arts. This panel will discuss and showcase the use of motion capture across these creative fields and consider the future of virtual production in the creative industries.

The supervision tango : perceptions of supervisors of international graduate students in Engineering and IT

This paper, which was part of a larger study, reports on a survey that explored the perceptions of 69 graduate supervisors regarding issues in supervision from three higher education institutions in Australia. Factors that contribute to student success in higher education research degrees are many and diverse, including a complex dance of student factors, supervisor factors, and their supervisory context factors, and those informed by cultural and language differences. Therefore, a complex system approach using Bayesian network modelling was used to explore how student and/or supervisor factors influence the success of culturally and linguistically diverse (CALD) graduate students in Engineering and IT. Findings suggest that key factors include the experience of supervisors in terms of experience with the Australian higher education system, personal cross-cultural experience.

Made by motion, Series one

“Made by Motion” is a collaboration between digital artist Paul Van Opdenbosch and performer and choreographer Elise May; a series of studies on captured motion data used to generating experimental visual forms that reverberate in space and time. The project investigates the invisible forces generated by and influencing the movement of a dancer. Along with how the forces can be captured and applied to generating visual outcomes that surpass simple data visualisation, projecting the intent of the performer’s movements. The source or ‘seed’ comes from using an Xsens MVN - Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. In this first series the visual investigation focused on manipulating the movement date at the instance of capture, capture been the recording of three-dimensional movement as ‘seen’ by the hardware and ‘understood’ through the calibration of software. By repositioning the capture hardware on the body we can effectively change how the same sequence of movements is ‘seen’ by the motion capture system thus generating a different visual result from effetely identical movement. The outcomes from the experiments clearly demonstrates the effectiveness of using motion capture hardware as a creative tool to manipulate the perception of the capture subject, in this case been a sequence of dance movements. The creative work exhibited is a cross-section of the experiments conducted in practice with the first animated work (Movement A - Control) using the motion capture hardware in its default ‘normal’ configuration. Following this is the lower body moved to the upper body (Lb-Ub), right arm moved onto the left arm (Ra-La), right leg moved onto the left leg (Rl-Ll) and finally the left leg moved onto a object that is then held in the left hand (Ll-Pf (Lh)).

Experimental arts practice incorporating motion capture

My practice-led research explores and maps workflows for generating experimental creative work involving inertia based motion capture technology. Motion capture has often been used as a way to bridge animation and dance resulting in abstracted visuals outcomes. In early works this process was largely done by rotoscoping, reference footage and mechanical forms of motion capture. With the evolution of technology, optical and inertial forms of motion capture are now more accessible and able to accurately capture a larger range of complex movements. Made by Motion is a collaboration between digital artist Paul Van Opdenbosch and performer and choreographer Elise May; a series of studies on captured motion data used to generate experimental visual forms that reverberate in space and time. The project investigates the invisible forces generated by and influencing the movement of a dancer. Along with how the forces can be captured and applied to generating visual outcomes that surpass simple data visualisation, projecting the intent of the performer’s movements. The source or ‘seed’ comes from using an Xsens MVN – Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. In my presentation I will be displaying and discussing a selected creative works from the project along with the process and considerations behind the work.

Found in translation : debating the abstract elements of cultures through actor training styles

While the synthesis of acting methodologies in intercultural acting has been discussed at length, little discussion has focussed on the potential of diverse actor training styles to affect performance making and audience reception. This article explores a project where the abstract elements of the British and American cultures were translated in rehearsal and in production through the purposeful juxtaposition of two differing actor training styles: the British ‘traditional’ approach and the American Method. William Nicholson’s Shadowlands was produced by Crossbow Productions at the Brisbane Powerhouse in 2010. Nicholson’s play contains a discourse on the cultural cringe of British – American relations. As a research project, the production aimed to extend and augment audience experience of the socio-cultural tensions inherent in the play by juxtaposing two seemingly culturally inscribed approaches to acting. Actors were chosen who had been trained under a traditional conservatoire approach and the American Method. A brief overview of these acting approaches is followed by a discussion centred on the project. This article analyses how from the casting room to the rehearsal room to the mise en scene and into the audience discussions, cultural issues were articulated, translated and debated through the language of acting.

An evaluation of different features and learning models for anomalous event detection

The huge amount of CCTV footage available makes it very burdensome to process these videos manually through human operators. This has made automated processing of video footage through computer vision technologies necessary. During the past several years, there has been a large effort to detect abnormal activities through computer vision techniques. Typically, the problem is formulated as a novelty detection task where the system is trained on normal data and is required to detect events which do not fit the learned ‘normal’ model. There is no precise and exact definition for an abnormal activity; it is dependent on the context of the scene. Hence there is a requirement for different feature sets to detect different kinds of abnormal activities. In this work we evaluate the performance of different state of the art features to detect the presence of the abnormal objects in the scene. These include optical flow vectors to detect motion related anomalies, textures of optical flow and image textures to detect the presence of abnormal objects. These extracted features in different combinations are modeled using different state of the art models such as Gaussian mixture model(GMM) and Semi- 2D Hidden Markov model(HMM) to analyse the performances. Further we apply perspective normalization to the extracted features to compensate for perspective distortion due to the distance between the camera and objects of consideration. The proposed approach is evaluated using the publicly available UCSD datasets and we demonstrate improved performance compared to other state of the art methods.

Patron-driven acquisition of online video

Letting the patron choose ebooks has been a successful experience. Why not apply the same purchase model to other formats? This showcase outlines Queensland University of Technology’s experience with a trial of patron driven acquisition (PDA) for online video. The trial commencing in August 2012 provided access to over 700 online videos licensed from Kanopy across a number of discipline areas. As online video publishing is still in the early stages of development, and as the trial is only in the very early stages, it is too early to draw any firm conclusions about the likely suitability of this model for online video selection and acquisition. However, the trial provides some interesting initial comparisons with ebook PDA and existing online video purchase models and prompts further consideration of PDA as a method for online video selection and licensing.

Semi-binary based video features for activity representation

Efficient and effective feature detection and representation is an important consideration when processing videos, and a large number of applications such as motion analysis, 3D scene understanding, tracking etc. depend on this. Amongst several feature description methods, local features are becoming increasingly popular for representing videos because of their simplicity and efficiency. While they achieve state-of-the-art performance with low computational complexity, their performance is still too limited for real world applications. Furthermore, rapid increases in the uptake of mobile devices has increased the demand for algorithms that can run with reduced memory and computational requirements. In this paper we propose a semi binary based feature detectordescriptor based on the BRISK detector, which can detect and represent videos with significantly reduced computational requirements, while achieving comparable performance to the state of the art spatio-temporal feature descriptors. First, the BRISK feature detector is applied on a frame by frame basis to detect interest points, then the detected key points are compared against consecutive frames for significant motion. Key points with significant motion are encoded with the BRISK descriptor in the spatial domain and Motion Boundary Histogram in the temporal domain. This descriptor is not only lightweight but also has lower memory requirements because of the binary nature of the BRISK descriptor, allowing the possibility of applications using hand held devices.We evaluate the combination of detectordescriptor performance in the context of action classification with a standard, popular bag-of-features with SVM framework. Experiments are carried out on two popular datasets with varying complexity and we demonstrate comparable performance with other descriptors with reduced computational complexity.

Swimmer localization from a moving camera

At the highest level of competitive sport, nearly all performances of athletes (both training and competitive) are chronicled using video. Video is then often viewed by expert coaches/analysts who then manually label important performance indicators to gauge performance. Stroke-rate and pacing are important performance measures in swimming, and these are previously digitised manually by a human. This is problematic as annotating large volumes of video can be costly, and time-consuming. Further, since it is difficult to accurately estimate the position of the swimmer at each frame, measures such as stroke rate are generally aggregated over an entire swimming lap. Vision-based techniques which can automatically, objectively and reliably track the swimmer and their location can potentially solve these issues and allow for large-scale analysis of a swimmer across many videos. However, the aquatic environment is challenging due to fluctuations in scene from splashes, reflections and because swimmers are frequently submerged at different points in a race. In this paper, we temporally segment races into distinct and sequential states, and propose a multimodal approach which employs individual detectors tuned to each race state. Our approach allows the swimmer to be located and tracked smoothly in each frame despite a diverse range of constraints. We test our approach on a video dataset compiled at the 2012 Australian Short Course Swimming Championships.

Body stories

This research is in the field of arts education. Eisner claims that ‘teachers rarely view themselves as artists’ (Taylor, 1993:21). Situating professional dance artists and teacher-artists (Mc Lean, 2009) in close proximity to classroom dance teachers, spatially, through a shared rehearsal studio and creatively, by engaging them in a co-artistry approach, allows participants to map unique and new creative processes, kinaesthetically and experientially. This pratice encourages teachers to attune and align themselves with artists’ states of mind and enables them to nurture both their teacher-self and their artist-self (Lichtenstein 2009). The research question was: can interactions between professional dance artists, teacher-artists (Mc Lean, 2009) and classroom dance teachers change classroom dance teachers’ self-perceptions? The research found that Artists in Residence projects provide up-skilling in situ for classroom dance teachers, and give credence to the act of art making for classroom dance teachers within their peer context, positively enhancing their self-image and promoting self-identification as ‘teacher-artists’ (Mc Lean, 2009). This project received an Artist in Residence Grant (an Australia Council for the Arts, Education Queensland and Queensland Arts Council partnership). The research findings were chosen for inclusion in the Queensland Performing Arts Complex program, Feet First: an invitation to dance, 2013 and selected for inclusion on the Creative Campus website, http://www.creative-campus.org.uk.

Separating shadows

This practice-led research is in the field of dance creation and performance. The dancer, unlike many artists from different fields, has to contend with the added complexity of being a creative tool. Grove states, ‘..they are the phenomenon of self-creation twice over, being both the artist and the work of art’ (2005, 44). A dancer’s success relies on the quality of their instrument and their ability to reliably employ it in the creative act (Jowitt 2001a). The traditional rehearsal studio is the creative meeting place for dance artists. A liminal space with specific spatial, temporal and personal considerations: a space fraught with uncertainty and vulnerability, ripe with potential. If harnessed, the creative potential inherent in vulnerability, experienced as increased sensitivity and openness (Press 2002), can facilitate new ways of investigating and doing. This research investigated ways in which dancers prepare themselves during the act of creation and rehearsal within the studio, for the public presentation of a site-specific dance work. Navigating the complexities inherent in performing site-specific dance work is best achieved through the development of a connection with the site during the creation of the work. This is achieved through the provision of rehearsals within the site and ensures seamless replication of rehearsal qualities from studio to non-traditional site. This research received funding and support from the Australia Council for the Arts, Arts Queensland, Brisbane Festival, Kelvin Grove Urban Village, Besen Family Foundation, Korean Culture Arts Foundation and the Australia Korea Foundation. It was presented in the Brisbane Festival, 2006. http://www.accentedbody.com/projects/accented-body