Dancing in suits: a performer's perspective on the collaborative exchange between self, body, motion capture, animation and audience

The motion capture process places unique demands on performers. The impact of this process on the simultaneously artistic/somatic nature of dance practice is profound. This paper explores, from a performer’s perspective, how the process of performing in an optical motion capture system can impact and limit, but also expand and reconfigure a dancer’s somatic practice. This paper argues that working within motion capture processes affects not only the immediate contexts of capture and interactive performance, but also sets up a dialogue between dance practices within and beyond the motion capture studio.

Aura, real-time motion capture dance and 3D stereoscopic dance

Aura explored the potential of motion capture and 3D stereo projection to visualize 1950's dance philosopher, Susanne K. Langer's notion of 'virtual force'.

Choreographer-mathematician collaboration: developing machine segmentation techniques for motion capture analysis of dance

This paper/presentation focuses on the science of human movement, motion capture and cognition in action, and examines the necessity of choreographer-mathematician collaboration in developing appropriate analysis techniques.

Touching space : using motion capture and stereo projection to create a virtual haptics of dance

This paper describes the work of a group of artists in Australia who used real-time motion capture and 3D stereo projection to create a large-scale performance environment in which dancers seemed to "touch" the volume. This project re-versions Suzanne Langer's 1950s philosophy of dance as "virtual force" to realize the idea of a "virtual haptics" of dance that extends the dancer's physical agency literally across and through the surrounding spatial volume. The project presents a vision of interactive dance performance that "touches" space by visualizing kinematics as intentionality and agency. In doing so, we suggest the possibility of new kinds of human-computer interfaces that emphasize touch as embodied, nuanced agency that is mediated by the subtle qualities of whole-body movement, in addition to more goal-oriented, task-based gestures such as pointing or clicking.

Capturing dance : using motion capture analysis to enhance dance creation and performance

Opening keynote address.

Recognition and response to human movement contained in motion capture data using the Self Organising Map

Neural Networks have been used successfully for recognition of human gestures in many applications including analysis of motion capture data. This paper investigates the potential for using the same methods for both recognition and synthesising responses in relation to movement contained in motion capture sequences.

Real-time motion capture interactive, 3D stereoscopic visualization

Vincs, McCormick and dancers Steph Hutchinson & Megan Beckwith present live motion capture interactive pipelines that visualise the kinematics of a performer’s movement in stereoscopic environments created using the Unity game engine, and discuss their use in Choreotopography (2010) and Choreotopography (2011). This work forms part of Vincs’ ARC Discovery Project Capturing Dance: using motion capture to enhance the creation of innovative Australian dance (DP0987101).

Snapshots of complexity: using motion capture and principal component analysis to reconceptualise dance

This article brings together the disparate worlds of dance practice, motion capture and statistical analysis. Digital technologies such as motion capture offer dance artists new processes for recording and studying dance movement. Statistical analysis of these data can reveal hidden patterns in movement in ways that are semantically ‘blind’, and are hence able to challenge accepted culturo-physical ‘grammars’ of dance creation. The potential benefit to dance artists is to open up new ways of understanding choreographic movement. However, quantitative analysis does not allow for the uncertainty inherent in emergent, artistic practices such as dance. This article uses motion capture and principal component analysis (PCA), a common statistical technique in human movement recognition studies, to examine contemporary dance movement, and explores how this analysis might be interpreted in an artistic context to generate a new way of looking at the nature and role of movement patterning in dance creation.

An adaptive complementary filter for inertial sensor based data fusion to track upper body motion

  Remote human activity monitoring is critical and essential in physiotherapy with respect to the skyrocketing healthcare expenditure and the fast aging population. One of frequently used method to monitor human activity is wearing inertial sensors since it is low-cost and accurate. However, the measurements of those sensors are able only to estimate the orientation and rotation angles with respect to actual movement angles, because of differences in the body’s co-ordination system and the sensor’s co-ordination system. There were numerous studies being conducted to improve the accuracy of estimation, though there is potential for further discussions on improving accuracy by replacing heavy algorithms to less complexity. This research is an attempt to propose an adaptive complementary filter for identifying human upper arm movements. Further, this article discusses a feasibility of upper arm rehabilitation using the proposed adaptive complementary filter and inertial measurement sensors. The proposed algorithm is tested with four healthy subjects wearing an inertial sensor against gold standard, which is the VICON system. It demonstrated root mean squared error of 8.77◦ for upper body limb orientation estimation when compared to gold standard VICON optical motion capture system.

Touching space: Using motion capture and stereo projection to create a "virtual haptics" of dance

This paper describes the work of a group of artists in Australia who used real-time motion capture and 3D stereo projection to create a large-scale performance environment in which dancers seemed to "touch" the volume. This project re-versions Suzanne Langer's 1950s philosophy of dance as "virtual force" to realize the idea of a "virtual haptics" of dance that extends the dancer's physical agency literally across and through the surrounding spatial volume. The project presents a vision of interactive dance performance that "touches" space by visualizing kinematics as intentionality and agency. In doing so, we suggest the possibility of new kinds of human-computer interfaces that emphasize touch as embodied, nuanced agency that is mediated by the subtle qualities of whole-body movement, in addition to more goal-oriented, task-based gestures such as pointing or clicking. © 2010.

Capture, hold, release: an ontology of motion capture

In proposing an ontology of motion capture, this paper identifies three modalities — capture, hold, release — to conceptualise the peculiar affordances of motion capture technology in its relationship to a performer's movement. Motion capture is unique among contemporary moving image media in its capacity to re-perform a performer'srecorded movement a potentially limitless number of times, e.g. as applied to innumerable different CG characters. Unlike live-action film or even rotoscoping (motion capture's closest equivalent), the movement extracted from the captured performance lives on, but only by way of the inimagable (non-visible) domain of motion data.Motion data 'holds' movement itself in inimagable form, and 'releases' it in the domain of the digital moving image. This tri-fold conception relates an important dimension of (Heideggerian) Being to the idea of movement as fundamental to an ontology or 'being' of motion capture. At the same time, the proposed ontology challenges the 'illusion of life' metaphor as the accepted definition of (motion capture) animation.The Oscar's Special Rules for the Animated Feature Film Award asserts that 'by itself' motion capture does not qualify as an animation method. The notion that a technology could do or be anything 'by itself' affords a conceptual leap toward Heideggerian thinking on the nature of Being as embodied in temporality, in which past, present and future are unified.In its capacity to operate outside the domain of the digital moving image, the concept of 'movement itself' not only articulates an ontology of motion capture: motion capture itself can be understood to be brought into being by movement, thus also challenging the notion that capture technology has a parasitic relationship to a performer's originary performance.

Tracking-as-recognition for articulated full-body human motion analysis

This paper addresses the problem of markerless tracking of a human in full 3D with a high-dimensional (29D) body model Most work in this area has been focused on achieving accurate tracking in order to replace marker-based motion capture, but do so at the cost of relying on relatively clean observing conditions. This paper takes a different perspective, proposing a body-tracking model that is explicitly designed to handle real-world conditions such as occlusions by scene objects, failure recovery, long-term tracking, auto-initialisation, generalisation to different people and integration with action recognition. To achieve these goals, an action's motions are modelled with a variant of the hierarchical hidden Markov model The model is quantitatively evaluated with several tests, including comparison to the annealed particle filter, tracking different people and tracking with a reduced resolution and frame rate.

BioKin: an ambulatory platform for gait kinematic and feature assessment

A platform to move gait analysis, which is normally restricted to a clinical environment in a well-equipped gait laboratory, into an ambulatory system, potentially in non-clinical settings is introduced. This novel system can provide functional measurements to guide therapeutic interventions for people requiring rehabilitation with limited access to such gait laboratories. BioKin system consists of three layers: a low-cost wearable wireless motion capture sensor, data collection and storage engine, and the motion analysis and visualisation platform. Moreover, a novel limb orientation estimation algorithm is implemented in the motion analysis platform. The performance of the orientation estimation algorithm is validated against the orientation results from a commercial optical motion analysis system and an instrumented treadmill. The study results demonstrate a root-mean-square error less than 4° and a correlation coefficient more than 0.95 when compared with the industry standard system. These results indicate that the proposed motion analysis platform is a potential addition to existing gait laboratories in order to facilitate gait analysis in remote locations.

Silk Road project

Choreographer Kim Vincs and Scenographer Matthew Delbridge worked with dancer, Carlee Mellow, musicians Rob Vincs, Scott Dunbabin and Eugene Ughetti to create a virtual visual performance where performer's movement was rendered using a motion capture system and projected onto translucent screens.