Tracking-as-recognition for articulated full-body human motion analysis

This paper addresses the problem of markerless tracking of a human in full 3D with a high-dimensional (29D) body model Most work in this area has been focused on achieving accurate tracking in order to replace marker-based motion capture, but do so at the cost of relying on relatively clean observing conditions. This paper takes a different perspective, proposing a body-tracking model that is explicitly designed to handle real-world conditions such as occlusions by scene objects, failure recovery, long-term tracking, auto-initialisation, generalisation to different people and integration with action recognition. To achieve these goals, an action's motions are modelled with a variant of the hierarchical hidden Markov model The model is quantitatively evaluated with several tests, including comparison to the annealed particle filter, tracking different people and tracking with a reduced resolution and frame rate.

Motion analysis of a robotic assisted surgery and microsurgery system - experimental verification

Motion analysis of a parallel robot assisted minimally invasive surgery/microsurgery system (PRAMiSS) and the control structures enabling it to achieve milli/micromanipulations under the constraint of moving through a fixed penetration point or so-called remote centre-of-motion (RCM) are presented in this article. Two control algorithms are proposed suitable for minimally invasive surgery (MIS) with submillimeter accuracy and for minimally invasive micro-surgery (MIMS) with submicrometer accuracy. The RCM constraint is performed without having any mechanical constraint. Control algorithms also apply orientation constraint preventing the tip to orient relative to the soft tissues due to the robot movements. Experiments were conducted to verify accuracy and effectiveness of the proposed control algorithms for MIS and MIMS operations. The experimental results demonstrate accuracy and performance of the proposed position control algorithms.

Resting toucher: a time and motion analysis of elite lawn bowls

Whilst numerous investigations have explored the physical demands placed upon competitive sportspeople from a wide array of sports little is known about the physical demands placed on lawn bowlers. The purpose of this study was to ascertain the movement activities of Australian representative singles and pairs players and to determine the frequency and duration of these activities. One match each of two male and two female players (one singles and one pairs player per gender) were videotaped during an international tournament. During playback of the videotaped matches (n = 4), a single observer coded the players’ activities into five distinct categories (waiting, walking forward, walking backward, jogging and bowling) using a computerised video editing system (Gamebreaker™ Digital Video Analysis System). Field calibration of players over 30m for forward motions and 15m for the backward motion was performed to allow for the estimation of total distance covered during the match. Heart rate was monitored during each match. The duration of a match was found to be (mean ± SD) 1hr 28 ± 15mins. The total distance covered during each match was 2093 ± 276m. The mean percentage of match time spent in each motion was: waiting, 61.8 ± 9.3%; walking forward, 22.3 ± 5.6%; walking backward, 2.0 ± 0.4%; jogging, 1.1 ± 0.5%; and bowling, 8.5 ± 4.2%. Average heart rate was found to be 57 ± 7% of age-predicted HRmax with a maximum of 78 ± 9% of age-predicted HRmax. The results of this study suggest that playing lawn bowls at an international level requires light-moderate intensity activity similar to that reported for golf.

Time-motion analysis of test and one-day international cricket centuries

The aim of this study was to quantify movement patterns of batsmen scoring 100 runs (century), including analysis at 50, 80, and 100 runs, in Test and One-Day international (one-day) matches and between the first and second 50 within a Test century. Test centuries (n = 13) and one-day scores above 80 (n = 12) filmed during the 2005 - 2006 Australian international season were analysed for movement patterns of standing, walking, jogging, striding, sprinting, shot playing, and turning. At each run target, differences in total time, duration of individual movement pattern, movement pattern frequency, and number of balls faced were determined between Test and one-day matches (analysis of variance). Differences within Test centuries were assessed using paired t-tests. A similar fractional predominance of time spent in low-intensity activity (standing and walking) between Test and one-day matches at each run target (94 and 96% respectively) was observed, with no differences in duration of striding or sprinting (Test: 1.1 min, s = 0.5; one-day: 0.9 min, s = 0.5 for sprinting: P = 0.28). A 37% longer total duration occurred in Tests, resulting in longer recovery bouts between high-intensity efforts. There were no differences between the first and second 50 runs of a Test century for any measure (P at best = 0.34). In summary, Test and one-day centuries are characterized by much low-intensity activity and patterns of high-intensity activity similar to many repeat-sprint team sports and greater recovery breaks in longer matches.

Capturing dance : using motion capture analysis to enhance dance creation and performance

Opening keynote address.

Indexing narrative structure and semantics in motion pictures with a probabilistic framework

This work constitutes the first attempt to extract an important narrative structure, the 3-Act story telling paradigm, in film. This narrative structure is prevalent in the domain of film as it forms the foundation and framework in which the film can be made to function as an effective tool for story telling, and its extraction is a vital step in automatic content management for film data. A novel act boundary likelihood function for Act 1 is derived using a Bayesian formulation under guidance from film grammar, tested under many configurations and the results are reported for experiments involving 25 full length movies. The formulation is shown to be a useful tool in both the automatic and semi-interactive setting for semantic analysis of film.

Automated film rhythm extraction for scene analysis

This paper examines film rhythm, an important expressive element in motion pictures, based on our ongoing study to exploit film grammar as a broad computational framework for the task of automated film and video understanding. Of the many, more or less elusive, narrative devices contributing to film rhythm, this paper discusses motion characteristics that form the basis of our analysis, and presents novel computational models for extracting rhythmic patterns induced through a perception of motion. In our rhythm model, motion behaviour is classified as being either nonexistent, fluid or staccato for a given shot. Shot neighbourhoods in movies are then grouped by proportional makeup of these motion behavioural classes to yield seven high-level rhythmic arrangements that prove to be adept at indicating likely scene content (e.g. dialogue or chase sequence) in our experiments. Underlying causes for this level of codification in our approach are postulated from film grammar, and are accompanied by detailed demonstration from real movies for the purposes of clarification.

Global positioning system data analysis: velocity ranges and a new definition of sprinting for field sport athletes

Global positioning system (GPS) technology has improved the speed, accuracy, and ease of time-motion analyses of field sport athletes. The large volume of numerical data generated by GPS technology is usually summarized by reporting the distance traveled and time spent in various locomotor categories (e.g., walking, jogging, and running). There are a variety of definitions used in the literature to represent these categories, which makes it nearly impossible to compare findings among studies.

The purpose of this work was to propose standard definitions (velocity ranges) that were determined by an objective analysis of time-motion data. In addition, we discuss the limitations of the existing definition of a sprint and present a new definition of sprinting for field sport athletes.

Twenty-five GPS data files collected from 5 different sports (men’s and women’s field hockey, men’s and women’s soccer, and Australian Rules Football) were analyzed to identify the average velocity distribution. A curve fitting process was then used to determine the optimal placement of 4 Gaussian curves representing the typical locomotor categories. 

Multichannel biomedical time series clustering via hierarchical probabilistic latent semantic analysis

Biomedical time series clustering that automatically groups a collection of time series according to their internal similarity is of importance for medical record management and inspection such as bio-signals archiving and retrieval. In this paper, a novel framework that automatically groups a set of unlabelled multichannel biomedical time series according to their internal structural similarity is proposed. Specifically, we treat a multichannel biomedical time series as a document and extract local segments from the time series as words. We extend a topic model, i.e., the Hierarchical probabilistic Latent Semantic Analysis (H-pLSA), which was originally developed for visual motion analysis to cluster a set of unlabelled multichannel time series. The H-pLSA models each channel of the multichannel time series using a local pLSA in the first layer. The topics learned in the local pLSA are then fed to a global pLSA in the second layer to discover the categories of multichannel time series. Experiments on a dataset extracted from multichannel Electrocardiography (ECG) signals demonstrate that the proposed method performs better than previous state-of-the-art approaches and is relatively robust to the variations of parameters including length of local segments and dictionary size. Although the experimental evaluation used the multichannel ECG signals in a biometric scenario, the proposed algorithm is a universal framework for multichannel biomedical time series clustering according to their structural similarity, which has many applications in biomedical time series management.

3D motion matching algorithm using signature feature descriptor

This paper introduces a basic frame for rehabilitation motion practice system which detects 3D motion trajectory with the Microsoft Kinect (MSK) sensor system and proposes a cost-effective 3D motion matching algorithm. The rehabilitation motion practice system displays a reference 3D motion in the database system that the player (patient) tries to follow. The player’s motion is traced by the MSK sensor system and then compared with the reference motion to evaluate how well the player follows the reference motion. In this system, 3D motion matching algorithm is a key feature for accurate evaluation for player’s performance. Even though similarity measurement of 3D trajectories is one of the most important tasks in 3D motion analysis, existing methods are still limited. Recent researches focus on the full length 3D trajectory data set. However, it is not true that every point on the trajectory plays the same role and has the same meaning. In this situation, we developed a new cost-effective method that only uses the less number of features called ‘signature’ which is a flexible descriptor computed from the region of ‘elbow points’. Therefore, our proposed method runs faster than other methods which use the full length trajectory information. The similarity of trajectories is measured based on the signature using an alignment method such as dynamic time warping (DTW), continuous dynamic time warping (CDTW) or longest common sub-sequence (LCSS) method. In the experimental studies, we applied the MSK sensor system to detect, trace and match the 3D motion of human body. This application was assumed as a system for guiding a rehabilitation practice which can evaluate how well the motion practice was performed based on comparison of the patient’s practice motion traced by the MSK system with the pre-defined reference motion in a database. In order to evaluate the accuracy of our 3D motion matching algorithm, we compared our method with two other methods using Australian sign word dataset. As a result, our matching algorithm outperforms in matching 3D motion, and it can be exploited for a base framework for various 3D motion-based applications at low cost with high accuracy.

Differences in end range of motion vertical jump kinetic and kinematic strategies between trained weightlifters and elite short track speed skaters

The purpose of this investigation was to identify differences in end range of motion (ROM) kinetic and kinematic strategies between highly resistance and vertical jump-trained athletes and controls. Weightlifters (WL: n 4), short track speed skaters (STSS: n 5), and nonresistance-trained controls (C: n 6) performed 6 standing vertical squat jumps (SJ) and countermovement jumps (CMJ) without external resistance. Jump testing was performed using 3-dimensional marker trajectories captured with a 15-camera motion analysis system synchronized with 2 in-ground force plates. During SJ, there were large effects for the difference in time before toe off of peak vertical velocity between WL to STSS and C (ES: -1.43; ES: -1.73, respectively) and for the decrease between peak and toe off vertical velocity (ES: -1.28; ES: -1.71, respectively). During CMJ, there were large effects for the difference in time before toe off of peak vertical velocity between WL to STSS and C (ES: -1.28; ES: -1.53, respectively) and for decrease between peak and toe off vertical velocity (ES: -1.03; ES: -1.59, respectively). Accompanying these differences for both jump types were large effects for time of joint deceleration before toe off for all lower body joints between WL compared with C with large effects between WL and STSS at the hip and between STSS and C at the ankle. These findings suggest that the end ROM kinetic and kinematic strategy used during jumping is group-specific in power-trained athletes, with WL exhibiting superior strategies as compared with resistance- and jump-trained STSS.

Target tracking with range and bearing measurements via robust linear filtering

In this paper we provide a robust version of a linear Kalman filter for target tracking with nonlinear range and bearing measurements. Moreover, we prove that the state estimation error is bounded in a probabilistic sense. We compare our approach with the current state of the art in converted radar measurement based linear filtering.

Ageing effects on knee and ankle joint angles at key events and phases of the gait cycle.

The objective of this research was to determine whether joint angles at critical gait events and during major energy generation/absorption phases of the gait cycle would reliably discriminate age-related degeneration during unobstructed walking. The gaits of 24 healthy adults (12 young and 12 elderly) were analysed using the PEAK Motus motion analysis system. The elderly participants showed significantly greater single (60.3% versus 62.3%, p < 0.01) and double ( p < 0.05) support times, reduced knee flexion (47.7° versus 43.0°, p < 0.05) and ankle plantarflexion (16.8° compared to 3.3°, p = 0.053) at toe off, reduced knee flexion during push-off and reduced ankle dorsiflexion (16.8° compared to 22.0°, p < 0.05) during the swing phase. The plantarflexing ankle joint motion during the stance to swing phase transition (A₂) for the young group (31.3°) was about twice ( p < 0.05) that of the elderly (16.9°). Reduced knee extension range of motion suggests that the elderly favoured a flexed-knee gait to assist in weight acceptance. Reduced dorsiflexion by the elderly in the swing phase implies greater risk of toe contact with obstacles. Overall, the results suggest that joint angle measures at critical events/phases in the gait cycle provide a useful indication of age-related degeneration in the control of lower limb trajectories during unobstructed walking.