Classifying and learning cricket shots using camera motion

This paper presents a method to classify and learn cricket shots. The procedure begins by extracting the camera motion parameters from the shots. Then the camera parameter values are converted to symbolic form and combined to generate a symbolic description that defines the trajectory of the cricket bell. The description generated is used to classify the cricket shot and to dynamically expand or update the system's knowledge of shots. The first novel aspect of this approach is that by using the camera motion parameters, a complex and difficult process of low level image segmenting of either the batsman or the cricket ball from video images is avoided. Also the method does not require high resolution images. Another novel aspect of this work is the use of a new incremental learning algorithm that enables the system to improve and update its knowledge base. Unlike previously developed algorithms which store training instances and have simple method to prime their concept hierarchies, the incremental learning algorithm used in this work generates compact concept hierarchies and uses evidence based forgetting. The results show that the system performs well in the task of classifying four types of cricket shots.

Classifying complex human motion using point distribution models

The Point Distribution Model (PDM) has been successfully used in modelling shape variations in groups of static images. It has also been effectively adapted to temporal image sets and used to track moving bodies such as hands and walking persons. However standard models do not consider the temporal characteristics of the data and are purely models of shape. This research proposes an extension to the PDM which explicitly considers the temporal sequencing of the images in the motion. The modified model can then be built from temporal quantities such as linear velocity and acceleration which are derived from the images. The new model formulation also enables movements to be tracked and classified according to their distinguishing temporal characteristics. This has been tested against distinct sets of arm movements under varying sets of experimental conditions.

Determining motion components using the point distribution model

The Point Distribution Model (PDM) has proven effective in modelling variations in shape in sets of images, including those in which motion is involved such as body and hand tracking. This paper proposes an extension to the PDM through a re-parameterisation of the model which uses factors such as the angular velocity and distance travelled for sets of points on a moving shape. This then enables non-linear quantities such as acceleration and the average velocity of the body to be expressed in a linear model by the PDM. Results are shown for objects with known acceleration and deceleration components, these being a simulated pendulum modelled using simple harmonic motion and video sequences of a real pendulum in motion.

Film grammar based refinements to extracting scenes in motion pictures

To enable high-level semantic indexing of video, we tackle the problem of automatically structuring motion pictures into meaningful story units, namely scenes. In our recent work, drawing guidance from film grammar, we proposed an algorithmic solution for extracting scenes in motion pictures based on a shot neighborhood color coherence measure. In this paper, we extend our work by presenting various refinement mechanisms, inspired by the knowledge of film devices that are brought to bear while crafting scenes, to further improve the results of the scene detection algorithm. We apply the enhanced algorithm to ten motion pictures and demonstrate the resulting improvements in performance.

Finding the beat : an analysis of the rhythmic elements of motion pictures

This paper forms a continuation of our work focused on exploiting film grammar for the task of automated film understanding. We examine film rhythm, a powerful narrative concept used to endow structure and form to the film compositionally and to enhance its lyrical quality experientially. Of the many, often complex, cinematic devices contributing to film rhythm, this paper investigates the rhythmic elements that are present in edited sequences of shots, and presents a novel computational model to detect shot structural rhythm as either metric, accelerated, decelerated, or free. Details of the algorithm for the extraction of these editing rhythm classes are presented, along with experimental results on real movie data. Following this we study the usefulness of combining the rhythmic patterns induced through both motion and editing in film. We show that, whilst detailed content identification via rhythm types alone is not possible by virtue of the fact that film is not codified to this level in terms of rhythmic elements, analysis of the combined motion/shot rhythm can allow us to determine that the content has changed and hypothesize as to why this is so. We present 3 such categories of change and demonstrate their efficacy for capturing useful film elements (e.g., scene change precipitated by plot event), by providing data support from 5 motion pictures.

Real-time motion capture interactive, 3D stereoscopic visualization

Vincs, McCormick and dancers Steph Hutchinson & Megan Beckwith present live motion capture interactive pipelines that visualise the kinematics of a performer’s movement in stereoscopic environments created using the Unity game engine, and discuss their use in Choreotopography (2010) and Choreotopography (2011). This work forms part of Vincs’ ARC Discovery Project Capturing Dance: using motion capture to enhance the creation of innovative Australian dance (DP0987101).

History's motion : on absolute time and space in Tibet

On-going contestations to establish the hegemonic narrative of Tibet's history rest on the shared assumption that a true narrative, or history's motion, exists. This essay suggests that history's motion is a continuing legacy of Newton's concepts of absolute time and space, even while the current disputes over Tibet's history point to the limitations of these concepts in practice.

Reliability maps and probabilistic guarantee of task motion for robotic manipulators

There are many applications for which reliable and safe robots are desired. For example, assistant robots for disabled or elderly people and surgical robots are required to be safe and reliable to prevent human injury and task failure. However, different levels of safety and reliability are required for different tasks so that understanding the reliability of robots is paramount. Currently, it is possible to guarantee the completion of a task when the robot is fault tolerant and the task remains in the fault-tolerant workspace (FTW). The traditional definition of FTW does not consider different reliabilities for the robotic manipulator's different joints. The aim of this paper is to extend the concept of a FTW to address the reliability of different joints. Such an extension can offer a wider FTW while maintaining the required level of reliability. This is achieved by associating a probability with every part of the workspace to extend the FTW. As a result, reliable fault-tolerant workspaces (RFTWs) are introduced by using the novel concept of conditional reliability maps. Such a RFTW can be used to improve the performance of assistant robots while providing the confidence that the robot remains reliable for completion of its assigned tasks. © 2012 Copyright Taylor & Francis and The Robotics Society of Japan.

Localisation of an object in motion in 3D space via angle only measurements

In this paper, we discuss an approach to localisation of a moving object in 3D space. The method used to track this object is angle only measurements obtained via radar elements strategically placed within the X, Y and Z planes. In addition, computer simulations are conducted to verify the theoretical assertions presented with respect to the application employing an Extended Kalman Filter.

Large-scale statistical modeling of motion patterns : a Bayesian nonparametric approach

We propose a novel framework for large-scale scene understanding in static camera surveillance. Our techniques combine fast rank-1 constrained robust PCA to compute the foreground, with non-parametric Bayesian models for inference. Clusters are extracted in foreground patterns using a joint multinomial+Gaussian Dirichlet process model (DPM). Since the multinomial distribution is normalized, the Gaussian mixture distinguishes between similar spatial patterns but different activity levels (eg. car vs bike). We propose a modification of the decayed MCMC technique for incremental inference, providing the ability to discover theoretically unlimited patterns in unbounded video streams. A promising by-product of our framework is online, abnormal activity detection. A benchmark video and two surveillance videos, with the longest being 140 hours long are used in our experiments. The patterns discovered are as informative as existing scene understanding algorithms. However, unlike existing work, we achieve near real-time execution and encouraging performance in abnormal activity detection.