Person tracking using motion detection and optical flow

Person tracking systems to date have either relied on motion detection or optical flow as a basis for person detection and tracking. As yet, systems have not been developed that utilise both these techniques. We propose a person tracking system that uses both, made possible by a novel hybrid optical flow-motion detection technique that we have developed. This provides the system with two methods of person detection, helping to avoid missed detections and the need to predict position, which can lead to errors in tracking and mistakes when handling occlusion situations. Our results show that our system is able to track people accurately, with an average error less than four pixels, and that our system outperforms the current CAVIAR benchmark system.

The anatomical and biomechanical consequences of anterior vertebral stapling for the fusionless correction of scoliosis

Fusionless scoliosis surgery is an emerging treatment for idiopathic scoliosis as it offers theoretical advantages over current forms of treatment. Anterior vertebral stapling using a nitinol staple is one such treatment. Despite increasing interest in this technique, little is known about the effects on the spine following insertion, or the mechanism of action of the staple. The aims of this study were threefold; (1) to measure changes in the bending stiffness of a single motion segment following staple insertion, (2) to describe the forces that occur within the staple during spinal movement, and (3) to describe the anatomical changes that occur following staple insertion. Results suggest that staple insertion consistently decreased stiffness in all directions of motion. An explanation for the finding may be found in the outcomes of the strain gauge testing and micro-CT scan. The strain gauge testing showed that once inserted, the staple tips applied a baseline compressive force to the surrounding trabecular bone and vertebral end-plate. This finding would be consistent with the current belief that the clinical effect of the staples is via unilateral compression of the physis. Interestingly however, as each specimen progressed through the five cycles of each test, the baseline load on the staple tips gradually decreased, implying that the force at the staple tip-bone interface was decreasing. We believe that this was likely occurring as a result of structural damage to the trabecular bone and vertebral end-plate by the staple effectively causing ‘loosening’ of the staple. This hypothesis is further supported by the findings of the micro-CT scan. The pictures depict significant trabecular bone and physeal injury around the staple blades. These results suggest that the current hypothesis that stapling modulates growth through physeal compression may be incorrect, but rather the effect occurs through mechanical disruption of the vertebral growth plate.

Constraints on the complete optimization of human motion

In sport and exercise biomechanics, forward dynamics analyses or simulations have frequently been used in attempts to establish optimal techniques for performance of a wide range of motor activities. However, the accuracy and validity of these simulations is largely dependent on the complexity of the mathematical model used to represent the neuromusculoskeletal system. It could be argued that complex mathematical models are superior to simple mathematical models as they enable basic mechanical insights to be made and individual-specific optimal movement solutions to be identified. Contrary to some claims in the literature, however, we suggest that it is currently not possible to identify the complete optimal solution for a given motor activity. For a complete optimization of human motion, dynamical systems theory implies that mathematical models must incorporate a much wider range of organismic, environmental and task constraints. These ideas encapsulate why sports medicine specialists need to adopt more individualized clinical assessment procedures in interpreting why performers' movement patterns may differ.

Seeing pedestrians at night : visual clutter does not mask biological motion

Although placing reflective markers on pedestrians’ major joints can make pedestrians more conspicuous to drivers at night, it has been suggested that this “biological motion” effect may be reduced when visual clutter is present. We tested whether extraneous points of light affected the ability of 12 younger and 12 older drivers to see pedestrians as they drove on a closed road at night. Pedestrians wore black clothing alone or with retroreflective markings in four different configurations. One pedestrian walked in place and was surrounded by clutter on half of the trials. Another was always surrounded by visual clutter but either walked in place or stood still. Clothing configuration, pedestrian motion, and driver age influenced conspicuity but clutter did not. The results confirm that even in the presence of visual clutter pedestrians wearing biological motion configurations are recognized more often and at greater distances than when they wear a reflective vest.

A brush with the real world : the future of inertial motion capture in live performance

3D Motion capture is a medium that plots motion, typically human motion, converting it into a form that can be represented digitally. It is a fast evolving field and recent inertial technology may provide new artistic possibilities for its use in live performance. Although not often used in this context, motion capture has a combination of attributes that can provide unique forms of collaboration with performance arts. The inertial motion capture suit used for this study has orientation sensors placed at strategic points on the body to map body motion. Its portability, real-time performance, ease of use, and its immunity from line-of-sight problems inherent in optical systems suggest it would work well as a live performance technology. Many animation techniques can be used in real-time. This research examines a broad cross-section of these techniques using four practice-led cases to assess the suitability of inertial motion capture to live performance. Although each case explores different visual possibilities, all make use of the performativity of the medium, using either an improvisational format or interactivity among stage, audience and screen that would be difficult to emulate any other way. A real-time environment is not capable of reproducing the depth and sophistication of animation people have come to expect through media. These environments take many hours to render. In time the combination of what can be produced in real-time and the tools available in a 3D environment will no doubt create their own tree of aesthetic directions in live performance. The case study looks at the potential of interactivity that this technology offers.

Anterior vertebral stapling for the fusionless correction of scoliosis

Fusionless scoliosis surgery is an emerging treatment for idiopathic scoliosis as it offers theoretical advantages over current forms of treatment. Currently the treatment options for idiopathic scoliosis are observation, bracing and fusion. While brace treatment is non-invasive, and preserves the growth, motion, and function of the spine, it does not correct deformity and is only modestly successful in preventing curve progression. In adolescents who fail brace treatment, surgical treatment with an instrumented spinal fusion usually results in better deformity correction but is associated with substantially greater risk. Furthermore in younger patients requiring surgical treatment, fusion procedures are known to adversely effect the future growth of the chest and spine. Fusionless treatments have been developed to allow effective surgical treatment of patients with idiopathic scoliosis who are too young for fusion procedures. Anterior vertebral stapling is one such fusionless treatment which aims to modulate the growth of vertebra to allow correction of scoliosis whilst maintaining normal spinal motion The Mater Misericordiae Hospital in Brisbane has begun to use anterior vertebral stapling to treat patients with idiopathic scoliosis who are too young for fusion procedures. Currently the only staple approved for clinical use is manufactured by Medtronic Sofamor Danek (Memphis, TN). This thesis explains the biomechanical and anatomical changes that occur following anterior vertebral staple insertion using in vitro experiments performed on an immature bovine model. Currently there is a paucity of published information about anterior vertebral stapling so it is hoped that this project will provide information that will aid in our understanding of the clinical effects of staple insertion. The aims of this experimental study were threefold. The first phase was designed to determine the changes in the bending stiffness of the spine following staple insertion. The second phase was designed to measure the forces experienced by the staple during spinal movements. The third and final phase of testing was designed to describe the structural changes that occur to a vertebra as a consequence of staple insertion. The first phase of testing utilised a displacement controlled testing robot to compare the change in stiffness of a single spinal motion segment following staple insertion for the three basic spinal motions of flexion-extension, lateral bending, and axial rotation. For the second phase of testing strain gauges were attached to staples and used to measure staple forces during spinal movement. In the third and final phase the staples were removed and a testing specimen underwent micro-computed tomography (CT) scanning to describe the anatomical changes that occur following staple insertion. The displacement controlled testing showed that there was a significant decrease in bending stiffness in flexion, extension, lateral bending away from the staple, and axial rotation away from the staple following staple insertion. The strain gauge measurements showed that the greatest staple forces occurred in flexion and the least in extension. In addition, a reduction in the baseline staple compressive force was seen with successive loading cycles. Micro-CT scanning demonstrated that significant damage to the vertebral body and endplate occurred as a consequence of staple insertion. The clinical implications of this study are significant. Based on the findings of this project it is likely that the clinical effect of the anterior vertebral staple evaluated in this project is a consequence of growth plate damage (also called hemiepiphysiodesis) causing a partial growth arrest of the vertebra rather than simply compression of the growth plate. The surgical creation of a unilateral growth arrest is a well established treatment used in the management of congenital scoliosis but has not previously been considered for use in idiopathic scoliosis.

Abandoned object detection using multi-layer motion detection

Abandoned object detection (AOD) systems are required to run in high traffic situations, with high levels of occlusion. Systems rely on background segmentation techniques to locate abandoned objects, by detecting areas of motion that have stopped. This is often achieved by using a medium term motion detection routine to detect long term changes in the background. When AOD systems are integrated into person tracking system, this often results in two separate motion detectors being used to handle the different requirements. We propose a motion detection system that is capable of detecting medium term motion as well as regular motion. Multiple layers of medium term (static) motion can be detected and segmented. We demonstrate the performance of this motion detection system and as part of an abandoned object detection system.

Object tracking using multiple motion modalities

This paper presents an object tracking system that utilises a hybrid multi-layer motion segmentation and optical flow algorithm. While many tracking systems seek to combine multiple modalities such as motion and depth or multiple inputs within a fusion system to improve tracking robustness, current systems have avoided the combination of motion and optical flow. This combination allows the use of multiple modes within the object detection stage. Consequently, different categories of objects, within motion or stationary, can be effectively detected utilising either optical flow, static foreground or active foreground information. The proposed system is evaluated using the ETISEO database and evaluation metrics and compared to a baseline system utilising a single mode foreground segmentation technique. Results demonstrate a significant improvement in tracking results can be made through the incorporation of the additional motion information.

Improved simultaneous computation of motion detection and optical flow for object tracking

Object tracking systems require accurate segmentation of the objects from the background for effective tracking. Motion segmentation or optical flow can be used to segment incoming images. Whilst optical flow allows multiple moving targets to be separated based on their individual velocities, optical flow techniques are prone to errors caused by changing lighting and occlusions, both common in a surveillance environment. Motion segmentation techniques are more robust to fluctuating lighting and occlusions, but don't provide information on the direction of the motion. In this paper we propose a combined motion segmentation/optical flow algorithm for use in object tracking. The proposed algorithm uses the motion segmentation results to inform the optical flow calculations and ensure that optical flow is only calculated in regions of motion, and improve the performance of the optical flow around the edge of moving objects. Optical flow is calculated at pixel resolution and tracking of flow vectors is employed to improve performance and detect discontinuities, which can indicate the location of overlaps between objects. The algorithm is evaluated by attempting to extract a moving target within the flow images, given expected horizontal and vertical movement (i.e. the algorithms intended use for object tracking). Results show that the proposed algorithm outperforms other widely used optical flow techniques for this surveillance application.

Inertial motion capture and live performance (with a focus on dance)

3D Motion capture is a fast evolving field and recent inertial technology may expand the artistic possibilities for its use in live performance. Inertial motion capture has three attributes that make it suitable for use with live performance; it is portable, easy to use and can operate in real-time. Using four projects, this paper discusses the suitability of inertial motion capture to live performance with a particular emphasis on dance. Dance is an artistic application of human movement and motion capture is the means to record human movement as digital data. As such, dance is clearly a field in which the use of real-time motion capture is likely to become more common, particularly as projected visual effects including real-time video are already often used in dance performances. Understandably, animation generated in real-time using motion capture is not as extensive or as clean as the highly mediated animation used in movies and games, but the quality is still impressive and the ‘liveness’ of the animation has compensating features that offer new ways of communicating with an audience.