Improved simultaneous computation of motion detection and optical flow for object tracking

Object tracking systems require accurate segmentation of the objects from the background for effective tracking. Motion segmentation or optical flow can be used to segment incoming images. Whilst optical flow allows multiple moving targets to be separated based on their individual velocities, optical flow techniques are prone to errors caused by changing lighting and occlusions, both common in a surveillance environment. Motion segmentation techniques are more robust to fluctuating lighting and occlusions, but don't provide information on the direction of the motion. In this paper we propose a combined motion segmentation/optical flow algorithm for use in object tracking. The proposed algorithm uses the motion segmentation results to inform the optical flow calculations and ensure that optical flow is only calculated in regions of motion, and improve the performance of the optical flow around the edge of moving objects. Optical flow is calculated at pixel resolution and tracking of flow vectors is employed to improve performance and detect discontinuities, which can indicate the location of overlaps between objects. The algorithm is evaluated by attempting to extract a moving target within the flow images, given expected horizontal and vertical movement (i.e. the algorithms intended use for object tracking). Results show that the proposed algorithm outperforms other widely used optical flow techniques for this surveillance application.

Robust tracking control of autonomous underwater vehicles in the presence of disturbance inputs

An autonomous underwater vehicle (AUV) is expected to operate in an ocean in the presence of poorly known disturbance forces and moments. The uncertainties of the environment makes it difficult to apply open-loop control scheme for the motion planning of the vehicle. The objective of this paper is to develop a robust feedback trajectory tracking control scheme for an AUV that can track a prescribed trajectory amidst such disturbances. We solve a general problem of feedback trajectory tracking of an AUV in SE(3). The feedback control scheme is derived using Lyapunov-type analysis. The results obtained from numerical simulations confirm the asymptotic tracking properties of the feedback control law. We apply the feedback control scheme to different mission scenarios, with the disturbances being initial errors in the state of the AUV.

Robust speed tracking control of synchronous motors using immersion and invariance

This paper presents a novel control strategy for velocity tracking of Permanent Magnet Synchronous Machines (PMSM). The model of the machine is considered within the port-Hamiltonian framework and a control is designed using concepts of immersion and invariance (I&I) recently developed in the literature. The proposed controller ensures internal stability and output regulation, and it forces integral action on non-passive outputs.

Manoeuvring control of fully-actuated marine vehicles : a Port-Hamiltonian system approach to tracking

This paper presents a novel control strategy for trajectory tracking of marine vehicles manoeuvring at low speed. The model of the marine vehicle is formulated as a Port-Hamiltonian system, and the tracking controller is designed using energy shaping and damping assignment. The controller guarantees global asymptotic stability and includes integral action for output variables with relative degree greater than one.

Detection and Characterization of Long-Pulse Low-Velocity Impact Damage in Plastic Bonded Explosives

Damage not only degrades the mechanical properties of explosives, but also influences the shock sensitivity, combustion and even detonation behavior of explosives. The study of impact damage is crucial in the vulnerability evaluation of explosives. A long-pulse low-velocity gas gun with a gas buffer was developed and used to induce impact damage in a hot pressed plastic bonded explosive. Various methods were used to detect and characterize the impact damage of the explosive. The microstructure was examined by use of polarized light microscopy. Fractal analysis of the micrographs was conducted by use of box counting method. The correlation between the fractal dimensions and microstructures was analyzed. Ultrasonic testing was conducted using a pulse through-transmission method to obtain the ultrasonic velocity and ultrasonic attenuation. Spectra analyses were carried out for recorded ultrasonic signals using fast Fourier transform. The correlations between the impact damage and ultrasonic parameters including ultrasonic velocities and attenuation coefficients were also analyzed. To quantitatively assess the impact induced explosive crystal fractures, particle size distribution analyses of explosive crystals were conducted by using a thorough etching technique, in which the explosives samples were soaked in a solution for enough time that the binder was totally removed. Impact induces a large extent of explosive crystal fractures and a large number of microcracks. The ultrasonic velocity decreases and attenuation coefficients increase with the presence of impact damage. Both ultrasonic parameters and fractal dimension can be used to quantitatively assess the impact damage of plastic bonded explosives.

Review of NRA tracking projects on salmon, Salmo salar L., and sea trout, Salmo trutta L

The report briefly outlines the programme of the National Rivers Authority (NRA), placing the Fisheries programme in the context of the work of the NRA as a whole, and viewing the tracking work against the broader requirements of the NRA Fisheries research programme. All regions of England and Wales are considered. Two techniques currently exist for studying the detailed timing and extent of movements of adult salmon: tracking of individually identifiable fish, and counting the numbers of fish moving past a fixed point in the river. The development of tracking techniques and the integrated use of tracking and fish counters is briefly reviewed in Section 3. Further details of these techniques are given in Appendices. Section 4 summarises and assesses completed and current NRA tracking studies. Section 5 discusses the scientific content of these studies in relation to similar work carried out elsewhere in the UK. The NRA programme of tracking studies is evaluated in Section 6. Section 7 discusses future fisheries projects and Section 8 details the future development of tracking techniques. Finally, recommendations arising out of this review are summarised in Section 9.

Use of telemetric tracking to examine environmental influences on catch/effort indices. A case study of Atlantic Salmon (Salmo salar L.)in the R. Tywi, S. Wales

A case study of Atlantic Salmon runs into the R. Tyvi (S. Wales) is presented. Radio tracking of over 200 salmon in 1988 and 1989 has demonstrated that flow is an important factor in modifying both run timing and migratory success. Entry of salmon into the river is typically in response to flow events, and periods of low falling flows delay entry and may directly result in reduced runs into the river. Delayed entry may also increase the proportion of the run migrating after the end of both rod and net fishing seasons. The implications of these results for net and rod catch and catch/effort data are discussed, using both statutory reported catch data and data from specific catch/effort studies. Flow is demonstrated to be a dominant factor in determining the within-season distribution of rod catch and catch/effort during low-flow years. Estuarial seine net catch and catch/effort tend to be controlled more by time of return than by flow although low flows may delay runs. Annual reported rod catch is correlated with flow, which controls in season availability, catchability and consequently the amount of fishing effort. Use of catch or catch/effort data should take account of inter-year variations in flow and other environmental factors. Although catch and catch/effort are valuable indicators of fishery performance, they are inadequate to represent changing stock levels.

Description of NRA tracking studies: tracking techniques and fish counter technology

The study began on the 7th January 1991 and was completed in June 1991. Two reports have been produced. This report published as R&D Note 33 describes NRA tracking studies, tracking techniques and fish counter technology. The second report published as R&D Note 34 evaluates NRA tracking studies and recommends future research. The latter will be used solely for NRA management purposes. This report briefly outlines the programme of the NRA, placing the Fisheries programme in the context of the work of the NRA as a whole, and viewing the tracking work against the broader requirements of the NRA Fisheries research programme. Two techniques currently exist for studying the detailed timing and extent of movements of adult salmon: tracking of individually identifiable fish, and counting the numbers of fish moving past a fixed point in the river. Further details of these techniques and their development are given in Sections 2 and 3. Section 4 summarises and assesses completed and current NRA tracking Studies. Complete project descriptions for the studies are contained in Appendix A. Section 5 discusses the scientific content of these studies in relation to similar work carried out elsewhere in the UK. Section 6 details the future development of tracking techniques. Tracking work on migratory salmonids has tended to concentrate largely upon the movements of adult salmon. Much of this report will therefore be concerned with salmon tracking studies. NRA studies involving sea trout are referred to where appropriate. The methodological problems of sea trout tracking studies are summarised in Section 2.1.3.

3D Trajectory Recovery for Tracking Multiple Objects and Trajectory Guided Recognition of Actions

A mechanism is proposed that integrates low-level (image processing), mid-level (recursive 3D trajectory estimation), and high-level (action recognition) processes. It is assumed that the system observes multiple moving objects via a single, uncalibrated video camera. A novel extended Kalman filter formulation is used in estimating the relative 3D motion trajectories up to a scale factor. The recursive estimation process provides a prediction and error measure that is exploited in higher-level stages of action recognition. Conversely, higher-level mechanisms provide feedback that allows the system to reliably segment and maintain the tracking of moving objects before, during, and after occlusion. The 3D trajectory, occlusion, and segmentation information are utilized in extracting stabilized views of the moving object. Trajectory-guided recognition (TGR) is proposed as a new and efficient method for adaptive classification of action. The TGR approach is demonstrated using "motion history images" that are then recognized via a mixture of Gaussian classifier. The system was tested in recognizing various dynamic human outdoor activities; e.g., running, walking, roller blading, and cycling. Experiments with synthetic data sets are used to evaluate stability of the trajectory estimator with respect to noise.

Trajectory Guided Tracking and Recognition of Actions

A combined 2D, 3D approach is presented that allows for robust tracking of moving people and recognition of actions. It is assumed that the system observes multiple moving objects via a single, uncalibrated video camera. Low-level features are often insufficient for detection, segmentation, and tracking of non-rigid moving objects. Therefore, an improved mechanism is proposed that integrates low-level (image processing), mid-level (recursive 3D trajectory estimation), and high-level (action recognition) processes. A novel extended Kalman filter formulation is used in estimating the relative 3D motion trajectories up to a scale factor. The recursive estimation process provides a prediction and error measure that is exploited in higher-level stages of action recognition. Conversely, higher-level mechanisms provide feedback that allows the system to reliably segment and maintain the tracking of moving objects before, during, and after occlusion. The 3D trajectory, occlusion, and segmentation information are utilized in extracting stabilized views of the moving object that are then used as input to action recognition modules. Trajectory-guided recognition (TGR) is proposed as a new and efficient method for adaptive classification of action. The TGR approach is demonstrated using "motion history images" that are then recognized via a mixture-of-Gaussians classifier. The system was tested in recognizing various dynamic human outdoor activities: running, walking, roller blading, and cycling. Experiments with real and synthetic data sets are used to evaluate stability of the trajectory estimator with respect to noise.

Adaptive Fusion Of Particle Filtering And Spatio-Temporal Motion Energy For Human Tracking

Object tracking is an active research area nowadays due to its importance in human computer interface, teleconferencing and video surveillance. However, reliable tracking of objects in the presence of occlusions, pose and illumination changes is still a challenging topic. In this paper, we introduce a novel tracking approach that fuses two cues namely colour and spatio-temporal motion energy within a particle filter based framework. We conduct a measure of coherent motion over two image frames, which reveals the spatio-temporal dynamics of the target. At the same time, the importance of both colour and motion energy cues is determined in the stage of reliability evaluation. This determination helps maintain the performance of the tracking system against abrupt appearance changes. Experimental results demonstrate that the proposed method outperforms the other state of the art techniques in the used test datasets.

Quantitative analysis of accuracy of an inertial/acoustic 6DOF tracking system in motion

An increasing number of neuroscience experiments are using virtual reality to provide a more immersive and less artificial experimental environment. This is particularly useful to navigation and three-dimensional scene perception experiments. Such experiments require accurate real-time tracking of the observer's head in order to render the virtual scene. Here, we present data on the accuracy of a commonly used six degrees of freedom tracker (Intersense IS900) when it is moved in ways typical of virtual reality applications. We compared the reported location of the tracker with its location computed by an optical tracking method. When the tracker was stationary, the root mean square error in spatial accuracy was 0.64 mm. However, we found that errors increased over ten-fold (up to 17 mm) when the tracker moved at speeds common in virtual reality applications. We demonstrate that the errors we report here are predominantly due to inaccuracies of the IS900 system rather than the optical tracking against which it was compared. (c) 2006 Elsevier B.V. All rights reserved.

Sensitivities of a cyclone detection and tracking algorithm: individual tracks and climatology

Northern Hemisphere cyclone activity is assessed by applying an algorithm for the detection and tracking of synoptic scale cyclones to mean sea level pressure data. The method, originally developed for the Southern Hemisphere, is adapted for application in the Northern Hemisphere winter season. NCEP-Reanalysis data from 1958/59 to 1997/98 are used as input. The sensitivities of the results to particular parameters of the algorithm are discussed for both case studies and from a climatological point of view. Results show that the choice of settings is of major relevance especially for the tracking of smaller scale and fast moving systems. With an appropriate setting the algorithm is capable of automatically tracking different types of cyclones at the same time: Both fast moving and developing systems over the large ocean basins and smaller scale cyclones over the Mediterranean basin can be assessed. The climatology of cyclone variables, e.g., cyclone track density, cyclone counts, intensification rates, propagation speeds and areas of cyclogenesis and -lysis gives detailed information on typical cyclone life cycles for different regions. The lowering of the spatial and temporal resolution of the input data from full resolution T62/06h to T42/12h decreases the cyclone track density and cyclone counts. Reducing the temporal resolution alone contributes to a decline in the number of fast moving systems, which is relevant for the cyclone track density. Lowering spatial resolution alone mainly reduces the number of weak cyclones.

Software tools and efficient algorithms for the feature detection, feature tracking, event localization, and visualization of large sets of atmospheric data

Data sets describing the state of the earth's atmosphere are of great importance in the atmospheric sciences. Over the last decades, the quality and sheer amount of the available data increased significantly, resulting in a rising demand for new tools capable of handling and analysing these large, multidimensional sets of atmospheric data. The interdisciplinary work presented in this thesis covers the development and the application of practical software tools and efficient algorithms from the field of computer science, aiming at the goal of enabling atmospheric scientists to analyse and to gain new insights from these large data sets. For this purpose, our tools combine novel techniques with well-established methods from different areas such as scientific visualization and data segmentation. In this thesis, three practical tools are presented. Two of these tools are software systems (Insight and IWAL) for different types of processing and interactive visualization of data, the third tool is an efficient algorithm for data segmentation implemented as part of Insight.Insight is a toolkit for the interactive, three-dimensional visualization and processing of large sets of atmospheric data, originally developed as a testing environment for the novel segmentation algorithm. It provides a dynamic system for combining at runtime data from different sources, a variety of different data processing algorithms, and several visualization techniques. Its modular architecture and flexible scripting support led to additional applications of the software, from which two examples are presented: the usage of Insight as a WMS (web map service) server, and the automatic production of a sequence of images for the visualization of cyclone simulations. The core application of Insight is the provision of the novel segmentation algorithm for the efficient detection and tracking of 3D features in large sets of atmospheric data, as well as for the precise localization of the occurring genesis, lysis, merging and splitting events. Data segmentation usually leads to a significant reduction of the size of the considered data. This enables a practical visualization of the data, statistical analyses of the features and their events, and the manual or automatic detection of interesting situations for subsequent detailed investigation. The concepts of the novel algorithm, its technical realization, and several extensions for avoiding under- and over-segmentation are discussed. As example applications, this thesis covers the setup and the results of the segmentation of upper-tropospheric jet streams and cyclones as full 3D objects. Finally, IWAL is presented, which is a web application for providing an easy interactive access to meteorological data visualizations, primarily aimed at students. As a web application, the needs to retrieve all input data sets and to install and handle complex visualization tools on a local machine are avoided. The main challenge in the provision of customizable visualizations to large numbers of simultaneous users was to find an acceptable trade-off between the available visualization options and the performance of the application. Besides the implementational details, benchmarks and the results of a user survey are presented.

Daily organ tracking in intensity-modulated radiotherapy of prostate cancer using an electronic portal imaging device with a dose saving acquisition mode

BACKGROUND AND PURPOSE: Daily use of conventional electronic portal imaging devices (EPID) for organ tracking is limited due to the relatively high dose required for high quality image acquisition. We studied the use of a novel dose saving acquisition mode (RadMode) allowing to take images with one monitor unit per image in prostate cancer patients undergoing intensity-modulated radiotherapy (IMRT) and tracking of implanted fiducial gold markers. PATIENTS AND METHODS: Twenty five patients underwent implantation of three fiducial gold markers prior to the planning CT. Before each treatment of a course of 37 fractions, orthogonal localization images from the antero-posterior and from the lateral direction were acquired. Portal images of both the setup procedure and the five IMRT treatment beams were analyzed. RESULTS: On average, four localization images were needed for a correct patient setup, resulting in four monitor units extra dose per fraction. The mean extra dose delivered to the patient was thereby increased by 1.2%. The procedure was precise enough to reduce the mean displacements prior to treatment to < o =0.3 mm. CONCLUSIONS: The use of a new dose saving acquisition mode enables to perform daily EPID-based prostate tracking with a cumulative extra dose of below 1 Gy. This concept is efficiently used in IMRT-treated patients, where separation of setup beams from treatment beams is mandatory.