Neural Dynamics of Saccadic and Smooth Pursuit Eye Movement Coordination during Visual Tracking of Unpredictably Moving Targets

How does the brain use eye movements to track objects that move in unpredictable directions and speeds? Saccadic eye movements rapidly foveate peripheral visual or auditory targets and smooth pursuit eye movements keep the fovea pointed toward an attended moving target. Analyses of tracking data in monkeys and humans reveal systematic deviations from predictions of the simplest model of saccade-pursuit interactions, which would use no interactions other than common target selection and recruitment of shared motoneurons. Instead, saccadic and smooth pursuit movements cooperate to cancel errors of gaze position and velocity, and thus to maximize target visibility through time. How are these two systems coordinated to promote visual localization and identification of moving targets? How are saccades calibrated to correctly foveate a target despite its continued motion during the saccade? A neural model proposes answers to such questions. The modeled interactions encompass motion processing areas MT, MST, FPA, DLPN and NRTP; saccade planning and execution areas FEF and SC; the saccadic generator in the brain stem; and the cerebellum. Simulations illustrate the model’s ability to functionally explain and quantitatively simulate anatomical, neurophysiological and behavioral data about SAC-SPEM tracking.

Target Selection by Frontal Cortex During Coordinated Saccadic and Smooth Pursuit Eye Movement

Oculomotor tracking of moving objects is an important component of visually based cognition and planning. Such tracking is achieved by a combination of saccades and smooth pursuit eye movements. In particular, the saccadic and smooth pursuit systems interact to often choose the same target, and to maximize its visibility through time. How do multiple brain regions interact, including frontal cortical areas, to decide the choice of a target among several competing moving stimuli? How is target selection information that is created by a bias (e.g., electrical stimulation) transferred from one movement system to another? These saccade-pursuit interactions are clarified by a new computational neural model, which describes interactions among motion processing areas MT, MST, FPA, DLPN; saccade specification, selection, and planning areas LIP, FEF, SNr, SC; the saccadic generator in the brain stem; and the cerebellum. Model simulations explain a broad range of neuroanatomical and neurophysiological data. These results are in contrast with the simplest parallel model with no interactions between saccades and pursuit than common-target selection and recruitment of shared motoneurons. Actual tracking episodes in primates reveal multiple systematic deviations from predictions of the simplest parallel model, which are explained by the current model.

Effect of lesion morphology on microwave signature in 2-D ultra-wideband breast imaging

This paper studies the possibility of distinguishing between benign and malignant masses by exploiting the morphology-dependent temporal and spectral characteristics of their microwave backscatter response in ultra-wideband breast cancer detection. The spiculated border profiles of 2-D breast masses are generated by modifying the baseline elliptical rings based upon the irregularity of their peripheries. Furthermore, the single- and multilayer lesion models are used to characterize a distinct mass region followed by a sharp transition to background, and a blurred mass border exhibiting a gradual transition to background, respectively. Subsequently, the complex natural resonances (CNRs) of the backscatter microwave signature can be derived from the late-time target response and reveal diagnostically useful information. The fractional sequence CLEAN algorithm is proposed to estimate the lesions' delay intervals and identify the late-time responses. Finally, it is shown through numerical examples that the locations of dominant CNRs are dependent on the lesion morphologies, where 2-D computational breast phantoms with single and multiple lesions are investigated. The analysis is of potential use for discrimination between benign and malignant lesions, where the former usually possesses a better-defined, more compact shape as opposed to the latter.

Morphology and localization of interstitial cells in the guinea pig bladder: structural relationships with smooth muscle and neurons.

PURPOSE: In the current study we examined the location of interstitial cell of Cajal (ICC)-like cells in the guinea pig bladder wall and studied their structural interactions with nerves and smooth muscle cells. MATERIALS AND METHODS: Whole mount samples and cryosections of bladder tissue were labeled with primary and fluorescent secondary antibodies, and imaged using confocal and multiphoton microscopy. RESULTS: Kit positive ICC-like cells were located below the urothelium, in the lamina propria region and throughout the detrusor. In the suburothelium they had a stellate morphology and appeared to network. They made connections with nerves, as shown by double labeling experiments with anti-kit and anti-protein gene product 9.5. A network of vimentin positive cells was also found, of which many but not all were kit positive. In the detrusor kit positive cells were most often seen at the edge of smooth muscle bundles. They were elongated with lateral branches, running in parallel with the bundles and closely associated with intramural nerves. Another population of kit positive cells was seen in the detrusor between muscle bundles. These cells had a more stellate-like morphology and made connections with each other. Kit positive cells were seen tracking nerve bundles and close to intramural ganglia. Vimentin positive cells were present in the detrusor, of which some were also kit positive. CONCLUSIONS: There are several populations of ICC-like cells throughout the guinea pig bladder wall. They differ in morphology and orientation but all make connections with intramural nerves and in the detrusor they are closely associated with smooth muscle cells.

Non-intrusive tracking of commercial broiler chickens in situ at different stocking densities

Unlike several other farm animal species, the broiler chicken remains unprotected by species-specific legislation. The densities at which broilers should be kept is a highly contentious issue-some studies have demonstrated increased welfare problems at higher densities, whilst a few others have, contrary to expectations, suggested that broilers may actually find crowds of other birds attractive. A tracking method was developed and used to provide an insight into the social preferences of commercial broiler chickens in situ-inside commercial, closed-system broiler houses. The aim was to simultaneously assess the relative impact of global measures of density, such as target and actual stocking densities and local measures of the social environment on the behaviour and route taken to feed by focal birds. Birds were tracked inside 20 commercial broiler houses across the UK. Results from this study show that stocking density per se seems to have little direct effect on the individual behaviours of focal broiler chickens. However, there may still be an indirect effect of stocking density on broiler behaviour, mediated through the local social environment. (C) 2007 Elsevier B.V. All rights reserved.

Rao-Blackwellised particle filter for colour-based tracking

Colour-based particle filters have been used exhaustively in the literature given rise to multiple applications However tracking coloured objects through time has an important drawback since the way in which the camera perceives the colour of the object can change Simple updates are often used to address this problem which imply a risk of distorting the model and losing the target In this paper a joint image characteristic-space tracking is proposed which updates the model simultaneously to the object location In order to avoid the curse of dimensionality a Rao-Blackwellised particle filter has been used Using this technique the hypotheses are evaluated depending on the difference between the model and the current target appearance during the updating stage Convincing results have been obtained in sequences under both sudden and gradual illumination condition changes Crown Copyright (C) 2010 Published by Elsevier B V All rights reserved

Multicamera sport player tracking with Bayesian estimation of measurements

We propose a complete application capable of tracking multiple objects in an environment monitored by multiple cameras. The system has been specially developed to be applied to sport games, and it has been evaluated in a real association-football stadium. Each target is tracked using a local importance-sampling particle filter in each camera, but the final estimation is made by combining information from the other cameras using a modified unscented Kalman filter algorithm. Multicamera integration enables us to compensate for bad measurements or occlusions in some cameras thanks to the other views it offers. The final algorithm results in a more accurate system with a lower failure rate. (C) 2009 Society of Photo-Optical Instrumentation Engineers. [DOI: 10.1117/1.3114605]

An efficient particle filter for color-based tracking in complex scenes

In this paper, we introduce an efficient method for particle selection in tracking objects in complex scenes. Firstly, we improve the proposal distribution function of the tracking algorithm, including current observation, reducing the cost of evaluating particles with a very low likelihood. In addition, we use a partitioned sampling approach to decompose the dynamic state in several stages. It enables to deal with high-dimensional states without an excessive computational cost. To represent the color distribution, the appearance of the tracked object is modelled by sampled pixels. Based on this representation, the probability of any observation is estimated using non-parametric techniques in color space. As a result, we obtain a Probability color Density Image (PDI) where each pixel points its membership to the target color model. In this way, the evaluation of all particles is accelerated by computing the likelihood p(z|x) using the Integral Image of the PDI.

Gaussian Approximation for Tracking Occluding and Interacting Targets

In this paper, we show how interacting and occluding targets can be tackled successfully within a Gaussian approximation. For that purpose, we develop a general expansion of the mean and covariance of the posterior and we consider a first order approximation of it. The proposed method differs from EKF in that neither a non-linear dynamical model nor a non-linear measurement vector to state relation have to be defined, so it works with any kind of interaction potential and likelihood. The approach has been tested on three sequences (10400, 2500, and 400 frames each one). The results show that our approach helps to reduce the number of failures without increasing too much the computation time with respect to methods that do not take into account target interactions.

Robust visual tracking based on online learning sparse representation

Handling appearance variations is a very challenging problem for visual tracking. Existing methods usually solve this problem by relying on an effective appearance model with two features: (1) being capable of discriminating the tracked target from its background, (2) being robust to the target's appearance variations during tracking. Instead of integrating the two requirements into the appearance model, in this paper, we propose a tracking method that deals with these problems separately based on sparse representation in a particle filter framework. Each target candidate defined by a particle is linearly represented by the target and background templates with an additive representation error. Discriminating the target from its background is achieved by activating the target templates or the background templates in the linear system in a competitive manner. The target's appearance variations are directly modeled as the representation error. An online algorithm is used to learn the basis functions that sparsely span the representation error. The linear system is solved via ℓ1 minimization. The candidate with the smallest reconstruction error using the target templates is selected as the tracking result. We test the proposed approach using four sequences with heavy occlusions, large pose variations, drastic illumination changes and low foreground-background contrast. The proposed approach shows excellent performance in comparison with two latest state-of-the-art trackers.

Adaptive Fusion Of Particle Filtering And Spatio-Temporal Motion Energy For Human Tracking

Object tracking is an active research area nowadays due to its importance in human computer interface, teleconferencing and video surveillance. However, reliable tracking of objects in the presence of occlusions, pose and illumination changes is still a challenging topic. In this paper, we introduce a novel tracking approach that fuses two cues namely colour and spatio-temporal motion energy within a particle filter based framework. We conduct a measure of coherent motion over two image frames, which reveals the spatio-temporal dynamics of the target. At the same time, the importance of both colour and motion energy cues is determined in the stage of reliability evaluation. This determination helps maintain the performance of the tracking system against abrupt appearance changes. Experimental results demonstrate that the proposed method outperforms the other state of the art techniques in the used test datasets.

Adaptive NormalHedge for robust visual tracking

In this paper, we propose a novel visual tracking framework, based on a decision-theoretic online learning algorithm namely NormalHedge. To make NormalHedge more robust against noise, we propose an adaptive NormalHedge algorithm, which exploits the historic information of each expert to perform more accurate prediction than the standard NormalHedge. Technically, we use a set of weighted experts to predict the state of the target to be tracked over time. The weight of each expert is online learned by pushing the cumulative regret of the learner towards that of the expert. Our simulation experiments demonstrate the effectiveness of the proposed adaptive NormalHedge, compared to the standard NormalHedge method. Furthermore, the experimental results of several challenging video sequences show that the proposed tracking method outperforms several state-of-the-art methods.

Vehicle-barrier tracking of a scaled crash test for roadside barrier design

In this paper the tracking system used to perform a scaled vehicle-barrier crash test is reported. The scaled crash test was performed as part of a wider project aimed at designing a new safety barrier making use of natural building materials. The scaled crash test was designed and performed as a proof of concept of the new mass-based safety barriers and the study was composed of two parts: the scaling technique and of a series of performed scaled crash tests. The scaling method was used for 1) setting the scaled test impact velocity so that energy dissipation and momentum transferring, from the car to the barrier, can be reproduced and 2) predicting the acceleration, velocity and displacement values occurring in the full-scale impact from the results obtained in a scaled test. To achieve this goal the vehicle and barrier displacements were to be recorded together with the vehicle accelerations and angular velocities. These quantities were measured during the tests using acceleration sensors and a tracking system. The tracking system was composed of a high speed camera and a set of targets to measure the vehicle linear and angular velocities. A code was developed to extract the target velocities from the videos and the velocities obtained were then compared with those obtained integrating the accelerations provided by the sensors to check the reliability of the method.

Robust visual tracking using structurally random projection and weighted least squares

Sparse representation based visual tracking approaches have attracted increasing interests in the community in recent years. The main idea is to linearly represent each target candidate using a set of target and trivial templates while imposing a sparsity constraint onto the representation coefficients. After we obtain the coefficients using L1-norm minimization methods, the candidate with the lowest error, when it is reconstructed using only the target templates and the associated coefficients, is considered as the tracking result. In spite of promising system performance widely reported, it is unclear if the performance of these trackers can be maximised. In addition, computational complexity caused by the dimensionality of the feature space limits these algorithms in real-time applications. In this paper, we propose a real-time visual tracking method based on structurally random projection and weighted least squares techniques. In particular, to enhance the discriminative capability of the tracker, we introduce background templates to the linear representation framework. To handle appearance variations over time, we relax the sparsity constraint using a weighed least squares (WLS) method to obtain the representation coefficients. To further reduce the computational complexity, structurally random projection is used to reduce the dimensionality of the feature space while preserving the pairwise distances between the data points in the feature space. Experimental results show that the proposed approach outperforms several state-of-the-art tracking methods.

Identifying the Influence of Channel Morphology on Physical Habitat Availability for Native Fish: Application to the Two-spined Blackfish (Gadopsis bispinosus) in the Cotter River, Australia.

The impact of channel morphology and flow on physical habitat availability for the two-spined blackfish (Gadopsis bispinosus) was assessed in the Cotter River, ACT, Australia. Physical habitat requirements for three life stages were identified based on previous field sampling in the Cotter River. Two sites were selected with contrasting channel morphology: Spur Hole, with a moderate gradient and runs and glides, and Vanity’s Crossing, with a steeper gradient, rapids, and fast-flowing pools. Physical Habitat Simulation System (PHABSIM) was used to simulate the flow v. physical habitat availability relationship for each life stage at both sites. Clear differences were apparent between sites, with Spur Hole characterised by increasing habitat with increasing flow and Vanity’s Crossing showing the opposite relationship. The nature of the channel morphology determined this difference, with Spur Hole characterised by marginal zones becoming inundated at higher flows and providing additional suitable physical habitat as discharge increases. Vanity’s Crossing does not contain similar marginal zones. Further analysis demonstrated that high water velocity was the most important factor limiting physical habitat availability at both sites. This approach demonstrates the importance of channel morphology in determining physical habitat availability and an alternative use of PHABSIM to highlight limiting factors for target species.