Real-time Surveillance Application by Multiple Detectors and Compressive Trackers

A real-time surveillance system for IP network cameras is presented. Motion, part-body, and whole-body detectors are efficiently combined to generate robust and fast detections, which feed multiple compressive trackers. The generated trajectories are then improved using a reidentification strategy for long term operation.

Robust Real-time Vision-based Aircraft Tracking From Unmanned Aerial Vehicles.

Aircraft tracking plays a key and important role in the Sense-and-Avoid system of Unmanned Aerial Vehicles (UAVs). This paper presents a novel robust visual tracking algorithm for UAVs in the midair to track an arbitrary aircraft at real-time frame rates, together with a unique evaluation system. This visual algorithm mainly consists of adaptive discriminative visual tracking method, Multiple-Instance (MI) learning approach, Multiple-Classifier (MC) voting mechanism and Multiple-Resolution (MR) representation strategy, that is called Adaptive M3 tracker, i.e. AM3. In this tracker, the importance of test sample has been integrated to improve the tracking stability, accuracy and real-time performances. The experimental results show that this algorithm is more robust, efficient and accurate against the existing state-of-art trackers, overcoming the problems generated by the challenging situations such as obvious appearance change, variant surrounding illumination, partial aircraft occlusion, blur motion, rapid pose variation and onboard mechanical vibration, low computation capacity and delayed information communication between UAVs and Ground Station (GS). To our best knowledge, this is the first work to present this tracker for solving online learning and tracking freewill aircraft/intruder in the UAVs.

Real-Time Adaptive Multi-Classifier Multi-Resolution Visual Tracking Framework for Unmanned Aerial Vehicles

This paper presents a novel robust visual tracking framework, based on discriminative method, for Unmanned Aerial Vehicles (UAVs) to track an arbitrary 2D/3D target at real-time frame rates, that is called the Adaptive Multi-Classifier Multi-Resolution (AMCMR) framework. In this framework, adaptive Multiple Classifiers (MC) are updated in the (k-1)th frame-based Multiple Resolutions (MR) structure with compressed positive and negative samples, and then applied them in the kth frame-based Multiple Resolutions (MR) structure to detect the current target. The sample importance has been integrated into this framework to improve the tracking stability and accuracy. The performance of this framework was evaluated with the Ground Truth (GT) in different types of public image databases and real flight-based aerial image datasets firstly, then the framework has been applied in the UAV to inspect the Offshore Floating Platform (OFP). The evaluation and application results show that this framework is more robust, efficient and accurate against the existing state-of-art trackers, overcoming the problems generated by the challenging situations such as obvious appearance change, variant illumination, partial/full target occlusion, blur motion, rapid pose variation and onboard mechanical vibration, among others. To our best knowledge, this is the first work to present this framework for solving the online learning and tracking freewill 2D/3D target problems, and applied it in the UAVs.

Pedestrian Motion Prediction: A Graph Based Approach

A novel pedestrian motion prediction technique is presented in this paper. Its main achievement regards to none previous observation, any knowledge of pedestrian trajectories nor the existence of possible destinations is required; hence making it useful for autonomous surveillance applications. Prediction only requires initial position of the pedestrian and a 2D representation of the scenario as occupancy grid. First, it uses the Fast Marching Method (FMM) to calculate the pedestrian arrival time for each position in the map and then, the likelihood that the pedestrian reaches those positions is estimated. The technique has been tested with synthetic and real scenarios. In all cases, accurate probability maps as well as their representative graphs were obtained with low computational cost.

High-frequency, spin-label EPR of nonaxial lipid ordering and motion in cholesterol-containing membranes

The EPR spectra of spin-labeled lipid chains in fully hydrated bilayer membranes of dimyristoyl phosphatidylcholine containing 40 mol % of cholesterol have been studied in the liquid-ordered phase at a microwave radiation frequency of 94 GHz. At such high field strengths, the spectra should be optimally sensitive to lateral chain ordering that is expected in the formation of in-plane domains. The high-field EPR spectra from random dispersions of the cholesterol-containing membranes display very little axial averaging of the nitroxide g-tensor anisotropy for lipids spin labeled toward the carboxyl end of the sn-2 chain (down to the 8-C atom). For these positions of labeling, anisotropic 14N-hyperfine splittings are resolved in the gzz and gyy regions of the nonaxial EPR spectra. For positions of labeling further down the lipid chain, toward the terminal methyl group, the axial averaging of the spectral features systematically increases and is complete at the 14-C atom position. Concomitantly, the time-averaged 〈Azz〉 element of the 14N-hyperfine tensor decreases, indicating that the axial rotation at the terminal methyl end of the chains arises from correlated torsional motions about the bonds of the chain backbone, the dynamics of which also give rise to a differential line broadening of the 14N-hyperfine manifolds in the gzz region of the spectrum. These results provide an indication of the way in which lateral ordering of lipid chains in membranes is induced by cholesterol.

Elucidation of a PTS–Carbohydrate Chemotactic Signal Pathway in Escherichia coli Using a Time-resolved Behavioral Assay

Chemotaxis of Escherichia coli toward phosphotransferase systems (PTSs)–carbohydrates requires phosphoenolpyruvate-dependent PTSs as well as the chemotaxis response regulator CheY and its kinase, CheA. Responses initiated by flash photorelease of a PTS substrates d-glucose and its nonmetabolizable analog methyl α-d-glucopyranoside were measured with 33-ms time resolution using computer-assisted motion analysis. This, together with chemotactic mutants, has allowed us to map out and characterize the PTS chemotactic signal pathway. The responses were absent in mutants lacking the general PTS enzymes EI or HPr, elevated in PTS transport mutants, retarded in mutants lacking CheZ, a catalyst of CheY autodephosphorylation, and severely reduced in mutants with impaired methyl-accepting chemotaxis protein (MCP) signaling activity. Response kinetics were comparable to those triggered by MCP attractant ligands over most of the response range, the most rapid being 11.7 ± 3.1 s−1. The response threshold was <10 nM for glucose. Responses to methyl α-d-glucopyranoside had a higher threshold, commensurate with a lower PTS affinity, but were otherwise kinetically indistinguishable. These facts provide evidence for a single pathway in which the PTS chemotactic signal is relayed rapidly to MCP–CheW–CheA signaling complexes that effect subsequent amplification and slower CheY dephosphorylation. The high sensitivity indicates that this signal is generated by transport-induced dephosphorylation of the PTS rather than phosphoenolpyruvate consumption.

Real-Time Imaging of the Axonal Transport of Granules Containing a Tissue Plasminogen Activator/Green Fluorescent Protein Hybrid

A hybrid protein, tPA/GFP, consisting of rat tissue plasminogen activator (tPA) and green fluorescent protein (GFP) was expressed in PC12 cells and used to study the distribution, secretory behavior, and dynamics of secretory granules containing tPA in living cells with a neuronal phenotype. High-resolution images demonstrate that tPA/GFP has a growth cone-biased distribution in differentiated cells and that tPA/GFP is transported in granules of the regulated secretory pathway that colocalize with granules containing secretogranin II. Time-lapse images of secretion reveal that secretagogues induce substantial loss of cellular tPA/GFP fluorescence, most importantly from growth cones. Time-lapse images of the axonal transport of granules containing tPA/GFP reveal a surprising complexity to granule dynamics. Some granules undergo canonical fast axonal transport; others move somewhat more slowly, especially in highly fluorescent neurites. Most strikingly, granules traffic bidirectionally along neurites to an extent that depends on granule accumulation, and individual granules can reverse their direction of motion. The retrograde component of this bidirectional transport may help to maintain cellular homeostasis by transporting excess tPA/GFP back toward the cell body. The results presented here provide a novel view of the axonal transport of secretory granules. In addition, the results suggest that tPA is targeted for regulated secretion from growth cones of differentiated cells, strategically positioning tPA to degrade extracellular barriers or to activate other barrier-degrading proteases during axonal elongation.

Time-Lapse Video Microscopy of Gliding Motility in Toxoplasma gondii Reveals a Novel, Biphasic Mechanism of Cell LocomotionV⃞

Toxoplasma gondii is a member of the phylum Apicomplexa, a diverse group of intracellular parasites that share a unique form of gliding motility. Gliding is substrate dependent and occurs without apparent changes in cell shape and in the absence of traditional locomotory organelles. Here, we demonstrate that gliding is characterized by three distinct forms of motility: circular gliding, upright twirling, and helical rotation. Circular gliding commences while the crescent-shaped parasite lies on its right side, from where it moves in a counterclockwise manner at a rate of ∼1.5 μm/s. Twirling occurs when the parasite rights itself vertically, remaining attached to the substrate by its posterior end and spinning clockwise. Helical gliding is similar to twirling except that it occurs while the parasite is positioned horizontally, resulting in forward movement that follows the path of a corkscrew. The parasite begins lying on its left side (where the convex side is defined as dorsal) and initiates a clockwise revolution along the long axis of the crescent-shaped body. Time-lapse video analyses indicated that helical gliding is a biphasic process. During the first 180o of the turn, the parasite moves forward one body length at a rate of ∼1–3 μm/s. In the second phase, the parasite flips onto its left side, in the process undergoing little net forward motion. All three forms of motility were disrupted by inhibitors of actin filaments (cytochalasin D) and myosin ATPase (butanedione monoxime), indicating that they rely on an actinomyosin motor in the parasite. Gliding motility likely provides the force for active penetration of the host cell and may participate in dissemination within the host and thus is of both fundamental and practical interest.

Temperature, ordering, and equilibrium with time-dependent confining forces

The concepts of temperature and equilibrium are not well defined in systems of particles with time-varying external forces. An example is a radio frequency ion trap, with the ions laser cooled into an ordered solid, characteristic of sub-mK temperatures, whereas the kinetic energies associated with the fast coherent motion in the trap are up to 7 orders of magnitude higher. Simulations with 1,000 ions reach equilibrium between the degrees of freedom when only aperiodic displacements (secular motion) are considered. The coupling of the periodic driven motion associated with the confinement to the nonperiodic random motion of the ions is very small at low temperatures and increases quadratically with temperature.

Diffractive optics-based heterodyne-detected four-wave mixing signals of protein motion: From “protein quakes” to ligand escape for myoglobin

Ligand transport through myoglobin (Mb) has been observed by using optically heterodyne-detected transient grating spectroscopy. Experimental implementation using diffractive optics has provided unprecedented sensitivity for the study of protein motions by enabling the passive phase locking of the four beams that constitute the experiment, and an unambiguous separation of the Real and Imaginary parts of the signal. Ligand photodissociation of carboxymyoglobin (MbCO) induces a sequence of events involving the relaxation of the protein structure to accommodate ligand escape. These motions show up in the Real part of the signal. The ligand (CO) transport process involves an initial, small amplitude, change in volume, reflecting the transit time of the ligand through the protein, followed by a significantly larger volume change with ligand escape to the surrounding water. The latter process is well described by a single exponential process of 725 ± 15 ns at room temperature. The overall dynamics provide a distinctive signature that can be understood in the context of segmental protein fluctuations that aid ligand escape via a few specific cavities, and they suggest the existence of discrete escape pathways.

Psychophysical evidence for fast region-based segmentation processes in motion and color.

Theories of image segmentation suggest that the human visual system may use two distinct processes to segregate figure from background: a local process that uses local feature contrasts to mark borders of coherent regions and a global process that groups similar features over a larger spatial scale. We performed psychophysical experiments to determine whether and to what extent the global similarity process contributes to image segmentation by motion and color. Our results show that for color, as well as for motion, segmentation occurs first by an integrative process on a coarse spatial scale, demonstrating that for both modalities the global process is faster than one based on local feature contrasts. Segmentation by motion builds up over time, whereas segmentation by color does not, indicating a fundamental difference between the modalities. Our data suggest that segmentation by motion proceeds first via a cooperative linking over space of local motion signals, generating almost immediate perceptual coherence even of physically incoherent signals. This global segmentation process occurs faster than the detection of absolute motion, providing further evidence for the existence of two motion processes with distinct dynamic properties.

Human Motion Analysis Based on Sequential Modeling of Radar Signal and Stereo Image Features

Falls are one of the greatest threats to elderly health in their daily living routines and activities. Therefore, it is very important to detect falls of an elderly in a timely and accurate manner, so that immediate response and proper care can be provided, by sending fall alarms to caregivers. Radar is an effective non-intrusive sensing modality which is well suited for this purpose, which can detect human motions in all types of environments, penetrate walls and fabrics, preserve privacy, and is insensitive to lighting conditions. Micro-Doppler features are utilized in radar signal corresponding to human body motions and gait to detect falls using a narrowband pulse-Doppler radar. Human motions cause time-varying Doppler signatures, which are analyzed using time-frequency representations and matching pursuit decomposition (MPD) for feature extraction and fall detection. The extracted features include MPD features and the principal components of the time-frequency signal representations. To analyze the sequential characteristics of typical falls, the extracted features are used for training and testing hidden Markov models (HMM) in different falling scenarios. Experimental results demonstrate that the proposed algorithm and method achieve fast and accurate fall detections. The risk of falls increases sharply when the elderly or patients try to exit beds. Thus, if a bed exit can be detected at an early stage of this motion, the related injuries can be prevented with a high probability. To detect bed exit for fall prevention, the trajectory of head movements is used for recognize such human motion. A head detector is trained using the histogram of oriented gradient (HOG) features of the head and shoulder areas from recorded bed exit images. A data association algorithm is applied on the head detection results to eliminate head detection false alarms. Then the three dimensional (3D) head trajectories are constructed by matching scale-invariant feature transform (SIFT) keypoints in the detected head areas from both the left and right stereo images. The extracted 3D head trajectories are used for training and testing an HMM based classifier for recognizing bed exit activities. The results of the classifier are presented and discussed in the thesis, which demonstrates the effectiveness of the proposed stereo vision based bed exit detection approach.

Vertical crustal motion along the Mediterranean and Black Sea coast derived from ocean altimetry and tide gauge data

Tide gauge (TG) data along the northern Mediterranean and Black Sea coasts are compared to the sea-surface height (SSH) anomaly obtained from ocean altimetry (TOPEX/Poseidon and ERS-1/2) for a period of nine years (1993–2001). The TG measures the SSH relative to the ground whereas the altimetry does so with respect to the geocentric reference frame; therefore their difference would be in principle a vertical ground motion of the TG sites, though there are different error sources for this estimate as is discussed in the paper. In this study we estimate such vertical ground motion, for each TG site, from the slope of the SSH time series of the (non-seasonal) difference between the TG record and the altimetry measurement at a point closest to the TG. Where possible, these estimates are further compared with those derived from nearby continuous Global Positioning System (GPS) data series. These results on vertical ground motion along the Mediterranean and Black Sea coasts provide useful source data for studying, contrasting, and constraining tectonic models of the region. For example, in the eastern coast of the Adriatic Sea and in the western coast of Greece, a general subsidence is observed which may be related to the Adriatic lithosphere subducting beneath the Eurasian plate along the Dinarides fault.

eFisioTrack: a telerehabilitation environment based on motion recognition using accelerometry

The growing demand for physical rehabilitation processes can result in the rising of costs and waiting lists, becoming a threat to healthcare services’ sustainability. Telerehabilitation solutions can help in this issue by discharging patients from points of care while improving their adherence to treatment. Sensing devices are used to collect data so that the physiotherapists can monitor and evaluate the patients’ activity in the scheduled sessions. This paper presents a software platform that aims to meet the needs of the rehabilitation experts and the patients along a physical rehabilitation plan, allowing its use in outpatient scenarios. It is meant to be low-cost and easy-to-use, improving patients and experts experience. We show the satisfactory results already obtained from its use, in terms of the accuracy evaluating the exercises, and the degree of users’ acceptance. We conclude that this platform is suitable and technically feasible to carry out rehabilitation plans outside the point of care.

An investigation of simultaneous motions as treated in the methods-time measurement system; a progress report.

Mode of access: Internet.