Real time motion estimation using a neural architecture implemented on GPUs

This work describes a neural network based architecture that represents and estimates object motion in videos. This architecture addresses multiple computer vision tasks such as image segmentation, object representation or characterization, motion analysis and tracking. The use of a neural network architecture allows for the simultaneous estimation of global and local motion and the representation of deformable objects. This architecture also avoids the problem of finding corresponding features while tracking moving objects. Due to the parallel nature of neural networks, the architecture has been implemented on GPUs that allows the system to meet a set of requirements such as: time constraints management, robustness, high processing speed and re-configurability. Experiments are presented that demonstrate the validity of our architecture to solve problems of mobile agents tracking and motion analysis.

Global color estimation of special-effect coatings from measurements by commercially available portable multiangle spectrophotometers

Colors of special-effect coatings have strong dependence on illumination/viewing geometry and an appealing appearance. An open question is to ask about the minimum number of measurement geometries required to completely characterize their observed color shift. A recently published principal components analysis (PCA)-based procedure to estimate the color of special-effect coatings at any geometry from measurements at a reduced set of geometries was tested in this work by using the measurement geometries of commercial portable multiangle spectrophotometers X-Rite MA98, Datacolor FX10, and BYK-mac as reduced sets. The performance of the proposed PCA procedure for the color-shift estimation for these commercial geometries has been examined for 15 special-effect coatings. Our results suggest that for rendering the color appearance of 3D objects covered with special-effect coatings, the color accuracy obtained with this procedure may be sufficient. This is the case especially if geometries of X-Rite MA98 or Datacolor FX10 are used.

Estimation of Key Dates and Stages in Rice Crops Using Dual-Polarization SAR Time Series and a Particle Filtering Approach

Information of crop phenology is essential for evaluating crop productivity. In a previous work, we determined phenological stages with remote sensing data using a dynamic system framework and an extended Kalman filter (EKF) approach. In this paper, we demonstrate that the particle filter is a more reliable method to infer any phenological stage compared to the EKF. The improvements achieved with this approach are discussed. In addition, this methodology enables the estimation of key cultivation dates, thus providing a practical product for many applications. The dates of some important stages, as the sowing date and the day when the crop reaches the panicle initiation stage, have been chosen to show the potential of this technique.

Estimation of Time-Limited Channel Spectra From Nonuniform Samples

This paper deals with the estimation of a time-invariant channel spectrum from its own nonuniform samples, assuming there is a bound on the channel’s delay spread. Except for this last assumption, this is the basic estimation problem in systems providing channel spectral samples. However, as shown in the paper, the delay spread bound leads us to view the spectrum as a band-limited signal, rather than the Fourier transform of a tapped delay line (TDL). Using this alternative model, a linear estimator is presented that approximately minimizes the expected root-mean-square (RMS) error for a deterministic channel. Its main advantage over the TDL is that it takes into account the spectrum’s smoothness (time width), thus providing a performance improvement. The proposed estimator is compared numerically with the maximum likelihood (ML) estimator based on a TDL model in pilot-assisted channel estimation (PACE) for OFDM.

Contribution to Real-Time Estimation of Crop Phenological States in a Dynamical Framework Based on NDVI Time Series: Data Fusion With SAR and Temperature

In this study, a methodology based in a dynamical framework is proposed to incorporate additional sources of information to normalized difference vegetation index (NDVI) time series of agricultural observations for a phenological state estimation application. The proposed implementation is based on the particle filter (PF) scheme that is able to integrate multiple sources of data. Moreover, the dynamics-led design is able to conduct real-time (online) estimations, i.e., without requiring to wait until the end of the campaign. The evaluation of the algorithm is performed by estimating the phenological states over a set of rice fields in Seville (SW, Spain). A Landsat-5/7 NDVI series of images is complemented with two distinct sources of information: SAR images from the TerraSAR-X satellite and air temperature information from a ground-based station. An improvement in the overall estimation accuracy is obtained, especially when the time series of NDVI data is incomplete. Evaluations on the sensitivity to different development intervals and on the mitigation of discontinuities of the time series are also addressed in this work, demonstrating the benefits of this data fusion approach based on the dynamic systems.

A new algorithm to accelerate harmonic analysis of time series

The Lomb periodogram has been traditionally a tool that allows us to elucidate if a frequency turns out to be important for explaining the behaviour of a given time series. Many linear and nonlinear reiterative harmonic processes that are used for studying the spectral content of a time series take into account this periodogram in order to avoid including spurious frequencies in their models due to the leakage problem of energy from one frequency to others. However, the estimation of the periodogram requires long computation time that makes the harmonic analysis slower when we deal with certain time series. Here we propose an algorithm that accelerates the extraction of the most remarkable frequencies from the periodogram, avoiding its whole estimation of the harmonic process at each iteration. This algorithm allows the user to perform a specific analysis of a given scalar time series. As a result, we obtain a functional model made of (1) a trend component, (2) a linear combination of Fourier terms, and (3) the so-called mixed secular terms by reducing the computation time of the estimation of the periodogram.

3D Hand Pose Estimation with Neural Networks

We propose the design of a real-time system to recognize and interprethand gestures. The acquisition devices are low cost 3D sensors. 3D hand pose will be segmented, characterized and track using growing neural gas (GNG) structure. The capacity of the system to obtain information with a high degree of freedom allows the encoding of many gestures and a very accurate motion capture. The use of hand pose models combined with motion information provide with GNG permits to deal with the problem of the hand motion representation. A natural interface applied to a virtual mirrorwriting system and to a system to estimate hand pose will be designed to demonstrate the validity of the system.

Spontaneous Abortions and Shift Work in a Cohort of Nurses in Norway

Background: An association between spontaneous abortions and shift work has been suggested, but present research results are conflicting. The aim of the study is to evaluate the relationship between spontaneous abortions among nurses, shift schedules, and nights worked. Methods: This is a longitudinal study where we identified 914 females from a cohort of nurses in Norway who had worked the same type of shift schedule 2008-2010; either permanent day shift, three-shift rotation or permanent night shift. Information on age, work and life-style factors, as well as spontaneous abortions during lifetime and the past three years (2008-2010) was obtained by annual questionnaires. Results: A higher prevalence of experienced spontaneous abortions before study start (2008) was found among nurses working permanent night shift compared to other nurses. In a linear regression analysis, a risk of 1.3 was found for experienced spontaneous abortions before study start among permanent night shift nurses, with day shift as reference, when adjusting for age, smoking, caffeine and job strain, but the finding was not statistical significant (95 per cent confidence interval 0.8-2.1). Permanent night shift workers had a risk of 1.5 experiencing spontaneous abortions in 2008-2010 compared to day shift nurses, although not statistical significant (95 per cent confidence interval 0.7-3.5). The number of night shifts the past three years was not associated with experiencing spontaneous abortions 2008-2010, but associated with a reduced risk of experiencing spontaneous abortions during lifetime. The results must be interpreted in the light of a possible selection bias; both selections into the occupation of nursing and into the different shift types of the more healthy persons may have occurred in this population. Conclusion: No significant increased risk of spontaneous abortion among permanent night shift nurses compared to day-time nurses was found in this study, and no association was found between spontaneous abortions and the number of worked night shifts.

Towards a real-time 3D object recognition pipeline on mobile GPGPU computing platforms using low-cost RGB-D sensors

In this project, we propose the implementation of a 3D object recognition system which will be optimized to operate under demanding time constraints. The system must be robust so that objects can be recognized properly in poor light conditions and cluttered scenes with significant levels of occlusion. An important requirement must be met: the system must exhibit a reasonable performance running on a low power consumption mobile GPU computing platform (NVIDIA Jetson TK1) so that it can be integrated in mobile robotics systems, ambient intelligence or ambient assisted living applications. The acquisition system is based on the use of color and depth (RGB-D) data streams provided by low-cost 3D sensors like Microsoft Kinect or PrimeSense Carmine. The range of algorithms and applications to be implemented and integrated will be quite broad, ranging from the acquisition, outlier removal or filtering of the input data and the segmentation or characterization of regions of interest in the scene to the very object recognition and pose estimation. Furthermore, in order to validate the proposed system, we will create a 3D object dataset. It will be composed by a set of 3D models, reconstructed from common household objects, as well as a handful of test scenes in which those objects appear. The scenes will be characterized by different levels of occlusion, diverse distances from the elements to the sensor and variations on the pose of the target objects. The creation of this dataset implies the additional development of 3D data acquisition and 3D object reconstruction applications. The resulting system has many possible applications, ranging from mobile robot navigation and semantic scene labeling to human-computer interaction (HCI) systems based on visual information.

Real-time monitoring of electrochemically active biofilm developing behavior on bioanode by using EQCM and ATR/FTIR

In the current study, the relationship between current and biomass and bio-adhesion mechanism of electrogenic biofilm on electrode were investigated using EQCM and ATR-SEIRAS linking electrochemistry. The results indicated that cellular biomass of biofilm on QCM-crystal surface showed maximum value of 6.0 μg/cm2 in initial batch and 11.5 μg/cm2 in the second batch on mature biofilm, producing a similar maximum current density of 110 μA/μg. Especially, the optimum cell biomass linking high electricity production ratio (110 μA/μg) occurred before maximum biomass coming, implying that over-growth mature biofilm is not an optimum state for enhancing power output of MFCs. On the other hand, the spectra using ATR-SEIRAS technique linking electrochemistry obviously exhibited water structure adsorption change at early biofilm formation and meanwhile the water adsorption accompanied the adsorbed bacteria and the bound cells population on the electrode increased with time. Meanwhile, the direct contact of bacteria and electrode via outer-membrane protein can be confirmed via a series spectra shift at amide I and amide II modes and water movement from negative bands displacing by adsorbed bacteria. Our study provided supplementary information about the interaction between the microbes and electrode beyond traditional electrochemistry.

Dynamical Approach for Real-Time Monitoring of Agricultural Crops

In this paper, a novel approach for exploiting multitemporal remote sensing data focused on real-time monitoring of agricultural crops is presented. The methodology is defined in a dynamical system context using state-space techniques, which enables the possibility of merging past temporal information with an update for each new acquisition. The dynamic system context allows us to exploit classical tools in this domain to perform the estimation of relevant variables. A general methodology is proposed, and a particular instance is defined in this study based on polarimetric radar data to track the phenological stages of a set of crops. A model generation from empirical data through principal component analysis is presented, and an extended Kalman filter is adapted to perform phenological stage estimation. Results employing quad-pol Radarsat-2 data over three different cereals are analyzed. The potential of this methodology to retrieve vegetation variables in real time is shown.