Image sequence segmentation using mixture-models with uniqueness and spatio-temporal consistency constraints

The use of mixture-model techniques for motion estimation and image sequence segmentation was discussed. The issues such as modeling of occlusion and uncovering, determining the relative depth of the objects in a scene, and estimating the number of objects in a scene were also investigated. The segmentation algorithm was found to be computationally demanding, but the computational requirements were reduced as the motion parameters and segmentation of the frame were initialized. The method provided a stable description, in whichthe addition and removal of objects from the description corresponded to the entry and exit of objects from the scene.

Spatio-temporal clustering of probabilistic region trajectories

We propose a novel model for the spatio-temporal clustering of trajectories based on motion, which applies to challenging street-view video sequences of pedestrians captured by a mobile camera. A key contribution of our work is the introduction of novel probabilistic region trajectories, motivated by the non-repeatability of segmentation of frames in a video sequence. Hierarchical image segments are obtained by using a state-of-the-art hierarchical segmentation algorithm, and connected from adjacent frames in a directed acyclic graph. The region trajectories and measures of confidence are extracted from this graph using a dynamic programming-based optimisation. Our second main contribution is a Bayesian framework with a twofold goal: to learn the optimal, in a maximum likelihood sense, Random Forests classifier of motion patterns based on video features, and construct a unique graph from region trajectories of different frames, lengths and hierarchical levels. Finally, we demonstrate the use of Isomap for effective spatio-temporal clustering of the region trajectories of pedestrians. We support our claims with experimental results on new and existing challenging video sequences. © 2011 IEEE.

Cell shape changes indicate a role for extrinsic tensile forces in Drosophila germ-band extension.

Drosophila germ-band extension (GBE) is an example of the convergence and extension movements that elongate and narrow embryonic tissues. To understand the collective cell behaviours underlying tissue morphogenesis, we have continuously quantified cell intercalation and cell shape change during GBE. We show that the fast, early phase of GBE depends on cell shape change in addition to cell intercalation. In antero-posterior patterning mutants such as those for the gap gene Krüppel, defective polarized cell intercalation is compensated for by an increase in antero-posterior cell elongation, such that the initial rate of extension remains the same. Spatio-temporal patterns of cell behaviours indicate that an antero-posterior tensile force deforms the germ band, causing the cells to change shape passively. The rate of antero-posterior cell elongation is reduced in twist mutant embryos, which lack mesoderm. We propose that cell shape change contributing to germ-band extension is a passive response to mechanical forces caused by the invaginating mesoderm.

Differential Dynamic Microscopy: a High-Throughput Method for Characterizing the Motility of Microorganism

We present a fast, high-throughput method for characterizing the motility of microorganisms in 3D based on standard imaging microscopy. Instead of tracking individual cells, we analyse the spatio-temporal fluctuations of the intensity in the sample from time-lapse images and obtain the intermediate scattering function (ISF) of the system. We demonstrate our method on two different types of microorganisms: bacteria, both smooth swimming (run only) and wild type (run and tumble) Escherichia coli, and the bi-flagellate alga Chlamydomonas reinhardtii. We validate the methodology using computer simulations and particle tracking. From the ISF, we are able to extract (i) for E. coli: the swimming speed distribution, the fraction of motile cells and the diffusivity, and (ii) for C. reinhardtii: the swimming speed distribution, the amplitude and frequency of the oscillatory dynamics. In both cases, the motility parameters are averaged over \approx 10^4 cells and obtained in a few minutes.

A high-resolution atlas and statistical model of the human heart from multislice CT

Atlases and statistical models play important roles in the personalization and simulation of cardiac physiology. For the study of the heart, however, the construction of comprehensive atlases and spatio-temporal models is faced with a number of challenges, in particular the need to handle large and highly variable image datasets, the multi-region nature of the heart, and the presence of complex as well as small cardiovascular structures. In this paper, we present a detailed atlas and spatio-temporal statistical model of the human heart based on a large population of 3D+time multi-slice computed tomography sequences, and the framework for its construction. It uses spatial normalization based on nonrigid image registration to synthesize a population mean image and establish the spatial relationships between the mean and the subjects in the population. Temporal image registration is then applied to resolve each subject-specific cardiac motion and the resulting transformations are used to warp a surface mesh representation of the atlas to fit the images of the remaining cardiac phases in each subject. Subsequently, we demonstrate the construction of a spatio-temporal statistical model of shape such that the inter-subject and dynamic sources of variation are suitably separated. The framework is applied to a 3D+time data set of 138 subjects. The data is drawn from a variety of pathologies, which benefits its generalization to new subjects and physiological studies. The obtained level of detail and the extendability of the atlas present an advantage over most cardiac models published previously. © 1982-2012 IEEE.

Absolute and convective instability in gas turbine fuel injectors

Hydrodynamic instabilities in gas turbine fuel injectors help to mix the fuel and air but can sometimes lock into acoustic oscillations and contribute to thermoacoustic instability. This paper describes a linear stability analysis that predicts the frequencies and strengths of hydrodynamic instabilities and identifies the regions of the flow that cause them. It distinguishes between convective instabilities, which grow in time but are convected away by the flow, and absolute instabilities, which grow in time without being convected away. Convectively unstable flows amplify external perturbations, while absolutely unstable flows also oscillate at intrinsic frequencies. As an input, this analysis requires velocity and density fields, either from a steady but unstable solution to the Navier-Stokes equations, or from time-averaged numerical simulations. In the former case, the analysis is a predictive tool. In the latter case, it is a diagnostic tool. This technique is applied to three flows: a swirling wake at Re = 400, a single stream swirling fuel injector at Re - 106, and a lean premixed gas turbine injector with five swirling streams at Re - 106. Its application to the swirling wake demonstrates that this technique can correctly predict the frequency, growth rate and dominant wavemaker region of the flow. It also shows that the zone of absolute instability found from the spatio-temporal analysis is a good approximation to the wavemaker region, which is found by overlapping the direct and adjoint global modes. This approximation is used in the other two flows because it is difficult to calculate their adjoint global modes. Its application to the single stream fuel injector demonstrates that it can identify the regions of the flow that are responsible for generating the hydrodynamic oscillations seen in LES and experimental data. The frequencies predicted by this technique are within a few percent of the measured frequencies. The technique also explains why these oscillations become weaker when a central jet is injected along the centreline. This is because the absolutely unstable region that causes the oscillations becomes convectively unstable. Its application to the lean premixed gas turbine injector reveals that several regions of the flow are hydrodynamically unstable, each with a different frequency and a different strength. For example, it reveals that the central region of confined swirling flow is strongly absolutely unstable and sets up a precessing vortex core, which is likely to aid mixing throughout the injector. It also reveals that the region between the second and third streams is slightly absolutely unstable at a frequency that is likely to coincide with acoustic modes within the combustion chamber. This technique, coupled with knowledge of the acoustic modes in a combustion chamber, is likely to be a useful design tool for the passive control of mixing and combustion instability. Copyright © 2012 by ASME.

Dicke superradiance in GaN quantum wells

We numerically modeled the spatio-temporal dynamics of Dicke superradiance in GaN/InGaN heterostructure quantum wells in a ridge waveguide cavity. Model predictions envisage ultrashort pulses of intensities superior to what can be obtained in mode-locked lasers. ©2010 IEEE.

Control of aircraft in the terminal manoeuvring area using parallelised sequential Monte Carlo

This paper reports on the use of a parallelised Model Predictive Control, Sequential Monte Carlo algorithm for solving the problem of conflict resolution and aircraft trajectory control in air traffic management specifically around the terminal manoeuvring area of an airport. The target problem is nonlinear, highly constrained, non-convex and uses a single decision-maker with multiple aircraft. The implementation includes a spatio-temporal wind model and rolling window simulations for realistic ongoing scenarios. The method is capable of handling arriving and departing aircraft simultaneously including some with very low fuel remaining. A novel flow field is proposed to smooth the approach trajectories for arriving aircraft and all trajectories are planned in three dimensions. Massive parallelisation of the algorithm allows solution speeds to approach those required for real-time use.

Detecting bipedal motion from correlated probabilistic trajectories

This paper is about detecting bipedal motion in video sequences by using point trajectories in a framework of classification. Given a number of point trajectories, we find a subset of points which are arising from feet in bipedal motion by analysing their spatio-temporal correlation in a pairwise fashion. To this end, we introduce probabilistic trajectories as our new features which associate each point over a sufficiently long time period in the presence of noise. They are extracted from directed acyclic graphs whose edges represent temporal point correspondences and are weighted with their matching probability in terms of appearance and location. The benefit of the new representation is that it practically tolerates inherent ambiguity for example due to occlusions. We then learn the correlation between the motion of two feet using the probabilistic trajectories in a decision forest classifier. The effectiveness of the algorithm is demonstrated in experiments on image sequences captured with a static camera, and extensions to deal with a moving camera are discussed. © 2013 Elsevier B.V. All rights reserved.

Modal stability theory

This article contains a review of modal stability theory. It covers local stability analysis of parallel flows including temporal stability, spatial stability, phase velocity, group velocity, spatio-temporal stability, the linearized Navier-Stokes equations, the Orr-Sommerfeld equation, the Rayleigh equation, the Briggs-Bers criterion, Poiseuille flow, free shear flows, and secondary modal instability. It also covers the parabolized stability equation (PSE), temporal and spatial biglobal theory, 2D eigenvalue problems, 3D eigenvalue problems, spectral collocation methods, and other numerical solution methods. Computer codes are provided for tutorials described in the article. These tutorials cover the main topics of the article and can be adapted to form the basis of research codes. Copyright © 2014 by ASME.