Warping trajectories for video synchronization

Temporal synchronization of multiple video recordings of the same dynamic event is a critical task in many computer vision applications e.g. novel view synthesis and 3D reconstruction. Typically this information is implied, since recordings are made using the same timebase, or time-stamp information is embedded in the video streams. Recordings using consumer grade equipment do not contain this information; hence, there is a need to temporally synchronize signals using the visual information itself. Previous work in this area has either assumed good quality data with relatively simple dynamic content or the availability of precise camera geometry. In this paper, we propose a technique which exploits feature trajectories across views in a novel way, and specifically targets the kind of complex content found in consumer generated sports recordings, without assuming precise knowledge of fundamental matrices or homographies. Our method automatically selects the moving feature points in the two unsynchronized videos whose 2D trajectories can be best related, thereby helping to infer the synchronization index. We evaluate performance using a number of real recordings and show that synchronization can be achieved to within 1 sec, which is better than previous approaches. Copyright 2013 ACM.

Synchronization of user-generated videos through trajectory correspondence and a refinement procedure

Temporal synchronization of multiple video recordings of the same dynamic event is a critical task in many computer vision applications e.g. novel view synthesis and 3D reconstruction. Typically this information is implied through the time-stamp information embedded in the video streams. User-generated videos shot using consumer grade equipment do not contain this information; hence, there is a need to temporally synchronize signals using the visual information itself. Previous work in this area has either assumed good quality data with relatively simple dynamic content or the availability of precise camera geometry. Our first contribution is a synchronization technique which tries to establish correspondence between feature trajectories across views in a novel way, and specifically targets the kind of complex content found in consumer generated sports recordings, without assuming precise knowledge of fundamental matrices or homographies. We evaluate performance using a number of real video recordings and show that our method is able to synchronize to within 1 sec, which is significantly better than previous approaches. Our second contribution is a robust and unsupervised view-invariant activity recognition descriptor that exploits recurrence plot theory on spatial tiles. The descriptor is individually shown to better characterize the activities from different views under occlusions than state-of-the-art approaches. We combine this descriptor with our proposed synchronization method and show that it can further refine the synchronization index. © 2013 ACM.

Synchronization in a coupled architecture of microelectromechanical oscillators

There has been much recent interest in engineering the phenomenon of synchronization in coupled micro-/nano-scale oscillators for applications ranging from precision time and frequency references to new approaches to information processing. This paper presents descriptive modelling detail and further experimental validation of the phenomenon of mutual synchronization in coupled MEMS oscillators building upon recent experimental validation of this concept by the present authors. In particular, the underlying dependence of the observation of synchronization on system parameters is studied through numerical and analytical modelling while considering essential nonlinearities in both the resonator and circuit domain. Experimental results demonstrating synchronized response are elaborated based on the realization of electrically coupled MEMS resonator based square-wave oscillators. The experimental results on frequency entrainment are found to be in general agreement with results obtained through analytical modeling and numerical simulation. The concept presented here is scalable and could be used to investigate the dynamics of large-arrays of coupled MEMS oscillators. © 2014 AIP Publishing LLC.

Electrically coupled MEMS oscillators

In this paper, we demonstrate synchronization of two electrically coupled MEMS oscillators incorporating nearly identical silicon tuning fork microresonators. It is seen that as the output of the oscillators are coupled, they exhibit a synchronized response wherein the output amplitudes and signal-to-noise ratios of the two oscillators are improved relative to the case where the two oscillators are uncoupled. The observed output frequency of each oscillator before coupling is 219402.4 Hz and 219403.6 Hz respectively. In contrast, when the oscillators are driven simultaneously, they lock at a common output frequency of 219401.3 Hz and their outputs are found to be out-of-phase with respect to each other. A 6 dBm gain in output power and a reduction in the phase fluctuations of the output signal are observed for the coupled oscillators compared to the case when the oscillators are uncoupled. © 2011 IEEE.

Improving co-development through process alignment

There has been a recent surge of enthusiasm icithin tlie automotive industry to build closer supplier relationships idthin the area of product development. One concept deemed central to these relationships is the alignment of development processes between the collaborating organizations, an area that is expanded upon idthin this paper. We suggest that synchronization can be achieved through the four key steps of process standardization, knowledge sliaring, alignment of existing practices, and continuous elimination oftcaste idthin the joint development cycles. A methodology for implementing these stages is presented along idth the underlying prindples on which it is based - the importance of joint teamworking and multi-company involvement idthin the alignment process is higlilighted. © MCB University Press.

Spread transform watermarking for video sources

Spread Transform (ST) is a quantization watermarking algorithm in which vectors of the wavelet coefficients of a host work are quantized, using one of two dithered quantizers, to embed hidden information bits; Loo had some success in applying such a scheme to still images. We extend ST to the video watermarking problem. Visibility considerations require that each spreading vector refer to corresponding pixels in each of several frames, that is, a multi-frame embedding approach. Use of the hierarchical complex wavelet transform (CWT) for a visual mask reduces computation and improves robustness to jitter and valumetric scaling. We present a method of recovering temporal synchronization at the detector, and give initial results demonstrating the robustness and capacity of the scheme.

Generalized vector control for brushless doubly fed machines with nested-loop rotor

This paper presents a generalized vector control system for a generic brushless doubly fed (induction) machine (BDFM) with nested-loop type rotor. The generic BDFM consists of p1/p2 pole-pair stator windings and a nested-loop rotor with N number of loops per nest. The vector control system is derived based on the basic BDFM equation in the synchronous mode accompanied with an appropriate synchronization approach to the grid. An analysis is performed for the vector control system using the generic BDFM vector model. The analysis proves the efficacy of the proposed approach in BDFM electromagnetic torque and rotor flux control. In fact, in the proposed vector control system, the BDFM torque can be controlled very effectively promising a high-performance BDFM shaft speed control system. A closed-loop shaft speed control system is composed based on the presented vector control system whose performance is examined both in simulations and experiments. The results confirm the high performance of the proposed approach in BDFM shaft speed control as well as a very close agreement between the simulations and experiments. Tests are performed on a 180-frame prototype BDFM. © 2012 IEEE.

Contraction of monotone phase-coupled oscillators

This paper establishes a global contraction property for networks of phase-coupled oscillators characterized by a monotone coupling function. The contraction measure is a total variation distance. The contraction property determines the asymptotic behavior of the network, which is either finite-time synchronization or asymptotic convergence to a splay state. © 2012 Elsevier B.V. All rights reserved.

Consensus on homogeneous manifolds

The present paper considers distributed consensus algorithms for agents evolving on a connected compact homogeneous (CCH) manifold. The agents track no external reference and communicate their relative state according to an interconnection graph. The paper first formalizes the consensus problem for synchronization (i.e. maximizing the consensus) and balancing (i.e. minimizing the consensus); it thereby introduces the induced arithmetic mean, an easily computable mean position on CCH manifolds. Then it proposes and analyzes various consensus algorithms on manifolds: natural gradient algorithms which reach local consensus equilibria; an adaptation using auxiliary variables for almost-global synchronization or balancing; and a stochastic gossip setting for global synchronization. It closes by investigating the dependence of synchronization properties on the attraction function between interacting agents on the circle. The theory is also illustrated on SO(n) and on the Grassmann manifolds. ©2009 IEEE.

Clustering behaviors in networks of integrate-and-fire oscillators

Clustering behavior is studied in a model of integrate-and-fire oscillators with excitatory pulse coupling. When considering a population of identical oscillators, the main result is a proof of global convergence to a phase-locked clustered behavior. The robustness of this clustering behavior is then investigated in a population of nonidentical oscillators by studying the transition from total clustering to the absence of clustering as the group coherence decreases. A robust intermediate situation of partial clustering, characterized by few oscillators traveling among nearly phase-locked clusters, is of particular interest. The analysis complements earlier studies of synchronization in a closely related model. © 2008 American Institute of Physics.

Collective optimization over average quantities

This paper addresses the design of algorithms for the collective optimization of a cost function defined over average quantities in the presence of limited communication. We argue that several meaningful collective optimization problems can be formulated in this way. As an application of the proposed approach, we propose a novel algorithm that achieves synchronization or balancing in phase models of coupled oscillators under mild connectedness assumptions on the (possibly time-varying and unidirectional) communication graphs. © 2006 IEEE.

Engine modelling for diesel smoke feedback control system design

A novel smoke sensor was used to measure the smoke response to the fuel rack on a diesel engine. The conventional modelling methods used for engine control were investigated. The synchronization technique and Recursive Least Square method were applied to engine modelling and two models for controller design were derived.

Observation of locked phase dynamics and enhanced frequency stability in synchronized micromechanical oscillators

Even though synchronization in autonomous systems has been observed for over three centuries, reports of systematic experimental studies on synchronized oscillators are limited. Here, we report on observations of internal synchronization in coupled silicon micromechanical oscillators associated with a reduction in the relative phase random walk that is modulated by the magnitude of the reactive coupling force between the oscillators. Additionally, for the first time, a significant improvement in the frequency stability of synchronized micromechanical oscillators is reported. The concept presented here is scalable and could be suitably engineered to establish the basis for a new class of highly precise miniaturized clocks and frequency references. © 2013 American Physical Society.

Finding resonance: Adaptive frequency oscillators for dynamic legged locomotion

There is much to gain from providing walking machines with passive dynamics, e.g. by including compliant elements in the structure. These elements can offer interesting properties such as self-stabilization, energy efficiency and simplified control. However, there is still no general design strategy for such robots and their controllers. In particular, the calibration of control parameters is often complicated because of the highly nonlinear behavior of the interactions between passive components and the environment. In this article, we propose an approach in which the calibration of a key parameter of a walking controller, namely its intrinsic frequency, is done automatically. The approach uses adaptive frequency oscillators to automatically tune the intrinsic frequency of the oscillators to the resonant frequency of a compliant quadruped robot The tuning goes beyond simple synchronization and the learned frequency stays in the controller when the robot is put to halt. The controller is model free, robust and simple. Results are presented illustrating how the controller can robustly tune itself to the robot, as well as readapt when the mass of the robot is changed. We also provide an analysis of the convergence of the frequency adaptation for a linearized plant, and show how that analysis is useful for determining which type of sensory feedback must be used for stable convergence. This approach is expected to explain some aspects of developmental processes in biological and artificial adaptive systems that "develop" through the embodied system-environment interactions. © 2006 IEEE.