Warping trajectories for video synchronization

Temporal synchronization of multiple video recordings of the same dynamic event is a critical task in many computer vision applications e.g. novel view synthesis and 3D reconstruction. Typically this information is implied, since recordings are made using the same timebase, or time-stamp information is embedded in the video streams. Recordings using consumer grade equipment do not contain this information; hence, there is a need to temporally synchronize signals using the visual information itself. Previous work in this area has either assumed good quality data with relatively simple dynamic content or the availability of precise camera geometry. In this paper, we propose a technique which exploits feature trajectories across views in a novel way, and specifically targets the kind of complex content found in consumer generated sports recordings, without assuming precise knowledge of fundamental matrices or homographies. Our method automatically selects the moving feature points in the two unsynchronized videos whose 2D trajectories can be best related, thereby helping to infer the synchronization index. We evaluate performance using a number of real recordings and show that synchronization can be achieved to within 1 sec, which is better than previous approaches. Copyright 2013 ACM.

Synchronization of user-generated videos through trajectory correspondence and a refinement procedure

Temporal synchronization of multiple video recordings of the same dynamic event is a critical task in many computer vision applications e.g. novel view synthesis and 3D reconstruction. Typically this information is implied through the time-stamp information embedded in the video streams. User-generated videos shot using consumer grade equipment do not contain this information; hence, there is a need to temporally synchronize signals using the visual information itself. Previous work in this area has either assumed good quality data with relatively simple dynamic content or the availability of precise camera geometry. Our first contribution is a synchronization technique which tries to establish correspondence between feature trajectories across views in a novel way, and specifically targets the kind of complex content found in consumer generated sports recordings, without assuming precise knowledge of fundamental matrices or homographies. We evaluate performance using a number of real video recordings and show that our method is able to synchronize to within 1 sec, which is significantly better than previous approaches. Our second contribution is a robust and unsupervised view-invariant activity recognition descriptor that exploits recurrence plot theory on spatial tiles. The descriptor is individually shown to better characterize the activities from different views under occlusions than state-of-the-art approaches. We combine this descriptor with our proposed synchronization method and show that it can further refine the synchronization index. © 2013 ACM.

Synchronization in a coupled architecture of microelectromechanical oscillators

There has been much recent interest in engineering the phenomenon of synchronization in coupled micro-/nano-scale oscillators for applications ranging from precision time and frequency references to new approaches to information processing. This paper presents descriptive modelling detail and further experimental validation of the phenomenon of mutual synchronization in coupled MEMS oscillators building upon recent experimental validation of this concept by the present authors. In particular, the underlying dependence of the observation of synchronization on system parameters is studied through numerical and analytical modelling while considering essential nonlinearities in both the resonator and circuit domain. Experimental results demonstrating synchronized response are elaborated based on the realization of electrically coupled MEMS resonator based square-wave oscillators. The experimental results on frequency entrainment are found to be in general agreement with results obtained through analytical modeling and numerical simulation. The concept presented here is scalable and could be used to investigate the dynamics of large-arrays of coupled MEMS oscillators. © 2014 AIP Publishing LLC.

Chaotic behavior of pulsating heat pipes

Chaotic behavior of closed loop pulsating heat pipes (PHPs) was studied. The PHPs were fabricated by capillary tubes with outer and inner diameters of 2.0 and 1.20 mm. FC-72 and deionized water were used as the working fluids. Experiments cover the following data ranges: number of turns of 4, 6, and 9, inclination angles from 5 degrees (near horizontal) to 90, (vertical), charge ratios from 50% to 80%, heating powers from 7.5 to 60.0 W. The nonlinear analysis is based on the recorded time series of temperatures on the evaporation, adiabatic, and condensation sections. The present study confirms that PHPs are deterministic chaotic systems. Autocorrelation functions (ACF) are decreased versus time, indicating prediction ability of the system is finite. Three typical attractor patterns are identified. Hurst exponents are very high, i.e., from 0.85 to 0.95, indicating very strong persistent properties of PHPs. Curves of correlation integral versus radius of hypersphere indicate two linear sections for water PHPs, corresponding to both high frequency, low amplitude, and low frequency, large amplitude oscillations. At small inclination angles near horizontal, correlation dimensions are not uniform at different turns of PHPs. The non-uniformity of correlation dimensions is significantly improved with increases in inclination angles. Effect of inclination angles on the chaotic parameters is complex for FC-72 PHPs, but it is certain that correlation dimensions and Kolmogorov entropies are increased with increases in inclination angles. The optimal charge ratios are about 60-70%, at which correlation dimensions and Kolmogorov entropies are high. The higher the heating power, the larger the correlation dimensions and Kolmogorov entropies are. For most runs, large correlation dimensions and Kolmogorov entropies correspond to small thermal resistances, i.e., better thermal performance, except for FC-72 PHPs at small inclination angles of theta < 15 degrees.

Using Special-Purpose Computing to Examine Chaotic Behavior in Nonlinear Mappings

Studying chaotic behavior in nonlinear systems requires numerous computations in order to simulate the behavior of such systems. The Standard Map Machine was designed and implemented as a special computer for performing these intensive computations with high-speed and high-precision. Its impressive performance is due to its simple architecture specialized to the numerical computations required of nonlinear systems. This report discusses the design and implementation of the Standard Map Machine and its use in the study of nonlinear mappings; in particular, the study of the standard map.

Priority-Based Synchronization of Distributed Data

We consider the general problem of synchronizing the data on two devices using a minimum amount of communication, a core infrastructural requirement for a large variety of distributed systems. Our approach considers the interactive synchronization of prioritized data, where, for example, certain information is more time-sensitive than other information. We propose and analyze a new scheme for efficient priority-based synchronization, which promises benefits over conventional synchronization.

Fast Synchronization of Perpetual Grouping in Laminar Visual Cortical Circuits

Perceptual grouping is well-known to be a fundamental process during visual perception, notably grouping across scenic regions that do not receive contrastive visual inputs. Illusory contours are a classical example of such groupings. Recent psychophysical and neurophysiological evidence have shown that the grouping process can facilitate rapid synchronization of the cells that are bound together by a grouping, even when the grouping must be completed across regions that receive no contrastive inputs. Synchronous grouping can hereby bind together different object parts that may have become desynchronized due to a variety of factors, and can enhance the efficiency of cortical transmission. Neural models of perceptual grouping have clarified how such fast synchronization may occur by using bipole grouping cells, whose predicted properties have been supported by psychophysical, anatomical, and neurophysiological experiments. These models have not, however, incorporated some of the realistic constraints on which groupings in the brain are conditioned, notably the measured spatial extent of long-range interactions in layer 2/3 of a grouping network, and realistic synaptic and axonal signaling delays within and across cells in different cortical layers. This work addresses the question: Can long-range interactions that obey the bipole constraint achieve fast synchronization under realistic anatomical and neurophysiological constraints that initially desynchronize grouping signals? Can the cells that synchronize retain their analog sensitivity to changing input amplitudes? Can the grouping process complete and synchronize illusory contours across gaps in bottom-up inputs? Our simulations show that the answer to these questions is Yes.

The synchronization of superparamagnetic beads driven by a micro-magnetic ratchet.

We present theoretical, numerical, and experimental analyses on the non-linear dynamic behavior of superparamagnetic beads exposed to a periodic array of micro-magnets and an external rotating field. The agreement between theoretical and experimental results revealed that non-linear magnetic forcing dynamics are responsible for transitions between phase-locked orbits, sub-harmonic orbits, and closed orbits, representing different mobility regimes of colloidal beads. These results suggest that the non-linear behavior can be exploited to construct a novel colloidal separation device that can achieve effectively infinite separation resolution for different types of beads, by exploiting minor differences in their bead's properties. We also identify a unique set of initial conditions, which we denote the "devil's gate" which can be used to expeditiously identify the full range of mobility for a given bead type.