Online Estimation of Evolving Human Visual Interest

Regions in video streams attracting human interest contribute significantly to human understanding of the video. Being able to predict salient and informative Regions of Interest (ROIs) through a sequence of eye movements is a challenging problem. Applications such as content-aware retargeting of videos to different aspect ratios while preserving informative regions and smart insertion of dialog (closed-caption text) into the video stream can significantly be improved using the predicted ROIs. We propose an interactive human-in-the-loop framework to model eye movements and predict visual saliency into yet-unseen frames. Eye tracking and video content are used to model visual attention in a manner that accounts for important eye-gaze characteristics such as temporal discontinuities due to sudden eye movements, noise, and behavioral artifacts. A novel statistical-and algorithm-based method gaze buffering is proposed for eye-gaze analysis and its fusion with content-based features. Our robust saliency prediction is instantiated for two challenging and exciting applications. The first application alters video aspect ratios on-the-fly using content-aware video retargeting, thus making them suitable for a variety of display sizes. The second application dynamically localizes active speakers and places dialog captions on-the-fly in the video stream. Our method ensures that dialogs are faithful to active speaker locations and do not interfere with salient content in the video stream. Our framework naturally accommodates personalisation of the application to suit biases and preferences of individual users.

Evidence of Low Field Magnetoimpedance Effect in (111) Oriented Fe3O4 Thin Films

Thin film of Fe3O4 is grown on (100) oriented GaAs substrate using pulsed laser deposition (PLD). The films were found to be (111) oriented. They were characterized morphologically as well as magnetically. They show Verwey transition at 120 K with the coercivity of 220 Oe at room temperature. These films were found to show magnetoimpedance effect with the ac magnetoresistance (MRac) of the order of similar to -6% at 10 MHz, at room temperature. The MRac was found to increase in low field-low frequency regime and decrease in low field high frequency regime.

Exploiting oriented attachment in stabilizing La3+-doped gallium oxide nano-spindles

Retaining the morphology of gallium oxide nanostructures during structural transformations or after doping with lanthanide ions is not facile. Here we report on the sonochemical synthesis of nearly monodisperse similar to 550 nm long nano-spindles of undoped and La-doped alpha-GaOOH. The transformation of as-prepared undoped and La-doped alpha-GaOOH powders into the corresponding undoped and La-doped Ga2O3 phases (alpha and beta) was achieved by carrying out controlled annealing at elevated temperatures under optimized conditions. The formation of gallium oxide nano-spindles is explained by invoking the phenomenon of oriented attachment, as amply supported by electron microscopy. Interestingly, the morphology of the gallium oxide nano-spindles remained conserved even after doping them with more than 1.4 at% of La3+ ions. Such robust structural stability could be attributed to the oriented attachment-type growth observed in the nano-spindles. The as-prepared samples and the corresponding annealed ones were thoroughly characterized by powder X-ray diffraction (PXRD), electron microscopy (SEM, TEM, and STEM-EDS) and X-ray photoelectron spectroscopy (XPS). Finally, photoluminescence from the single-crystalline undoped and La-doped beta-Ga2O3 was explored.

VISUAL OBJECT TRACKING VIA RANDOM FERNS BASED CLASSIFICATION

Designing a robust algorithm for visual object tracking has been a challenging task since many years. There are trackers in the literature that are reasonably accurate for many tracking scenarios but most of them are computationally expensive. This narrows down their applicability as many tracking applications demand real time response. In this paper, we present a tracker based on random ferns. Tracking is posed as a classification problem and classification is done using ferns. We used ferns as they rely on binary features and are extremely fast at both training and classification as compared to other classification algorithms. Our experiments show that the proposed tracker performs well on some of the most challenging tracking datasets and executes much faster than one of the state-of-the-art trackers, without much difference in tracking accuracy.

Compiler/Runtime Framework for Dynamic Dataflow Parallelization of Tiled Programs

Task-parallel languages are increasingly popular. Many of them provide expressive mechanisms for intertask synchronization. For example, OpenMP 4.0 will integrate data-driven execution semantics derived from the StarSs research language. Compared to the more restrictive data-parallel and fork-join concurrency models, the advanced features being introduced into task-parallelmodels in turn enable improved scalability through load balancing, memory latency hiding, mitigation of the pressure on memory bandwidth, and, as a side effect, reduced power consumption. In this article, we develop a systematic approach to compile loop nests into concurrent, dynamically constructed graphs of dependent tasks. We propose a simple and effective heuristic that selects the most profitable parallelization idiom for every dependence type and communication pattern. This heuristic enables the extraction of interband parallelism (cross-barrier parallelism) in a number of numerical computations that range from linear algebra to structured grids and image processing. The proposed static analysis and code generation alleviates the burden of a full-blown dependence resolver to track the readiness of tasks at runtime. We evaluate our approach and algorithms in the PPCG compiler, targeting OpenStream, a representative dataflow task-parallel language with explicit intertask dependences and a lightweight runtime. Experimental results demonstrate the effectiveness of the approach.

Mixed Mode Analysis of Obliquely Oriented Edge Cracked Semicircular Disk Under Compression

A new mixed-mode compression fracture specimen, obliquely oriented edge cracked semicircular disk (OECSD) is analyzed by extending pure opening mode configuration of edge cracked semicircular disk (ECSD) under Hertzian compression. Photoelastic experiments are conducted on two different specimens of OECSD of same size and different crack lengths and inclinations. Finite element method (FEM) is used to solve a number of cases of the problem varying crack length and crack inclination. FE results show a good match with experiments. Inclination of edge crack in OECSD can be so made as to obtain any mode-mixity ratio between zero and one and beyond for any crack length. The new specimen can be used for fracture testing under compression more conveniently than the existing ones in several ways.

Oriented nanometric aggregates of partially inverted zinc ferrite: One-step processing and tunable high-frequency magnetic properties

In this work, it is demonstrated that the in situ growth of oriented nanometric aggregates of partially inverted zinc ferrite can potentially pave a way to alter and tune magnetocrystalline anisotropy that, in turn, dictates ferromagnetic resonance frequency (f(FMR)) by inducing strain due to aggregation. Furthermore, the influence of interparticle interaction on magnetic properties of the aggregates is investigated. Mono-dispersed zinc ferrite nanoparticles (<5 nm) with various degrees of aggregation were prepared through decomposition of metal-organic compounds of zinc (II) and iron (III) in an alcoholic solution under controlled microwave irradiation, below 200 degrees C. The nanocrystallites were found to possess high degree of inversion (>0.5). With increasing order of aggregation in the samples, saturation magnetization (at 5 K) is found to decrease from 38 emu/g to 24 emu/g, while coercivity is found to increase gradually by up to 100% (525 Oe to 1040 Oe). Anisotropy-mediated shift of f(FMR) has also been measured and discussed. In essence, the result exhibits an easy way to control the magnetic characteristics of nanocrystalline zinc ferrite, boosted with significant degree of inversion, at GHz frequencies. (C) 2015 AIP Publishing LLC.

Experimentally validated Raman Monte Carlo simulation for a cuboid object to obtain Raman spectroscopic signatures for hidden material

In conventional Raman spectroscopic measurements of liquids or surfaces the preferred geometry for detection of the Raman signal is the backscattering (or reflection) mode. For non-transparent layered materials, sub-surface Raman signals have been retrieved using spatially offset Raman spectroscopy (SORS), usually with light collection in the same plane as the point of excitation. However, as a result of multiple scattering in a turbid medium, Raman photons will be emitted in all directions. In this study, Monte Carlo simulations for a three-dimensional layered sample with finite geometry have been performed to confirm the detectability of Raman signals at all angles and at all sides of the object. We considered a non-transparent cuboid container (high density polyethylene) with explosive material (ammonium nitrate) inside. The simulation results were validated with experimental Raman intensities. Monte Carlo simulation results reveal that the ratio of sub-surface to surface signals improves at geometries other than backscattering. In addition, we demonstrate through simulations the effects of the absorption and scattering coefficients of the layers, and that of the diameter of the excitation beam. The advantage of collecting light from all possible 4 angles, over other collection modes, is that this technique is not geometry specific and molecular identification of layers underneath non-transparent surfaces can be obtained with minimal interference from the surface layer. To what extent all sides of the object will contribute to the total signal will depend on the absorption and scattering coefficients and the physical dimensions. Copyright (c) 2015 John Wiley & Sons, Ltd.

SeamSeg: Video Object Segmentation using Patch Seams

In this paper, we propose a technique for video object segmentation using patch seams across frames. Typically, seams, which are connected paths of low energy, are utilised for retargeting, where the primary aim is to reduce the image size while preserving the salient image contents. Here, we adapt the formulation of seams for temporal label propagation. The energy function associated with the proposed video seams provides temporal linking of patches across frames, to accurately segment the object. The proposed energy function takes into account the similarity of patches along the seam, temporal consistency of motion and spatial coherency of seams. Label propagation is achieved with high fidelity in the critical boundary regions, utilising the proposed patch seams. To achieve this without additional overheads, we curtail the error propagation by formulating boundary regions as rough-sets. The proposed approach out-perform state-of-the-art supervised and unsupervised algorithms, on benchmark datasets.

Investigation on the origin of exchange bias in epitaxial, oriented and polycrystalline Fe3O4 thin films

We observe exchange bias (EB) in a single magnetic film Fe3O4 at temperature T < 200 K. Irrespective of crystallographic orientations of grown Fe3O4; they exhibit similar nature of EB for (100) epitaxial, (111) oriented and polycrystalline Fe3O4 thin films. Growth induced defects such as anti-phase boundaries (APBs) in epitaxial Fe3O4 thin film is known to have an influence on the magnetic interaction. But, it is noticed that according to the common consensus of APBs alone cannot explain the origin of EB. If majority of APBs end up with mainly anti-ferromagnetic interactions across these boundaries together with the internal ordering modification in Fe3O4, then EB can emerge at low temperatures. Hence, we propose the idea of directional anti-ferromagnetic APB induced EB in Fe3O4 triggered by internal ordering for T <= 200 K. Similar arguments are extended to (111) oriented as well as polycrystalline Fe3O4 films where the grain boundaries can impart same consequence as that of APBs. (C) 2015 Author(s).

Detection and estimation of liquid flow through a pipe in a tissue-like object with ultrasound-assisted diffuse correlation spectroscopy

Using coherent light interrogating a turbid object perturbed by a focused ultrasound (US) beam, we demonstrate localized measurement of dynamics in the focal region, termed the region-of-interest (ROI), from the decay of the modulation in intensity autocorrelation of light. When the ROI contains a pipe flow, the decay is shown to be sensitive to the average flow velocity from which the mean-squared displacement (MSD) of the scattering centers in the flow can be estimated. While the MSD estimated is seen to be an order of magnitude higher than that obtainable through the usual diffusing wave spectroscopy (DWS) without the US, it is seen to be more accurate as verified by the volume flow estimated from it. It is further observed that, whereas the MSD from the localized measurement grows with time as tau(alpha) with alpha approximate to 1.65, without using the US, a is seen to be much less. Moreover, with the local measurement, this super-diffusive nature of the pipe flow is seen to persist longer, i.e., over a wider range of initial tau, than with the unassisted DWS. The reason for the super-diffusivity of flow, i.e., alpha < 2, in the ROI is the presence of a fluctuating (thermodynamically nonequilibrium) component in the dynamics induced by the US forcing. Beyond this initial range, both methods measure MSDs that rise linearly with time, indicating that ballistic and near-ballistic photons hardly capture anything beyond the background Brownian motion. (C) 2015 Optical Society of America

Sparse representation-based human detection: a scale-embedded dictionary approach

Human detection is a complex problem owing to the variable pose that they can adopt. Here, we address this problem in sparse representation framework with an overcomplete scale-embedded dictionary. Histogram of oriented gradient features extracted from the candidate image patches are sparsely represented by the dictionary that contain positive bases along with negative and trivial bases. The object is detected based on the proposed likelihood measure obtained from the distribution of these sparse coefficients. The likelihood is obtained as the ratio of contribution of positive bases to negative and trivial bases. The positive bases of the dictionary represent the object (human) at various scales. This enables us to detect the object at any scale in one shot and avoids multiple scanning at different scales. This significantly reduces the computational complexity of detection task. In addition to human detection, it also finds the scale at which the human is detected due to the scale-embedded structure of the dictionary.

Object attributes combine additively in visual search

We perceive objects as containing a variety of attributes: local features, relations between features, internal details, and global properties. But we know little about how they combine. Here, we report a remarkably simple additive rule that governs how these diverse object attributes combine in vision. The perceived dissimilarity between two objects was accurately explained as a sum of (a) spatially tuned local contour-matching processes modulated by part decomposition; (b) differences in internal details, such as texture; (c) differences in emergent attributes, such as symmetry; and (d) differences in global properties, such as orientation or overall configuration of parts. Our results elucidate an enduring question in object vision by showing that the whole object is not a sum of its parts but a sum of its many attributes.

SALIENT OBJECT DETECTION VIA OBJECTNESS MEASURE

Salient object detection has become an important task in many image processing applications. The existing approaches exploit background prior and contrast prior to attain state of the art results. In this paper, instead of using background cues, we estimate the foreground regions in an image using objectness proposals and utilize it to obtain smooth and accurate saliency maps. We propose a novel saliency measure called `foreground connectivity' which determines how tightly a pixel or a region is connected to the estimated foreground. We use the values assigned by this measure as foreground weights and integrate these in an optimization framework to obtain the final saliency maps. We extensively evaluate the proposed approach on two benchmark databases and demonstrate that the results obtained are better than the existing state of the art approaches.