Visual Fixation for 3D Video Stabilization

Visual fixation is employed by humans and some animals to keep a specific 3D location at the center of the visual gaze. Inspired by this phenomenon in nature, this paper explores the idea to transfer this mechanism to the context of video stabilization for a handheld video camera. A novel approach is presented that stabilizes a video by fixating on automatically extracted 3D target points. This approach is different from existing automatic solutions that stabilize the video by smoothing. To determine the 3D target points, the recorded scene is analyzed with a stateof- the-art structure-from-motion algorithm, which estimates camera motion and reconstructs a 3D point cloud of the static scene objects. Special algorithms are presented that search either virtual or real 3D target points, which back-project close to the center of the image for as long a period of time as possible. The stabilization algorithm then transforms the original images of the sequence so that these 3D target points are kept exactly in the center of the image, which, in case of real 3D target points, produces a perfectly stable result at the image center. Furthermore, different methods of additional user interaction are investigated. It is shown that the stabilization process can easily be controlled and that it can be combined with state-of-theart tracking techniques in order to obtain a powerful image stabilization tool. The approach is evaluated on a variety of videos taken with a hand-held camera in natural scenes.

Computational Tools for Stereo and Light Field Photography

This thesis covers a broad part of the field of computational photography, including video stabilization and image warping techniques, introductions to light field photography and the conversion of monocular images and videos into stereoscopic 3D content. We present a user assisted technique for stereoscopic 3D conversion from 2D images. Our approach exploits the geometric structure of perspective images including vanishing points. We allow a user to indicate lines, planes, and vanishing points in the input image, and directly employ these as guides of an image warp that produces a stereo image pair. Our method is most suitable for scenes with large scale structures such as buildings and is able to skip the step of constructing a depth map. Further, we propose a method to acquire 3D light fields using a hand-held camera, and describe several computational photography applications facilitated by our approach. As the input we take an image sequence from a camera translating along an approximately linear path with limited camera rotations. Users can acquire such data easily in a few seconds by moving a hand-held camera. We convert the input into a regularly sampled 3D light field by resampling and aligning them in the spatio-temporal domain. We also present a novel technique for high-quality disparity estimation from light fields. Finally, we show applications including digital refocusing and synthetic aperture blur, foreground removal, selective colorization, and others.

A hierarchical strategy for real-time tracking on-board UAVs

In this paper, we present a real-time tracking strategy based on direct methods for tracking tasks on-board UAVs, that is able to overcome problems posed by the challenging conditions of the task: e.g. constant vibrations, fast 3D changes, and limited capacity on-board. The vast majority of approaches make use of feature-based methods to track objects. Nonetheless, in this paper we show that although some of these feature-based solutions are faster, direct methods can be more robust under fast 3D motions (fast changes in position), some changes in appearance, constant vibrations (without requiring any specific hardware or software for video stabilization), and situations where part of the object to track is out the field of view of the camera. The performance of the proposed strategy is evaluated with images from real-flight tests using different evaluation mechanisms (e.g. accurate position estimation using a Vicon sytem). Results show that our tracking strategy performs better than well known feature-based algorithms and well known configurations of direct methods, and that the recovered data is robust enough for vision-in-the-loop tasks.

A Hierarchical Tracking Strategy for Vision-Based Applications On-Board UAVs

In this paper, we apply a hierarchical tracking strategy of planar objects (or that can be assumed to be planar) that is based on direct methods for vision-based applications on-board UAVs. The use of this tracking strategy allows to achieve the tasks at real-time frame rates and to overcome problems posed by the challenging conditions of the tasks: e.g. constant vibrations, fast 3D changes, or limited capacity on-board. The vast majority of approaches make use of feature-based methods to track objects. Nonetheless, in this paper we show that although some of these feature-based solutions are faster, direct methods can be more robust under fast 3D motions (fast changes in position), some changes in appearance, constant vibrations (without requiring any specific hardware or software for video stabilization), and situations in which part of the object to track is outside of the field of view of the camera. The performance of the proposed tracking strategy on-board UAVs is evaluated with images from realflight tests using manually-generated ground truth information, accurate position estimation using a Vicon system, and also with simulated data from a simulation environment. Results show that the hierarchical tracking strategy performs better than wellknown feature-based algorithms and well-known configurations of direct methods, and that its performance is robust enough for vision-in-the-loop tasks, e.g. for vision-based landing tasks.

Online Learning-based Robust Visual Tracking for Autonomous Landing of Unmanned Aerial Vehicles

Autonomous landing is a challenging and important technology for both military and civilian applications of Unmanned Aerial Vehicles (UAVs). In this paper, we present a novel online adaptive visual tracking algorithm for UAVs to land on an arbitrary field (that can be used as the helipad) autonomously at real-time frame rates of more than twenty frames per second. The integration of low-dimensional subspace representation method, online incremental learning approach and hierarchical tracking strategy allows the autolanding task to overcome the problems generated by the challenging situations such as significant appearance change, variant surrounding illumination, partial helipad occlusion, rapid pose variation, onboard mechanical vibration (no video stabilization), low computational capacity and delayed information communication between UAV and Ground Control Station (GCS). The tracking performance of this presented algorithm is evaluated with aerial images from real autolanding flights using manually- labelled ground truth database. The evaluation results show that this new algorithm is highly robust to track the helipad and accurate enough for closing the vision-based control loop.

Online Learning-based Robust Visual Tracking for Autonomous Landing of Unmanned Aerial Vehicles

Autonomous landing is a challenging and important technology for both military and civilian applications of Unmanned Aerial Vehicles (UAVs). In this paper, we present a novel online adaptive visual tracking algorithm for UAVs to land on an arbitrary field (that can be used as the helipad) autonomously at real-time frame rates of more than twenty frames per second. The integration of low-dimensional subspace representation method, online incremental learning approach and hierarchical tracking strategy allows the autolanding task to overcome the problems generated by the challenging situations such as significant appearance change, variant surrounding illumination, partial helipad occlusion, rapid pose variation, onboard mechanical vibration (no video stabilization), low computational capacity and delayed information communication between UAV and Ground Control Station (GCS). The tracking performance of this presented algorithm is evaluated with aerial images from real autolanding flights using manually- labelled ground truth database. The evaluation results show that this new algorithm is highly robust to track the helipad and accurate enough for closing the vision-based control loop.

Curva de aprendizado da ovariohisterectomia video-assistida e da miniceliotomia associada à técnica do gancho de snook em gatas (Felis catus, Linnaeus, 1758)

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Mapping wide row crops with video sequences acquired from a tractor moving at treatment speed

This paper presents a mapping method for wide row crop fields. The resulting map shows the crop rows and weeds present in the inter-row spacing. Because field videos are acquired with a camera mounted on top of an agricultural vehicle, a method for image sequence stabilization was needed and consequently designed and developed. The proposed stabilization method uses the centers of some crop rows in the image sequence as features to be tracked, which compensates for the lateral movement (sway) of the camera and leaves the pitch unchanged. A region of interest is selected using the tracked features, and an inverse perspective technique transforms the selected region into a bird’s-eye view that is centered on the image and that enables map generation. The algorithm developed has been tested on several video sequences of different fields recorded at different times and under different lighting conditions, with good initial results. Indeed, lateral displacements of up to 66% of the inter-row spacing were suppressed through the stabilization process, and crop rows in the resulting maps appear straight

Stabilization of microtubule dynamics by estramustine by binding to a novel site in tubulin: A possible mechanistic basis for its antitumor action

The cellular targets for estramustine, an antitumor drug used in the treatment of hormone-refractory prostate cancer, are believed to be the spindle microtubules responsible for chromosome separation at mitosis. Estramustine only weakly inhibits polymerization of purified tubulin into microtubules by binding to tubulin (Kd, ≈30 μM) at a site distinct from the colchicine or the vinblastine binding sites. However, by video microscopy, we find that estramustine strongly stabilizes growing and shortening dynamics at plus ends of bovine brain microtubules devoid of microtubule-associated proteins at concentrations substantially below those required to inhibit polymerization of the microtubules. Estramustine strongly reduced the rate and extent both of shortening and growing, increased the percentage of time the microtubules spent in an attenuated state, neither growing nor shortening detectably, and reduced the overall dynamicity of the microtubules. Significantly, the combined suppressive effects of vinblastine and estramustine on the rate and extent of shortening and dynamicity were additive. Thus, like the antimitotic mechanisms of action of the antitumor drugs vinblastine and taxol, the antimitotic mechanism of action of estramustine may be due to kinetic stabilization of spindle microtubule dynamics. The results may explain the mechanistic basis for the benefit derived from combined use of estramustine with vinblastine or taxol, two other drugs that target microtubules, in the treatment of hormone-refractory prostate cancer.

The Effect Of Celastrol, A Triterpene With Antitumorigenic Activity, On Conformational And Functional Aspects Of The Human 90kda Heat Shock Protein Hsp90α, A Chaperone Implicated In The Stabilization Of The Tumor Phenotype.

Hsp90 is a molecular chaperone essential for cell viability in eukaryotes that is associated with the maturation of proteins involved in important cell functions and implicated in the stabilization of the tumor phenotype of various cancers, making this chaperone a notably interesting therapeutic target. Celastrol is a plant-derived pentacyclic triterpenoid compound with potent antioxidant, anti-inflammatory and anticancer activities; however, celastrol's action mode is still elusive. In this work, we investigated the effect of celastrol on the conformational and functional aspects of Hsp90α. Interestingly, celastrol appeared to target Hsp90α directly as the compound induced the oligomerization of the chaperone via the C-terminal domain as demonstrated by experiments using a deletion mutant. The nature of the oligomers was investigated by biophysical tools demonstrating that a two-fold excess of celastrol induced the formation of a decameric Hsp90α bound throughout the C-terminal domain. When bound, celastrol destabilized the C-terminal domain. Surprisingly, standard chaperone functional investigations demonstrated that neither the in vitro chaperone activity of protecting against aggregation nor the ability to bind a TPR co-chaperone, which binds to the C-terminus of Hsp90α, were affected by celastrol. Celastrol interferes with specific biological functions of Hsp90α. Our results suggest a model in which celastrol binds directly to the C-terminal domain of Hsp90α causing oligomerization. However, the ability to protect against protein aggregation (supported by our results) and to bind to TPR co-chaperones are not affected by celastrol. Therefore celastrol may act primarily by inducing specific oligomerization that affects some, but not all, of the functions of Hsp90α. To the best of our knowledge, this study is the first work to use multiple probes to investigate the effect that celastrol has on the stability and oligomerization of Hsp90α and on the binding of this chaperone to Tom70. This work provides a novel mechanism by which celastrol binds Hsp90α.

Metodo de sincronização de cameras de video utilizando a banda de audio

Universidade Estadual de Campinas . Faculdade de Educação Física

Metodologia para descrição tridimensional do movimento humano a partir de cameras de video não sincronizadas

Universidade Estadual de Campinas. Faculdade de Educação Física

Haptic Stabilization of Posture in Adults With Intellectual Disabilities Using a Nonrigid Tool

This study assessed the effects of haptic information on the postural control systems of individuals with intellectual disabilities (ID), through the use of a nonrigid tool that we call the ""anchor system"" (e.g., ropes attached to graduated weights that rest on the floor). Eleven participants with ID were asked to stand, blindfolded, on a balance beam placed at two heights (10 and 20 cm), for 30 s, while using the anchor system at two weights. The lighter anchor weight appeared to improve the individuals' balance in contrast to a control task condition; therefore, we concluded that haptic sensitivity was more significant in helping to orient the body than was the anchor's mechanical support alone.

On the stabilization of conducting pernigraniline salt by the synthesis and oxidation of polyaniline in hydrophobic ionic liquids

The electrochemical polymerization of aniline in a hydrophobic room-temperature ionic liquid and the spectroelectrochemical characterization of the formed film are presented. The polymerization occurs without the presence of acid in 1-butyl-2,3-dimethylimidazolium bis(trifluoromethanesulfonyl)imide (BMMITFSI), leading to a very stable electroactive material where no degradation was observed even at high applied potentials. Both in situ UV-Vis and Raman spectroscopic studies provided evidence for the stabilization of pernigraniline salt at high oxidation potentials and that this polyaniline state is the conducting form, as was corroborated by in situ resistance measurements. These data are indicative that low conductivity is not an intrinsic property of pernigraniline salt and this point must be reconsidered.

LEARNING A COMPLEX MOTOR SKILL FROM VIDEO AND POINT-LIGHT DEMONSTRATIONS

The aim of this Study was to compare the learning process of a highly complex ballet skill following demonstrations of point light and video models 16 participants divided into point light and video groups (ns = 8) performed 160 trials of a pirouette equally distributed in blocks of 20 trials alternating periods of demonstration and practice with a retention test a day later Measures of head and trunk oscillation coordination d1 parity from the model and movement time difference showed similarities between video and point light groups ballet experts evaluations indicated superiority of performance in the video over the point light group Results are discussed in terms of the task requirements of dissociation between head and trunk rotations focusing on the hypothesis of sufficiency and higher relevance of information contained in biological motion models applied to learning of complex motor skills