Spherical image-based visual servo and structure estimation

This paper presents a formulation of image-based visual servoing (IBVS) for a spherical camera where coordinates are parameterized in terms of colatitude and longitude: IBVSSph. The image Jacobian is derived and simulation results are presented for canonical rotational, translational as well as general motion. Problems with large rotations that affect the planar perspective form of IBVS are not present on the sphere, whereas the desirable robustness properties of IBVS are shown to be retained. We also describe a structure from motion (SfM) system based on camera-centric spherical coordinates and show how a recursive estimator can be used to recover structure. The spherical formulations for IBVS and SfM are particularly suitable for platforms, such as aerial and underwater robots, that move in SE(3).

Graphcut-based interactive segmentation using colour and depth cues

Segmentation of novel or dynamic objects in a scene, often referred to as background sub- traction or foreground segmentation, is critical for robust high level computer vision applica- tions such as object tracking, object classifca- tion and recognition. However, automatic real- time segmentation for robotics still poses chal- lenges including global illumination changes, shadows, inter-re ections, colour similarity of foreground to background, and cluttered back- grounds. This paper introduces depth cues provided by structure from motion (SFM) for interactive segmentation to alleviate some of these challenges. In this paper, two prevailing interactive segmentation algorithms are com- pared; Lazysnapping [Li et al., 2004] and Grab- cut [Rother et al., 2004], both based on graph- cut optimisation [Boykov and Jolly, 2001]. The algorithms are extended to include depth cues rather than colour only as in the original pa- pers. Results show interactive segmentation based on colour and depth cues enhances the performance of segmentation with a lower er- ror with respect to ground truth.

Graph rigidity for near-coplanar structure from motion

Recent algorithms for monocular motion capture (MoCap) estimate weak-perspective camera matrices between images using a small subset of approximately-rigid points on the human body (i.e. the torso and hip). A problem with this approach, however, is that these points are often close to coplanar, causing canonical linear factorisation algorithms for rigid structure from motion (SFM) to become extremely sensitive to noise. In this paper, we propose an alternative solution to weak-perspective SFM based on a convex relaxation of graph rigidity. We demonstrate the success of our algorithm on both synthetic and real world data, allowing for much improved solutions to marker less MoCap problems on human bodies. Finally, we propose an approach to solve the two-fold ambiguity over bone direction using a k-nearest neighbour kernel density estimator.

GrabCutSFM : how 3D information improves unsupervised object segmentation

In this paper, we present an unsupervised graph cut based object segmentation method using 3D information provided by Structure from Motion (SFM), called Grab- CutSFM. Rather than focusing on the segmentation problem using a trained model or human intervention, our approach aims to achieve meaningful segmentation autonomously with direct application to vision based robotics. Generally, object (foreground) and background have certain discriminative geometric information in 3D space. By exploring the 3D information from multiple views, our proposed method can segment potential objects correctly and automatically compared to conventional unsupervised segmentation using only 2D visual cues. Experiments with real video data collected from indoor and outdoor environments verify the proposed approach.

Fibroin-based materials support cultivation of limbal stromal cells

Purpose: The silk protein fibroin provides a potential substrate for use in ocular tissue reconstruction. We have previously demonstrated that transparent membranes produced from fibroin support cultivation of human limbal epithelial cells (Tissue Eng A. 14(2008)1203-11). We presently extend this body of work to studies of human limbal stromal cell (HLS) growth on fibroin in the presence and absence of serum. Methods: Primary cultures of HLS cells were established in DMEM/F12 medium supplemented with either 10% fetal bovine serum (FBS) or 2% B27 supplement. Defined keratinocyte serum-free medium (DK-SFM, Invitrogen) was also tested. The resulting cultures were analysed by flow cytometry for expression of CD34, CD90, CD45, and CD141. Cultures grown under each condition were subsequently passaged either onto transparent fibroin membranes prepared from purified fibroin or within 3D scaffolds prepared from partially-solubilised fibroin. Results: HLS cultures were successfully established under each condition, but grew more slowly and passaged poorly in the absence of serum. Cultures grown in 10% FBS were <0.5% CD34+ (keratocytes) and >97% CD90+ (fibroblasts). Cultures established in 2% B27 formed floating spheres and contained >8% CD34+ cells and reduced CD90 expression. Cultures established in DK-SFM displayed traces of epithelial cell growth (CD141), but mostly consisted of CD90+ cells with <1% CD34+ cells. Cells of bone marrow lineage (CD45) were rarely observed under any conditions. Cultures grown in 10% FBS were able to adhere to and proliferate on silk fibroin 3-D scaffolds and transparent films while those grown serum-free could not. Adhesion of HLS cells to fibroin was initially poorer than that displayed on tissue culture plastic. Conclusions: HLS cultures containing cells of predominantly fibroblast lineage can be grown on fibroin-based materials, but this process is dependent upon additional ECM factors such as those provided by serum.

Molecular sliding filament model for muscular contraction based on multiscale investigation

A multiscale approach that bridges the biophysics of the actin molecules at nanoscale and the biomechanics of actin filament at microscale level is developed and used to evaluate the mechanical performances of actin filament bundles. In order to investigate the contractile properties of skeletal muscle which is induced by the protein motor of myosin, a molecular model is proposed in the prediction of the dynamic behaviors of skeletal muscle based on classic sliding filament model. Randomly distributed myosin motors are applied on a 2.2 μm long sarcomere, whose principal components include actin and myosin filaments. It can be found that, the more myosin motors on the sarcomere, the faster the sarcomere contracts. The result demonstrates that the sarcomere shortening speed cannot increase infinitely by the modulation of myosin, thus providing insight into the self-protective properties of skeletal muscles. This molecular filament sliding model provides a theoretical way to evaluate the properties of skeletal muscles, and contributes to the understandings of the molecular mechanisms in the physiological phenomenon of muscular contraction.

Endurance test-rig for diagnostics and prognostics of rolling element bearings

Detection of faults in roller element bearing is a topic widely discussed in the scientific field. Bearings diagnostics is usually performed by analyzing experimental signals, almost always vibration signals, measured during operation. A number of signal processing techniques have been proposed and applied to measured vibrations. The diagnostic effectiveness of the techniques depends on their capacities and on the environmental conditions (i.e. environmental noise). The current trend, especially from an industrial point of view, is to couple the prognostics to the diagnostics. The realization of a prognostic procedure require the definition of parameters able to describe the bearing condition during its operation. Monitoring the values of these parameters during time allows to define their trends depending on the progress of the wear. In this way, a relation between the variation of the selected parameters and the wear progress, useful for diagnostics and prognostics of bearings in real industrial applications, can be established. In this paper, a laboratory test-rig designed to perform endurance tests on roller element bearing is presented. Since the test-rig has operated for a short time, only some preliminary available results are discussed.

An experimental based assessment of the deviation of the bearing characteristic frequencies

Slippage in the contact roller-races has always played a central role in the field of diagnostics of rolling element bearings. Due to this phenomenon, vibrations triggered by a localized damage are not strictly periodic and therefore not detectable by means of common spectral functions as power spectral density or discrete Fourier transform. Due to the strong second order cyclostationary component, characterizing these signals, techniques such as cyclic coherence, its integrated form and square envelope spectrum have proven to be effective in a wide range of applications. An expert user can easily identify a damage and its location within the bearing components by looking for particular patterns of peaks in the output of the selected cyclostationary tool. These peaks will be found in the neighborhood of specific frequencies, that can be calculated in advance as functions of the geometrical features of the bearing itself. Unfortunately the non-periodicity of the vibration signal is not the only consequence of the slippage: often it also involves a displacement of the damage characteristic peaks from the theoretically expected frequencies. This issue becomes particularly important in the attempt to develop highly automated algorithms for bearing damage recognition, and, in order to correctly set thresholds and tolerances, a quantitative description of the magnitude of the above mentioned deviations is needed. This paper is aimed at identifying the dependency of the deviations on the different operating conditions. This has been possible thanks to an extended experimental activity performed on a full scale bearing test rig, able to reproduce realistically the operating and environmental conditions typical of an industrial high power electric motor and gearbox. The importance of load will be investigated in detail for different bearing damages. Finally some guidelines on how to cope with such deviations will be given, accordingly to the expertise obtained in the experimental activity.