Estudi i implementació d’un mètode de reconstrucció 3D basat en SfM i registre de vistes 3D parcials

Aquest projecte es basarà en reconstruir una imatge 3D gran a partir d’una seqüència d’imatges 2D capturades per una càmera. Ens centrem en l’estudi de les bases matemàtiques de la visió per computador així com en diferents mètodes emprats en la reconstrucció 3D d’imatges. Per portar a terme aquest estudi s’utilitza la plataforma de desenvolupament MatLab ja que permet tractar operacions matemàtiques, imatges i matrius de gran tamany amb molta senzillesa, rapidesa i eficiència, per aquesta raó s’usa en moltes recerques sobre aquest tema. El projecte aprofundeix en el tema descrit anteriorment estudiant i implementant un mètode que consisteix en aplicar Structure From Motion (SFM) a pocs frames seguits obtinguts d’una seqüència d’imatges 2D per crear una reconstrucció 3D. Quan s’han creat dues reconstruccions 3D consecutives i fent servir un frame com a mínim en comú entre elles, s’aplica un mètode de registre d’estructures 3D, l’Iterative Closest Point (ICP), per crear una reconstrucció 3D més gran a través d’unir les diferents reconstruccions obtingudes a partir de SfM. El mètode consisteix en anar repetint aquestes operacions fins al final dels frames per poder aconseguir una reconstrucció 3D més gran que les petites imatges que s’aconsegueixen a través de SfM. A la Figura 1 es pot veure un esquema del procés que es segueix. Per avaluar el comportament del mètode, utilitzem un conjunt de seqüències sintètiques i un conjunt de seqüències reals obtingudes a partir d’una càmera. L’objectiu final d’aquest projecte és construir una nova toolbox de MatLab amb tots els mètodes per crear reconstruccions 3D grans per tal que sigui possible tractar amb facilitat aquest problema i seguir-lo desenvolupant en un futur

Calculating the Uncertainty of a Structure from Motion (SfM) Model, Cadman Quarry, Monroe, Washington

Structure from Motion (SfM) is a new form of photogrammetry that automates the rendering of georeferenced 3D models of objects using digital photographs and independently surveyed Ground Control Points (GCPs). This project seeks to quantify the error found in Digital Elevation Models (DEMs) produced using SfM. I modeled a rockslide found at the Cadman Quarry (Monroe, Washington) because the surface is vegetation-free, which is ideal for SfM and Terrestrial LiDAR Scanner (TLS) surveys. By using SfM, TLS, and GPS positioning at the same time, I attempted to find the deviation in the SfM model from the TLS model and GPS points. Using the deviation, I found the Root-Mean-Square Error (RMSE) between the SfM DEM and GPS positions. The RMSE of the SfM model when compared to surveyed GPS points is 17cm. I propagated the uncertainty of the GPS points with the RMSE of the SfM model to find the uncertainty of the SfM model compared to the NAD 1984 datum. The uncertainty of the SfM model compared to the NAD 1984 is 27cm. This study did not produce a model from the TLS that had sufficient resolution on horizontal surfaces to compare to surveyed GPS points.

Spherical image-based visual servo and structure estimation

This paper presents a formulation of image-based visual servoing (IBVS) for a spherical camera where coordinates are parameterized in terms of colatitude and longitude: IBVSSph. The image Jacobian is derived and simulation results are presented for canonical rotational, translational as well as general motion. Problems with large rotations that affect the planar perspective form of IBVS are not present on the sphere, whereas the desirable robustness properties of IBVS are shown to be retained. We also describe a structure from motion (SfM) system based on camera-centric spherical coordinates and show how a recursive estimator can be used to recover structure. The spherical formulations for IBVS and SfM are particularly suitable for platforms, such as aerial and underwater robots, that move in SE(3).

Graphcut-based interactive segmentation using colour and depth cues

Segmentation of novel or dynamic objects in a scene, often referred to as background sub- traction or foreground segmentation, is critical for robust high level computer vision applica- tions such as object tracking, object classifca- tion and recognition. However, automatic real- time segmentation for robotics still poses chal- lenges including global illumination changes, shadows, inter-re ections, colour similarity of foreground to background, and cluttered back- grounds. This paper introduces depth cues provided by structure from motion (SFM) for interactive segmentation to alleviate some of these challenges. In this paper, two prevailing interactive segmentation algorithms are com- pared; Lazysnapping [Li et al., 2004] and Grab- cut [Rother et al., 2004], both based on graph- cut optimisation [Boykov and Jolly, 2001]. The algorithms are extended to include depth cues rather than colour only as in the original pa- pers. Results show interactive segmentation based on colour and depth cues enhances the performance of segmentation with a lower er- ror with respect to ground truth.

Graph rigidity for near-coplanar structure from motion

Recent algorithms for monocular motion capture (MoCap) estimate weak-perspective camera matrices between images using a small subset of approximately-rigid points on the human body (i.e. the torso and hip). A problem with this approach, however, is that these points are often close to coplanar, causing canonical linear factorisation algorithms for rigid structure from motion (SFM) to become extremely sensitive to noise. In this paper, we propose an alternative solution to weak-perspective SFM based on a convex relaxation of graph rigidity. We demonstrate the success of our algorithm on both synthetic and real world data, allowing for much improved solutions to marker less MoCap problems on human bodies. Finally, we propose an approach to solve the two-fold ambiguity over bone direction using a k-nearest neighbour kernel density estimator.

GrabCutSFM : how 3D information improves unsupervised object segmentation

In this paper, we present an unsupervised graph cut based object segmentation method using 3D information provided by Structure from Motion (SFM), called Grab- CutSFM. Rather than focusing on the segmentation problem using a trained model or human intervention, our approach aims to achieve meaningful segmentation autonomously with direct application to vision based robotics. Generally, object (foreground) and background have certain discriminative geometric information in 3D space. By exploring the 3D information from multiple views, our proposed method can segment potential objects correctly and automatically compared to conventional unsupervised segmentation using only 2D visual cues. Experiments with real video data collected from indoor and outdoor environments verify the proposed approach.

Fibroin-based materials support cultivation of limbal stromal cells

Purpose: The silk protein fibroin provides a potential substrate for use in ocular tissue reconstruction. We have previously demonstrated that transparent membranes produced from fibroin support cultivation of human limbal epithelial cells (Tissue Eng A. 14(2008)1203-11). We presently extend this body of work to studies of human limbal stromal cell (HLS) growth on fibroin in the presence and absence of serum. Methods: Primary cultures of HLS cells were established in DMEM/F12 medium supplemented with either 10% fetal bovine serum (FBS) or 2% B27 supplement. Defined keratinocyte serum-free medium (DK-SFM, Invitrogen) was also tested. The resulting cultures were analysed by flow cytometry for expression of CD34, CD90, CD45, and CD141. Cultures grown under each condition were subsequently passaged either onto transparent fibroin membranes prepared from purified fibroin or within 3D scaffolds prepared from partially-solubilised fibroin. Results: HLS cultures were successfully established under each condition, but grew more slowly and passaged poorly in the absence of serum. Cultures grown in 10% FBS were <0.5% CD34+ (keratocytes) and >97% CD90+ (fibroblasts). Cultures established in 2% B27 formed floating spheres and contained >8% CD34+ cells and reduced CD90 expression. Cultures established in DK-SFM displayed traces of epithelial cell growth (CD141), but mostly consisted of CD90+ cells with <1% CD34+ cells. Cells of bone marrow lineage (CD45) were rarely observed under any conditions. Cultures grown in 10% FBS were able to adhere to and proliferate on silk fibroin 3-D scaffolds and transparent films while those grown serum-free could not. Adhesion of HLS cells to fibroin was initially poorer than that displayed on tissue culture plastic. Conclusions: HLS cultures containing cells of predominantly fibroblast lineage can be grown on fibroin-based materials, but this process is dependent upon additional ECM factors such as those provided by serum.

Molecular sliding filament model for muscular contraction based on multiscale investigation

A multiscale approach that bridges the biophysics of the actin molecules at nanoscale and the biomechanics of actin filament at microscale level is developed and used to evaluate the mechanical performances of actin filament bundles. In order to investigate the contractile properties of skeletal muscle which is induced by the protein motor of myosin, a molecular model is proposed in the prediction of the dynamic behaviors of skeletal muscle based on classic sliding filament model. Randomly distributed myosin motors are applied on a 2.2 μm long sarcomere, whose principal components include actin and myosin filaments. It can be found that, the more myosin motors on the sarcomere, the faster the sarcomere contracts. The result demonstrates that the sarcomere shortening speed cannot increase infinitely by the modulation of myosin, thus providing insight into the self-protective properties of skeletal muscles. This molecular filament sliding model provides a theoretical way to evaluate the properties of skeletal muscles, and contributes to the understandings of the molecular mechanisms in the physiological phenomenon of muscular contraction.

Endurance test-rig for diagnostics and prognostics of rolling element bearings

Detection of faults in roller element bearing is a topic widely discussed in the scientific field. Bearings diagnostics is usually performed by analyzing experimental signals, almost always vibration signals, measured during operation. A number of signal processing techniques have been proposed and applied to measured vibrations. The diagnostic effectiveness of the techniques depends on their capacities and on the environmental conditions (i.e. environmental noise). The current trend, especially from an industrial point of view, is to couple the prognostics to the diagnostics. The realization of a prognostic procedure require the definition of parameters able to describe the bearing condition during its operation. Monitoring the values of these parameters during time allows to define their trends depending on the progress of the wear. In this way, a relation between the variation of the selected parameters and the wear progress, useful for diagnostics and prognostics of bearings in real industrial applications, can be established. In this paper, a laboratory test-rig designed to perform endurance tests on roller element bearing is presented. Since the test-rig has operated for a short time, only some preliminary available results are discussed.

An experimental based assessment of the deviation of the bearing characteristic frequencies

Slippage in the contact roller-races has always played a central role in the field of diagnostics of rolling element bearings. Due to this phenomenon, vibrations triggered by a localized damage are not strictly periodic and therefore not detectable by means of common spectral functions as power spectral density or discrete Fourier transform. Due to the strong second order cyclostationary component, characterizing these signals, techniques such as cyclic coherence, its integrated form and square envelope spectrum have proven to be effective in a wide range of applications. An expert user can easily identify a damage and its location within the bearing components by looking for particular patterns of peaks in the output of the selected cyclostationary tool. These peaks will be found in the neighborhood of specific frequencies, that can be calculated in advance as functions of the geometrical features of the bearing itself. Unfortunately the non-periodicity of the vibration signal is not the only consequence of the slippage: often it also involves a displacement of the damage characteristic peaks from the theoretically expected frequencies. This issue becomes particularly important in the attempt to develop highly automated algorithms for bearing damage recognition, and, in order to correctly set thresholds and tolerances, a quantitative description of the magnitude of the above mentioned deviations is needed. This paper is aimed at identifying the dependency of the deviations on the different operating conditions. This has been possible thanks to an extended experimental activity performed on a full scale bearing test rig, able to reproduce realistically the operating and environmental conditions typical of an industrial high power electric motor and gearbox. The importance of load will be investigated in detail for different bearing damages. Finally some guidelines on how to cope with such deviations will be given, accordingly to the expertise obtained in the experimental activity.

Improved damping capacity and machinability of graphite particle-aluminum alloy composites

The damping capacity of cast graphitic aluminum alloy composites has been measured using a torsion pendulum at a constant strain amplitude. It was found that flake-graphite particles dispersed in the matrix of aluminum alloys increased the damping capacity; the improvement was greater, the higher the amount of graphite dispersed in the matrix. At sufficiently high graphite contents the damping capacity of graphitic aluminum composites approaches that of cast iron. The ratio between the damping capacity and the density of graphitic aluminum alloys is higher than cast iron, making them very attractive as light-weight, high-damping materials for possible aircraft applications. Machinability tests on graphite particle-aluminum composites, conducted at speeds of 315 sfm and 525 sfm, showed that the chip length decreased with the amount of graphite of a given size. When the size of graphite was decreased, at a given machining speed, the chip length decreased. Metallographic examination shows that graphite particles act as chip breakers, and are frequently sheared parallel to the plane of the

Global and EU governance for sustainable forest management with special reference to capacity building in Ethiopia and Southern Sudan

The purpose of this study was to produce information on and practical recommendations for informed decision-making on and capacity building for sustainable forest management (SFM) and good forest governance. This was done within the overall global framework for sustainable development with special emphasis on the EU and African frameworks and on Southern Sudan and Ethiopia in particular. The case studies on Southern Sudan and Ethiopia focused on local, national and regional issues. Moreover, this study attempted to provide both theoretical and practical new insight. The aim was to build an overall theoretical framework and to study its key contents and main implications for SFM and good forest governance at all administration levels, for providing new tools for capacity building in natural resources management. The theoretical framework and research approach were based on the original research problem and the general and specific aims of the study. The key elements of the framework encompass sustainable development, global and EU governance, sustainable forest management (SFM), good forest governance, as well as international and EU law. The selected research approach comprised matrix-based assessment of international, regional (EU and Africa) and national (Southern Sudan and Ethiopia) policy and legal documents. The specific case study on Southern Sudan also involved interviews and group discussions with local community members and government officials. As a whole, this study attempted to link the global, regional, national and local levels in forest-sector development and especially to analyse how the international policy development in environmental and forestry issues is reflected in field-level progress towards SFM and good forest governance, for the specific cases of Southern Sudan and Ethiopia. The results on Southern Sudan focused on the existing situation and perceived needs in capacity building for SFM and good forest governance at all administration levels. Specifically, the results of the case study on Southern Sudan presented the current situation in selected villages in the northern parts of Renk County in Upper Nile State, and the implications of Multilateral Environmental Agreements (MEAs) and of the new forest policy framework for capacity building actions. The results on Ethiopia focused on training, extension, research, education and new curriculum development within higher education institutions and particularly at the Wondo Genet College of Forestry and Natural Resources (WGCF-NR), which administratively lies under Hawassa University. The results suggest that, for both cases studies, informed decision-making on and capacity building for SFM and good forest governance require comprehensive, long-term, cross-sectoral, coherent and consistent approaches within the dynamic and evolving overall global framework, including its multiple inter-linked levels. The specific priority development and focus areas comprised the establishment of SFM and good forest governance in accordance with the overall sustainable development priorities and with more focus on the international trade in forest products that are derived from sustainable and legal sources with an emphasis on effective forest law enforcement and governance at all levels. In Upper Nile State in Southern Sudan there were positive development signals such as the will of the local people to plant more multipurpose trees on farmlands and range lands as well as the recognition of the importance of forests and trees for sustainable rural development where food security is a key element. In addition, it was evident that the local communities studied in Southern Sudan also wanted to establish good governance systems through partnerships with all actors and through increased local responsibilities. The results also suggest that the implementation of MEAs at the local level in Southern Sudan requires mutually supportive and coherent approaches within the agreements as well as significantly more resources and financial and technical assistance for capacity building, training and extension. Finally, the findings confirm the importance of full utilization of the existing local governance and management systems and their traditional and customary knowledge and practices, and of new development partnerships with full participation of all stakeholders. The planned new forest law for Southern Sudan, based on an already existing new forest policy, is expected to recognize the roles of local-level actors, and it would thus obviously facilitate the achieving of sustainable forest management.