Live 3D shape reconstruction, recognition and registration

We present a video-based system which interactively captures the geometry of a 3D object in the form of a point cloud, then recognizes and registers known objects in this point cloud in a matter of seconds (fig. 1). In order to achieve interactive speed, we exploit both efficient inference algorithms and parallel computation, often on a GPU. The system can be broken down into two distinct phases: geometry capture, and object inference. We now discuss these in further detail. © 2011 IEEE.

Reconstruction of Outdoor Sculptures from Silhouettes under Approximate Circular Motion of an Uncalibrated Hand-Held Camera

This paper presents a novel technique for reconstructing an outdoor sculpture from an uncalibrated image sequence acquired around it using a hand-held camera. The technique introduced here uses only the silhouettes of the sculpture for both motion estimation and model reconstruction, and no corner detection nor matching is necessary. This is very important as most sculptures are composed of smooth textureless surfaces, and hence their silhouettes are very often the only information available from their images. Besides, as opposed to previous works, the proposed technique does not require the camera motion to be perfectly circular (e.g., turntable sequence). It employs an image rectification step before the motion estimation step to obtain a rough estimate of the camera motion which is only approximately circular. A refinement process is then applied to obtain the true general motion of the camera. This allows the technique to handle large outdoor sculptures which cannot be rotated on a turntable, making it much more practical and flexible.

Achievements and Challenges in Recognizing and Reconstructing Civil Infrastructure

The US National Academy of Engineering recently identified restoring and improving urban infrastructure as one of the grand challenges of engineering. Part of this challenge stems from the lack of viable methods to map/label existing infrastructure. For computer vision, this challenge becomes “How can we automate the process of extracting geometric, object oriented models of infrastructure from visual data?” Object recognition and reconstruction methods have been successfully devised and/or adapted to answer this question for small or linear objects (e.g. columns). However, many infrastructure objects are large and/or planar without significant and distinctive features, such as walls, floor slabs, and bridge decks. How can we recognize and reconstruct them in a 3D model? In this paper, strategies for infrastructure object recognition and reconstruction are presented, to set the stage for posing the question above and discuss future research in featureless, large/planar object recognition and modeling.

3D modeling of high-T c superconductors by finite element software

A three-dimensional (3D) numerical model is proposed to solve the electromagnetic problems involving transport current and background field of a high-T c superconducting (HTS) system. The model is characterized by the E-J power law and H-formulation, and is successfully implemented using finite element software. We first discuss the model in detail, including the mesh methods, boundary conditions and computing time. To validate the 3D model, we calculate the ac loss and trapped field solution for a bulk material and compare the results with the previously verified 2D solutions and an analytical solution. We then apply our model to test some typical problems such as superconducting bulk array and twisted conductors, which cannot be tackled by the 2D models. The new 3D model could be a powerful tool for researchers and engineers to investigate problems with a greater level of complicity.

The plastic collapse and energy absorption capacity of egg-box panels

The plastic collapse response of aluminium egg-box panels subjected to out-of-plane compression has been measured and modelled. It is observed that the collapse strength and energy absorption are sensitive to the level of in-plane constraint, with collapse dictated either by plastic buckling or by a travelling plastic knuckle mechanism. Drop weight tests have been performed at speeds of up to 6 m s-1, and an elevation in strength with impact velocity is noted. A 3D finite element shell model is needed in order to reproduce the observed behaviours. Additional calculations using an axisymmetric finite element model give the correct collapse modes but are less accurate than the more sophisticated 3D model. The finite element simulations suggest that the observed velocity dependence of strength is primarily due to strain-rate sensitivity of the aluminium sheet, with material inertia playing a negligible role. Finally, it is shown that the energy absorption capacity of the egg-box material is comparable to that of metallic foams. © 2003 Elsevier Ltd. All rights reserved.

Pothole detection in asphalt pavement images

Pavement condition assessment is essential when developing road network maintenance programs. In practice, the data collection process is to a large extent automated. However, pavement distress detection (cracks, potholes, etc.) is mostly performed manually, which is labor-intensive and time-consuming. Existing methods either rely on complete 3D surface reconstruction, which comes along with high equipment and computation costs, or make use of acceleration data, which can only provide preliminary and rough condition surveys. In this paper we present a method for automated pothole detection in asphalt pavement images. In the proposed method an image is first segmented into defect and non-defect regions using histogram shape-based thresholding. Based on the geometric properties of a defect region the potential pothole shape is approximated utilizing morphological thinning and elliptic regression. Subsequently, the texture inside a potential defect shape is extracted and compared with the texture of the surrounding non-defect pavement in order to determine if the region of interest represents an actual pothole. This methodology has been implemented in a MATLAB prototype, trained and tested on 120 pavement images. The results show that this method can detect potholes in asphalt pavement images with reasonable accuracy.

Testing of Depth-Encoded Hough Voting for Infrastructure Object Detection

The lack of viable methods to map and label existing infrastructure is one of the engineering grand challenges for the 21st century. For instance, over two thirds of the effort needed to geometrically model even simple infrastructure is spent on manually converting a cloud of points to a 3D model. The result is that few facilities today have a complete record of as-built information and that as-built models are not produced for the vast majority of new construction and retrofit projects. This leads to rework and design changes that can cost up to 10% of the installed costs. Automatically detecting building components could address this challenge. However, existing methods for detecting building components are not view and scale-invariant, or have only been validated in restricted scenarios that require a priori knowledge without considering occlusions. This leads to their constrained applicability in complex civil infrastructure scenes. In this paper, we test a pose-invariant method of labeling existing infrastructure. This method simultaneously detects objects and estimates their poses. It takes advantage of a recent novel formulation for object detection and customizes it to generic civil infrastructure scenes. Our preliminary experiments demonstrate that this method achieves convincing recognition results.

Modelling of settlement induced building damage

This thesis focuses on the modelling of settlement induced damage to masonry buildings. In densely populated areas, the need for new space is nowadays producing a rapid increment of underground excavations. Due to the construction of new metro lines, tunnelling activity in urban areas is growing. One of the consequences is a greater attention to the risk of damage on existing structures. Thus, the assessment of potential damage of surface buildings has become an essential stage in the excavation projects in urban areas (Chapter 1). The current damage risk assessment procedure is based on strong simplifications, which not always lead to conservative results. Object of this thesis is the development of an improved damage classification system, which takes into account the parameters influencing the structural response to settlement, like the non-linear behaviour of masonry and the soil-structure interaction. The methodology used in this research is based on experimental and numerical modelling. The design and execution of an experimental benchmark test representative of the problem allows to identify the principal factors and mechanisms involved. The numerical simulations enable to generalize the results to a broader range of physical scenarios. The methodological choice is based on a critical review of the currently available procedures for the assessment of settlement-induced building damage (Chapter 2). A new experimental test on a 1/10th masonry façade with a rubber base interface is specifically designed to investigate the effect of soil-structure interaction on the tunnelling-induced damage (Chapter 3). The experimental results are used to validate a 2D semi-coupled finite element model for the simulation of the structural response (Chapter 4). The numerical approach, which includes a continuum cracking model for the masonry and a non-linear interface to simulate the soil-structure interaction, is then used to perform a sensitivity study on the effect of openings, material properties, initial damage, initial conditions, normal and shear behaviour of the base interface and applied settlement profile (Chapter 5). The results assess quantitatively the major role played by the normal stiffness of the soil-structure interaction and by the material parameters defining the quasi-brittle masonry behaviour. The limitation of the 2D modelling approach in simulating the progressive 3D displacement field induced by the excavation and the consequent torsional response of the building are overcome by the development of a 3D coupled model of building, foundation, soil and tunnel (Chapter 6). Following the same method applied to the 2D semi-coupled approach, the 3D model is validated through comparison with the monitoring data of a literature case study. The model is then used to carry out a series of parametric analyses on geometrical factors: the aspect ratio of horizontal building dimensions with respect to the tunnel axis direction, the presence of adjacent structures and the position and alignment of the building with respect to the excavation (Chapter 7). The results show the governing effect of the 3D building response, proving the relevance of 3D modelling. Finally, the results from the 2D and 3D parametric analyses are used to set the framework of an overall damage model which correlates the analysed structural features with the risk for the building of being damaged by a certain settlement (Chapter 8). This research therefore provides an increased experimental and numerical understanding of the building response to excavation-induced settlements, and sets the basis for an operational tool for the risk assessment of structural damage (Chapter 9).