Automated 3D Structure Inference of Civil Infrastructure Using a Stereo Camera Set

The commercial far-range (>10m) infrastructure spatial data collection methods are not completely automated. They need significant amount of manual post-processing work and in some cases, the equipment costs are significant. This paper presents a method that is the first step of a stereo videogrammetric framework and holds the promise to address these issues. Under this method, video streams are initially collected from a calibrated set of two video cameras. For each pair of simultaneous video frames, visual feature points are detected and their spatial coordinates are then computed. The result, in the form of a sparse 3D point cloud, is the basis for the next steps in the framework (i.e., camera motion estimation and dense 3D reconstruction). A set of data, collected from an ongoing infrastructure project, is used to show the merits of the method. Comparison with existing tools is also shown, to indicate the performance differences of the proposed method in the level of automation and the accuracy of results.

Recovering 3D Structure of Poorly Textured Infrastructure Scenes Using Point and Line Features

Most of the existing automated machine vision-based techniques for as-built documentation of civil infrastructure utilize only point features to recover the 3D structure of a scene. However it is often the case in man-made structures that not enough point features can be reliably detected (e.g. buildings and roofs); this can potentially lead to the failure of these techniques. To address the problem, this paper utilizes the prominence of straight lines in infrastructure scenes. It presents a hybrid approach that benefits from both point and line features. A calibrated stereo set of video cameras is used to collect data. Point and line features are then detected and matched across video frames. Finally, the 3D structure of the scene is recovered by finding 3D coordinates of the matched features. The proposed approach has been tested on realistic outdoor environments and preliminary results indicate its capability to deal with a variety of scenes.

IREE: Automated Vision Tracking of Project Related Entities

The purpose of this supplemental project was to collect invaluable data from the large-scale construction sites of Egnatia Odos motorway needed to validate a novel automated vision-tracking method created under the parent grant. For this purpose, one US graduate and three US undergraduate students traveled to Greece for 4 months and worked together with 2 Greek graduate students of the local faculty collaborator. This team of students monitored project activities and scheduled data collection trips on a daily basis, setup a mobile video data collection lab on the back of a truck, and drove to various sites every day to collect hundreds of hours of video from multiple cameras on a large variety of activities ranging from soil excavation to bridge construction. The US students were underrepresented students from minority groups who had never visited a foreign country. As a result, this trip was a major life experience to them. They learned how to live in a non-English speaking country, communicate with Greek students, workers and engineers. They lead a project in a very unfamiliar environment, troubleshoot myriad problems that hampered their progress daily and, above all, how to collaborate effectively and efficiently with other cultures. They returned to the US more mature, with improved leadership and problem-solving skills and a wider perspective of their profession.

Three-Dimensional Tracking of Construction Resources using an On-Site Camera System

Vision trackers have been proposed as a promising alternative for tracking at large-scale, congested construction sites. They provide the location of a large number of entities in a camera view across frames. However, vision trackers provide only two-dimensional (2D) pixel coordinates, which are not adequate for construction applications. This paper proposes and validates a method that overcomes this limitation by employing stereo cameras and converting 2D pixel coordinates to three-dimensional (3D) metric coordinates. The proposed method consists of four steps: camera calibration, camera pose estimation, 2D tracking, and triangulation. Given that the method employs fixed, calibrated stereo cameras with a long baseline, appropriate algorithms are selected for each step. Once the first two steps reveal camera system parameters, the third step determines 2D pixel coordinates of entities in subsequent frames. The 2D coordinates are triangulated on the basis of the camera system parameters to obtain 3D coordinates. The methodology presented in this paper has been implemented and tested with data collected from a construction site. The results demonstrate the suitability of this method for on-site tracking purposes.

Innovative Stereo Vision-Based Approach to Generate Dense Depth Map of Transportation Infrastructure

Three-dimensional (3-D) spatial data of a transportation infrastructure contain useful information for civil engineering applications, including as-built documentation, on-site safety enhancements, and progress monitoring. Several techniques have been developed for acquiring 3-D point coordinates of infrastructure, such as laser scanning. Although the method yields accurate results, the high device costs and human effort required render the process infeasible for generic applications in the construction industry. A quick and reliable approach, which is based on the principles of stereo vision, is proposed for generating a depth map of an infrastructure. Initially, two images are captured by two similar stereo cameras at the scene of the infrastructure. A Harris feature detector is used to extract feature points from the first view, and an innovative adaptive window-matching technique is used to compute feature point correspondences in the second view. A robust algorithm computes the nonfeature point correspondences. Thus, the correspondences of all the points in the scene are obtained. After all correspondences have been obtained, the geometric principles of stereo vision are used to generate a dense depth map of the scene. The proposed algorithm has been tested on several data sets, and results illustrate its potential for stereo correspondence and depth map generation.

Automated On-Site Retrieval of Project Information

Among several others, the on-site inspection process is mainly concerned with finding the right design and specifications information needed to inspect each newly constructed segment or element. While inspecting steel erection, for example, inspectors need to locate the right drawings for each member and the corresponding specifications sections that describe the allowable deviations in placement among others. These information seeking tasks are highly monotonous, time consuming and often erroneous, due to the high similarity of drawings and constructed elements and the abundance of information involved which can confuse the inspector. To address this problem, this paper presents the first steps of research that is investigating the requirements of an automated computer vision-based approach to automatically identify “as-built” information and use it to retrieve “as-designed” project information for field construction, inspection, and maintenance tasks. Under this approach, a visual pattern recognition model was developed that aims to allow automatic identification of construction entities and materials visible in the camera’s field of view at a given time and location, and automatic retrieval of relevant design and specifications information.

Material-Based Construction Site Image Retrieval

The technological advancements in digital imaging, the widespread popularity of digital cameras, and the increasing demand by owners and contractors for detailed and complete site photograph logs have triggered an ever-increasing growth in the rate of construction image data collection, with thousands of images being stored for each project. However, the sheer volume of images and the difficulties in accurately and manually indexing them have generated a pressing need for methods that can index and retrieve images with minimal or no user intervention. This paper reports recent developments from research efforts in the indexing and retrieval of construction site images in architecture, engineering, construction, and facilities management image database systems. The limitations and benefits of the existing methodologies will be presented, as well as an explanation of the reasons for the development of a novel image retrieval approach that not only can recognize construction materials within the image content in order to index images, but also can be compatible with existing retrieval methods, enabling enhanced results.

Content-Based Search Engines for Construction Image Databases

Images represent a valuable source of information for the construction industry. Due to technological advancements in digital imaging, the increasing use of digital cameras is leading to an ever-increasing volume of images being stored in construction image databases and thus makes it hard for engineers to retrieve useful information from them. Content-Based Search Engines are tools that utilize the rich image content and apply pattern recognition methods in order to retrieve similar images. In this paper, we illustrate several project management tasks and show how Content-Based Search Engines can facilitate automatic retrieval, and indexing of construction images in image databases.

Mechanisms of projectile penetration in Dyneema® encapsulated aluminum structures

Polymer composites comprising ultra-high molecular weight polyethylene (UHWMPE) fibers in a compliant matrix are now widely used in ballistic applications with varying levels of success. This is primarily due to a poor understanding of the mechanics of penetration of these composites in ballistic protection systems. In this study, we report experimental observations of the penetration mechanisms in four model systems impacted by a 12.7 mm diameter spherical steel projectile. The four model targets designed to highlight different penetration mechanisms in Dyneema® UHWMPE composites were: (i) a bare aluminum plate; (ii) the same plate fully encased in a 5.9 mm thick casing of Dyneema®; (iii) the fully encased plate with a portion of the Dyneema® removed from the front face so that the projectile impacts directly the Al plate; and (iv) the fully encased plate with a portion of the Dyneema® removed from the rear face so that the projectile can exit the Al plate without again interacting with the Dyneema®. A combination of synchronized high speed photography with three cameras, together with post-test examination of the targets via X-ray tomography and optical microscopy was used to elucidate the deformation and perforation mechanisms. The measurements show that the ballistic resistance of these targets increases in the order: bare Al plate, rear face cutout target, fully encased target and front face cutout target. These findings are explained based on the following key findings: (a) the ballistic performance of Dyneema® plates supported on a foundation is inferior to Dyneema® plates supported along their edges; (b) the apparent ballistic resistance of Dyneema® plates increases if the plates are given an initial velocity prior to the impact by the projectile, thereby reducing the relative velocity between the Dyneema® plate and projectile; and (c) when the projectile is fragmented prior to impact, the spatially and temporally distributed loading enhances the ballistic resistance of the Dyneema®. The simple model targets designed here have elucidated mechanisms by which Dyneema® functions in multi-material structures. © 2014 Elsevier Ltd.

SLP: A zero-contact non-invasive method for pulmonary function testing

Structured Light Plethysmography (SLP) is a novel non-invasive method that uses structured light to perform pulmonary function testing that does not require physical contact with a patient. The technique produces an estimate of chest wall volume changes over time. A patient is observed continuously by two cameras and a known pattern of light (i.e. structured light) is projected onto the chest using an off-the-shelf projector. Corner features from the projected light pattern are extracted, tracked and brought into correspondence for both camera views over successive frames. A novel self calibration algorithm recovers the intrinsic and extrinsic camera parameters from these point correspondences. This information is used to reconstruct a surface approximation of the chest wall and several novel ideas for 'cleaning up' the reconstruction are used. The resulting volume and derived statistics (e.g. FVC, FEV) agree very well with data taken with a spirometer. © 2010. The copyright of this document resides with its authors.

基于双目视觉的运动物体实时跟踪与测距

利用双目视觉信息系统实现三维空间中运动物体实时跟踪与测距。当运动目标超出视野范围时,可通过控制摄像机云台转动搜索目标。此外,还研究了在摄像头运动情况下,无需重新标定,即可实现运动物体测距的算法。这里,自适应背景建模法与CamShift算法用于实现运动物体的辨识与跟踪。实验结果证明了所提出的算法能够有效地追踪物体,并同时准确地测量它的三维位置。

基于非线性修正的多线阵像机的空间定位

介绍了一种基于多线阵像机构成的视觉空间定位系统.该系统利用线阵像机的快速性与高分辨率的特点,采用了非平行空间投影面相交定位的基本原理,利用几何投影关系定位求解的方法,实现了多线阵像机视觉系统的空间定位.并提出了多线阵像机的神经网络非线性修正方法,使修正后的PSD能在较宽的位置范围内输出高线性度的信号.实验结果表明,基于非线性修正的多线阵像机位姿测量系统简化了立体视觉空间定位计算的复杂性,在定位精度、定位范围和采样速度上均达到了良好效果.

轮式移动宜人机器人技术研究

轮式移动宜人机器人项目研究的主要目的是开发自主式仿人机器人样机 ,探索先进的机器人理论和技术。轮式移动宜人机器人由正交轮式移动平台、腰部、躯干及头部和双臂组成 ,共 2 1个自由度。整体结构包括 :电源系统、机械系统、控制系统和传感系统。电源系统采用车载电池供电。机械系统包括变刚度结构 ,提高了机器人与人交互作业的安全性。控制系统分为中央协调层和执行层结构。传感系统主要实现关节位置检测、姿态检测、力检测和视觉。文章讨论了此机器人的研究进展。

一种基于神经网络的视觉定位系统

本文提出了一种基于人工神经网络的多线阵相机系统标定与 3D定位方法 ,并应用于基于多线阵相机构成的视觉空间定位系统 .该视觉定位系统利用了线阵相机的快速性与高分辨率的特点 ,非平行空间投影面相交定位的基本原理 ,实现了这种结构下快速、高精度空间定位 .实验表明 ,人工神经网络的定位方法简化了多线阵视觉定位系统标定与定位计算的复杂性 ,在定位精度上达到了良好效果 .为机器人位置反馈控制提供了有效的技术途径

ROV模糊控制导航方法

本文提出一种水下 ROV(Remotely Operated Vehicles)的模糊导航方法和基于该方法的控制器结构 .通常由于水下环境光照不足或是水质混浊 ,很难依赖摄像机准确地为 ROV导航 ,引导 ROV到达预定目标 ,尤其是工作空间存在障碍物时 ,ROV很可能发生碰撞 .文中提出的模糊控制方法 ,将 ROV在 3D空间运动的状态、局部环境信息以及导航规划数据表示为多重模糊条件 ,然后结合 ROV的导航特点 ,建立了一个三级模糊控制器 ,该控制器使用同一种控制模式完成 ROV有障碍和无障碍的导航任务 .仿真实验结果验证了所提出方法的有效性