Visual Pattern Recognition Models for Remote Sensing of Civil Infrastructure

As-built models have been proven useful in many project-related applications, such as progress monitoring and quality control. However, they are not widely produced in most projects because a lot of effort is still necessary to manually convert remote sensing data from photogrammetry or laser scanning to an as-built model. In order to automate the generation of as-built models, the first and fundamental step is to automatically recognize infrastructure-related elements from the remote sensing data. This paper outlines a framework for creating visual pattern recognition models that can automate the recognition of infrastructure-related elements based on their visual features. The framework starts with identifying the visual characteristics of infrastructure element types and numerically representing them using image analysis tools. The derived representations, along with their relative topology, are then used to form element visual pattern recognition (VPR) models. So far, the VPR models of four infrastructure-related elements have been created using the framework. The high recognition performance of these models validates the effectiveness of the framework in recognizing infrastructure-related elements.

Innovative Stereo Vision-Based Approach to Generate Dense Depth Map of Transportation Infrastructure

Three-dimensional (3-D) spatial data of a transportation infrastructure contain useful information for civil engineering applications, including as-built documentation, on-site safety enhancements, and progress monitoring. Several techniques have been developed for acquiring 3-D point coordinates of infrastructure, such as laser scanning. Although the method yields accurate results, the high device costs and human effort required render the process infeasible for generic applications in the construction industry. A quick and reliable approach, which is based on the principles of stereo vision, is proposed for generating a depth map of an infrastructure. Initially, two images are captured by two similar stereo cameras at the scene of the infrastructure. A Harris feature detector is used to extract feature points from the first view, and an innovative adaptive window-matching technique is used to compute feature point correspondences in the second view. A robust algorithm computes the nonfeature point correspondences. Thus, the correspondences of all the points in the scene are obtained. After all correspondences have been obtained, the geometric principles of stereo vision are used to generate a dense depth map of the scene. The proposed algorithm has been tested on several data sets, and results illustrate its potential for stereo correspondence and depth map generation.

Comparison of Camera Motion Estimation Methods for 3D Reconstruction of Infrastructure

Camera motion estimation is one of the most significant steps for structure-from-motion (SFM) with a monocular camera. The normalized 8-point, the 7-point, and the 5-point algorithms are normally adopted to perform the estimation, each of which has distinct performance characteristics. Given unique needs and challenges associated to civil infrastructure SFM scenarios, selection of the proper algorithm directly impacts the structure reconstruction results. In this paper, a comparison study of the aforementioned algorithms is conducted to identify the most suitable algorithm, in terms of accuracy and reliability, for reconstructing civil infrastructure. The free variables tested are baseline, depth, and motion. A concrete girder bridge was selected as the "test-bed" to reconstruct using an off-the-shelf camera capturing imagery from all possible positions that maximally the bridge's features and geometry. The feature points in the images were extracted and matched via the SURF descriptor. Finally, camera motions are estimated based on the corresponding image points by applying the aforementioned algorithms, and the results evaluated.

Generating the Sparse Point Cloud of a Civil Infrastructure Scene Using a Single Video Camera under Practical Constraints

Automating the model generation process of infrastructure can substantially reduce the modeling time and cost. This paper presents a method to generate a sparse point cloud of an infrastructure scene using a single video camera under practical constraints. It is the first step towards establishing an automatic framework for object-oriented as-built modeling. Motion blur and key frame selection criteria are considered. Structure from motion and bundle adjustment are explored. The method is demonstrated in a case study where the scene of a reinforced concrete bridge is videotaped, reconstructed, and metrically validated. The result indicates the applicability, efficiency, and accuracy of the proposed method.

Detection of Construction Workers in Video Frames for Automatic Initialization of Vision Trackers

Vision based tracking can provide the spatial location of construction entities such as equipment, workers, and materials in large scale, congested construction sites. It tracks entities in video streams by inferring their locations based on the entities’ visual features and motion histories. To initiate the process, it is necessary to determine the pixel areas corresponding to the construction entities to be tracked in the following consecutive video frames. In order to fully automate the process, an automated way of initialization is needed. This paper presents the method for construction worker detection which can automatically recognize and localize construction workers in video frames. The method first finds the foreground areas of moving objects using a background subtraction method. Within these foreground areas, construction workers are recognized based on the histogram of oriented gradients (HOG) and histogram of the HSV colors. HOG’s have proved to work effectively for detection of people, and the histogram of HSV colors helps differentiate between pedestrians and construction workers wearing safety vests. Preliminary experiments show that the proposed method has the potential to automate the initialization process of vision based tracking.

Comparison of Image-Based and Time-of-Flight-Based Technologies for 3D Reconstruction of Infrastructure

Image-based (i.e., photo/videogrammetry) and time-of-flight-based (i.e., laser scanning) technologies are typically used to collect spatial data of infrastructure. In order to help architecture, engineering, and construction (AEC) industries make cost-effective decisions in selecting between these two technologies with respect to their settings, this paper makes an attempt to measure the accuracy, quality, time efficiency, and cost of applying image-based and time-of-flight-based technologies to conduct as-built 3D reconstruction of infrastructure. In this paper, a novel comparison method is proposed, and preliminary experiments are conducted. The results reveal that if the accuracy and quality level desired for a particular application is not high (i.e., error < 10 cm, and completeness rate > 80%), image-based technologies constitute a good alternative for time-of-flight-based technologies and significantly reduce the time and cost needed for collecting the data on site.

Content Based Integration of Construction Site Images in Architecture, Engineering, Construction, and Facilities Management (AEC/FM) Model based Systems

This book explores the processes for retrieval, classification, and integration of construction images in AEC/FM model based systems. The author describes a combination of techniques from the areas of image and video processing, computer vision, information retrieval, statistics and content-based image and video retrieval that have been integrated into a novel method for the retrieval of related construction site image data from components of a project model. This method has been tested on available construction site images from a variety of sources like past and current building construction and transportation projects and is able to automatically classify, store, integrate and retrieve image data files in inter-organizational systems so as to allow their usage in project management related tasks. objects. Therefore, automated methods for the integration of construction images are important for construction information management. During this research, processes for retrieval, classification, and integration of construction images in AEC/FM model based systems have been explored. Specifically, a combination of techniques from the areas of image and video processing, computer vision, information retrieval, statistics and content-based image and video retrieval have been deployed in order to develop a methodology for the retrieval of related construction site image data from components of a project model. This method has been tested on available construction site images from a variety of sources like past and current building construction and transportation projects and is able to automatically classify, store, integrate and retrieve image data files in inter-organizational systems so as to allow their usage in project management related tasks.

Comprehensive Property Retrieval and Measurement of Concrete Spalling Using Machine Vision for Post-Earthquake Safety Assessments

Active vibration control (AVC) is a relatively new technology for the mitigation of annoying human-induced vibrations in floors. However, recent technological developments have demonstrated its great potential application in this field. Despite this, when a floor is found to have problematic floor vibrations after construction the unfamiliar technology of AVC is usually avoided in favour of more common techniques, such as Tuned Mass Dampers (TMDs) which have a proven track record of successful application, particularly for footbridges and staircases. This study aims to investigate the advantages and disadvantages that AVC has, when compared with TMDs, for the application of mitigation of pedestrian-induced floor vibrations in offices. Simulations are performed using the results from a finite element model of a typical office layout that has a high vibration response level. The vibration problems on this floor are then alleviated through the use of both AVC and TMDs and the results of each mitigation configuration compared. The results of this study will enable a more informed decision to be made by building owners and structural engineers regarding suitable technologies for reducing floor vibrations.

Modelling and Fragility Analysis of Non-Ductile Reinforced Concrete Buildings in Low-to-Moderate Seismic Zones

Reinforced concrete buildings in low-to-moderate seismic zones are often designed only for gravity loads in accordance with the non-seismic detailing provisions. Deficient detailing of columns and beam-column joints can lead to unpredictable brittle failures even under moderate earthquakes. Therefore, a reliable estimate of structural response is required for the seismic evaluation of these structures. For this purpose, analytical models for both interior and exterior slab-beam-column subassemblages and for a 1/3 scale model frame were implemented into the nonlinear finite element platform OpenSees. Comparison between the analytical results and experimental data available in the literature is carried out using nonlinear pushover analyses and nonlinear time history analysis for the subassemblages and the model frame, respectively. Furthermore, the seismic fragility assessment of reinforced concrete buildings is performed on a set of non-ductile frames using nonlinear time history analyses. The fragility curves, which are developed for various damage states for the maximum interstory drift ratio are characterized in terms of peak ground acceleration and spectral acceleration using a suite of ground motions representative of the seismic hazard in the region.

Transcriptome of embryonic and neonatal mouse cortex by high-throughput RNA sequencing

Brain structure and function experience dramatic changes from embryonic to postnatal development. Microarray analyses have detected differential gene expression at different stages and in disease models, but gene expression information during early brain development is limited. We have generated >27 million reads to identify mRNAs from the mouse cortex for>16,000 genes at either embryonic day 18 (E18) or postnatal day 7 (P7), a period of significant synapto-genesis for neural circuit formation. In addition, we devised strategies to detect alternative splice forms and uncovered more splice variants. We observed differential expression of 3,758 genes between the 2 stages, many with known functions or predicted to be important for neural development. Neurogenesis-related genes, such as those encoding Sox4, Sox11, and zinc-finger proteins, were more highly expressed at E18 than at P7. In contrast, the genes encoding synaptic proteins such as synaptotagmin, complexin 2, and syntaxin were up-regulated from E18 to P7. We also found that several neurological disorder-related genes were highly expressed at E18. Our transcriptome analysis may serve as a blueprint for gene expression pattern and provide functional clues of previously unknown genes and disease-related genes during early brain development.

Extraordinarily thick-boned fish linked to the aridification of the Qaidam Basin (northern Tibetan Plateau)

Scattered with numerous salt lakes and approximate to 2,700-3,200 m above sea level, the giant Qaidam inland basin on the northern Tibetan Plateau has experienced continuing aridification since the beginning of the Late Cenozoic as a result of the India-Asia plate collision and associated uplift of the Tibetan Plateau. Previous evidence of aridification comes mainly from evaporite deposits and salinity-tolerant invertebrate fossils. Vertebrate fossils were rare until recent discoveries of abundant fish. Here, we report an unusual cyprinid fish, Hsianwenia wui, gen. et sp. nov., from Pliocene lake deposits of the Qaidam Basin, characterized by an extraordinarily thick skeleton that occupied almost the entire body. Such enormous skeletal thickening, apparently leaving little room for muscles, is unknown among extant fish. However, an almost identical condition occurs in the much smaller cyprinodontid Aphanius crassicaudus (Cyprinodonyiformes), collected from evaporites exposed along the northern margins of the Mediterranean Sea during the Messinian desiccation period. H. wui and A. crassicaudus both occur in similar deposits rich in carbonates (CaCO3) and sulfates (CaSO4), indicating that both were adapted to the extreme conditions resulting from the ariclification in the two areas. The overall skeletal thickening was most likely formed through deposition of the oversaturated calcium and was apparently a normal feature of the biology and growth of these fish.

Establishment of a normal medakafish spermatogonial cell line capable of sperm production in vitro

Spermatogonia are the male germ stem cells that continuously produce sperm for the next generation. Spermatogenesis is a complicated process that proceeds through mitotic phase of stem cell renewal and differentiation, meiotic phase, and postmeiotic phase of spermiogenesis. Full recapitulation of spermatogenesis in vitro has been impossible, as generation of normal spermatogonial stem cell lines without immortalization and production of motile sperm from these cells after long-term culture have not been achieved. Here we report the derivation of a normal spermatogonial cell line from a mature medakafish testis without immortalization. After 140 passages during 2 years of culture, this cell line retains stable but growth factor-dependent proliferation, a diploid karyotype, and the phenotype and gene expression pattern of spermatogonial stem cells. Furthermore, we show that this cell line can undergo meiosis and spermiogenesis to generate motile sperm. Therefore, the ability of continuous proliferation and sperm production in culture is an intrinsic property of medaka spermatogonial stem cells, and immortalization apparently is not necessary to derive male germ cell cultures. Our findings and cell line will offer a unique opportunity to study and recapitulate spermatogenesis in vitro and to develop approaches for germ-line transmission.