Achievements and challenges in machine vision-based inspection of large concrete structures

Large concrete structures need to be inspected in order to assess their current physical and functional state, to predict future conditions, to support investment planning and decision making, and to allocate limited maintenance and rehabilitation resources. Current procedures in condition and safety assessment of large concrete structures are performed manually leading to subjective and unreliable results, costly and time-consuming data collection, and safety issues. To address these limitations, automated machine vision-based inspection procedures have increasingly been proposed by the research community. This paper presents current achievements and open challenges in vision-based inspection of large concrete structures. First, the general concept of Building Information Modeling is introduced. Then, vision-based 3D reconstruction and as-built spatial modeling of concrete civil infrastructure are presented. Following that, the focus is set on structural member recognition as well as on concrete damage detection and assessment exemplified for concrete columns. Although some challenges are still under investigation, it can be concluded that vision-based inspection methods have significantly improved over the last 10 years, and now, as-built spatial modeling as well as damage detection and assessment of large concrete structures have the potential to be fully automated.

Microfabricated tissue gauges to measure and manipulate forces from 3D microtissues

Physical forces generated by cells drive morphologic changes during development and can feedback to regulate cellular phenotypes. Because these phenomena typically occur within a 3-dimensional (3D) matrix in vivo, we used microelectromechanical systems (MEMS) technology to generate arrays of microtissues consisting of cells encapsulated within 3D micropatterned matrices. Microcantilevers were used to simultaneously constrain the remodeling of a collagen gel and to report forces generated during this process. By concurrently measuring forces and observing matrix remodeling at cellular length scales, we report an initial correlation and later decoupling between cellular contractile forces and changes in tissue morphology. Independently varying the mechanical stiffness of the cantilevers and collagen matrix revealed that cellular forces increased with boundary or matrix rigidity whereas levels of cytoskeletal and extracellular matrix (ECM) proteins correlated with levels of mechanical stress. By mapping these relationships between cellular and matrix mechanics, cellular forces, and protein expression onto a bio-chemo-mechanical model of microtissue contractility, we demonstrate how intratissue gradients of mechanical stress can emerge from collective cellular contractility and finally, how such gradients can be used to engineer protein composition and organization within a 3D tissue. Together, these findings highlight a complex and dynamic relationship between cellular forces, ECM remodeling, and cellular phenotype and describe a system to study and apply this relationship within engineered 3D microtissues.

3D thermo-electro-mechanical simulations of gas sensors based on SOI membranes

3D thermo-electro-mechanical device simulations are presented of a novel fully CMOS-compatible MOSFET gas sensor operating in a SOI membrane. A comprehensive stress analysis of a Si-SiO2-based multilayer membrane has been performed to ensure a high degree of mechanical reliability at a high operating temperature (e.g. up to 400°C). Moreover, optimisation of the layout dimensions of the SOI membrane, in particular the aspect ratio between the membrane length and membrane thickness, has been carried out to find the best trade-off between minimal device power consumption and acceptable mechanical stress.

Curvature and wrinkling of premixed flame Kernels comparison between planar laser induced fluorescence (PLIF) and 3D direct numerical simulations (DNS)

A direct comparison between time resolved PLIF measurements of OH and two dimensional slices from a full three dimensional DNS data set of turbulent premixed flame kernels in lean methane/air mixture was presented. The local flame structure and the degree of flame wrinkling were examined in response to differing turbulence intensities and turbulent Reynolds numbers. Simulations were performed using the SEGA DNS code, which is based on the solution of the compressible Navier Stokes, species, and energy equations for a lean hydrocarbon mixture. For the OH PLIF measurements, a cluster of four Nd:YAG laser was fired sequentially at high repetition rates and used to pump a dye laser. The frequency doubled laser beam was formed into a sheet of 40 mm height using a cylindrical telescope. The combination of PLIF and DNS has been demonstrated as a powerful tool for flame analysis. This research will form the basis for the development of sub-grid-scale (SGS) models for LES of lean-premixed combustion systems such as gas turbines. This is an abstract of a paper presented at the 30th International Symposium on Combustion (Chicago, IL 7/25-30/2004).

Building the perfect 3D hologram

A new liquid crystal device structure has been developed using a vertically grown Multi-Wall Carbon NanoTube (MWCNT) as a 3D electrode structure, which allows complicated phase only hologram to be displayed using conventional liquid crystal materials. The nanotubes act as an individual electrode sites that generate an electric field profile, dictating the refractive index profile with the liquid crystal cell. Changing the electric field applied makes it possible to tune the properties to modulate the light in an ideal kinoform. A perfect 3D image can be generated by a computer generated hologram by using the diffraction of the light from the hologram pixels to create an optical wave front that appears to come from 3D object. A multilevel phase modulating device based on nematic LC's is also under progress, which will be used with the LC/CNT devices on an LCOS backplane to project a full 3D image from the kinoform.

Field of view expansion for 3-D holographic display using a single spatial light modulator with scanning reconstruction light

Increasing the field of view of a holographic display while maintaining adequate image size is a difficult task. To address this problem, we designed a system that tessellates several sub-holograms into one large hologram at the output. The sub-holograms we generate is similar to a kinoform but without the paraxial approximation during computation. The sub-holograms are loaded onto a single spatial light modulator consecutively and relayed to the appropriate position at the output through a combination of optics and scanning reconstruction light. We will review the method of computer generated hologram and describe the working principles of our system. Results from our proof-of-concept system are shown to have an improved field of view and reconstructed image size. ©2009 IEEE.

Coarse-to-fine vision-based localization by indexing scale-invariant features

This paper presents a novel coarse-to-fine global localization approach inspired by object recognition and text retrieval techniques. Harris-Laplace interest points characterized by scale-invariant transformation feature descriptors are used as natural landmarks. They are indexed into two databases: a location vector space model (LVSM) and a location database. The localization process consists of two stages: coarse localization and fine localization. Coarse localization from the LVSM is fast, but not accurate enough, whereas localization from the location database using a voting algorithm is relatively slow, but more accurate. The integration of coarse and fine stages makes fast and reliable localization possible. If necessary, the localization result can be verified by epipolar geometry between the representative view in the database and the view to be localized. In addition, the localization system recovers the position of the camera by essential matrix decomposition. The localization system has been tested in indoor and outdoor environments. The results show that our approach is efficient and reliable. © 2006 IEEE.

Vision-based global localization using a visual vocabular

This paper presents a novel coarse-to-fine global localization approach that is inspired by object recognition and text retrieval techniques. Harris-Laplace interest points characterized by SIFT descriptors are used as natural land-marks. These descriptors are indexed into two databases: an inverted index and a location database. The inverted index is built based on a visual vocabulary learned from the feature descriptors. In the location database, each location is directly represented by a set of scale invariant descriptors. The localization process consists of two stages: coarse localization and fine localization. Coarse localization from the inverted index is fast but not accurate enough; whereas localization from the location database using voting algorithm is relatively slow but more accurate. The combination of coarse and fine stages makes fast and reliable localization possible. In addition, if necessary, the localization result can be verified by epipolar geometry between the representative view in database and the view to be localized. Experimental results show that our approach is efficient and reliable. ©2005 IEEE.