Image-based delineation and classification of built heritage masonry

[EN]Fundación Zain is developing new built heritage assessment protocols. The goal is to objectivize and standardize the analysis and decision process that leads to determining the degree of protection of built heritage in the Basque Country. The ultimate step in this objectivization and standardization effort will be the development of an information and communication technology (ICT) tool for the assessment of built heritage. This paper presents the ground work carried out to make this tool possible: the automatic, image-based delineation of stone masonry. This is a necessary first step in the development of the tool, as the built heritage that will be assessed consists of stone masonry construction, and many of the features analyzed can be characterized according to the geometry and arrangement of the stones. Much of the assessment is carried out through visual inspection. Thus, this process will be automated by applying image processing on digital images of the elements under inspection. The principal contribution of this paper is the automatic delineation the framework proposed. The other contribution is the performance evaluation of this delineation as the input to a classifier for a geometrically characterized feature of a built heritage object. The element chosen to perform this evaluation is the stone arrangement of masonry walls. The validity of the proposed framework is assessed on real images of masonry walls.

Wireless parylene-based retinal implant

The degeneration of the outer retina usually causes blindness by affecting the photoreceptor cells. However, the ganglion cells, which consist of optic nerves, on the middle and inner retina layers are often intact. The retinal implant, which can partially restore vision by electrical stimulation, soon becomes a focus for research. Although many groups worldwide have spent a lot of effort on building devices for retinal implant, current state-of-the-art technologies still lack a reliable packaging scheme for devices with desirable high-density multi-channel features. Wireless flexible retinal implants have always been the ultimate goal for retinal prosthesis. In this dissertation, the reliable packaging scheme for a wireless flexible parylene-based retinal implants has been well developed. It can not only provide stable electrical and mechanical connections to the high-density multi-channel (1000+ channels on 5 mm × 5 mm chip area) IC chips, but also survive for more than 10 years in the human body with corrosive fluids.

The device is based on a parylene-metal-parylene sandwich structure. In which, the adhesion between the parylene layers and the metals embedded in the parylene layers have been studied. Integration technology for high-density multi-channel IC chips has also been addressed and tested with dummy and real 268-channel and 1024-channel retinal IC chips. In addition, different protection schemes have been tried in application to IC chips and discrete components to gain the longest lifetime. The effectiveness has been confirmed by the accelerated and active lifetime soaking test in saline solution. Surgical mockups have also been designed and successfully implanted inside dog's and pig's eyes. Additionally, the electrodes used to stimulate the ganglion cells have been modified to lower the interface impedance and shaped to better fit the retina. Finally, all the developed technologies have been applied on the final device with a dual-metal-layer structure.

SteelConverter and Caltech VirtualShaker: Rapid Nonlinear Cloud-Based Structural Model Conversion and Analysis

STEEL, the Caltech created nonlinear large displacement analysis software, is currently used by a large number of researchers at Caltech. However, due to its complexity, lack of visualization tools (such as pre- and post-processing capabilities) rapid creation and analysis of models using this software was difficult. SteelConverter was created as a means to facilitate model creation through the use of the industry standard finite element solver ETABS. This software allows users to create models in ETABS and intelligently convert model information such as geometry, loading, releases, fixity, etc., into a format that STEEL understands. Models that would take several days to create and verify now take several hours or less. The productivity of the researcher as well as the level of confidence in the model being analyzed is greatly increased.

It has always been a major goal of Caltech to spread the knowledge created here to other universities. However, due to the complexity of STEEL it was difficult for researchers or engineers from other universities to conduct analyses. While SteelConverter did help researchers at Caltech improve their research, sending SteelConverter and its documentation to other universities was less than ideal. Issues of version control, individual computer requirements, and the difficulty of releasing updates made a more centralized solution preferred. This is where the idea for Caltech VirtualShaker was born. Through the creation of a centralized website where users could log in, submit, analyze, and process models in the cloud, all of the major concerns associated with the utilization of SteelConverter were eliminated. Caltech VirtualShaker allows users to create profiles where defaults associated with their most commonly run models are saved, and allows them to submit multiple jobs to an online virtual server to be analyzed and post-processed. The creation of this website not only allowed for more rapid distribution of this tool, but also created a means for engineers and researchers with no access to powerful computer clusters to run computationally intensive analyses without the excessive cost of building and maintaining a computer cluster.

In order to increase confidence in the use of STEEL as an analysis system, as well as verify the conversion tools, a series of comparisons were done between STEEL and ETABS. Six models of increasing complexity, ranging from a cantilever column to a twenty-story moment frame, were analyzed to determine the ability of STEEL to accurately calculate basic model properties such as elastic stiffness and damping through a free vibration analysis as well as more complex structural properties such as overall structural capacity through a pushover analysis. These analyses showed a very strong agreement between the two softwares on every aspect of each analysis. However, these analyses also showed the ability of the STEEL analysis algorithm to converge at significantly larger drifts than ETABS when using the more computationally expensive and structurally realistic fiber hinges. Following the ETABS analysis, it was decided to repeat the comparisons in a software more capable of conducting highly nonlinear analysis, called Perform. These analyses again showed a very strong agreement between the two softwares in every aspect of each analysis through instability. However, due to some limitations in Perform, free vibration analyses for the three story one bay chevron brace frame, two bay chevron brace frame, and twenty story moment frame could not be conducted. With the current trend towards ultimate capacity analysis, the ability to use fiber based models allows engineers to gain a better understanding of a building’s behavior under these extreme load scenarios.

Following this, a final study was done on Hall’s U20 structure [1] where the structure was analyzed in all three softwares and their results compared. The pushover curves from each software were compared and the differences caused by variations in software implementation explained. From this, conclusions can be drawn on the effectiveness of each analysis tool when attempting to analyze structures through the point of geometric instability. The analyses show that while ETABS was capable of accurately determining the elastic stiffness of the model, following the onset of inelastic behavior the analysis tool failed to converge. However, for the small number of time steps the ETABS analysis was converging, its results exactly matched those of STEEL, leading to the conclusion that ETABS is not an appropriate analysis package for analyzing a structure through the point of collapse when using fiber elements throughout the model. The analyses also showed that while Perform was capable of calculating the response of the structure accurately, restrictions in the material model resulted in a pushover curve that did not match that of STEEL exactly, particularly post collapse. However, such problems could be alleviated by choosing a more simplistic material model.

Development of a Cationic Mucic Acid Polymer-Based Nanoparticle siRNA Delivery System

Cancer chemotherapy has advanced from highly toxic drugs to more targeted treatments in the last 70 years. Chapter 1 opens with an introduction to targeted therapy for cancer. The benefits of using a nanoparticle to deliver therapeutics are discussed. We move on to siRNA in particular, and why it would be advantageous as a therapy. Specific to siRNA delivery are some challenges, such as nuclease degradation, quick clearance from circulation, needing to enter cells, and getting to the cytosol. We propose the development of a nanoparticle delivery system to tackle these challenges so that siRNA can be effective.

Chapter 2 of this thesis discusses the synthesis and analysis of a cationic mucic acid polymer (cMAP) which condenses siRNA to form a nanoparticle. Various methods to add polyethylene glycol (PEG) for stabilizing the nanoparticle in physiologic solutions, including using a boronic acid binding to diols on mucic acid, forming a copolymer of cMAP with PEG, and creating a triblock with mPEG on both ends of cMAP. The goal of these various pegylation strategies was to increase the circulation time of the siRNA nanoparticle in the bloodstream to allow more of the nanoparticle to reach tumor tissue by the enhanced permeation and retention effect. We found that the triblock mPEG-cMAP-PEGm polymer condensed siRNA to form very stable 30-40 nm particles that circulated for the longest time – almost 10% of the formulation remained in the bloodstream of mice 1 h after intravenous injection.

Chapter 3 explores the use of an antibody as a targeting agent for nanoparticles. Some antibodies of the IgG1 subtype are able to recruit natural killer cells that effect antibody dependent cellular cytotoxicity (ADCC) to kill the targeted cell to which the antibody is bound. There is evidence that the ADCC effect remains in antibody-drug conjugates, so we wanted to know whether the ADCC effect is preserved when the antibody is bound to a nanoparticle, which is a much larger and complex entity. We utilized antibodies against epidermal growth factor receptor with similar binding and pharmacokinetics, cetuximab and panitumumab, which differ in that cetuximab is an IgG1 and panitumumab is an IgG2 (which does not cause ADCC). Although a natural killer cell culture model showed that gold nanoparticles with a full antibody targeting agent can elicit target cell lysis, we found that this effect was not preserved in vivo. Whether this is due to the antibody not being accessible to immune cells or whether the natural killer cells are inactivated in a tumor xenograft remains unknown. It is possible that using a full antibody still has value if there are immune functions which are altered in a complex in vivo environment that are intact in an in vitro system, so the value of using a full antibody as a targeting agent versus using an antibody fragment or a protein such as transferrin is still open to further exploration.

In chapter 4, nanoparticle targeting and endosomal escape are further discussed with respect to the cMAP nanoparticle system. A diboronic acid entity, which gives an order of magnitude greater binding (than boronic acid) to cMAP due to the vicinal diols in mucic acid, was synthesized, attached to 5kD or 10kD PEG, and conjugated to either transferrin or cetuximab. A histidine was incorporated into the triblock polymer between cMAP and the PEG blocks to allow for siRNA endosomal escape. Nanoparticle size remained 30-40 nm with a slightly negative ca. -3 mV zeta potential with the triblock polymer containing histidine and when targeting agents were added. Greater mRNA knockdown was seen with the endosomal escape mechanism than without. The nanoparticle formulations were able to knock down the targeted mRNA in vitro. Mixed effects suggesting function were seen in vivo.

Chapter 5 summarizes the project and provides an outlook on siRNA delivery as well as targeted combination therapies for the future of personalized medicine in cancer treatment.

Image-Based Delineation and Classification of Built Heritage Masonry

Fundacion Zain is developing new built heritage assessment protocols. The goal is to objectivize and standardize the analysis and decision process that leads to determining the degree of protection of built heritage in the Basque Country. The ultimate step in this objectivization and standardization effort will be the development of an information and communication technology (ICT) tool for the assessment of built heritage. This paper presents the ground work carried out to make this tool possible: the automatic, image-based delineation of stone masonry. This is a necessary first step in the development of the tool, as the built heritage that will be assessed consists of stone masonry construction, and many of the features analyzed can be characterized according to the geometry and arrangement of the stones. Much of the assessment is carried out through visual inspection. Thus, this process will be automated by applying image processing on digital images of the elements under inspection. The principal contribution of this paper is the automatic delineation the framework proposed. The other contribution is the performance evaluation of this delineation as the input to a classifier for a geometrically characterized feature of a built heritage object. The element chosen to perform this evaluation is the stone arrangement of masonry walls. The validity of the proposed framework is assessed on real images of masonry walls.

Fabrication of diamond based schottky barrier diodes with oxide ramp termination

The paper's goal is the first demonstration of the fabrication of high power Schottky diodes on synthetic diamond using oxide ramp termination. In order to allow full activated impurities at room temperature and a high hole mobility a low boron doping of the drift layer is employed. Several aspects of the manufacturing technology are presented. A termination with a small ramp angle can be obtained using only RIE technique due to diamond wafer nonuniformity (roughness). Experimental forward and reverse characteristics measured on diamond diodes are also included. © 2007 IEEE.

Integrated conceptual ecosystem model development for the Florida Keys/Dry Tortugas coastal marine ecosystem: MARine Estuarine goal Setting (MARES) for South Florida

The overall goal of the MARine and Estuarine goal Setting (MARES) project for South Florida is “to reach a science-based consensus about the defining characteristics and fundamental regulating processes of a South Florida coastal marine ecosystem that is both sustainable and capable of providing the diverse ecosystem services upon which our society depends.” Through participation in a systematic process of reaching such a consensus, science can contribute more directly and effectively to the critical decisions being made by both policy makers and by natural resource and environmental management agencies. The document that follows briefly describes the MARES project and this systematic process. It then describes in considerable detail the resulting output from the first two steps in the process, the development of conceptual diagrams and an Integrated Conceptual Ecosystem Model (ICEM) for the first subregion to be addressed by MARES, the Florida Keys/Dry Tortugas (FK/DT). What follows with regard to the FK/DT is the input received from more than 60 scientists, agency resource managers, and representatives of environmental organizations beginning with a workshop held December 9-10, 2009 at Florida International University in Miami, Florida.

Integrated conceptual ecosystem model development for the southeast Florida coastal marine ecosystem: MARine Estuarine goal Setting (MARES) for South Florida

The overall goal of the MARES (MARine and Estuarine goal Setting) project for South Florida is “to reach a science-based consensus about the defining characteristics and fundamental regulating processes of a South Florida coastal marine ecosystem that is both sustainable and capable of providing the diverse ecosystem services upon which our society depends.” Through participation in a systematic process of reaching such a consensus, science can contribute more directly and effectively to the critical decisions being made both by policy makers and by natural resource and environmental management agencies. The document that follows briefly describes MARES overall and this systematic process. It then describes in considerable detail the resulting output from the first step in the process, the development of an Integrated Conceptual Ecosystem Model (ICEM) for the third subregion to be addressed by MARES, the Southeast Florida Coast (SEFC). What follows with regard to the SEFC relies upon the input received from more than 60 scientists, agency resource managers, and representatives of environmental organizations during workshops held throughout 2009–2012 in South Florida.

Integrated conceptual ecosystem model development for the southwest Florida shelf coastal marine ecosystem: MARine Estuarine goal Setting (MARES) for South Florida

The overall goal of the MARine and Estuarine goal Setting (MARES) project for South Florida is “to reach a science-based consensus about the defining characteristics and fundamental regulating processes of a South Florida coastal marine ecosystem that is both sustainable and capable of providing the diverse ecosystem services upon which our society depends.” Through participation in a systematic process of reaching such a consensus, science can contribute more directly and effectively to the critical decisions being made by both policy makers and by natural resource and environmental management agencies. The document that follows briefly describes the MARES project and this systematic process. It then describes in considerable detail the resulting output from the first two steps in the process, the development of conceptual diagrams and an Integrated Conceptual Ecosystem Model (ICEM) for the second subregion to be addressed by MARES, the Southwest Florida Shelf (SWFS). What follows with regard to the SWFS is the input received from more than 60 scientists, agency resource managers, and representatives of environmental organizations beginning with a workshop held August 19-20, 2010 at Florida Gulf Coast University in Fort Myers, Florida.

Effective handling of dialogue state in the hidden information state POMDP-based dialogue manager

Effective dialogue management is critically dependent on the information that is encoded in the dialogue state. In order to deploy reinforcement learning for policy optimization, dialogue must be modeled as a Markov Decision Process. This requires that the dialogue statemust encode all relevent information obtained during the dialogue prior to that state. This can be achieved by combining the user goal, the dialogue history, and the last user action to form the dialogue state. In addition, to gain robustness to input errors, dialogue must be modeled as a Partially Observable Markov Decision Process (POMDP) and hence, a distribution over all possible states must be maintained at every dialogue turn. This poses a potential computational limitation since there can be a very large number of dialogue states. The Hidden Information State model provides a principled way of ensuring tractability in a POMDP-based dialogue model. The key feature of this model is the grouping of user goals into partitions that are dynamically built during the dialogue. In this article, we extend this model further to incorporate the notion of complements. This allows for a more complex user goal to be represented, and it enables an effective pruning technique to be implemented that preserves the overall system performance within a limited computational resource more effectively than existing approaches. © 2011 ACM.

Toward automated generation of parametric BIMs based on hybrid video and laser scanning data

Only very few constructed facilities today have a complete record of as-built information. Despite the growing use of Building Information Modelling and the improvement in as-built records, several more years will be required before guidelines that require as-built data modelling will be implemented for the majority of constructed facilities, and this will still not address the stock of existing buildings. A technical solution for scanning buildings and compiling Building Information Models is needed. However, this is a multidisciplinary problem, requiring expertise in scanning, computer vision and videogrammetry, machine learning, and parametric object modelling. This paper outlines the technical approach proposed by a consortium of researchers that has gathered to tackle the ambitious goal of automating as-built modelling as far as possible. The top level framework of the proposed solution is presented, and each process, input and output is explained, along with the steps needed to validate them. Preliminary experiments on the earlier stages (i.e. processes) of the framework proposed are conducted and results are shown; the work toward implementation of the remainder is ongoing.

Comparison of Civil Infrastructure Optical-based Spatial Data Acquisition Techniques

Infrastructure spatial data, such as the orientation and the location of in place structures and these structures' boundaries and areas, play a very important role for many civil infrastructure development and rehabilitation applications, such as defect detection, site planning, on-site safety assistance and others. In order to acquire these data, a number of modern optical-based spatial data acquisition techniques can be used. These techniques are based on stereo vision, optics, time of flight, etc., and have distinct characteristics, benefits and limitations. The main purpose of this paper is to compare these infrastructure optical-based spatial data acquisition techniques based on civil infrastructure application requirements. In order to achieve this goal, the benefits and limitations of these techniques were identified. Subsequently, these techniques were compared according to applications' requirements, such as spatial accuracy, the automation of acquisition, the portability of devices and others. With the help of this comparison, unique characteristics of these techniques were identified so that practitioners will be able to select an appropriate technique for their own applications.

Comparison of Civil Infrastructure Optical-based Spatial Data Acquisition Techniques

Infrastructure spatial data, such as the orientation and the location of in place structures and these structures' boundaries and areas, play a very important role for many civil infrastructure development and rehabilitation applications, such as defect detection, site planning, on-site safety assistance and others. In order to acquire these data, a number of modern optical-based spatial data acquisition techniques can be used. These techniques are based on stereo vision, optics, time of flight, etc., and have distinct characteristics, benefits and limitations. The main purpose of this paper is to compare these infrastructure optical-based spatial data acquisition techniques based on civil infrastructure application requirements. In order to achieve this goal, the benefits and limitations of these techniques were identified. Subsequently, these techniques were compared according to applications' requirements, such as spatial accuracy, the automation of acquisition, the portability of devices and others. With the help of this comparison, unique characteristics of these techniques were identified so that practitioners will be able to select an appropriate technique for their own applications.

A body force-based method for prediction of multiple-pure-tone noise: Validation

Emissions, fuel burn, and noise are the main drivers for innovative aircraft design. Embedded propulsion systems, such as for example used in hybrid-wing body aircraft, can offer fuel burn and noise reduction benefits but the impact of inlet flow distortion on the generation and propagation of turbomachinery noise has yet to be assessed. A novel approach is used to quantify the effects of non-uniform flow on the creation and propagation of multiple pure tone (MPT) noise. The ultimate goal is to conduct a parametric study of S-duct inlets to quantify the effects of inlet design parameters on the acoustic signature. The key challenge is that the effects of distortion transfer, noise source generation and propagation through the non-uniform flow field are inherently coupled such that a simultaneous computation of the aerodynamics and acoustics is required to capture the mechanisms at play. The technical approach is based on a body force description of the fan blade row that is able to capture the distortion transfer and the blade-to-blade flow variations that cause the MPT noise while reducing computational cost. A single, 3-D full-wheel CFD simulation, in which the Euler equations are solved to second-order spatial and temporal accuracy, simultaneously computes the MPT noise generation and its propagation in distorted inlet flow. A new method of producing the blade-to-blade variations in the body force field for MPT noise generation has been developed and validated. The numerical dissipation inherent to the solver is quantified and used to correct for non-physical attenuation in the far-field noise spectra. Source generation, acoustic propagation and acoustic energy transfer between modes is examined in detail. The new method is validated on NASA's Source Diagnostic Test fan and inlet, showing good agreement with experimental data for aerodynamic performance, acoustic source generation, and far-field noise spectra. The next steps involve the assessment of MPT noise in serpentine inlet ducts and the development of a reduced order formulation suitable for incorporation into NASA's ANOPP framework. © 2010 by Jeff Defoe, Alex Narkaj & Zoltan Spakovszky.

Guided self-organization in a dynamic embodied system based on attractor selection mechanism

Guided self-organization can be regarded as a paradigm proposed to understand how to guide a self-organizing system towards desirable behaviors, while maintaining its non-deterministic dynamics with emergent features. It is, however, not a trivial problem to guide the self-organizing behavior of physically embodied systems like robots, as the behavioral dynamics are results of interactions among their controller, mechanical dynamics of the body, and the environment. This paper presents a guided self-organization approach for dynamic robots based on a coupling between the system mechanical dynamics with an internal control structure known as the attractor selection mechanism. The mechanism enables the robot to gracefully shift between random and deterministic behaviors, represented by a number of attractors, depending on internally generated stochastic perturbation and sensory input. The robot used in this paper is a simulated curved beam hopping robot: a system with a variety of mechanical dynamics which depends on its actuation frequencies. Despite the simplicity of the approach, it will be shown how the approach regulates the probability of the robot to reach a goal through the interplay among the sensory input, the level of inherent stochastic perturbation, i.e., noise, and the mechanical dynamics. © 2014 by the authors; licensee MDPI, Basel, Switzerland.