POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.

Use of a 3D perfusion bioreactor with osteoblasts and osteoblast/endothelial cell co-cultures to improve tissue-engineered bone

The delivery of oxygen, nutrients, and the removal of waste are essential for cellular survival. Culture systems for 3D bone tissue engineering have addressed this issue by utilizing perfusion flow bioreactors that stimulate osteogenic activity through the delivery of oxygen and nutrients by low-shear fluid flow. It is also well established that bone responds to mechanical stimulation, but may desensitize under continuous loading. While perfusion flow and mechanical stimulation are used to increase cellular survival in vitro, 3D tissue-engineered constructs face additional limitations upon in vivo implantation. As it requires significant amounts of time for vascular infiltration by the host, implants are subject to an increased risk of necrosis. One solution is to introduce tissue-engineered bone that has been pre-vascularized through the co-culture of osteoblasts and endothelial cells on 3D constructs. It is unclear from previous studies: 1) how 3D bone tissue constructs will respond to partitioned mechanical stimulation, 2) how gene expression compares in 2D and in 3D, 3) how co-cultures will affect osteoblast activity, and 4) how perfusion flow will affect co-cultures of osteoblasts and endothelial cells. We have used an integrated approach to address these questions by utilizing mechanical stimulation, perfusion flow, and a co-culture technique to increase the success of 3D bone tissue engineering. We measured gene expression of several osteogenic and angiogenic genes in both 2D and 3D (static culture and mechanical stimulation), as well as in 3D cultures subjected to perfusion flow, mechanical stimulation and partitioned mechanical stimulation. Finally, we co-cultured osteoblasts and endothelial cells on 3D scaffolds and subjected them to long-term incubation in either static culture or under perfusion flow to determine changes in gene expression as well as histological measures of osteogenic and angiogenic activity. We discovered that 2D and 3D osteoblast cultures react differently to shear stress, and that partitioning mechanical stimulation does not affect gene expression in our model. Furthermore, our results suggest that perfusion flow may rescue 3D tissue-engineered constructs from hypoxic-like conditions by reducing hypoxia-specific gene expression and increasing histological indices of both osteogenic and angiogenic activity. Future research to elucidate the mechanisms behind these results may contribute to a more mature bone-like structure that integrates more quickly into host tissue, increasing the potential of bone tissue engineering.

ALTERNATING CURRENT DIELECTROPHORESIS OF CORE-SHELL NANOPARTICLES: EXPERIMENTS AND COMPARISON WITH THEORY

Nanoparticles are fascinating where physical and optical properties are related to size. Highly controllable synthesis methods and nanoparticle assembly are essential [6] for highly innovative technological applications. Among nanoparticles, nonhomogeneous core-shell nanoparticles (CSnp) have new properties that arise when varying the relative dimensions of the core and the shell. This CSnp structure enables various optical resonances, and engineered energy barriers, in addition to the high charge to surface ratio. Assembly of homogeneous nanoparticles into functional structures has become ubiquitous in biosensors (i.e. optical labeling) [7, 8], nanocoatings [9-13], and electrical circuits [14, 15]. Limited nonhomogenous nanoparticle assembly has only been explored. Many conventional nanoparticle assembly methods exist, but this work explores dielectrophoresis (DEP) as a new method. DEP is particle polarization via non-uniform electric fields while suspended in conductive fluids. Most prior DEP efforts involve microscale particles. Prior work on core-shell nanoparticle assemblies and separately, nanoparticle characterizations with dielectrophoresis and electrorotation [2-5], did not systematically explore particle size, dielectric properties (permittivity and electrical conductivity), shell thickness, particle concentration, medium conductivity, and frequency. This work is the first, to the best of our knowledge, to systematically examine these dielectrophoretic properties for core-shell nanoparticles. Further, we conduct a parametric fitting to traditional core-shell models. These biocompatible core-shell nanoparticles were studied to fill a knowledge gap in the DEP field. Experimental results (chapter 5) first examine medium conductivity, size and shell material dependencies of dielectrophoretic behaviors of spherical CSnp into 2D and 3D particle-assemblies. Chitosan (amino sugar) and poly-L-lysine (amino acid, PLL) CSnp shell materials were custom synthesized around a hollow (gas) core by utilizing a phospholipid micelle around a volatile fluid templating for the shell material; this approach proves to be novel and distinct from conventional core-shell models wherein a conductive core is coated with an insulative shell. Experiments were conducted within a 100 nl chamber housing 100 um wide Ti/Au quadrapole electrodes spaced 25 um apart. Frequencies from 100kHz to 80MHz at fixed local field of 5Vpp were tested with 10-5 and 10-3 S/m medium conductivities for 25 seconds. Dielectrophoretic responses of ~220 and 340(or ~400) nm chitosan or PLL CSnp were compiled as a function of medium conductivity, size and shell material.

A MARKET-BASED APPROACH TO 3D PRINTING FOR ECONOMIC DEVELOPMENT IN GHANA

The purpose of this report is to create the foundation for further study of a market-based approach to 3D printing as an instrument for economic development in Ghana. The delivery of improved products and services to the most underserved markets is needed to spur economic activity and improve standards of living. The relationship between economic development and the advancement of technology is considered within the context of Ghana. An opportunity for market entry exists within both the bottom of the economic pyramid and the mid-segment market. 3D printing (additive manufacturing) has proven to be a disruptive technology that has demonstrated an ability to expedite the speed of innovations and create products that were previously not possible. An investigation of how 3D printers can be used to create improved products for the most underserved markets within Ghana is presented. Questions are asked to elucidate how and when adoption of 3D printers and 3D printed products may occur in the future. Based upon the existing barriers to adoption, 3D printing technology must improve before widespread adoption will occur in Ghana.

STUDIES OF FUNCTIONALIZED NANOPARTICLES FOR SMART SELF-ASSEMBLY AND AS CONTROLLED DRUG DELIVERY

This dissertation is related to the studies of functionalized nanoparticles for self-assembly and as controlled drug delivery system. The whole topic is composed of two parts. In the first part, the research was conducted to design and synthesize a new type of ionic peptide-functionalized copolymer conjugates for self-assembly into nanoparticle fibers and 3D scaffolds with the ability of multi-drug loading and governing the release rate of each drug for tissue engineering. The self-assembly study confirmed that such peptide-functionalized amphiphilic copolymers underwent different self-assembly behavior. The bigger nanoparticles were more easily assembled into nanoparticle fibers and 3D scaffolds with larger pore size, while the smaller nanoparticle underwent faster self-assembly to form more compact 3D scaffolds with smaller porosity but more stable structure. Controlled release studies confirmed the ability of governing simultaneous release of different model drugs with independent release rate from a same scaffold. Cytotoxicity tests showed that all synthesized peptides, copolymers and peptide-copolymer conjugates were biocompatible with SW-620 cell lines and NIH3T3 cell lines. This new type of self-assembled scaffolds combined the advantages of peptide nanofibers and versatile controlled release of polymeric nanoparticles to achieve simultaneous multi-drug loading and controlled release of each drug, uniform distribution and flexibility of hydrogel scaffolds. The investigations in second part were first to design and synthesize organic biocide-loaded nanoparticles for low-leaching wood preservation using a cost-effective one-pot method to synthesize amphiphilic chitosan-g-PMMA nanoparticles loading with ~25-28 wt.% of the fungicide tebuconazole with particle size of ~100 nm diameter by FESEM. FESEM analysis confirmed efficient penetration of nanoparticles throughout the treated wooden stake with dimension of 19 × 19 × 455 mm^3. Leaching studies showed that biocide introduced into sapwood via nanoparticles leached only ~9% compared with the amount leached from tebuconazole solution-treated control, while soil jar tests showed that the nanoparticle-treated wood blocks were effectively protected from biological decay tested against G. trabeum, a brown rot fungus. Copper oxide nanoparticles with and without polymer stabilizers were also investigated to use as inorganic wood preservatives to clarify the factor affecting copper leaching from treated wood. Copper oxide nanoparticles with uniform diameters of ~10 nm and ~50 nm were prepared, and the leachates from southern pine sapwood treated with these nanoparticles were analyzed. It was found by TEM and EDS analysis that significant numbers of nanoparticles leached from the treated wood. The 50 nm nanoparticles leached slightly less than a soluble copper salt control, but 10 nm nanoparticles leached substantially more than the control. The effect of polymer stabilizers on nanoparticle leaching was also investigated. Results showed that polymer stabilizers increased leaching. The trends showed that nanoparticle size was a major factor in copper leaching.