VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

BALTHMETRIC SURVEY IN THE KEWEENAW WATER WAY IN MICHIGAN, USA, MAKING 3D MODEL, AND COMPARING SONAR EQUIPMENT OF THE MODERN AUV AND THE TRADITIONAL SINGLE BEAM SONAR

This thesis represents the overview of hydrographic surveying and different types of modern and traditional surveying equipment, and data acquisition using the traditional single beam sonar system and a modern fully autonomous underwater vehicle, IVER3. During the thesis, the data sets were collected using the vehicles of the Great Lake Research Center at Michigan Technological University. This thesis also presents how to process and edit the bathymetric data on SonarWiz5. Moreover, the three dimensional models were created after importing the data sets in the same coordinate system. In these interpolated surfaces, the details and excavations can be easily seen on the surface models. In this study, the profiles are plotted on the surface models to compare the sensors and details on the seabed. It is shown that single beam sonar might miss some details, such as pipeline and quick elevation changes on the seabed when we compare to the side scan sonar of IVER3 because the single side scan sonar can acquire better resolution. However, sometimes using single beam sonar can save your project time and money because the single beam sonar is cheaper than side scan sonars and the processing might be easier than the side scan data.

Use of a 3D perfusion bioreactor with osteoblasts and osteoblast/endothelial cell co-cultures to improve tissue-engineered bone

The delivery of oxygen, nutrients, and the removal of waste are essential for cellular survival. Culture systems for 3D bone tissue engineering have addressed this issue by utilizing perfusion flow bioreactors that stimulate osteogenic activity through the delivery of oxygen and nutrients by low-shear fluid flow. It is also well established that bone responds to mechanical stimulation, but may desensitize under continuous loading. While perfusion flow and mechanical stimulation are used to increase cellular survival in vitro, 3D tissue-engineered constructs face additional limitations upon in vivo implantation. As it requires significant amounts of time for vascular infiltration by the host, implants are subject to an increased risk of necrosis. One solution is to introduce tissue-engineered bone that has been pre-vascularized through the co-culture of osteoblasts and endothelial cells on 3D constructs. It is unclear from previous studies: 1) how 3D bone tissue constructs will respond to partitioned mechanical stimulation, 2) how gene expression compares in 2D and in 3D, 3) how co-cultures will affect osteoblast activity, and 4) how perfusion flow will affect co-cultures of osteoblasts and endothelial cells. We have used an integrated approach to address these questions by utilizing mechanical stimulation, perfusion flow, and a co-culture technique to increase the success of 3D bone tissue engineering. We measured gene expression of several osteogenic and angiogenic genes in both 2D and 3D (static culture and mechanical stimulation), as well as in 3D cultures subjected to perfusion flow, mechanical stimulation and partitioned mechanical stimulation. Finally, we co-cultured osteoblasts and endothelial cells on 3D scaffolds and subjected them to long-term incubation in either static culture or under perfusion flow to determine changes in gene expression as well as histological measures of osteogenic and angiogenic activity. We discovered that 2D and 3D osteoblast cultures react differently to shear stress, and that partitioning mechanical stimulation does not affect gene expression in our model. Furthermore, our results suggest that perfusion flow may rescue 3D tissue-engineered constructs from hypoxic-like conditions by reducing hypoxia-specific gene expression and increasing histological indices of both osteogenic and angiogenic activity. Future research to elucidate the mechanisms behind these results may contribute to a more mature bone-like structure that integrates more quickly into host tissue, increasing the potential of bone tissue engineering.

LATTICE BOLTZMANN METHOD AND CELLULAR AUTOMATA SIMULATION OF PARTICLE MOTION AND DEPOSITION IN 2-D CASE

This technical report discusses the application of the Lattice Boltzmann Method (LBM) and Cellular Automata (CA) simulation in fluid flow and particle deposition. The current work focuses on incompressible flow simulation passing cylinders, in which we incorporate the LBM D2Q9 and CA techniques to simulate the fluid flow and particle loading respectively. For the LBM part, the theories of boundary conditions are studied and verified using the Poiseuille flow test. For the CA part, several models regarding simulation of particles are explained. And a new Digital Differential Analyzer (DDA) algorithm is introduced to simulate particle motion in the Boolean model. The numerical results are compared with a previous probability velocity model by Masselot [Masselot 2000], which shows a satisfactory result.

POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.