VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.

Energy harvesting from body motion using rotational micro-generation

Autonomous system applications are typically limited by the power supply operational lifetime when battery replacement is difficult or costly. A trade-off between battery size and battery life is usually calculated to determine the device capability and lifespan. As a result, energy harvesting research has gained importance as society searches for alternative energy sources for power generation. For instance, energy harvesting has been a proven alternative for powering solar-based calculators and self-winding wristwatches. Thus, the use of energy harvesting technology can make it possible to assist or replace batteries for portable, wearable, or surgically-implantable autonomous systems. Applications such as cardiac pacemakers or electrical stimulation applications can benefit from this approach since the number of surgeries for battery replacement can be reduced or eliminated. Research on energy scavenging from body motion has been investigated to evaluate the feasibility of powering wearable or implantable systems. Energy from walking has been previously extracted using generators placed on shoes, backpacks, and knee braces while producing power levels ranging from milliwatts to watts. The research presented in this paper examines the available power from walking and running at several body locations. The ankle, knee, hip, chest, wrist, elbow, upper arm, side of the head, and back of the head were the chosen target localizations. Joints were preferred since they experience the most drastic acceleration changes. For this, a motor-driven treadmill test was performed on 11 healthy individuals at several walking (1-4 mph) and running (2-5 mph) speeds. The treadmill test provided the acceleration magnitudes from the listed body locations. Power can be estimated from the treadmill evaluation since it is proportional to the acceleration and frequency of occurrence. Available power output from walking was determined to be greater than 1mW/cm³ for most body locations while being over 10mW/cm³ at the foot and ankle locations. Available power from running was found to be almost 10 times higher than that from walking. Most energy harvester topologies use linear generator approaches that are well suited to fixed-frequency vibrations with sub-millimeter amplitude oscillations. In contrast, body motion is characterized with a wide frequency spectrum and larger amplitudes. A generator prototype based on self-winding wristwatches is deemed to be appropriate for harvesting body motion since it is not limited to operate at fixed-frequencies or restricted displacements. Electromagnetic generation is typically favored because of its slightly higher power output per unit volume. Then, a nonharmonic oscillating rotational energy scavenger prototype is proposed to harness body motion. The electromagnetic generator follows the approach from small wind turbine designs that overcome the lack of a gearbox by using a larger number of coil and magnets arrangements. The device presented here is composed of a rotor with multiple-pole permanent magnets having an eccentric weight and a stator composed of stacked planar coils. The rotor oscillations induce a voltage on the planar coil due to the eccentric mass unbalance produced by body motion. A meso-scale prototype device was then built and evaluated for energy generation. The meso-scale casing and rotor were constructed on PMMA with the help of a CNC mill machine. Commercially available discrete magnets were encased in a 25mm rotor. Commercial copper-coated polyimide film was employed to manufacture the planar coils using MEMS fabrication processes. Jewel bearings were used to finalize the arrangement. The prototypes were also tested at the listed body locations. A meso-scale generator with a 2-layer coil was capable to extract up to 234 µW of power at the ankle while walking at 3mph with a 2cm³ prototype for a power density of 117 µW/cm³. This dissertation presents the analysis of available power from walking and running at different speeds and the development of an unobtrusive miniature energy harvesting generator for body motion. Power generation indicates the possibility of powering devices by extracting energy from body motion.

Occasional white boarding : examining the effects of physics students' understanding of motion graphs

The Modeling method of teaching has demonstrated well--‐documented success in the improvement of student learning. The teacher/researcher in this study was introduced to Modeling through the use of a technique called White Boarding. Without formal training, the researcher began using the White Boarding technique for a limited number of laboratory experiences with his high school physics classes. The question that arose and was investigated in this study is “What specific aspects of the White Boarding process support student understanding?” For the purposes of this study, the White Boarding process was broken down into three aspects – the Analysis of data through the use of Logger Pro software, the Preparation of White Boards, and the Presentations each group gave about their specific lab data. The lab used in this study, an Acceleration of Gravity Lab, was chosen because of the documented difficulties students experience in the graphing of motion. In the lab, students filmed a given motion, utilized Logger Pro software to analyze the motion, prepared a White Board that described the motion with position--‐time and velocity--‐time graphs, and then presented their findings to the rest of the class. The Presentation included a class discussion with minimal contribution from the teacher. The three different aspects of the White Boarding experience – Analysis, Preparation, and Presentation – were compared through the use of student learning logs, video analysis of the Presentations, and follow--‐up interviews with participants. The information and observations gathered were used to determine the level of understanding of each participant during each phase of the lab. The researcher then looked for improvement in the level of student understanding, the number of “aha” moments students had, and the students’ perceptions about which phase was most important to their learning. The results suggest that while all three phases of the White Boarding experience play a part in the learning process for students, the Presentations provided the most significant changes. The implications for instruction are discussed.

Non-invasive method to predict viscosity and size using total internal reflection fluorescence microscopy (TIRFM) system

This study develops an automated analysis tool by combining total internal reflection fluorescence microscopy (TIRFM), an evanescent wave microscopic imaging technique to capture time-sequential images and the corresponding image processing Matlab code to identify movements of single individual particles. The developed code will enable us to examine two dimensional hindered tangential Brownian motion of nanoparticles with a sub-pixel resolution (nanoscale). The measured mean square displacements of nanoparticles are compared with theoretical predictions to estimate particle diameters and fluid viscosity using a nonlinear regression technique. These estimated values will be confirmed by the diameters and viscosities given by manufacturers to validate this analysis tool. Nano-particles used in these experiments are yellow-green polystyrene fluorescent nanospheres (200 nm, 500 nm and 1000 nm in diameter (nominal); 505 nm excitation and 515 nm emission wavelengths). Solutions used in this experiment are de-ionized (DI) water, 10% d-glucose and 10% glycerol. Mean square displacements obtained near the surface shows significant deviation from theoretical predictions which are attributed to DLVO forces in the region but it conforms to theoretical predictions after ~125 nm onwards. The proposed automation analysis tool will be powerfully employed in the bio-application fields needed for examination of single protein (DNA and/or vesicle) tracking, drug delivery, and cyto-toxicity unlike the traditional measurement techniques that require fixing the cells. Furthermore, this tool can be also usefully applied for the microfluidic areas of non-invasive thermometry, particle tracking velocimetry (PTV), and non-invasive viscometry.

Approach to carbon dioxide capture and storage at ambient conditions

Carbon dioxide (CO2) capture and storage experiments were conducted at ambient conditions in varying weight % sodium carbonate (Na2CO3) solutions. Experiments were conducted to determine the optimal amount of Na2CO3 in solution for CO2 absorption. It was concluded that a 2% Na2CO3 solution, by weight, was the most efficient solution. The 2% Na2CO3 solution is able to absorb 0.5 g CO2/g Na2CO3. These results led to studies to determine how the gas bubble size affected carbon dioxide absorption in the solution. Studies were conducted using ASTM porosity gas diffusers to vary the bubble size. Gas diffusers with porosities of fine, medium, and extra coarse were used. Results found that the medium porosity gas diffuser was the most efficient at absorbing CO2 at 50%. Variation in the bubble size concluded that absorption of carbon dioxide into the sodium carbonate solution does depend on the bubble size, thus is mass transfer limited. Once the capture stage was optimized (amount of Na2CO3 in solution and bubble size), the next step was to determine if carbon dioxide could be stored as a calcium carbonate mineral using calcium rich industrial waste and if the sodium carbonate solution could be simultaneously regenerated. Studies of CO2 sequestration at ambient conditions have shown that it is possible to permanently sequester CO2 in the form of calcium carbonate using a calcium rich industrial waste. Studies have also shown that it is possible to regenerate a fraction of the sodium carbonate solution.

LATTICE BOLTZMANN METHOD AND CELLULAR AUTOMATA SIMULATION OF PARTICLE MOTION AND DEPOSITION IN 2-D CASE

This technical report discusses the application of the Lattice Boltzmann Method (LBM) and Cellular Automata (CA) simulation in fluid flow and particle deposition. The current work focuses on incompressible flow simulation passing cylinders, in which we incorporate the LBM D2Q9 and CA techniques to simulate the fluid flow and particle loading respectively. For the LBM part, the theories of boundary conditions are studied and verified using the Poiseuille flow test. For the CA part, several models regarding simulation of particles are explained. And a new Digital Differential Analyzer (DDA) algorithm is introduced to simulate particle motion in the Boolean model. The numerical results are compared with a previous probability velocity model by Masselot [Masselot 2000], which shows a satisfactory result.

A Novel Approach to Carbon Dioxide Capture and Storage

The novel approach to carbon capture and storage (CCS) described in this dissertation is a significant departure from the conventional approach to CCS. The novel approach uses a sodium carbonate solution to first capture CO2 from post combustion flue gas streams. The captured CO2 is then reacted with an alkaline industrial waste material, at ambient conditions, to regenerate the carbonate solution and permanently store the CO2 in the form of an added value carbonate mineral. Conventional CCS makes use of a hazardous amine solution for CO2 capture, a costly thermal regeneration stage, and the underground storage of supercritical CO2. The objective of the present dissertation was to examine each individual stage (capture and storage) of the proposed approach to CCS. Study of the capture stage found that a 2% w/w sodium carbonate solution was optimal for CO2 absorption in the present system. The 2% solution yielded the best tradeoff between the CO2 absorption rate and the CO2 absorption capacity of the solutions tested. Examination of CO2 absorption in the presence of flue gas impurities (NOx and SOx) found that carbonate solutions possess a significant advantage over amine solutions, that they could be used for multi-pollutant capture. All the NOx and SOx fed to the carbonate solution was able to be captured. Optimization studies found that it was possible to increase the absorption rate of CO2 into the carbonate solution by adding a surfactant to the solution to chemically alter the gas bubble size. The absorption rate of CO2 was increased by as much as 14%. Three coal combustion fly ash materials were chosen as the alkaline industrial waste materials to study the storage CO2 and regeneration the absorbent. X-ray diffraction analysis on reacted fly ash samples confirmed that the captured CO2 reacts with the fly ash materials to form a carbonate mineral, specifically calcite. Studies found that after a five day reaction time, 75% utilization of the waste material for CO2 storage could be achieved, while regenerating the absorbent. The regenerated absorbent exhibited a nearly identical CO2 absorption capacity and CO2 absorption rate as a fresh Na2CO3 solution.