VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.

Theoretical estimation of optical absorption and photoluminescence in nanostructured silicon; an approach to improve efficiency in nanostructured solar cells

Renewable energy is growing in demand, and thus the the manufacture of solar cells and photovoltaic arrays has advanced dramatically in recent years. This is proved by the fact that the photovoltaic production has doubled every 2 years, increasing by an average of 48% each year since 2002. Covering the general overview of solar cell working, and its model, this thesis will start with the three generations of photovoltaic solar cell technology, and move to the motivation of dedicating research to nanostructured solar cell. For the current generation solar cells, among several factors, like photon capture, photon reflection, carrier generation by photons, carrier transport and collection, the efficiency also depends on the absorption of photons. The absorption coefficient,α, and its dependence on the wavelength, λ, is of major concern to improve the efficiency. Nano-silicon structures (quantum wells and quantum dots) have a unique advantage compared to bulk and thin film crystalline silicon that multiple direct and indirect band gaps can be realized by appropriate size control of the quantum wells. This enables multiple wavelength photons of the solar spectrum to be absorbed efficiently. There is limited research on the calculation of absorption coefficient in nano structures of silicon. We present a theoretical approach to calculate the absorption coefficient using quantum mechanical calculations on the interaction of photons with the electrons of the valence band. One model is that the oscillator strength of the direct optical transitions is enhanced by the quantumconfinement effect in Si nanocrystallites. These kinds of quantum wells can be realized in practice in porous silicon. The absorption coefficient shows a peak of 64638.2 cm-1 at = 343 nm at photon energy of ξ = 3.49 eV ( = 355.532 nm). I have shown that a large value of absorption coefficient α comparable to that of bulk silicon is possible in silicon QDs because of carrier confinement. Our results have shown that we can enhance the absorption coefficient by an order of 10, and at the same time a nearly constant absorption coefficient curve over the visible spectrum. The validity of plots is verified by the correlation with experimental photoluminescence plots. A very generic comparison for the efficiency of p-i-n junction solar cell is given for a cell incorporating QDs and sans QDs. The design and fabrication technique is discussed in brief. I have shown that by using QDs in the intrinsic region of a cell, we can improve the efficiency by a factor of 1.865 times. Thus for a solar cell of efficiency of 26% for first generation solar cell, we can improve the efficiency to nearly 48.5% on using QDs.

Optical hysteresis of ridge waveguide magnetic garnet films and cavities in two-dimensional magneto-photonic crystal slabs

Magnetic iron garnets as well as magnetic photonic crystals are of great interests in magneto-optic applications such as isolators, current captors, circulators, TE-TM mode conversion, wavelength accordable filters, optical sensors and switches, all of which provide a promising platform for future integrated optical circuits. In the present work, two topics are studied based on magnetic iron garnet films. In the first part, the characteristics of the magnetization are investigated for ridge waveguides fabricated on (100) oriented iron garnet thin films. The magnetic response in magneto-optic waveguides patterned on epitaxial magnetic garnet films depends on the crystallographic orientation of the waveguides and the magnetic anisotropy of the material. These can be studied by polarization rotation hysteresis loops, which are related to the component of magnetization parallel to the light propagation direction and the linear birefringence. Polarization rotation hysteresis loops for low birefringence waveguides with different orientations are experimentally investigated. Asymmetric stepped curves are obtained from waveguides along, due to the large magnetocrystalline anisotropy in the plane. A model based on the free energy density is developed to demonstrate the motion of the magnetization and can be used in the design of magneto-optic devices. The second part of this thesis focuses on the design and fabrication of high-Q cavities in two-dimensional magneto-photonic crystal slabs. The device consists of a layer of silicon and a layer of iron garnet thin film. Triangular lattice elliptical air holes are patterned in the slab. The fundamental TM band gap overlaps with the first-order TE band gap from 0374~0.431(a/λ) showing that both TE and TM polarization light can be confined in the photonic crystals. A nanocavity is designed to obtain both TE and TM defect modes in the band gaps. Additional work is needed to overlap the TE and TM defect modes and obtain a high-Q cavity so as to develop miniaturized Faraday rotators.

NONLINEAR EFFECTS IN MAGNETIC GARNET FILMS AND NONRECIPROCAL OPTICAL BLOCH OSCILLATIONS IN WAVEGUIDE ARRAYS

This dissertation presents detailed experimental and theoretical investigations of nonlinear and nonreciprocal effects in magnetic garnet films. The dissertation thus comprises two major sections. The first section concentrates on the study of a new class of nonlinear magneto-optic thin film materials possessing strong higher order magnetic susceptibility for nonlinear optical applications. The focus was on enlarging the nonlinear performance of ferrite garnet films by strain generation and compositional gradients in the sputter-deposition growth of these films. Under this project several bismuth-substituted yttrium iron garnet (Bi,Y) 3 (Fe,Ga)5 O12(acronym as Bi:YIG) films have been sputter-deposited over gadolinium gallium garnet (Gd 3 Ga5 O12 ) substrates and characterized for their nonlinear optical response. One of the important findings of this work is that lattice mismatch strain drives the second harmonic (SH) signal in the Bi:YIG films, in agreement with theoretical predictions; whereas micro-strain was found not to correlate significantly with SH signal at the micro-strain levels present in these films. This study also elaborates on the role of the film's constitutive elements and their concentration gradients in nonlinear response of the films. Ultrahigh sensitivity delivered by second harmonic generation provides a new exciting tool for studying magnetized surfaces and buried interfaces, making this work important from both a fundamental and application point of view. The second part of the dissertation addresses an important technological need; namely the development of an on-chip optical isolator for use in photonic integrated circuits. It is based on two related novel effects, nonreciprocal and unidirectional optical Bloch oscillations (BOs), recently proposed and developed by Professor Miguel Levy and myself. This dissertation work has established a comprehensive theoretical background for the implementation of these effects in magneto-optic waveguide arrays. The model systems we developed consist of photonic lattices in the form of one-dimensional waveguide arrays where an optical force is introduced into the array through geometrical design turning the beam sideways. Laterally displaced photons are periodically returned to a central guide by photonic crystal action. The effect leads to a novel oscillatory optical phenomenon that can be magnetically controlled and rendered unidirectional. An on-chip optical isolator was designed based on the unidirectionality of the magneto-opticBloch oscillatory motion. The proposed device delivers an isolation ratio as high as 36 dB that remains above 30 dB in a 0.7 nm wavelength bandwidth, at the telecommunication wavelength 1.55 μm. Slight modifications in isolator design allow one to achieve an even more impressive isolation ratio ~ 55 dB, but at the expense of smaller bandwidth. Moreover, the device allows multifunctionality, such as optical switching with a simultaneous isolation function, well suited for photonic integrated circuits.