VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

IMPROVED SENSITIVITY OF RESONANT MASS SENSOR BASED ON MICRO TILTING PLATE AND MICRO CANTILEVER

Vapor sensors have been used for many years. Their applications range from detection of toxic gases and dangerous chemicals in industrial environments, the monitoring of landmines and other explosives, to the monitoring of atmospheric conditions. Microelectrical mechanical systems (MEMS) fabrication technologies provide a way to fabricate sensitive devices. One type of MEMS vapor sensors is based on mass changing detection and the sensors have a functional chemical coating for absorbing the chemical vapor of interest. The principle of the resonant mass sensor is that the resonant frequency will experience a large change due to a small mass of gas vapor change. This thesis is trying to build analytical micro-cantilever and micro-tilting plate models, which can make optimization more efficient. Several objectives need to be accomplished: (1) Build an analytical model of MEMS resonant mass sensor based on micro-tilting plate with the effects of air damping. (2) Perform design optimization of micro-tilting plate with a hole in the center. (3) Build an analytical model of MEMS resonant mass sensor based on micro-cantilever with the effects of air damping. (4) Perform design optimization of micro-cantilever by COMSOL. Analytical models of micro-tilting plate with a hole in the center are compared with a COMSOL simulation model and show good agreement. The analytical models have been used to do design optimization that maximizes sensitivity. The micro-cantilever analytical model does not show good agreement with a COMSOL simulation model. To further investigate, the air damping pressures at several points on the micro-cantilever have been compared between analytical model and COMSOL model. The analytical model is inadequate for two reasons. First, the model’s boundary condition assumption is not realistic. Second, the deflection shape of the cantilever changes with the hole size, and the model does not account for this. Design optimization of micro-cantilever is done by COMSOL.

Inductive-Capacitive Resonant Circuit Sensors for Structural Health and Environmental Monitoring

Inductive-capacitive (LC) resonant circuit sensors are low-cost, wireless, durable, simple to fabricate and battery-less. Consequently, they are well suited to sensing applications in harsh environments or in situations where large numbers of sensors are needed. They are also advantageous in applications where access to the sensor is limited or impossible or when sensors are needed on a disposable basis. Due to their many advantages, LC sensors have been used for sensing a variety of parameters including humidity, temperature, chemical concentrations, pH, stress/pressure, strain, food quality and even biological growth. However, current versions of the LC sensor technology are limited to sensing only one parameter. The purpose of this work is to develop new types of LC sensor systems that are simpler to fabricate (hence lower cost) or capable of monitoring multiple parameters simultaneously. One design presented in this work, referred to as the multi-element LC sensor, is able to measure multiple parameters simultaneously using a second capacitive element. Compared to conventional LC sensors, this design can sense multiple parameters with a higher detection range than two independent sensors while maintaining the same overall sensor footprint. In addition, the two-element sensor does not suffer from interference issues normally encountered while implementing two LC sensors in close proximity. Another design, the single-spiral inductive-capacitive sensor, utilizes the parasitic capacitance of a coil or spring structure to form a single layer LC resonant circuit. Unlike conventional LC sensors, this design is truly planar, thus simplifying its fabrication process and reducing sensor cost. Due to the simplicity of this sensor layout it will be easier and more cost-effective for embedding in common building or packaging materials during manufacturing processes, thereby adding functionality to current products (such as drywall sheets) while having a minor impact on overall unit cost. These modifications to the LC sensor design significantly improve the functionality and commercial feasibility of this technology, especially for applications where a large array of sensors or multiple sensing parameters are required.

Differential GPS as a monitoring tool on Volcano Santa Ana (Illamatepec) and the Coatepeque Caldera, El Salvador

We used differential GPS measurements from a 13 station GPS network spanning the Santa Ana Volcano and Coatepeque Caldera to characterize the inter-eruptive activity and tectonic movements near these two active and potentially hazardous features. Caldera-forming events occurred from 70-40 ka and at Santa Ana/Izalco volcanoes eruptive activity occurred as recently as 2005. Twelve differential stations were surveyed for 1 to 2 hours on a monthly basis from February through September 2009 and tied to a centrally located continuous GPS station, which serves as the reference site for this volcanic network. Repeatabilities of the averages from 20-minute sessions taken over 20 hours or longer range from 2-11 mm in the horizontal (north and east) components of the inter-station baselines, suggesting a lower detection limit for the horizontal components of any short-term tectonic or volcanic deformation. Repeatabilities of the vertical baseline component range from 12-34 mm. Analysis of the precipitable water vapor in the troposphere suggests that tropospheric decorrelation as a function of baseline lengths and variable site elevations are the most likely sources of vertical error. Differential motions of the 12 sites relative to the continuous reference site reveal inflation from February through July at several sites surrounding the caldera with vertical displacements that range from 61 mm to 139 mm followed by a lower magnitude deflation event on 1.8-7.4 km-long baselines. Uplift rates for the inflationary period reach 300 mm/yr with 1σ uncertainties of +/- 26 – 119 mm. Only one other station outside the caldera exhibits a similar deformation trend, suggesting a localized source. The results suggest that the use of differential GPS measurements from short duration occupations over short baselines can be a useful monitoring tool at sub-tropical volcanoes and calderas.

Remote sensing of volcanic plumes using the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER).

The Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) has been used to quantify SO2 emissions from passively degassing volcanoes. This dissertation explores ASTER’s capability to detect SO2 with satellite validation, enhancement techniques and extensive processing of images at a variety of volcanoes. ASTER is compared to the Mini UV Spectrometer (MUSe), a ground based instrument, to determine if reasonable SO2 fluxes can be quantified from a plume emitted from Lascar, Chile. The two sensors were in good agreement with ASTER proving to be a reliable detector of SO2. ASTER illustrated the advantages of imaging a plume in 2D, with better temporal resolution than the MUSe. SO2 plumes in ASTER imagery are not always discernible in the raw TIR data. Principal Component Analysis (PCA) and Decorrelation Stretch (DCS) enhancement techniques were compared to determine how well they highlight a variety of volcanic plumes. DCS produced a consistent output and the composition of the plumes was easy to identify from explosive eruptions. As the plumes became smaller and lower in altitude they became harder to distinguish using DCS. PCA proved to be better at identifying smaller low altitude plumes. ASTER was used to investigate SO2 emissions at Lascar, Chile. Activity at Lascar has been characterized by cyclic behavior and persistent degassing (Matthews et al. 1997). Previous studies at Lascar have primarily focused on changes in thermal infrared anomalies, neglecting gas emissions. Using the SO2 data along with changes in thermal anomalies and visual observations it is evident that Lascar is at the end an eruptive cycle that began in 1993. Declining gas emissions and crater temperatures suggest that the conduit is sealing. ASTER and the Ozone Monitoring Instrument (OMI) were used to determine the annual contribution of SO2 to the troposphere from the Central and South American volcanic arcs between 2000 and 2011. Fluxes of 3.4 Tg/a for Central America and 3.7 Tg/a for South America were calculated. The detection limits of ASTER were explored. The results a proved to be interesting, with plumes from many of the high emitting volcanoes, such as Villarrica, Chile, not being detected by ASTER.

EXPLORATION OF THE MTSAT2 SATELLITE CAPABILITIES FOR REAL TIME DETECTION AND CHARACTERIZATION OF VOLCANIC EMISSIONS

In this report, we attempt to define the capabilities of the infrared satellite remote sensor, Multifunctional Transport Satellite-2 (MTSAT-2) (i.e. a geosynchronous instrument), in characterizing volcanic eruptive behavior in the highly active region of Indonesia. Sulfur dioxide data from NASA's Ozone Monitoring Instrument (OMI) (i.e. a polar orbiting instrument) are presented here for validation of the processes interpreted using the thermal infrared datasets. Data provided from two case studies are analyzed specifically for eruptive products producing large thermal anomalies (i.e. lava flows, lava domes, etc.), volcanic ash and SO2 clouds; three distinctly characteristic and abundant volcanic emissions. Two primary methods used for detection of heat signatures are used and compared in this report including, single-channel thermal radiance (4-µm) and the normalized thermal index (NTI) algorithm. For automated purposes, fixed thresholds must be determined for these methods. A base minimum detection limit (MDL) for single-channel thermal radiance of 2.30E+05 Wm- 2sr-1m-1 and -0.925 for NTI generate false alarm rates of 35.78% and 34.16%, respectively. A spatial comparison method, developed here specifically for use in Indonesia and used as a second parameter for detection, is implemented to address the high false alarm rate. For the single-channel thermal radiance method, the utilization of the spatial comparison method eliminated 100% of the false alarms while maintaining every true anomaly. The NTI algorithm showed similar results with only 2 false alarms remaining. No definitive difference is observed between the two thermal detection methods for automated use; however, the single-channel thermal radiance method coupled with the SO2 mass abundance data can be used to interpret volcanic processes including the identification of lava dome activity at Sinabung as well as the mechanism for the dome emplacement (i.e. endogenous or exogenous). Only one technique, the brightness temperature difference (BTD) method, is used for the detection of ash. Trends of ash area, water/ice area, and their respective concentrations yield interpretations of increased ice formation, aggregation, and sedimentation processes that only a high-temporal resolution instrument like the MTSAT-2 can analyze. A conceptual model of a secondary zone of aggregation occurring in the migrating Kelut ash cloud, which decreases the distal fine-ash component and hazards to flight paths, is presented in this report. Unfortunately, SO2 data was unable to definitively reinforce the concept of a secondary zone of aggregation due to the lack of a sufficient temporal resolution. However, a detailed study of the Kelut SO2 cloud is used to determine that there was no climatic impacts generated from this eruption due to the atmospheric residence times and e-folding rate of ~14 days for the SO2. This report applies the complementary assets offered by utilizing a high-temporal and a high-spatial resolution satellite, and it demonstrates that these two instruments can provide unparalleled observations of dynamic volcanic processes.

Development and characterization of fluorescent pH sensors based on porous silica and hydrogel support matrices

The hydrogen ion activity (pH) is a very important parameter in environment monitoring, biomedical research and other applications. Optical pH sensors have several advantages over traditional potentiometric pH measurement, such as high sensitivity, no need of constant calibration, easy for miniaturization and possibility for remote sensing. Several pH indicators has been successfully immobilized in three different solid porous materials to use as pH sensing probes. The fluorescent pH indicator fluorescein-5-isothiocyanate (FITC) was covalently bound onto the internal surface of porous silica (pore size ~10 nm) and retained its pH sensitivity. The excited state pK* a of FITC in porous silica (5.58) was slightly smaller than in solution (5.68) due to the free silanol groups (Si-OH) on the silica surface. The pH sensitive range for this probe is pH 4.5 - 7.0 with an error less than 0.1 pH units. The probe response was reproducible and stable for at least four month, stored in DI water, but exhibit a long equilibrium of up to 100 minutes. Sol-gel based pH sensors were developed with immobilization of two fluorescent pH indicators fluorescein-5-(and-6)-sulfonic acid, trisodium salt (FS) and 8-hydroxypyrene- 1,3,6-trisulfonic acid (HPTS) through physical entrapment. Prior to immobilization, the indicators were ion-paired with a common surfactant hexadecyltrimethylammonium bromide (CTAB) in order to prevent leaching. The sol-gel films were synthesized through the hydrolysis of two different precursors, ethyltriethoxysilane (ETEOS) and 3- glycidoxypropyltrimethoxysilane (GPTMS) and deposited on a quartz slide through spin coating. The pK a of the indicators immobilized in sol-gel films was much smaller than in solutions due to silanol groups on the inner surface of the sol-gel films and ammonium groups from the surrounding surfactants. Unlike in solution, the apparent pK a of the indicators in sol-gel films increased with increasing ionic strength. The equilibrium time for these sensors was within 5 minutes (with film thickness of ~470 nm). Polyethylene glycol (PEG) hydrogel was of interest for optical pH sensor development because it is highly proton permeable, transparent and easy to synthesize. pH indicators can be immobilized in hydrogel through physical entrapment and copolymerization. FS and HPTS ion-pairs were physically entrapped in hydrogel matrix synthesized via free radical initiation. For covalent immobilization, three indicators, 6,8-dihydroxypyrene-1,3- disulfonic acid (DHPDS), 2,7-dihydroxynaphthalene-3,6-disulfonic acid (DHNDS) and cresol red were first reacted with methacrylic anhydride (MA) to form methacryloylanalogs for copolymerization. These hydrogels were synthesized in aqueous solution with a redox initiation system. The thickness of the hydrogel film is controlled as ~ 0.5 cm and the porosity can be adjusted with the percentage of polyethylene glycol in the precursor solutions. The pK a of the indicators immobilized in the hydrogel both physically and covalently were higher than in solution due to the medium effect. The sensors are stable and reproducible with a short equilibrium time (less than 4 minutes). In addition, the color change of cresol red immobilized hydrogel is vivid from yellow (acidic condition) to purple (basic condition). Due to covalently binding, cresol red was not leaching out from the hydrogel, making it a good candidate of reusable "pH paper".