VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

A TWO-STAGE MICROBIAL FUEL CELL SYSTEM TO CONVERT SOLID ORGANIC WASTE TO ELECTRICITY

Microbial fuel cell (MFC) research has focused mostly on producing electricity using soluble organic and inorganic substrates. This study focused on converting solid organic waste into electricity using a two-stage MFC process. In the first stage, a hydrolysis reactor produced soluble organic substrates from solid organic waste. The soluble substrates from the hydrolysis reactor were pumped to the second stage reactor: a continuous-flow, air-cathode MFC. Maximum power output (Pmax) of the MFC was 296 mW/m3 at a current density of 25.4 mA/m2 while being fed only leachate from the first stage reactor. Addition of phosphate buffer increased Pmax to 1,470 mW/m3 (89.4 mA/m2), although this result could not be duplicated with repeated polarization testing. The minimum internal resistance achieved was 77 Omega with leachate feed and 17 Omega with phosphate buffer. The low coulombic efficiency (

Depiction of small veins draining into the vein of galen using preoperative 3-dimensional navigation in living patients

OBJECTIVE: The purpose of this study was to delineate the anatomy of the precentral cerebellar vein, superior vermian vein, and internal occipital vein using reconstructions of computed tomographic and magnetic resonance imaging scans with navigation software. These data were compared with previous anatomic and angiographic findings to show the resolution and accuracy of the system. METHODS: We retrospectively reviewed 100 patients with intracranial pathologies (50 computed tomographic scans with contrast and 50 magnetic resonance imaging scans with gadolinium) using a neuronavigation workstation for 3-dimensional reconstruction. Particular attention was paid to depiction of the precentral cerebellar vein, superior vermian vein, and internal occipital vein. The data were reviewed and analyzed. RESULTS: The precentral cerebellar vein, superior vermian vein, and its tributary, the supraculminate vein, were depicted in 52 (52%) patients. The internal occipital vein was delineated on 99 (49.5%) sides and joined the basal vein and vein of Galen in 39 (39.4%) and 60 (60.6%) hemispheres, respectively. Comparing these results with previous angiographic studies, the ability of the neuronavigation system for depicting these vessels is similar to that of digital subtraction angiography. CONCLUSION: This study illustrates the possibility of depicting the small vessels draining into the pineal region venous complex using 3-dimensional neuronavigation with an accuracy comparable to that of digital subtraction angiography. This tool provides important information for both surgical planning and intraoperative orientation.

Supporting Task-oriented Navigation in IDEs with Configurable HeatMaps

Mainstream IDEs generally rely on the static structure of a software project to support browsing and navigation. We propose HeatMaps, a simple but highly configurable technique to enrich the way an IDE displays the static structure of a software system with additional kinds of information. A heatmap highlights software artifacts according to various metric values, such as bright red or pale blue, to indicate their potential degree of interest. We present a prototype system that implements heatmaps, and we describe an initial study that assesses the degree to which different heatmaps effectively guide developers in navigating software.

Tackling Software Navigation Issues of the Smalltalk IDE

The IDE used in most Smalltalk dialects such as Pharo, Squeak or Cincom Smalltalk did not evolve significantly over the last years, if not to say decades. For other languages, for instance Java, the available IDEs made tremendous progress as Eclipse or NetBeans illustrate. While the Smalltalk IDE served as an exemplar for many years, other IDEs caught up or even overtook the erstwhile leader in terms of feature-richness, usability, or code navigation facilities. In this paper we first analyze the difficulty of software navigation in the Smalltalk IDE and second illustrate with concrete examples the features we added to the Smalltalk IDE to fill the gap to modern IDEs and to provide novel, improved means to navigate source space. We show that thanks to the agility and dynamics of Smalltalk, we are able to extend and enhance with reasonable effort the Smalltalk IDE to better support software navigation, program comprehension, and software maintenance in general. One such support is the integration of dynamic information into the static source views we are familiar with. Other means include easing the access to static information (for instance by better arranging important packages) or helping developers re-locating artifacts of interest (for example with a categorization system such as smart groups).

Hands-Free Navigation in Immersive Environments for the Evaluation of the Effectiveness of Indoor Navigation Systems

While navigation systems for cars are in widespread use, only recently, indoor navigation systems based on smartphone apps became technically feasible. Hence tools in order to plan and evaluate particular designs of information provision are needed. Since tests in real infrastructures are costly and environmental conditions cannot be held constant, one must resort to virtual infrastructures. This paper presents the development of an environment for the support of the design of indoor navigation systems whose center piece consists in a hands-free navigation method using the Microsoft Kinect in the four-sided Definitely Affordable Virtual Environment (DAVE). Navigation controls using the user's gestures and postures as the input to the controls are designed and implemented. The installation of expensive and bulky hardware like treadmills is avoided while still giving the user a good impression of the distance she has traveled in virtual space. An advantage in comparison to approaches using a head mounted display is that the DAVE allows the users to interact with their smartphone. Thus the effects of different indoor navigation systems can be evaluated already in the planning phase using the resulting system

Nucleic acid sensing by an orthogonal reporter system based on homo-DNA

We have developed an assay for single strand DNA or RNA detection which is based on the homo-DNA templated Staudinger reduction of the profluorophore rhodamine-azide. The assay is based on a three component system, consisting of a homo-DNA/DNA hybrid probe, a set of homo-DNA reporter strands and the target DNA or RNA. We present two different formats of the assay (Omega probe and linear probe) in which the linear probe was found to perform best with catalytic turnover of the reporter strands (TON: 8) and a match/mismatch discrimination of up to 19. The advantage of this system is that the reporting (homo-DNA) and sensing (DNA) domain are decoupled from each other since the two pairing systems are bioorthogonal. This allows independent optimization of either domain which may lead to higher selectivity in in vivo imaging.

Computer-assisted virtual autopsy using surgical navigation techniques

UNLABELLED OBJECTIVE; Virtual autopsy methods, such as postmortem CT and MRI, are increasingly being used in forensic medicine. Forensic investigators with little to no training in diagnostic radiology and medical laypeople such as state's attorneys often find it difficult to understand the anatomic orientation of axial postmortem CT images. We present a computer-assisted system that permits postmortem CT datasets to be quickly and intuitively resliced in real time at the body to narrow the gap between radiologic imaging and autopsy. CONCLUSION Our system is a potentially valuable tool for planning autopsies, showing findings to medical laypeople, and teaching CT anatomy, thus further closing the gap between radiology and forensic pathology.

Digital Vertical Aerial Camera System for High-resolution Site Inspections in Conservation Easment Monitoring

A three-level satellite to ground monitoring scheme for conservation easement monitoring has been implemented in which high-resolution imagery serves as an intermediate step for inspecting high priority sites. A digital vertical aerial camera system was developed to fulfill the need for an economical source of imagery for this intermediate step. A method for attaching the camera system to small aircraft was designed, and the camera system was calibrated and tested. To ensure that the images obtained were of suitable quality for use in Level 2 inspections, rectified imagery was required to provide positional accuracy of 5 meters or less to be comparable to current commercially available high-resolution satellite imagery. Focal length calibration was performed to discover the infinity focal length at two lens settings (24mm and 35mm) with a precision of O.1mm. Known focal length is required for creation of navigation points representing locations to be photographed (waypoints). Photographing an object of known size at distances on a test range allowed estimates of focal lengths of 25.lmm and 35.4mm for the 24mm and 35mm lens settings, respectively. Constants required for distortion removal procedures were obtained using analytical plumb-line calibration procedures for both lens settings, with mild distortion at the 24mm setting and virtually no distortion found at the 35mm setting. The system was designed to operate in a series of stages: mission planning, mission execution, and post-mission processing. During mission planning, waypoints were created using custom tools in geographic information system (GIs) software. During mission execution, the camera is connected to a laptop computer with a global positioning system (GPS) receiver attached. Customized mobile GIs software accepts position information from the GPS receiver, provides information for navigation, and automatically triggers the camera upon reaching the desired location. Post-mission processing (rectification) of imagery for removal of lens distortion effects, correction of imagery for horizontal displacement due to terrain variations (relief displacement), and relating the images to ground coordinates were performed with no more than a second-order polynomial warping function. Accuracy testing was performed to verify the positional accuracy capabilities of the system in an ideal-case scenario as well as a real-world case. Using many welldistributed and highly accurate control points on flat terrain, the rectified images yielded median positional accuracy of 0.3 meters. Imagery captured over commercial forestland with varying terrain in eastern Maine, rectified to digital orthophoto quadrangles, yielded median positional accuracies of 2.3 meters with accuracies of 3.1 meters or better in 75 percent of measurements made. These accuracies were well within performance requirements. The images from the digital camera system are of high quality, displaying significant detail at common flying heights. At common flying heights the ground resolution of the camera system ranges between 0.07 meters and 0.67 meters per pixel, satisfying the requirement that imagery be of comparable resolution to current highresolution satellite imagery. Due to the high resolution of the imagery, the positional accuracy attainable, and the convenience with which it is operated, the digital aerial camera system developed is a potentially cost-effective solution for use in the intermediate step of a satellite to ground conservation easement monitoring scheme.

Cooperation & Competition Between Navigation Systems in the Rat Brain: The Role of the Hippocampus and Striatum During a Dissociative Maze Task

While many tend to think of memory systems in the brain as a single process, in reality several experiments have supported multiple dissociations of different forms of learning, such as spatial learning and response learning. In both humans and rats, the hippocampus has long been shown to be specialized in the storage of spatial and contextual memory whereas the striatum is associated with motor responses and habitual behaviors. Previous studies have examined how damage to hippocampus or striatum has affected the acquisition of either a spatial or response navigation task. However even in a very familiar environment organisms must continuously switch between place and response strategies depending upon circumstances. The current research investigates how these two brain systems interact under normal conditions to produce navigational behavior. Rats were tested using a task developed by Jacobson and colleagues (2006) in which the two types of navigation could be controlled and studied simultaneously. Rats were trained to solve a plus maze using both a spatial and a response strategy. A cue (flashing light) was employed to indicate the correct strategy on a given trial. When no light was present, the animals were rewarded for making a 90º right turn (motor response). When the light was on, the animals were rewarded for going to a specific goal location (place strategy). After learning the task, animals had a sham surgery or dorsal striatum or hippocampus damaged. In order to investigate the individual role of each brain system and evaluate whether these brain regions compete or cooperate for control over strategy, we utilized a within-animal comparisons. The configuration of the maze allowed for the comparison of behavior in individual animals before and after specific brain areas were damaged. Animals with hippocampal lesions showed selective deficits on place trials after surgery and learned the reversal of the motor response more rapidly than striatal lesioned or sham rats. Unlike previous findings regarding maze learning, animals with striatal lesions showed deficits in both place and response trials and had difficulty learning the reversal of motor response. Therefore, the effects of lesions on the ability to switch back and forth between strategies were more complex than previously suggested. This work may reveal important new insight on the integration of hippocampal and striatal learning systems, and facilitate a better understanding of the brain dynamics underlying similar navigational processes in humans.