A new system for computer-aided preoperative planning and intraoperative navigation during corrective jaw surgery

A new system for computer-aided corrective surgery of the jaws has been developed and introduced clinically. It combines three-dimensional (3-D) surgical planning with conventional dental occlusion planning. The developed software allows simulating the surgical correction on virtual 3-D models of the facial skeleton generated from computed tomography (CT) scans. Surgery planning and simulation include dynamic cephalometry, semi-automatic mirroring, interactive cutting of bone and segment repositioning. By coupling the software with a tracking system and with the help of a special registration procedure, we are able to acquire dental occlusion plans from plaster model mounts. Upon completion of the surgical plan, the setup is used to manufacture positioning splints for intraoperative guidance. The system provides further intraoperative assistance with the help of a display showing jaw positions and 3-D positioning guides updated in real time during the surgical procedure. The proposed approach offers the advantages of 3-D visualization and tracking technology without sacrificing long-proven cast-based techniques for dental occlusion evaluation. The system has been applied on one patient. Throughout this procedure, we have experienced improved assessment of pathology, increased precision, and augmented control.

Accurate and robust reconstruction of proximal femur from sparse intraoperative data and dense point distribution model for surgical navigation

Constructing a 3D surface model from sparse-point data is a nontrivial task. Here, we report an accurate and robust approach for reconstructing a surface model of the proximal femur from sparse-point data and a dense-point distribution model (DPDM). The problem is formulated as a three-stage optimal estimation process. The first stage, affine registration, is to iteratively estimate a scale and a rigid transformation between the mean surface model of the DPDM and the sparse input points. The estimation results of the first stage are used to establish point correspondences for the second stage, statistical instantiation, which stably instantiates a surface model from the DPDM using a statistical approach. This surface model is then fed to the third stage, kernel-based deformation, which further refines the surface model. Handling outliers is achieved by consistently employing the least trimmed squares (LTS) approach with a roughly estimated outlier rate in all three stages. If an optimal value of the outlier rate is preferred, we propose a hypothesis testing procedure to automatically estimate it. We present here our validations using four experiments, which include 1 leave-one-out experiment, 2 experiment on evaluating the present approach for handling pathology, 3 experiment on evaluating the present approach for handling outliers, and 4 experiment on reconstructing surface models of seven dry cadaver femurs using clinically relevant data without noise and with noise added. Our validation results demonstrate the robust performance of the present approach in handling outliers, pathology, and noise. An average 95-percentile error of 1.7-2.3 mm was found when the present approach was used to reconstruct surface models of the cadaver femurs from sparse-point data with noise added.

VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

Depiction of small veins draining into the vein of galen using preoperative 3-dimensional navigation in living patients

OBJECTIVE: The purpose of this study was to delineate the anatomy of the precentral cerebellar vein, superior vermian vein, and internal occipital vein using reconstructions of computed tomographic and magnetic resonance imaging scans with navigation software. These data were compared with previous anatomic and angiographic findings to show the resolution and accuracy of the system. METHODS: We retrospectively reviewed 100 patients with intracranial pathologies (50 computed tomographic scans with contrast and 50 magnetic resonance imaging scans with gadolinium) using a neuronavigation workstation for 3-dimensional reconstruction. Particular attention was paid to depiction of the precentral cerebellar vein, superior vermian vein, and internal occipital vein. The data were reviewed and analyzed. RESULTS: The precentral cerebellar vein, superior vermian vein, and its tributary, the supraculminate vein, were depicted in 52 (52%) patients. The internal occipital vein was delineated on 99 (49.5%) sides and joined the basal vein and vein of Galen in 39 (39.4%) and 60 (60.6%) hemispheres, respectively. Comparing these results with previous angiographic studies, the ability of the neuronavigation system for depicting these vessels is similar to that of digital subtraction angiography. CONCLUSION: This study illustrates the possibility of depicting the small vessels draining into the pineal region venous complex using 3-dimensional neuronavigation with an accuracy comparable to that of digital subtraction angiography. This tool provides important information for both surgical planning and intraoperative orientation.

Supporting Task-oriented Navigation in IDEs with Configurable HeatMaps

Mainstream IDEs generally rely on the static structure of a software project to support browsing and navigation. We propose HeatMaps, a simple but highly configurable technique to enrich the way an IDE displays the static structure of a software system with additional kinds of information. A heatmap highlights software artifacts according to various metric values, such as bright red or pale blue, to indicate their potential degree of interest. We present a prototype system that implements heatmaps, and we describe an initial study that assesses the degree to which different heatmaps effectively guide developers in navigating software.

Hands-Free Navigation in Immersive Environments for the Evaluation of the Effectiveness of Indoor Navigation Systems

While navigation systems for cars are in widespread use, only recently, indoor navigation systems based on smartphone apps became technically feasible. Hence tools in order to plan and evaluate particular designs of information provision are needed. Since tests in real infrastructures are costly and environmental conditions cannot be held constant, one must resort to virtual infrastructures. This paper presents the development of an environment for the support of the design of indoor navigation systems whose center piece consists in a hands-free navigation method using the Microsoft Kinect in the four-sided Definitely Affordable Virtual Environment (DAVE). Navigation controls using the user's gestures and postures as the input to the controls are designed and implemented. The installation of expensive and bulky hardware like treadmills is avoided while still giving the user a good impression of the distance she has traveled in virtual space. An advantage in comparison to approaches using a head mounted display is that the DAVE allows the users to interact with their smartphone. Thus the effects of different indoor navigation systems can be evaluated already in the planning phase using the resulting system

Dominance of the proximal coordinate frame in determining the locations of hippocampal place cell activity during navigation.

The place-specific activity of hippocampal cells provides downstream structures with information regarding an animal's position within an environment and, perhaps, the location of goals within that environment. In rodents, recent research has suggested that distal cues primarily set the orientation of the spatial representation, whereas the boundaries of the behavioral apparatus determine the locations of place activity. The current study was designed to address possible biases in some previous research that may have minimized the likelihood of observing place activity bound to distal cues. Hippocampal single-unit activity was recorded from six freely moving rats as they were trained to perform a tone-initiated place-preference task on an open-field platform. To investigate whether place activity was bound to the room- or platform-based coordinate frame (or both), the platform was translated within the room at an "early" and at a "late" phase of task acquisition (Shift 1 and Shift 2). At both time points, CA1 and CA3 place cells demonstrated room-associated and/or platform-associated activity, or remapped in response to the platform shift. Shift 1 revealed place activity that reflected an interaction between a dominant platform-based (proximal) coordinate frame and a weaker room-based (distal) frame because many CA1 and CA3 place fields shifted to a location intermediate to the two reference frames. Shift 2 resulted in place activity that became more strongly bound to either the platform- or room-based coordinate frame, suggesting the emergence of two independent spatial frames of reference (with many more cells participating in platform-based than in room-based representations).