Multimodal augmented reality system for surgical microscopy

Image-guided, computer-assisted neurosurgery has emerged to improve localization and targeting, to provide a better anatomic definition of the surgical field, and to decrease invasiveness. Usually, in image-guided surgery, a computer displays the surgical field in a CT/MR environment, using axial, coronal or sagittal views, or even a 3D representation of the patient. Such a system forces the surgeon to look away from the surgical scene to the computer screen. Moreover, this kind of information, being pre-operative imaging, can not be modified during the operation, so it remains valid for guidance in the first stage of the surgical procedure, and mainly for rigid structures like bones. In order to solve the two constraints mentioned before, we are developing an ultrasoundguided surgical microscope. Such a system takes the advantage that surgical microscopy and ultrasound systems are already used in neurosurgery, so it does not add more complexity to the surgical procedure. We have integrated an optical tracking device in the microscope and an augmented reality overlay system with which we avoid the need to look away from the scene, providing correctly aligned surgical images with sub-millimeter accuracy. In addition to the standard CT and 3D views, we are able to track an ultrasound probe, and using a previous calibration and registration of the imaging, the image obtained is correctly projected to the overlay system, so the surgeon can always localize the target and verify the effects of the intervention. Several tests of the system have been already performed to evaluate the accuracy, and clinical experiments are currently in progress in order to validate the clinical usefulness of the system.

Accuracy considerations in navigated cup placement for total hip arthroplasty

Computer assisted orthopaedic surgery (CAOS) technology has recently been introduced to overcome problems resulting from acetabular component malpositioning in total hip arthroplasty. Available navigation modules can conceptually be categorized as computer tomography (CT) based, fluoroscopy based, or image-free. The current study presents a comprehensive accuracy analysis on the computer assisted placement accuracy of acetabular cups. It combines analyses using mathematical approaches, in vitro testing environments, and an in vivo clinical trial. A hybrid navigation approach combining image-free with fluoroscopic technology was chosen as the best compromise to CT-based systems. It introduces pointer-based digitization for easily assessable points and bi-planar fluoroscopy for deep-seated landmarks. From the in vitro data maximum deviations were found to be 3.6 degrees for inclination and 3.8 degrees for anteversion relative to a pre-defined test position. The maximum difference between intraoperatively calculated cup inclination and anteversion with the postoperatively measured position was 4 degrees and 5 degrees, respectively. These data coincide with worst cases scenario predictions applying a statistical simulation model. The proper use of navigation technology can reduce variability of cup placement well within the surgical safe zone. Surgeons have to concentrate on a variety of error sources during the procedure, which may explain the reported strong learning curves for CAOS technologies.

An integrated approach for reconstructing surface models of the proximal femur from sparse input data for surgical navigation

A patient-specific surface model of the proximal femur plays an important role in planning and supporting various computer-assisted surgical procedures including total hip replacement, hip resurfacing, and osteotomy of the proximal femur. The common approach to derive 3D models of the proximal femur is to use imaging techniques such as computed tomography (CT) or magnetic resonance imaging (MRI). However, the high logistic effort, the extra radiation (CT-imaging), and the large quantity of data to be acquired and processed make them less functional. In this paper, we present an integrated approach using a multi-level point distribution model (ML-PDM) to reconstruct a patient-specific model of the proximal femur from intra-operatively available sparse data. Results of experiments performed on dry cadaveric bones using dozens of 3D points are presented, as well as experiments using a limited number of 2D X-ray images, which demonstrate promising accuracy of the present approach.

Dynamic registration using ultrasound for anatomical referencing

This paper proposes methods to circumvent the need to attach physical markers to bones for anatomical referencing in computer-assisted orthopedic surgery. Using ultrasound, a bone could be non-invasively referenced, and so the problem is formulated as the need for dynamic registration. A method for correspondence establishment is presented, and the matching step is based on three least-squares algorithms: two that are typically used in registration methods such as ICP, and the third is a form of the Unscented Kalman filter that was adapted to work in this context. A simulation was developed in order to reliably evaluate and compare the dynamic registration methods

Precise estimation of postoperative cup alignment from single standard X-ray radiograph with gonadal shielding

This paper addresses the problem of estimating postoperative cup alignment from single standard X-ray radiograph with gonadal shielding. The widely used procedure of evaluation of cup orientation following total hip arthroplasty using single standard anteroposterior radiograph is known inaccurate, largely due to the wide variability in individual pelvic position relative to X-ray plate. 2D-3D image registration methods have been introduced to estimate the rigid transformation between a preoperative CT volume and postoperative radiograph(s) for an accurate estimation of the postoperative cup alignment relative to an anatomical reference extracted from the CT data. However, these methods require either multiple radiographs or a radiograph-specific calibration, both of which are not avaiable for most retrospective studies. Furthermore, these methods were only evaluated on X-ray radiograph(s) without gonadal shielding. In this paper, we propose to use a hybrid 2D-3D registration scheme combining an iterative landmark-to-ray registration with a 2D-3D intensity-based registration to estimate the rigid transfromation for a precise estimation of cup alignment. Quantitative and qualitative results evaluated on clinical and cadaveric datasets are given which indicate the validity of our approach.

Noninvasive three-dimensional assessment of femoroacetabular impingement

A CT-based method ("HipMotion") for the noninvasive three-dimensional assessment of femoroacetabular impingement (FAI) was developed, validated, and applied in a clinical pilot study. The method allows for the anatomically based calculation of hip range of motion (ROM), the exact location of the impingement zone, and the simulation of quantified surgical maneuvers for FAI. The accuracy of HipMotion was 0.7 +/- 3.1 degrees in a plastic bone setup and -5.0 +/- 5.6 degrees in a cadaver setup. Reliability and reproducibility were excellent [intraclass correlation coefficient (ICC) > 0.87] for all measures except external rotation (ICC = 0.48). The normal ROM was determined from a cohort of 150 patients and was compared to 31 consecutive hips with FAI. Patients with FAI had a significantly decreased flexion, internal rotation, and abduction in comparison to normal hips (p < 0.001). Normal hip flexion and internal rotation are generally overestimated in a number of orthopedic textbooks. HipMotion is a useful tool for further assessment of impinging hips and for appropriate planning of the necessary amount of surgical intervention, which represents the basis for future computer-assisted treatment of FAI with less invasive surgical approaches, such as hip arthroscopy.