High-accuracy patient-to-image registration for the facilitation of image-guided robotic microsurgery on the head

Image-guided microsurgery requires accuracies an order of magnitude higher than today's navigation systems provide. A critical step toward the achievement of such low-error requirements is a highly accurate and verified patient-to-image registration. With the aim of reducing target registration error to a level that would facilitate the use of image-guided robotic microsurgery on the rigid anatomy of the head, we have developed a semiautomatic fiducial detection technique. Automatic force-controlled localization of fiducials on the patient is achieved through the implementation of a robotic-controlled tactile search within the head of a standard surgical screw. Precise detection of the corresponding fiducials in the image data is realized using an automated model-based matching algorithm on high-resolution, isometric cone beam CT images. Verification of the registration technique on phantoms demonstrated that through the elimination of user variability, clinically relevant target registration errors of approximately 0.1 mm could be achieved.

A navigation system for percutaneous needle interventions based on PET/CT images: design, workflow and error analysis of soft tissue and bone punctures

Percutaneous needle intervention based on PET/CT images is effective, but exposes the patient to unnecessary radiation due to the increased number of CT scans required. Computer assisted intervention can reduce the number of scans, but requires handling, matching and visualization of two different datasets. While one dataset is used for target definition according to metabolism, the other is used for instrument guidance according to anatomical structures. No navigation systems capable of handling such data and performing PET/CT image-based procedures while following clinically approved protocols for oncologic percutaneous interventions are available. The need for such systems is emphasized in scenarios where the target can be located in different types of tissue such as bone and soft tissue. These two tissues require different clinical protocols for puncturing and may therefore give rise to different problems during the navigated intervention. Studies comparing the performance of navigated needle interventions targeting lesions located in these two types of tissue are not often found in the literature. Hence, this paper presents an optical navigation system for percutaneous needle interventions based on PET/CT images. The system provides viewers for guiding the physician to the target with real-time visualization of PET/CT datasets, and is able to handle targets located in both bone and soft tissue. The navigation system and the required clinical workflow were designed taking into consideration clinical protocols and requirements, and the system is thus operable by a single person, even during transition to the sterile phase. Both the system and the workflow were evaluated in an initial set of experiments simulating 41 lesions (23 located in bone tissue and 18 in soft tissue) in swine cadavers. We also measured and decomposed the overall system error into distinct error sources, which allowed for the identification of particularities involved in the process as well as highlighting the differences between bone and soft tissue punctures. An overall average error of 4.23 mm and 3.07 mm for bone and soft tissue punctures, respectively, demonstrated the feasibility of using this system for such interventions. The proposed system workflow was shown to be effective in separating the preparation from the sterile phase, as well as in keeping the system manageable by a single operator. Among the distinct sources of error, the user error based on the system accuracy (defined as the distance from the planned target to the actual needle tip) appeared to be the most significant. Bone punctures showed higher user error, whereas soft tissue punctures showed higher tissue deformation error.

Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies

Presenting visual feedback for image-guided surgery on a monitor requires the surgeon to perform time-consuming comparisons and diversion of sight and attention away from the patient. Deficiencies in previously developed augmented reality systems for image-guided surgery have, however, prevented the general acceptance of any one technique as a viable alternative to monitor displays. This work presents an evaluation of the feasibility and versatility of a novel augmented reality approach for the visualisation of surgical planning and navigation data. The approach, which utilises a portable image overlay device, was evaluated during integration into existing surgical navigation systems and during application within simulated navigated surgery scenarios.

A cost-effective surgical navigation solution for periacetabular osteotomy (PAO) surgery.

PURPOSE To evaluate a low-cost, inertial sensor-based surgical navigation solution for periacetabular osteotomy (PAO) surgery without the line-of-sight impediment. METHODS Two commercial inertial measurement units (IMU, Xsens Technologies, The Netherlands), are attached to a patient's pelvis and to the acetabular fragment, respectively. Registration of the patient with a pre-operatively acquired computer model is done by recording the orientation of the patient's anterior pelvic plane (APP) using one IMU. A custom-designed device is used to record the orientation of the APP in the reference coordinate system of the IMU. After registration, the two sensors are mounted to the patient's pelvis and acetabular fragment, respectively. Once the initial position is recorded, the orientation is measured and displayed on a computer screen. A patient-specific computer model generated from a pre-operatively acquired computed tomography scan is used to visualize the updated orientation of the acetabular fragment. RESULTS Experiments with plastic bones (eight hip joints) performed in an operating room comparing a previously developed optical navigation system with our inertial-based navigation system showed no statistically significant difference on the measurement of acetabular component reorientation. In all eight hip joints the mean absolute difference was below four degrees. CONCLUSION Using two commercially available inertial measurement units we show that it is possible to accurately measure the orientation (inclination and anteversion) of the acetabular fragment during PAO surgery and therefore to successfully eliminate the line-of-sight impediment that optical navigation systems have.

Intraoperative image-guided navigation system: development and applicability in 65 patients undergoing liver surgery

Background Image-guided systems have recently been introduced for their application in liver surgery.We aimed to identify and propose suitable indications for image-guided navigation systems in the domain of open oncologic liver surgery and,more specifically, in the setting of liver resection with and without microwave ablation. Method Retrospective analysis was conducted in patients undergoing liver resection with and without microwave ablation using an intraoperative image-guided stereotactic system during three stages of technological development (accuracy: 8.4 ± 4.4 mm in phase I and 8.4 ± 6.5 mm in phase II versus 4.5 ± 3.6 mm in phase III). It was evaluated, in which indications image-guided surgery was used according to the different stages of technical development. Results Between 2009 and 2013, 65 patients underwent image-guided surgical treatment, resection alone (n=38), ablation alone (n =11), or a combination thereof (n =16). With increasing accuracy of the system, image guidance was progressively used for atypical resections and combined microwave ablation and resection instead of formal liver resection (p<0.0001). Conclusion Clinical application of image guidance is feasible, while its efficacy is subject to accuracy. The concept of image guidance has been shown to be increasingly efficient for selected indications in liver surgery. While accuracy of available technology is increasing pertaining to technological advancements, more and more previously untreatable scenarios such as multiple small, bilobar lesions and so-called vanishing lesions come within reach.

The foundations of computer assisted surgery

Using navigation systems in general orthopaedic surgery and, in particular, knee replacement is becoming more and more accepted. This paper describes the basic technological concepts of modern computer assisted surgical systems. It explains the variation in currently available systems and outlines research activities that will potentially influence future products. In general, each navigation system is defined by three components: (1) the therapeutic object is the anatomical structure that is operated on using the navigation system, (2) the virtual object represents an image of the therapeutic object, with radiological images or computer generated models potentially being used, and (3) last but not least, the navigator acquires the spatial position and orientation of instruments and anatomy thus providing the necessary data to replay surgical action in real-time on the navigation system's screen.

Non-photorealistic rendering of virtual implant models for computer-assisted fluoroscopy-based surgical procedures

Surgical navigation systems visualize the positions and orientations of surgical instruments and implants as graphical overlays onto a medical image of the operated anatomy on a computer monitor. The orthopaedic surgical navigation systems could be categorized according to the image modalities that are used for the visualization of surgical action. In the so-called CT-based systems or 'surgeon-defined anatomy' based systems, where a 3D volume or surface representation of the operated anatomy could be constructed from the preoperatively acquired tomographic data or through intraoperatively digitized anatomy landmarks, a photorealistic rendering of the surgical action has been identified to greatly improve usability of these navigation systems. However, this may not hold true when the virtual representation of surgical instruments and implants is superimposed onto 2D projection images in a fluoroscopy-based navigation system due to the so-called image occlusion problem. Image occlusion occurs when the field of view of the fluoroscopic image is occupied by the virtual representation of surgical implants or instruments. In these situations, the surgeon may miss part of the image details, even if transparency and/or wire-frame rendering is used. In this paper, we propose to use non-photorealistic rendering to overcome this difficulty. Laboratory testing results on foamed plastic bones during various computer-assisted fluoroscopybased surgical procedures including total hip arthroplasty and long bone fracture reduction and osteosynthesis are shown.

Cone-beam computed tomography-guided stereotactic liver punctures: a phantom study

PURPOSE Images from computed tomography (CT), combined with navigation systems, improve the outcomes of local thermal therapies that are dependent on accurate probe placement. Although the usage of CT is desired, its availability for time-consuming radiological interventions is limited. Alternatively, three-dimensional images from C-arm cone-beam CT (CBCT) can be used. The goal of this study was to evaluate the accuracy of navigated CBCT-guided needle punctures, controlled with CT scans. METHODS Five series of five navigated punctures were performed on a nonrigid phantom using a liver specific navigation system and CBCT volumetric dataset for planning and navigation. To mimic targets, five titanium screws were fixed to the phantom. Target positioning accuracy (TPECBCT) was computed from control CT scans and divided into lateral and longitudinal components. Additionally, CBCT-CT guidance accuracy was deducted by performing CBCT-to-CT image coregistration and measuring TPECBCT-CT from fused datasets. Image coregistration was evaluated using fiducial registration error (FRECBCT-CT) and target registration error (TRECBCT-CT). RESULTS Positioning accuracies in lateral directions pertaining to CBCT (TPECBCT = 2.1 ± 1.0 mm) were found to be better to those achieved from previous study using CT (TPECT = 2.3 ± 1.3 mm). Image coregistration error was 0.3 ± 0.1 mm, resulting in an average TRE of 2.1 ± 0.7 mm (N = 5 targets) and average Euclidean TPECBCT-CT of 3.1 ± 1.3 mm. CONCLUSIONS Stereotactic needle punctures might be planned and performed on volumetric CBCT images and controlled with multidetector CT with positioning accuracy higher or similar to those performed using CT scanners.

Computer planned, image-guided combined resection and ablation for bilobar colorectal liver metastases

For patients with extensive bilobar colorectal liver metastases (CRLM), initial surgery may not be feasible and a multimodal approach including microwave ablation (MWA) provides the only chance for prolonged survival. Intraoperative navigation systems may improve the accuracy of ablation and surgical resection of so-called "vanishing lesions", ultimately improving patient outcome. Clinical application of intraoperative navigated liver surgery is illustrated in a patient undergoing combined resection/MWA for multiple, synchronous, bilobar CRLM. Regular follow-up with computed tomography (CT) allowed for temporal development of the ablation zones. Of the ten lesions detected in a preoperative CT scan, the largest lesion was resected and the others were ablated using an intraoperative navigation system. Twelve months post-surgery a new lesion (Seg IVa) was detected and treated by trans-arterial embolization. Nineteen months post-surgery new liver and lung metastases were detected and a palliative chemotherapy started. The patient passed away four years after initial diagnosis. For patients with extensive CRLM not treatable by standard surgery, navigated MWA/resection may provide excellent tumor control, improving longer-term survival. Intraoperative navigation systems provide precise, real-time information to the surgeon, aiding the decision-making process and substantially improving the accuracy of both ablation and resection. Regular follow-ups including 3D modeling allow for early discrimination between ablation zones and recurrent tumor lesions.

Galileo Orbit and Clock Quality of the IGS Multi-GNSS Experiment

The Multi-GNSS Experiment (MGEX) of the International GNSS Service (IGS) aims at the data collection and analysis of all available satellite navigation systems. In particular the new global and regional satellite navigation systems are of interest, i.e., the European Galileo, the Chinese BeiDou, the Japanese QZSS as well as satellite based augmentation systems. This article analyzes the orbit and clock quality of the Galileo products of four MGEX analysis centers for a common time period of 20 weeks. Orbit comparisons of the individual analysis centers have a consistency at the 5–30 cm level. Day boundary discontinuities range from 4 to 28 cm whereas 2-day orbit fit RMS values vary between 1 and 7 cm. The accuracy evaluated by satellite laser ranging residuals is on the one decimeter level with a systematic bias of about −5 cm for all analysis centers. In addition, systematic errors on the decimeter level related to solar radiation pressure mismodeling are present in all orbit products. Due to the correlation of radial orbit errors with the clock parameters, these errors are also visible as a bump in the Allan deviation of the Galileo satellite clocks at the orbital frequency.

Rapid method to express and purify human membrane protein using the Xenopus oocyte system for functional and low-resolution structural analysis.

Progress toward elucidating the 3D structures of eukaryotic membrane proteins has been hampered by the lack of appropriate expression systems. Recent work using the Xenopus oocyte as a novel expression system for structural analysis demonstrates the capability of providing not only the significant amount of protein yields required for structural work but also the expression of eukaryotic membrane proteins in a more native and functional conformation. There is a long history using the oocyte expression system as an efficient tool for membrane transporter and channel expression in direct functional analysis, but improvements in robotic injection systems and protein yield optimization allow the rapid scalability of expressed proteins to be purified and characterized in physiologically relevant structural states. Traditional overexpression systems (yeast, bacteria, and insect cells) by comparison require chaotropic conditions over several steps for extraction, solubilization, and purification. By contrast, overexpressing within the oocyte system for subsequent negative-staining transmission electron microscopy studies provides a single system that can functionally assess and purify eukaryotic membrane proteins in fewer steps maintaining the physiological properties of the membrane protein.

Image-Guided Orthopaedic Surgery

Image-guided surgery systems are increasingly being used during orthopaedic interventions. The aim of this chapter is to present the basic elements of these image-guided orthopaedic surgery (IGOS) devices and to review examples of preoperative or intra-operative imaging modalities, of trackers for navigation systems, of different surgical robots, and of methods for registration as well as referencing. IGOS modules that have been realised for different surgical procedures will be presented.

Computer-Assisted Orthopedic Surgery: Current State and Future Perspective

Introduced about two decades ago, computer-assisted orthopedic surgery (CAOS) has emerged as a new and independent area, due to the importance of treatment of musculoskeletal diseases in orthopedics and traumatology, increasing availability of different imaging modalities, and advances in analytics and navigation tools. The aim of this paper is to present the basic elements of CAOS devices and to review state-of-the-art examples of different imaging modalities used to create the virtual representations, of different position tracking devices for navigation systems, of different surgical robots, of different methods for registration and referencing, and of CAOS modules that have been realized for different surgical procedures. Future perspectives will also be outlined.

Comparison of three optical tracking systems in a complex navigation scenario

Three-dimensional rotational X-ray imaging with the SIREMOBIL Iso-C3D (Siemens AG, Medical Solutions, Erlangen, Germany) has become a well-established intra-operative imaging modality. In combination with a tracking system, the Iso-C3D provides inherently registered image volumes ready for direct navigation. This is achieved by means of a pre-calibration procedure. The aim of this study was to investigate the influence of the tracking system used on the overall navigation accuracy of direct Iso-C3D navigation. Three models of tracking system were used in the study: Two Optotrak 3020s, a Polaris P4 and a Polaris Spectra system, with both Polaris systems being in the passive operation mode. The evaluation was carried out at two different sites using two Iso-C3D devices. To measure the navigation accuracy, a number of phantom experiments were conducted using an acrylic phantom equipped with titanium spheres. After scanning, a special pointer was used to pinpoint these markers. The difference between the digitized and navigated positions served as the accuracy measure. Up to 20 phantom scans were performed for each tracking system. The average accuracy measured was 0.86 mm and 0.96 mm for the two Optotrak 3020 systems, 1.15 mm for the Polaris P4, and 1.04 mm for the Polaris Spectra system. For the Polaris systems a higher maximal error was found, but all three systems yielded similar minimal errors. On average, all tracking systems used in this study could deliver similar navigation accuracy. The passive Polaris system showed ? as expected ? higher maximal errors; however, depending on the application constraints, this might be negligible.