Automated Intervertebral Disc Detection from Low Resolution, Sparse MRI Images for the Planning of Scan Geometries

Robust and accurate identification of intervertebral discs from low resolution, sparse MRI scans is essential for the automated scan planning of the MRI spine scan. This paper presents a graphical model based solution for the detection of both the positions and orientations of intervertebral discs from low resolution, sparse MRI scans. Compared with the existing graphical model based methods, the proposed method does not need a training process using training data and it also has the capability to automatically determine the number of vertebrae visible in the image. Experiments on 25 low resolution, sparse spine MRI data sets verified its performance.

Single fluoroscopic image based 2D/3D reconstruction of a scaled, patient-specific vertebral model

Purpose Accurate three-dimensional (3D) models of lumbar vertebrae can enable image-based 3D kinematic analysis. The common approach to derive 3D models is by direct segmentation of CT or MRI datasets. However, these have the disadvantages that they are expensive, timeconsuming and/or induce high-radiation doses to the patient. In this study, we present a technique to automatically reconstruct a scaled 3D lumbar vertebral model from a single two-dimensional (2D) lateral fluoroscopic image. Methods Our technique is based on a hybrid 2D/3D deformable registration strategy combining a landmark-to-ray registration with a statistical shape model-based 2D/3D reconstruction scheme. Fig. 1 shows different stages of the reconstruction process. Four cadaveric lumbar spine segments (total twelve lumbar vertebrae) were used to validate the technique. To evaluate the reconstruction accuracy, the surface models reconstructed from the lateral fluoroscopic images were compared to the associated ground truth data derived from a 3D CT-scan reconstruction technique. For each case, a surface-based matching was first used to recover the scale and the rigid transformation between the reconstructed surface model Results Our technique could successfully reconstruct 3D surface models of all twelve vertebrae. After recovering the scale and the rigid transformation between the reconstructed surface models and the ground truth models, the average error of the 2D/3D surface model reconstruction over the twelve lumbar vertebrae was found to be 1.0 mm. The errors of reconstructing surface models of all twelve vertebrae are shown in Fig. 2. It was found that the mean errors of the reconstructed surface models in comparison to their associated ground truths after iterative scaled rigid registrations ranged from 0.7 mm to 1.3 mm and the rootmean squared (RMS) errors ranged from 1.0 mm to 1.7 mm. The average mean reconstruction error was found to be 1.0 mm. Conclusion An accurate, scaled 3D reconstruction of the lumbar vertebra can be obtained from a single lateral fluoroscopic image using a statistical shape model based 2D/3D reconstruction technique. Future work will focus on applying the reconstructed model for 3D kinematic analysis of lumbar vertebrae, an extension of our previously-reported imagebased kinematic analysis. The developed method also has potential applications in surgical planning and navigation.

Coupling biomechanics to a cellular level model: An approach to patient-specific image driven multi-scale and multi-physics tumor simulation

Modeling of tumor growth has been performed according to various approaches addressing different biocomplexity levels and spatiotemporal scales. Mathematical treatments range from partial differential equation based diffusion models to rule-based cellular level simulators, aiming at both improving our quantitative understanding of the underlying biological processes and, in the mid- and long term, constructing reliable multi-scale predictive platforms to support patient-individualized treatment planning and optimization. The aim of this paper is to establish a multi-scale and multi-physics approach to tumor modeling taking into account both the cellular and the macroscopic mechanical level. Therefore, an already developed biomodel of clinical tumor growth and response to treatment is self-consistently coupled with a biomechanical model. Results are presented for the free growth case of the imageable component of an initially point-like glioblastoma multiforme tumor. The composite model leads to significant tumor shape corrections that are achieved through the utilization of environmental pressure information and the application of biomechanical principles. Using the ratio of smallest to largest moment of inertia of the tumor material to quantify the effect of our coupled approach, we have found a tumor shape correction of 20\% by coupling biomechanics to the cellular simulator as compared to a cellular simulation without preferred growth directions. We conclude that the integration of the two models provides additional morphological insight into realistic tumor growth behavior. Therefore, it might be used for the development of an advanced oncosimulator focusing on tumor types for which morphology plays an important role in surgical and/or radio-therapeutic treatment planning.

Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies

Presenting visual feedback for image-guided surgery on a monitor requires the surgeon to perform time-consuming comparisons and diversion of sight and attention away from the patient. Deficiencies in previously developed augmented reality systems for image-guided surgery have, however, prevented the general acceptance of any one technique as a viable alternative to monitor displays. This work presents an evaluation of the feasibility and versatility of a novel augmented reality approach for the visualisation of surgical planning and navigation data. The approach, which utilises a portable image overlay device, was evaluated during integration into existing surgical navigation systems and during application within simulated navigated surgery scenarios.

Surgical planning tool for robotically assisted hearing aid implantation

PURPOSE : For the facilitation of minimally invasive robotically performed direct cochlea access (DCA) procedure, a surgical planning tool which enables the surgeon to define landmarks for patient-to-image registration, identify the necessary anatomical structures and define a safe DCA trajectory using patient image data (typically computed tomography (CT) or cone beam CT) is required. To this end, a dedicated end-to-end software planning system for the planning of DCA procedures that addresses current deficiencies has been developed. METHODS :    Efficient and robust anatomical segmentation is achieved through the implementation of semiautomatic algorithms; high-accuracy patient-to-image registration is achieved via an automated model-based fiducial detection algorithm and functionality for the interactive definition of a safe drilling trajectory based on case-specific drill positioning uncertainty calculations was developed. RESULTS :    The accuracy and safety of the presented software tool were validated during the conduction of eight DCA procedures performed on cadaver heads. The plan for each ear was completed in less than 20 min, and no damage to vital structures occurred during the procedures. The integrated fiducial detection functionality enabled final positioning accuracies of [Formula: see text] mm. CONCLUSIONS :    Results of this study demonstrated that the proposed software system could aid in the safe planning of a DCA tunnel within an acceptable time.

Impact of a self-developed planning and self-constructed navigation system on skull base surgery: 10 years experience

CONCLUSION: Our self-developed planning and navigation system has proven its capacity for accurate surgery on the anterior and lateral skull base. With the incorporation of augmented reality, image-guided surgery will evolve into 'information-guided surgery'. OBJECTIVE: Microscopic or endoscopic skull base surgery is technically demanding and its outcome has a great impact on a patient's quality of life. The goal of the project was aimed at developing and evaluating enabling navigation surgery tools for simulation, planning, training, education, and performance. This clinically applied technological research was complemented by a series of patients (n=406) who were treated by anterior and lateral skull base procedures between 1997 and 2006. MATERIALS AND METHODS: Optical tracking technology was used for positional sensing of instruments. A newly designed dynamic reference base with specific registration techniques using fine needle pointer or ultrasound enables the surgeon to work with a target error of < 1 mm. An automatic registration assessment method, which provides the user with a color-coded fused representation of CT and MR images, indicates to the surgeon the location and extent of registration (in)accuracy. Integration of a small tracker camera mounted directly on the microscope permits an advantageous ergonomic way of working in the operating room. Additionally, guidance information (augmented reality) from multimodal datasets (CT, MRI, angiography) can be overlaid directly onto the surgical microscope view. The virtual simulator as a training tool in endonasal and otological skull base surgery provides an understanding of the anatomy as well as preoperative practice using real patient data. RESULTS: Using our navigation system, no major complications occurred in spite of the fact that the series included difficult skull base procedures. An improved quality in the surgical outcome was identified compared with our control group without navigation and compared with the literature. The surgical time consumption was reduced and more minimally invasive approaches were possible. According to the participants' questionnaires, the educational effect of the virtual simulator in our residency program received a high ranking.

Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy

PURPOSE: The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation. METHODS AND MATERIALS: The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient. RESULTS: In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm). CONCLUSIONS: The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.

Computer-aided operation planning and 3-dimensional osteotomy guidance for alveolar distraction

Objectives: In alveolar distraction, in cases of severe atrophy in particular, it is often difficult to perform osteotomies in order to make a transport segment in optimal size and shape. Moreover care must be taken, not to damage the closely locating anato- mical structures such as the maxillary sinus, the inferior alveolar nerve, and the roots of the neighboring teeth. For setting ideal osteotomy lines exactly, we have developed a CT-based preoperative planning tool. Methods: 3-dimensional visual reconstruction of the jaw is created from the preoperative CT scans (1.0-mm slice thick- ness). Using the image-processing software Mimics (Materialise, Yokohama, Japan), various procedures of virtual cutting are simulated first to determine optimal osteotomy lines and to design an ideal transport segment. After the computer planning, data from the virtual solid model are transferred to a rapid prototype model, and a guiding splint is made to transfer the planned surgical simulation to the actual surgery. Results: The method was used in a case of severe atrophy of the anterior maxilla. The patient had a large maxillary sinus requir- ing a precise osteotomy in this critical area. Using the splint allowing a 3-dimensional guidance, alveolar osteotomies were easily done to achieve a transport segment in sufficient dimen- sion as planned, and any perforation of the maxillary sinus could be avoided. Finally the alveolar distraction of 10mm has suc- cessfully been performed. Conclusion: The preoperative planning method and the guiding splint described here are useful in problematic cases requiring an extremely precise osteotomy due to lack of bony space.

Computer-aided diagnosis of carotid atherosclerosis based on ultrasound image statistics, laws' texture and neural networks

Quantitative characterisation of carotid atherosclerosis and classification into symptomatic or asymptomatic is crucial in planning optimal treatment of atheromatous plaque. The computer-aided diagnosis (CAD) system described in this paper can analyse ultrasound (US) images of carotid artery and classify them into symptomatic or asymptomatic based on their echogenicity characteristics. The CAD system consists of three modules: a) the feature extraction module, where first-order statistical (FOS) features and Laws' texture energy can be estimated, b) the dimensionality reduction module, where the number of features can be reduced using analysis of variance (ANOVA), and c) the classifier module consisting of a neural network (NN) trained by a novel hybrid method based on genetic algorithms (GAs) along with the back propagation algorithm. The hybrid method is able to select the most robust features, to adjust automatically the NN architecture and to optimise the classification performance. The performance is measured by the accuracy, sensitivity, specificity and the area under the receiver-operating characteristic (ROC) curve. The CAD design and development is based on images from 54 symptomatic and 54 asymptomatic plaques. This study demonstrates the ability of a CAD system based on US image analysis and a hybrid trained NN to identify atheromatous plaques at high risk of stroke.

Adjuvant therapy after resection of brain metastases. Frameless image-guided LINAC-based radiosurgery and stereotactic hypofractionated radiotherapy

BACKGROUND: Tumor bed stereotactic radiosurgery (SRS) after resection of brain metastases is a new strategy to delay or avoid whole-brain irradiation (WBRT) and its associated toxicities. This retrospective study analyzes results of frameless image-guided linear accelerator (LINAC)-based SRS and stereotactic hypofractionated radiotherapy (SHRT) as adjuvant treatment without WBRT. MATERIALS AND METHODS: Between March 2009 and February 2012, 44 resection cavities in 42 patients were treated with SRS (23 cavities) or SHRT (21 cavities). All treatments were delivered using a stereotactic LINAC. All cavities were expanded by ≥ 2 mm in all directions to create the clinical target volume (CTV). RESULTS: The median planning target volume (PTV) for SRS was 11.1 cm(3). The median dose prescribed to the PTV margin for SRS was 17 Gy. Median PTV for SHRT was 22.3 cm(3). The fractionation schemes applied were: 4 fractions of 6 Gy (5 patients), 6 fractions of 4 Gy (6 patients) and 10 fractions of 4 Gy (10 patients). Median follow-up was 9.6 months. Local control (LC) rates after 6 and 12 months were 91 and 77 %, respectively. No statistically significant differences in LC rates between SRS and SHRT treatments were observed. Distant brain control (DBC) rates at 6 and 12 months were 61 and 33 %, respectively. Overall survival (OS) at 6 and 12 months was 87 and 63.5 %, respectively, with a median OS of 15.9 months. One patient treated by SRS showed symptoms of radionecrosis, which was confirmed histologically. CONCLUSION: Frameless image-guided LINAC-based adjuvant SRS and SHRT are effective and well tolerated local treatment strategies after resection of brain metastases in patients with oligometastatic disease.

Prediction of Cranio-Maxilofacial Surgical Planning using an Inverse Soft Tissue Modelling Approach

In cranio-maxillofacial surgery, the determination of a proper surgical plan is an important step to attain a desired aesthetic facial profile and a complete denture closure. In the present paper, we propose an efficient modeling approach to predict the surgical planning on the basis of the desired facial appearance and optimal occlusion. To evaluate the proposed planning approach, the predicted osteotomy plan of six clinical cases that underwent CMF surgery were compared to the real clinical plan. Thereafter, simulated soft-tissue outcomes were compared using the predicted and real clinical plan. This preliminary retrospective comparison of both osteotomy planning and facial outlook shows a good agreement and thereby demonstrates the potential application of the proposed approach in cranio-maxillofacial surgical planning prediction.

Three-dimensional printing creates models for surgical planning of aortic valve replacement after previous coronary bypass grafting.

PURPOSE Resternotomy for aortic valve replacement in patients with previous coronary artery bypass grafting and an internal mammary artery graft may be a surgical problem. Thus, we are exploring the effect of using rapid prototyping techniques for surgical planning and intraoperative orientation during aortic valve replacement after previous coronary artery bypass grafting (CABG). DESCRIPTION As a proof of concept, we studied a patient who had undergone CABG 5 years earlier. At that time the patient received a left internal mammary artery graft to the left anterior descending artery and a venous graft to the right coronary artery. Now the patient required aortic valve replacement due to symptomatic aortic valve stenosis. The left internal mammary artery bypass and the right coronary artery bypass were patent and showed good flow in the angiography. The patient was examined by 128-slice computed tomography. The image data were visualized and reconstructed. Afterwards, a replica showing the anatomic structures was fabricated using a rapid prototyping machine. EVALUATION Using data derived from 128-slice computed tomography angiography linked to proprietary software, we were able to create three-dimensional reconstructions of the vascular anatomy after the previous CABG. The models were sterilized and taken to the operating theatre for orientation during the surgical procedure. CONCLUSIONS Stereolithographic replicas are helpful for choosing treatment strategies in surgical planning and for intraoperative orientation during reoperations of patients with previous CABG.

X-ray image calibration and its application to clinical orthopedics.

X-ray imaging is one of the most commonly used medical imaging modality. Albeit X-ray radiographs provide important clinical information for diagnosis, planning and post-operative follow-up, the challenging interpretation due to its 2D projection characteristics and the unknown magnification factor constrain the full benefit of X-ray imaging. In order to overcome these drawbacks, we proposed here an easy-to-use X-ray calibration object and developed an optimization method to robustly find correspondences between the 3D fiducials of the calibration object and their 2D projections. In this work we present all the details of this outlined concept. Moreover, we demonstrate the potential of using such a method to precisely extract information from calibrated X-ray radiographs for two different orthopedic applications: post-operative acetabular cup implant orientation measurement and 3D vertebral body displacement measurement during preoperative traction tests. In the first application, we have achieved a clinically acceptable accuracy of below 1° for both anteversion and inclination angles, where in the second application an average displacement of 8.06±3.71 mm was measured. The results of both applications indicate the importance of using X-ray calibration in the clinical routine.

Semiautomatic Cochleostomy Target and Insertion Trajectory Planning for Minimally Invasive Cochlear Implantation

A major component of minimally invasive cochlear implantation is atraumatic scala tympani (ST) placement of the electrode array. This work reports on a semiautomatic planning paradigm that uses anatomical landmarks and cochlear surface models for cochleostomy target and insertion trajectory computation. The method was validated in a human whole head cadaver model (n = 10 ears). Cochleostomy targets were generated from an automated script and used for consecutive planning of a direct cochlear access (DCA) drill trajectory from the mastoid surface to the inner ear. An image-guided robotic system was used to perform both, DCA and cochleostomy drilling. Nine of 10 implanted specimens showed complete ST placement. One case of scala vestibuli insertion occurred due to a registration/drilling error of 0.79 mm. The presented approach indicates that a safe cochleostomy target and insertion trajectory can be planned using conventional clinical imaging modalities, which lack sufficient resolution to identify the basilar membrane.