Assessment of spline-based 2D-3D registration for image-guided spine surgery

2D-3D registration of pre-operative 3D volumetric data with a series of calibrated and undistorted intra-operative 2D projection images has shown great potential in CT-based surgical navigation because it obviates the invasive procedure of the conventional registration methods. In this study, a recently introduced spline-based multi-resolution 2D-3D image registration algorithm has been adapted together with a novel least-squares normalized pattern intensity (LSNPI) similarity measure for image guided minimally invasive spine surgery. A phantom and a cadaver together with their respective ground truths were specially designed to experimentally assess possible factors that may affect the robustness, accuracy, or efficiency of the registration. Our experiments have shown that it is feasible for the assessed 2D-3D registration algorithm to achieve sub-millimeter accuracy in a realistic setup in less than one minute.

Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy

PURPOSE: The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation. METHODS AND MATERIALS: The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient. RESULTS: In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm). CONCLUSIONS: The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.

ANIMATED TRANSITION IN SIMILARITY-BASED TILED IMAGE LAYOUT

Effective techniques for organizing and visualizing large image collections are in growing demand as visual search gets increasingly popular. iMap is a treemap representation for visualizing and navigating image search and clustering results based on the evaluation of image similarity using both visual and textual information. iMap not only makes effective use of available display area to arrange images but also maintains stable update when images are inserted or removed during the query. A key challenge of using iMap lies in the difficult to follow and track the changes when updating the image arrangement as the query image changes. For many information visualization applications, showing the transition when interacting with the data is critically important as it can help users better perceive the changes and understand the underlying data. This work investigates the effectiveness of animated transition in a tiled image layout where the spiral arrangement of the images is based on their similarity. Three aspects of animated transition are considered, including animation steps, animation actions, and flying paths. Exploring and weighting the advantages and disadvantages of different methods for each aspect and in conjunction with the characteristics of the spiral image layout, we present an integrated solution, called AniMap, for animating the transition from an old layout to a new layout when a different image is selected as the query image. To smooth the animation and reduce the overlap among images during the transition, we explore different factors that might have an impact on the animation and propose our solution accordingly. We show the effectiveness of our animated transition solution by demonstrating experimental results and conducting a comparative user study.

Computer-aided diagnosis of carotid atherosclerosis based on ultrasound image statistics, laws' texture and neural networks

Quantitative characterisation of carotid atherosclerosis and classification into symptomatic or asymptomatic is crucial in planning optimal treatment of atheromatous plaque. The computer-aided diagnosis (CAD) system described in this paper can analyse ultrasound (US) images of carotid artery and classify them into symptomatic or asymptomatic based on their echogenicity characteristics. The CAD system consists of three modules: a) the feature extraction module, where first-order statistical (FOS) features and Laws' texture energy can be estimated, b) the dimensionality reduction module, where the number of features can be reduced using analysis of variance (ANOVA), and c) the classifier module consisting of a neural network (NN) trained by a novel hybrid method based on genetic algorithms (GAs) along with the back propagation algorithm. The hybrid method is able to select the most robust features, to adjust automatically the NN architecture and to optimise the classification performance. The performance is measured by the accuracy, sensitivity, specificity and the area under the receiver-operating characteristic (ROC) curve. The CAD design and development is based on images from 54 symptomatic and 54 asymptomatic plaques. This study demonstrates the ability of a CAD system based on US image analysis and a hybrid trained NN to identify atheromatous plaques at high risk of stroke.

Pollen percentage thresholds of Abies alba based on 13-year annual records of pollen deposition in modified Tauber traps: perspectives of application to fossil situations

Abies alba (fir), a submontane tree from Central European mountains and uplands, is of special interest for palaeoecological and palaeoclimate interpretations due to its sensitivity to air and soil humidity. Its present distribution limit in the uplands of SE Poland is still a matter of debate. In the Holocene fir expanded to Poland very late, but early fir populations are supposed to occur in the Šumava Mts (Czech Republic). The study aims: to estimate pollen thresholds for fir presence/absence in Bohemia (Czech Republic) and Poland on the basis of modified Tauber pollen traps; to use these thresholds for tracing fir presence in two pollen diagrams from Poland (Słone and Bezedna lakes) in the border zone between the Roztocze region (with fir forest stands today) and Polesie (where fir has never played an important role); and to investigate how the percentage presence/absence threshold can be used to trace the occurrence and abundance of fir trees in the Šumava Mts based on the pollen diagrams of Rokytecká slat' and Mrtvý luh. The fir pollen thresholds estimated in terms of PAR (pollen accumulation rates or pollen influx) range from 843 (grains cm− 2 year− 1) (Roztocze) to 61 (Krkonoše) and 49 (Šumava). Percentage thresholds range from 0.3% in Krkonoše where fir trees are not present within 4 km to 22% in fir-dominated woodland of the Roztocze, providing evidence of strong underrepresentation of fir in the pollen deposition. Application of these percentage thresholds to the Słone and Bezedna pollen diagrams indicates that occurrence of fir in the region is possible from 3.5 cal ky BP onwards, though the evidence is not decisive. In the Šumava, a low representation of fir pollen (1–2%) reflecting presence of scattered fir trees was detected as early as ca. 7.0 cal ky BP.

Adjuvant therapy after resection of brain metastases. Frameless image-guided LINAC-based radiosurgery and stereotactic hypofractionated radiotherapy

BACKGROUND: Tumor bed stereotactic radiosurgery (SRS) after resection of brain metastases is a new strategy to delay or avoid whole-brain irradiation (WBRT) and its associated toxicities. This retrospective study analyzes results of frameless image-guided linear accelerator (LINAC)-based SRS and stereotactic hypofractionated radiotherapy (SHRT) as adjuvant treatment without WBRT. MATERIALS AND METHODS: Between March 2009 and February 2012, 44 resection cavities in 42 patients were treated with SRS (23 cavities) or SHRT (21 cavities). All treatments were delivered using a stereotactic LINAC. All cavities were expanded by ≥ 2 mm in all directions to create the clinical target volume (CTV). RESULTS: The median planning target volume (PTV) for SRS was 11.1 cm(3). The median dose prescribed to the PTV margin for SRS was 17 Gy. Median PTV for SHRT was 22.3 cm(3). The fractionation schemes applied were: 4 fractions of 6 Gy (5 patients), 6 fractions of 4 Gy (6 patients) and 10 fractions of 4 Gy (10 patients). Median follow-up was 9.6 months. Local control (LC) rates after 6 and 12 months were 91 and 77 %, respectively. No statistically significant differences in LC rates between SRS and SHRT treatments were observed. Distant brain control (DBC) rates at 6 and 12 months were 61 and 33 %, respectively. Overall survival (OS) at 6 and 12 months was 87 and 63.5 %, respectively, with a median OS of 15.9 months. One patient treated by SRS showed symptoms of radionecrosis, which was confirmed histologically. CONCLUSION: Frameless image-guided LINAC-based adjuvant SRS and SHRT are effective and well tolerated local treatment strategies after resection of brain metastases in patients with oligometastatic disease.

Food Volume Computation for Self Dietary Assessment Applications

There is great demand for easily-accessible, user-friendly dietary self-management applications. Yet accurate, fully-automatic estimation of nutritional intake using computer vision methods remains an open research problem. One key element of this problem is the volume estimation, which can be computed from 3D models obtained using multi-view geometry. The paper presents a computational system for volume estimation based on the processing of two meal images. A 3D model of the served meal is reconstructed using the acquired images and the volume is computed from the shape. The algorithm was tested on food models (dummy foods) with known volume and on real served food. Volume accuracy was in the order of 90 %, while the total execution time was below 15 seconds per image pair. The proposed system combines simple and computational affordable methods for 3D reconstruction, remained stable throughout the experiments, operates in near real time, and places minimum constraints on users.

Stacking of discontinuous regional palaeoclimate records: Chironomid-based summer temperatures from the Alpine region

Since multi-site reconstructions are less affected by site-specific climatic effects and artefacts, regional palaeotemperature reconstructions based on a number of sites can provide more robust estimates of centennial- to millennial-scale temperature trends than individual, site-specific records. Furthermore, reconstructions based on multiple records are necessary for developing continuous climate records over time scales longer than covered by individual sequences. Here, we present a procedure for developing such reconstructions based on relatively short (centuries to millennia), discontinuously sampled records as are typically developed when using biotic proxies in lake sediments for temperature reconstruction. The approach includes an altitudinal correction of temperatures, an interpolation of individual records to equal time intervals, a stacking procedure for sections of the interval of interest that have the same records available, as well as a splicing procedure to link the individual stacked records into a continuous reconstruction. Variations in the final, stacked and spliced reconstruction are driven by variations in the individual records, whereas the absolute temperature values are determined by the stacked segment based on the largest number of records. With numerical simulations based on the NGRIP δ18O record, we demonstrate that the interpolation and stacking procedure provides an approximation of a smoothed palaeoclimate record if based on a sufficient number of discontinuously sampled records. Finally, we provide an example of a stacked and spliced palaeotemperature reconstruction 15000–90 calibrated 14C yr BP based on six chironomid records from the northern and central Swiss Alps and eastern France to discuss the potential and limitations of this approach.

A stratigraphic framework for abrupt climatic changes during the Last Glacial period based on three synchronized Greenland ice-core records: refining and extending the INTIMATE event stratigraphy

Due to their outstanding resolution and well-constrained chronologies, Greenland ice-core records provide a master record of past climatic changes throughout the Last Interglacial–Glacial cycle in the North Atlantic region. As part of the INTIMATE (INTegration of Ice-core, MArine and TErrestrial records) project, protocols have been proposed to ensure consistent and robust correlation between different records of past climate. A key element of these protocols has been the formal definition and ordinal numbering of the sequence of Greenland Stadials (GS) and Greenland Interstadials (GI) within the most recent glacial period. The GS and GI periods are the Greenland expressions of the characteristic Dansgaard–Oeschger events that represent cold and warm phases of the North Atlantic region, respectively. We present here a more detailed and extended GS/GI template for the whole of the Last Glacial period. It is based on a synchronization of the NGRIP, GRIP, and GISP2 ice-core records that allows the parallel analysis of all three records on a common time scale. The boundaries of the GS and GI periods are defined based on a combination of stable-oxygen isotope ratios of the ice (δ18O, reflecting mainly local temperature) and calcium ion concentrations (reflecting mainly atmospheric dust loading) measured in the ice. The data not only resolve the well-known sequence of Dansgaard–Oeschger events that were first defined and numbered in the ice-core records more than two decades ago, but also better resolve a number of short-lived climatic oscillations, some defined here for the first time. Using this revised scheme, we propose a consistent approach for discriminating and naming all the significant abrupt climatic events of the Last Glacial period that are represented in the Greenland ice records. The final product constitutes an extended and better resolved Greenland stratotype sequence, against which other proxy records can be compared and correlated. It also provides a more secure basis for investigating the dynamics and fundamental causes of these climatic perturbations.

Graphical Model-Based Vertebra Identification from X-Ray Image(s)

Automated identification of vertebrae from X-ray image(s) is an important step for various medical image computing tasks such as 2D/3D rigid and non-rigid registration. In this chapter we present a graphical model-based solution for automated vertebra identification from X-ray image(s). Our solution does not ask for a training process using training data and has the capability to automatically determine the number of vertebrae visible in the image(s). This is achieved by combining a graphical model-based maximum a posterior probability (MAP) estimate with a mean-shift based clustering. Experiments conducted on simulated X-ray images as well as on a low-dose low quality X-ray spinal image of a scoliotic patient verified its performance.

Ruler Based Automatic C-Arm Image Stitching Without Overlapping Constraint

In this paper, we propose a new method for stitching multiple fluoroscopic images taken by a C-arm instrument. We employ an X-ray radiolucent ruler with numbered graduations while acquiring the images, and the image stitching is based on detecting and matching ruler parts in the images to the corresponding parts of a virtual ruler. To achieve this goal, we first detect the regular spaced graduations on the ruler and the numbers. After graduation labeling, for each image, we have the location and the associated number for every graduation on the ruler. Then, we initialize the panoramic X-ray image with the virtual ruler, and we “paste” each image by aligning the detected ruler part on the original image, to the corresponding part of the virtual ruler on the panoramic image. Our method is based on ruler matching but without the requirement of matching similar feature points in pairwise images, and thus, we do not necessarily require overlap between the images. We tested our method on eight different datasets of X-ray images, including long bones and a complete spine. Qualitative and quantitative experiments show that our method achieves good results.