Hardware accelerated ray cast of volume data and volume gradient for an optimized splines-based multi-resolution 2D-3D registration

This paper describes a method for DRR generation as well as for volume gradients projection using hardware accelerated 2D texture mapping and accumulation buffering and demonstrates its application in 2D-3D registration of X-ray fluoroscopy to CT images. The robustness of the present registration scheme are guaranteed by taking advantage of a coarse-to-fine processing of the volume/image pyramids based on cubic B-splines. A human cadaveric spine specimen together with its ground truth was used to compare the present scheme with a purely software-based scheme in three aspects: accuracy, speed, and capture ranges. Our experiments revealed an equivalent accuracy and capture ranges but with much shorter registration time with the present scheme. More specifically, the results showed 0.8 mm average target registration error, 55 second average execution time per registration, and 10 mm and 10° capture ranges for the present scheme when tested on a 3.0 GHz Pentium 4 computer.

Unifying energy minimization and mutual information maximization for robust 2D/3D registration of X-ray and CT images

Similarity measure is one of the main factors that affect the accuracy of intensity-based 2D/3D registration of X-ray fluoroscopy to CT images. Information theory has been used to derive similarity measure for image registration leading to the introduction of mutual information, an accurate similarity measure for multi-modal and mono-modal image registration tasks. However, it is known that the standard mutual information measure only takes intensity values into account without considering spatial information and its robustness is questionable. Previous attempt to incorporate spatial information into mutual information either requires computing the entropy of higher dimensional probability distributions, or is not robust to outliers. In this paper, we show how to incorporate spatial information into mutual information without suffering from these problems. Using a variational approximation derived from the Kullback-Leibler bound, spatial information can be effectively incorporated into mutual information via energy minimization. The resulting similarity measure has a least-squares form and can be effectively minimized by a multi-resolution Levenberg-Marquardt optimizer. Experimental results are presented on datasets of two applications: (a) intra-operative patient pose estimation from a few (e.g. 2) calibrated fluoroscopic images, and (b) post-operative cup alignment estimation from single X-ray radiograph with gonadal shielding.

A posteriori registration and subtraction of panoramic compared with intraoral radiography

OBJECTIVES: To demonstrate the feasibility of panoramic image subtraction for implant assessment. STUDY DESIGN: Three titanium implants were inserted into a fresh pig mandible. One intraoral and 2 panoramic images were obtained at baseline and after each of 6 incremental (0.3, 0.6, 1.0, 1.5, 2.0, 2.5 mm) removals of bone. For each incremental removal of bone, the mandible was removed from and replaced in the holding device. Images representing incremental bone removals were registered by computer with the baseline images and subtracted. Assessment of the subtraction images was based on visual inspection and analysis of structured noise. RESULTS: Incremental bone removals were more visible in intraoral than in panoramic subtraction images; however, computer-based registration of panoramic images reduced the structured noise and enhanced the visibility of incremental removals. CONCLUSION: The feasibility of panoramic image subtraction for implant assessment was demonstrated.

Stochastic rank correlation: a robust merit function for 2D/3D registration of image data obtained at different energies

In this article, the authors evaluate a merit function for 2D/3D registration called stochastic rank correlation (SRC). SRC is characterized by the fact that differences in image intensity do not influence the registration result; it therefore combines the numerical advantages of cross correlation (CC)-type merit functions with the flexibility of mutual-information-type merit functions. The basic idea is that registration is achieved on a random subset of the image, which allows for an efficient computation of Spearman's rank correlation coefficient. This measure is, by nature, invariant to monotonic intensity transforms in the images under comparison, which renders it an ideal solution for intramodal images acquired at different energy levels as encountered in intrafractional kV imaging in image-guided radiotherapy. Initial evaluation was undertaken using a 2D/3D registration reference image dataset of a cadaver spine. Even with no radiometric calibration, SRC shows a significant improvement in robustness and stability compared to CC. Pattern intensity, another merit function that was evaluated for comparison, gave rather poor results due to its limited convergence range. The time required for SRC with 5% image content compares well to the other merit functions; increasing the image content does not significantly influence the algorithm accuracy. The authors conclude that SRC is a promising measure for 2D/3D registration in IGRT and image-guided therapy in general.

A comparative study on manual and automatic slice-to-volume registration of CT images

In order to assess the clinical relevance of a slice-to-volume registration algorithm, this technique was compared to manual registration. Reformatted images obtained from a diagnostic CT examination of the lower abdomen were reviewed and manually registered by 41 individuals. The results were refined by the algorithm. Furthermore, a fully automatic registration of the single slices to the whole CT examination, without manual initialization, was also performed. The manual registration error for rotation and translation was found to be 2.7+/-2.8 degrees and 4.0+/-2.5 mm. The automated registration algorithm significantly reduced the registration error to 1.6+/-2.6 degrees and 1.3+/-1.6 mm (p = 0.01). In 3 of 41 (7.3%) registration cases, the automated registration algorithm failed completely. On average, the time required for manual registration was 213+/-197 s; automatic registration took 82+/-15 s. Registration was also performed without any human interaction. The resulting registration error of the algorithm without manual pre-registration was found to be 2.9+/-2.9 degrees and 1.1+/-0.2 mm. Here, a registration took 91+/-6 s, on average. Overall, the automated registration algorithm improved the accuracy of manual registration by 59% in rotation and 325% in translation. The absolute values are well within a clinically relevant range.