Automatic extraction of femur contours from calibrated fluoroscopic images

Automatic identification and extraction of bone contours from X-ray images is an essential first step task for further medical image analysis. In this paper we propose a 3D statistical model based framework for the proximal femur contour extraction from calibrated X-ray images. The automatic initialization is solved by an estimation of Bayesian network algorithm to fit a multiple component geometrical model to the X-ray data. The contour extraction is accomplished by a non-rigid 2D/3D registration between a 3D statistical model and the X-ray images, in which bone contours are extracted by a graphical model based Bayesian inference. Preliminary experiments on clinical data sets verified its validity

Non-photorealistic rendering of virtual implant models for computer-assisted fluoroscopy-based surgical procedures

Surgical navigation systems visualize the positions and orientations of surgical instruments and implants as graphical overlays onto a medical image of the operated anatomy on a computer monitor. The orthopaedic surgical navigation systems could be categorized according to the image modalities that are used for the visualization of surgical action. In the so-called CT-based systems or 'surgeon-defined anatomy' based systems, where a 3D volume or surface representation of the operated anatomy could be constructed from the preoperatively acquired tomographic data or through intraoperatively digitized anatomy landmarks, a photorealistic rendering of the surgical action has been identified to greatly improve usability of these navigation systems. However, this may not hold true when the virtual representation of surgical instruments and implants is superimposed onto 2D projection images in a fluoroscopy-based navigation system due to the so-called image occlusion problem. Image occlusion occurs when the field of view of the fluoroscopic image is occupied by the virtual representation of surgical implants or instruments. In these situations, the surgeon may miss part of the image details, even if transparency and/or wire-frame rendering is used. In this paper, we propose to use non-photorealistic rendering to overcome this difficulty. Laboratory testing results on foamed plastic bones during various computer-assisted fluoroscopybased surgical procedures including total hip arthroplasty and long bone fracture reduction and osteosynthesis are shown.

Precise estimation of postoperative cup alignment from single standard X-ray radiograph with gonadal shielding

This paper addresses the problem of estimating postoperative cup alignment from single standard X-ray radiograph with gonadal shielding. The widely used procedure of evaluation of cup orientation following total hip arthroplasty using single standard anteroposterior radiograph is known inaccurate, largely due to the wide variability in individual pelvic position relative to X-ray plate. 2D-3D image registration methods have been introduced to estimate the rigid transformation between a preoperative CT volume and postoperative radiograph(s) for an accurate estimation of the postoperative cup alignment relative to an anatomical reference extracted from the CT data. However, these methods require either multiple radiographs or a radiograph-specific calibration, both of which are not avaiable for most retrospective studies. Furthermore, these methods were only evaluated on X-ray radiograph(s) without gonadal shielding. In this paper, we propose to use a hybrid 2D-3D registration scheme combining an iterative landmark-to-ray registration with a 2D-3D intensity-based registration to estimate the rigid transfromation for a precise estimation of cup alignment. Quantitative and qualitative results evaluated on clinical and cadaveric datasets are given which indicate the validity of our approach.

Hierarchical Markov Random Fields Applied to Model Soft Tissue Deformations on Graphics Hardware

Many methodologies dealing with prediction or simulation of soft tissue deformations on medical image data require preprocessing of the data in order to produce a different shape representation that complies with standard methodologies, such as mass–spring networks, finite element method s (FEM). On the other hand, methodologies working directly on the image space normally do not take into account mechanical behavior of tissues and tend to lack physics foundations driving soft tissue deformations. This chapter presents a method to simulate soft tissue deformations based on coupled concepts from image analysis and mechanics theory. The proposed methodology is based on a robust stochastic approach that takes into account material properties retrieved directly from the image, concepts from continuum mechanics and FEM. The optimization framework is solved within a hierarchical Markov random field (HMRF) which is implemented on the graphics processor unit (GPU See Graphics processing unit ).

Distribution of intramyocellular lipids in human calf muscles as determined by MR spectroscopic imaging

In this study the distribution of intramyocellular lipids (IMCL) in human calf muscles was determined by 1H-MR spectroscopic imaging (MRSI) measurements. An obstacle for MRSI measurements in the calf, including different muscles, is the inevitable inclusion of regions with high concentrations of extramyocellular lipids (EMCL). This can lead to signal bleeding and consequently to unpredictable overlaps of IMCL resonances with EMCL in voxels of interest. The results of this study show that signal bleeding from EMCL can be substantially reduced in voxels from calf muscles by the application of a lipid extrapolation (LE) procedure (Haupt et al., Magn Reson Med 1996;35:678). The spectra of all voxels located within muscle tissue were fitted, and the metabolite values were assigned to one of 10 different muscles based on image segmentation. Significant IMCL differences between some muscles were obtained, with high values in m. soleus and two to three times lower values in the tibialis anterior, tibialis posterior, and gastrocnemius muscles. In addition to gross differences between muscles, significant intersubject differences were observed in both IMCL content and distribution over different muscles. A significant correlation between fiber orientation (obtained from orientation-dependent dipolar coupling of creatine and taurine resonances) and IMCL content was found, indicating that IMCL content is directly correlated to biomechanical properties.

Effects of camera aperture correction on keying and compositing of broadcast video

This contribution discusses the effects of camera aperture correction in broadcast video on colour-based keying. The aperture correction is used to ’sharpen’ an image and is one element that distinguishes the ’TV-look’ from ’film-look’. ’If a very high level of sharpening is applied, as is the case in many TV productions then this significantly shifts the colours around object boundaries with hight contrast. This paper discusses these effects and their impact on keying and describes a simple low-pass filter to compensate for them. Tests with colour-based segmentation algorithms show that the proposed compensation is an effective way of decreasing the keying artefacts on object boundaries.

Spare Time Activity Sheets from Photo Albums

Given arbitrary pictures, we explore the possibility of using new techniques from computer vision and artificial intelligence to create customized visual games on-the-fly. This includes coloring books, link-the-dot and spot-the-difference popular games. The feasibility of these systems is discussed and we describe prototype implementation that work well in practice in an automatic or semi-automatic way.

Prediction of Cranio-Maxilofacial Surgical Planning using an Inverse Soft Tissue Modelling Approach

In cranio-maxillofacial surgery, the determination of a proper surgical plan is an important step to attain a desired aesthetic facial profile and a complete denture closure. In the present paper, we propose an efficient modeling approach to predict the surgical planning on the basis of the desired facial appearance and optimal occlusion. To evaluate the proposed planning approach, the predicted osteotomy plan of six clinical cases that underwent CMF surgery were compared to the real clinical plan. Thereafter, simulated soft-tissue outcomes were compared using the predicted and real clinical plan. This preliminary retrospective comparison of both osteotomy planning and facial outlook shows a good agreement and thereby demonstrates the potential application of the proposed approach in cranio-maxillofacial surgical planning prediction.