Development of procedures for the design, optimization and manufacturing of customized orthopaedic and trauma implants: Geometrical/anatomical modelling from 3D medical imaging

Tese de Doutoramento (Programa Doutoral em Engenharia Biomédica)

Imaging and quantifying salt-tracer transport in a riparian groundwater system by means of 3D ERT monitoring

Determining groundwater flow paths of infiltrated river water is necessary for studying biochemical processes in the riparian zone, but their characterization is complicated by strong temporal and spatial heterogeneity. We investigated to what extent repeat 3D surface electrical resistance tomography (ERT) can be used to monitor transport of a salt-tracer plume under close to natural gradient conditions. The aim is to estimate groundwater flow velocities and pathways at a site located within a riparian groundwater system adjacent to the perialpine Thur River in northeastern Switzerland. Our ERT time-lapse images provide constraints on the plume's shape, flow direction, and velocity. These images allow the movement of the plume to be followed for 35 m. Although the hydraulic gradient is only 1.43 parts per thousand, the ERT time-lapse images demonstrate that the plume's center of mass and its front propagate with velocities of 2x10(-4) m/s and 5x10(-4) m/s, respectively. These velocities are compatible with groundwater resistivity monitoring data in two observation wells 5 m from the injection well. Five additional sensors in the 5-30 m distance range did not detect the plume. Comparison of the ERT time-lapse images with a groundwater transport model and time-lapse inversions of synthetic ERT data indicate that the movement of the plume can be described for the first 6 h after injection by a uniform transport model. Subsurface heterogeneity causes a change of the plume's direction and velocity at later times. Our results demonstrate the effectiveness of using time-lapse 3D surface ERT to monitor flow pathways in a challenging perialpine environment over larger scales than is practically possible with crosshole 3D ERT.

From inference to affordance : the problem of visual depth-perception in the optical writings of Descartes, Berkeley, and Gibson

This thesis explores the debate and issues regarding the status of visual ;,iferellces in the optical writings of Rene Descartes, George Berkeley and James 1. Gibson. It gathers arguments from across their works and synthesizes an account of visual depthperception that accurately reflects the larger, metaphysical implications of their philosophical theories. Chapters 1 and 2 address the Cartesian and Berkelean theories of depth-perception, respectively. For Descartes and Berkeley the debate can be put in the following way: How is it possible that we experience objects as appearing outside of us, at various distances, if objects appear inside of us, in the representations of the individual's mind? Thus, the Descartes-Berkeley component of the debate takes place exclusively within a representationalist setting. Representational theories of depthperception are rooted in the scientific discovery that objects project a merely twodimensional patchwork of forms on the retina. I call this the "flat image" problem. This poses the problem of depth in terms of a difference between two- and three-dimensional orders (i.e., a gap to be bridged by one inferential procedure or another). Chapter 3 addresses Gibson's ecological response to the debate. Gibson argues that the perceiver cannot be flattened out into a passive, two-dimensional sensory surface. Perception is possible precisely because the body and the environment already have depth. Accordingly, the problem cannot be reduced to a gap between two- and threedimensional givens, a gap crossed with a projective geometry. The crucial difference is not one of a dimensional degree. Chapter 3 explores this theme and attempts to excavate the empirical and philosophical suppositions that lead Descartes and Berkeley to their respective theories of indirect perception. Gibson argues that the notion of visual inference, which is necessary to substantiate representational theories of indirect perception, is highly problematic. To elucidate this point, the thesis steps into the representationalist tradition, in order to show that problems that arise within it demand a tum toward Gibson's information-based doctrine of ecological specificity (which is to say, the theory of direct perception). Chapter 3 concludes with a careful examination of Gibsonian affordallces as the sole objects of direct perceptual experience. The final section provides an account of affordances that locates the moving, perceiving body at the heart of the experience of depth; an experience which emerges in the dynamical structures that cross the body and the world.

L’asymétrie mammaire chez les adolescentes présentant une scoliose idiopathique

La scoliose idiopathique de l’adolescence (SIA) est une déformation tridimensionnelle complexe du rachis affectant majoritairement les filles. L’atteinte progressive est surtout esthétique avec, notamment, une déformation de la cage thoracique résultante. L’asymétrie mammaire est une préoccupation fréquente chez ces jeunes filles. Se définissant comme une différence de forme, de position ou de volume des seins ou des complexes aréolo-mamelonnaires, l’asymétrie mammaire est courante chez les femmes, mais habituellement mineure et non visible. Il demeure incertain dans la littérature si l’asymétrie mammaire est plus fréquente chez les scoliotiques. De plus, très peu d’études ont évalué la relation entre la scoliose et l’asymétrie mammaire. De façon instinctive, on serait porté à croire que ce ne sont pas les seins qui sont asymétriques, mais plutôt la déformation du thorax en rotation qui donne cette impression. Les seins représentent un des organes les plus difficiles à mesurer étant donné leur grande variabilité. Plusieurs méthodes de mesure ont été décrites. L’imagerie par résonance magnétique (IRM) est considérée l’outil le plus précis pour définir la glande mammaire et plus particulièrement, sa délimitation sur la cage thoracique. Ce projet consiste à quantifier l’asymétrie mammaire, représentée par une différence de volume entre les deux seins, chez une cohorte de jeunes filles présentant une SIA significative, en utilisant l’IRM comme outil de mesure. Ensuite, une méthode de mesure automatisée, à partir de la topographie surfacique 3D, est proposée. Les résultats obtenus avec cette méthode sont confrontés à ceux de l’IRM. L’influence de la posture sur le volume mammaire est également étudiée à partir de ces deux modalités différentes. Pour réaliser ces objectifs, une cohorte de 30 patientes scoliotiques a été recrutée sur la base de leur courbure thoracique et de leur maturité osseuse et mammaire. Deux imageries de tronc ont été effectuées : la topographie surfacique 3D et la résonance magnétique. Dans un premier temps, la sommation des images segmentées acquises par IRM nous a permis de mesurer de façon très précise le volume mammaire. Notre cohorte présente une asymétrie mammaire moyenne statistiquement significative de 8.32%. 66.6% des patientes présentent une asymétrie ≥ 5%. Par ailleurs, le sein gauche est plus volumineux chez 65.5% des patientes. Une faible corrélation non-significative existe entre les volumes mammaires et l’angle de Cobb ainsi que la gibbosité thoracique. Par la suite, une méthode de mesure automatisée, développée à partir de l’environnement mathématique Matlab, est appliquée directement sur les reconstructions 3D. En bref, elle consiste à identifier les contours des seins pour les exciser afin d’exposer la cage thoracique puis, à soustraire le thorax complet du thorax sans seins pour déterminer les volumes mammaires. Les volumes mammaires acquis par la méthode automatisée sont, de manière attendue, de plus petites tailles que ceux obtenus à l’IRM. Une forte corrélation est établie entre les volumes mammaires obtenus par les deux différentes techniques de mesure. Bien que statistiquement significatives, les asymétries mammaires (r= 0.614, p< .001) ne sont pas aussi fortement corrélées entre elles que les volumes. Le sein droit (r=0.805) présente une corrélation plus élevée que le sein gauche (r=0.747). Finalement, l’influence de la posture est étudiée à partir des maillages 3D de l’IRM (décubitus ventral) et de la topographie surfacique 3D (position debout). D’excellentes corrélations sont confirmées entre les volumes mammaires ; r= 0.896 et r= 0.939, respectivement pour les volumes mammaires gauches et droits. Ce projet a permis de démontrer, pour la première fois, qu’il est possible de calculer le volume mammaire de façon objective et précise avec l’IRM, chez une cohorte scoliotique. Grâce à la précision des repères anatomiques, l’IRM nous a permis de revisiter une croyance populaire dans la communauté de la scoliose. Celle soutenant que l’asymétrie mammaire ressentie par les patientes n’est qu’une perception. Ces nouvelles données nous permettrons de conseiller les jeunes filles avec la SIA, concernant leurs préoccupations sur l’asymétrie de leurs seins. Nous avons confirmé que la méthode de mesure automatisée est réalisable cliniquement et pourrait être utilisée pour prédire les volumes obtenus à l’IRM. Par ailleurs, c’est le premier outil de mesure de volumétrie mammaire complètement automatisé à notre connaissance. Les volumes mammaires obtenus debout et en décubitus ventral sont comparables.

The Perception of Subjective Surfaces

It is proposed that subjective contours are an artifact of the perception of natural three-dimensional surfaces. A recent theory of surface interpolation implies that "subjective surfaces" are constructed in the visual system by interpolation between three-dimensional values arising from interpretation of a variety of surface cues. We show that subjective surfaces can take any form, including singly and doubly curved surfaces, as well as the commonly discussed fronto-parallel planes. In addition, it is necessary in the context of computational vision to make explicit the discontinuities, both in depth and in surface orientation, in the surfaces constructed by interpolation. It is proposed that subjective surfaces and subjective contours are demonstrated. The role played by figure completion and enhanced brightness contrast in the determination of subjective surfaces is discussed. All considerations of surface perception apply equally to subjective surfaces.

3D scanning by multiple fan beam X-ray sources and sensors

*** Purpose – Computer tomography (CT) for 3D reconstruction entails a huge number of coplanar fan-beam projections for each of a large number of 2D slice images, and excessive radiation intensities and dosages. For some applications its rate of throughput is also inadequate. A technique for overcoming these limitations is outlined. *** Design methodology/approach – A novel method to reconstruct 3D surface models of objects is presented, using, typically, ten, 2D projective images. These images are generated by relative motion between this set of objects and a set of ten fanbeam X-ray sources and sensors, with their viewing axes suitably distributed in 2D angular space. *** Findings – The method entails a radiation dosage several orders of magnitude lower than CT, and requires far less computational power. Experimental results are given to illustrate the capability of the technique *** Practical implications – The substantially lower cost of the method and, more particularly, its dramatically lower irradiation make it relevant to many applications precluded by current techniques *** Originality/value – The method can be used in many applications such as aircraft hold-luggage screening, 3D industrial modelling and measurement, and it should also have important applications to medical diagnosis and surgery.

Effect of air-particle abrasion protocols on the biaxial flexural strength, surface characteristics and phase transformation of zirconia after cyclic loading

This study evaluated the effect of air-particle abrasion protocols on the biaxial flexural strength, surface characteristics and phase transformation of zirconia after cyclic loading. Disc-shaped zirconia specimens (Ø: 15mm, thickness: 1.2mm) (N=32) were submitted to one of the air-particle abrasion protocols (n=8 per group): (a) 50μm Al2O3 particles, (b) 110μm Al2O3 particles coated with silica (Rocatec Plus), (c) 30μm Al2O3 particles coated with silica (CoJet Sand) for 20s at 2.8bar pressure. Control group received no air-abrasion. All specimens were initially cyclic loaded (×20,000, 50N, 1Hz) in water at 37°C and then subjected to biaxial flexural strength testing where the conditioned surface was under tension. Zirconia surfaces were characterized and roughness was measured with 3D surface profilometer. Phase transformation from tetragonal to monoclinic was determined by Raman spectroscopy. The relative amount of transformed monoclinic zirconia (FM) and transformed zone depth (TZD) were measured using XRD. The data (MPa) were analyzed using ANOVA, Tukey's tests and Weibull modulus (m) were calculated for each group (95% CI). The biaxial flexural strength (MPa) of CoJet treated group (1266.3±158A) was not significantly different than that of Rocatec Plus group (1179±216.4A,B) but was significantly higher than the other groups (Control: 942.3±74.6C; 50μm Al2O3: 915.2±185.7B,C). Weibull modulus was higher for control (m=13.79) than those of other groups (m=4.95, m=5.64, m=9.13 for group a, b and c, respectively). Surface roughness (Ra) was the highest with 50μm Al2O3 (0.261μm) than those of other groups (0.15-0.195μm). After all air-abrasion protocols, FM increased (15.02%-19.25%) compared to control group (11.12%). TZD also showed increase after air-abrasion protocols (0.83-1.07μm) compared to control group (0.59μm). Air-abrasion protocols increased the roughness and monoclinic phase but in turn abrasion with 30μm Al2O3 particles coated with silica has increased the biaxial flexural strength of the tested zirconia. © 2013 Elsevier Ltd.

Hausdorff Distance evaluation of orthodontic accessories' streaking artifacts in 3D model superimposition

The aim of this study was to determine whether image artifacts caused by orthodontic metal accessories interfere with the accuracy of 3D CBCT model superimposition. A human dry skull was subjected three times to a CBCT scan: at first without orthodontic brackets (T1), then with stainless steel brackets bonded without (T2) and with orthodontic arch wires (T3) inserted into the brackets' slots. The registration of image surfaces and the superimposition of 3D models were performed. Within-subject surface distances between T1-T2, T1-T3 and T2-T3 were computed and calculated for comparison among the three data sets. The minimum and maximum Hausdorff Distance units (HDu) computed between the corresponding data points of the T1 and T2 CBCT 3D surface images were 0.000000 and 0.049280 HDu, respectively, and the mean distance was 0.002497 HDu. The minimum and maximum Hausdorff Distances between T1 and T3 were 0.000000 and 0.047440 HDu, respectively, with a mean distance of 0.002585 HDu. In the comparison between T2 and T3, the minimum, maximum and mean Hausdorff Distances were 0.000000, 0.025616 and 0.000347 HDu, respectively. In the current study, the image artifacts caused by metal orthodontic accessories did not compromise the accuracy of the 3D model superimposition. Color-coded maps of overlaid structures complemented the computed Hausdorff Distances and demonstrated a precise fusion between the data sets.

A variational approach to 3D cylindrical geometry reconstruction from multiple views

[EN] In this paper we present a variational technique for the reconstruction of 3D cylindrical surfaces. Roughly speaking by a cylindrical surface we mean a surface that can be parameterized using the projection on a cylinder in terms of two coordinates, representing the displacement and angle in a cylindrical coordinate system respectively. The starting point for our method is a set of different views of a cylindrical surface, as well as a precomputed disparity map estimation between pair of images. The proposed variational technique is based on an energy minimization where we balance on the one hand the regularity of the cylindrical function given by the distance of the surface points to cylinder axis, and on the other hand, the distance between the projection of the surface points on the images and the expected location following the precomputed disparity map estimation between pair of images. One interesting advantage of this approach is that we regularize the 3D surface by means of a bi-dimensio al minimization problem. We show some experimental results for large stereo sequences.

Regularization of 3D cylindrical surfaces

[EN] In this paper we present a method for the regularization of 3D cylindrical surfaces. By a cylindrical surface we mean a 3D surface that can be expressed as an application S(l; µ) ! R3 , where (l; µ) represents a cylindrical parametrization of the 3D surface. We built an initial cylindrical parametrization of the surface. We propose a new method to regularize such cylindrical surface. This method takes into account the information supplied by the disparity maps computed between pair of images to constraint the regularization of the set of 3D points. We propose a model based on an energy which is composed of two terms: an attachment term that minimizes the difference between the image coordinates and the disparity maps and a second term that enables a regularization by means of anisotropic diffusion. One interesting advantage of this approach is that we regularize the 3D surface by using a bi-dimensional minimization problem.

A variational approach to 3D geometry reconstruction from two or multiple views

[EN] In the last years we have developed some methods for 3D reconstruction. First we began with the problem of reconstructing a 3D scene from a stereoscopic pair of images. We developed some methods based on energy functionals which produce dense disparity maps by preserving discontinuities from image boundaries. Then we passed to the problem of reconstructing a 3D scene from multiple views (more than 2). The method for multiple view reconstruction relies on the method for stereoscopic reconstruction. For every pair of consecutive images we estimate a disparity map and then we apply a robust method that searches for good correspondences through the sequence of images. Recently we have proposed several methods for 3D surface regularization. This is a postprocessing step necessary for smoothing the final surface, which could be afected by noise or mismatch correspondences. These regularization methods are interesting because they use the information from the reconstructing process and not only from the 3D surface. We have tackled all these problems from an energy minimization approach. We investigate the associated Euler-Lagrange equation of the energy functional, and we approach the solution of the underlying partial differential equation (PDE) using a gradient descent method.

Single fluoroscopic image based 2D/3D reconstruction of a scaled, patient-specific vertebral model

Purpose Accurate three-dimensional (3D) models of lumbar vertebrae can enable image-based 3D kinematic analysis. The common approach to derive 3D models is by direct segmentation of CT or MRI datasets. However, these have the disadvantages that they are expensive, timeconsuming and/or induce high-radiation doses to the patient. In this study, we present a technique to automatically reconstruct a scaled 3D lumbar vertebral model from a single two-dimensional (2D) lateral fluoroscopic image. Methods Our technique is based on a hybrid 2D/3D deformable registration strategy combining a landmark-to-ray registration with a statistical shape model-based 2D/3D reconstruction scheme. Fig. 1 shows different stages of the reconstruction process. Four cadaveric lumbar spine segments (total twelve lumbar vertebrae) were used to validate the technique. To evaluate the reconstruction accuracy, the surface models reconstructed from the lateral fluoroscopic images were compared to the associated ground truth data derived from a 3D CT-scan reconstruction technique. For each case, a surface-based matching was first used to recover the scale and the rigid transformation between the reconstructed surface model Results Our technique could successfully reconstruct 3D surface models of all twelve vertebrae. After recovering the scale and the rigid transformation between the reconstructed surface models and the ground truth models, the average error of the 2D/3D surface model reconstruction over the twelve lumbar vertebrae was found to be 1.0 mm. The errors of reconstructing surface models of all twelve vertebrae are shown in Fig. 2. It was found that the mean errors of the reconstructed surface models in comparison to their associated ground truths after iterative scaled rigid registrations ranged from 0.7 mm to 1.3 mm and the rootmean squared (RMS) errors ranged from 1.0 mm to 1.7 mm. The average mean reconstruction error was found to be 1.0 mm. Conclusion An accurate, scaled 3D reconstruction of the lumbar vertebra can be obtained from a single lateral fluoroscopic image using a statistical shape model based 2D/3D reconstruction technique. Future work will focus on applying the reconstructed model for 3D kinematic analysis of lumbar vertebrae, an extension of our previously-reported imagebased kinematic analysis. The developed method also has potential applications in surgical planning and navigation.

Reconstruction and 3D visualisation based on objective real 3D based documentation

Reconstructions based directly upon forensic evidence alone are called primary information. Historically this consists of documentation of findings by verbal protocols, photographs and other visual means. Currently modern imaging techniques such as 3D surface scanning and radiological methods (Computer Tomography, Magnetic Resonance Imaging) are also applied. Secondary interpretation is based on facts and the examiner's experience. Usually such reconstructive expertises are given in written form, and are often enhanced by sketches. However, narrative interpretations can, especially in complex courses of action, be difficult to present and can be misunderstood. In this report we demonstrate the use of graphic reconstruction of secondary interpretation with supporting pictorial evidence, applying digital visualisation (using 'Poser') or scientific animation (using '3D Studio Max', 'Maya') and present methods of clearly distinguishing between factual documentation and examiners' interpretation based on three cases. The first case involved a pedestrian who was initially struck by a car on a motorway and was then run over by a second car. The second case involved a suicidal gunshot to the head with a rifle, in which the trigger was pushed with a rod. The third case dealt with a collision between two motorcycles. Pictorial reconstruction of the secondary interpretation of these cases has several advantages. The images enable an immediate overview, give rise to enhanced clarity, and compel the examiner to look at all details if he or she is to create a complete image.

An integrated system for 3D hip joint reconstruction from 2D X-rays: a preliminary validation study

The acquisition of conventional X-ray radiographs remains the standard imaging procedure for the diagnosis of hip-related problems. However, recent studies demonstrated the benefit of using three-dimensional (3D) surface models in the clinical routine. 3D surface models of the hip joint are useful for assessing the dynamic range of motion in order to identify possible pathologies such as femoroacetabular impingement. In this paper, we present an integrated system which consists of X-ray radiograph calibration and subsequent 2D/3D hip joint reconstruction for diagnosis and planning of hip-related problems. A mobile phantom with two different sizes of fiducials was developed for X-ray radiograph calibration, which can be robustly detected within the images. On the basis of the calibrated X-ray images, a 3D reconstruction method of the acetabulum was developed and applied together with existing techniques to reconstruct a 3D surface model of the hip joint. X-ray radiographs of dry cadaveric hip bones and one cadaveric specimen with soft tissue were used to prove the robustness of the developed fiducial detection algorithm. Computed tomography scans of the cadaveric bones were used to validate the accuracy of the integrated system. The fiducial detection sensitivity was in the same range for both sizes of fiducials. While the detection sensitivity was 97.96% for the large fiducials, it was 97.62% for the small fiducials. The acetabulum and the proximal femur were reconstructed with a mean surface distance error of 1.06 and 1.01 mm, respectively. The results for fiducial detection sensitivity and 3D surface reconstruction demonstrated the capability of the integrated system for 3D hip joint reconstruction from 2D calibrated X-ray radiographs.

3D volumetric intensity reconsturction from 2D x-ray images using partial least squares regression

Reconstruction of shape and intensity from 2D x-ray images has drawn more and more attentions. Previously introduced work suffers from the long computing time due to its iterative optimization characteristics and the requirement of generating digitally reconstructed radiographs within each iteration. In this paper, we propose a novel method which uses a patient-specific 3D surface model reconstructed from 2D x-ray images as a surrogate to get a patient-specific volumetric intensity reconstruction via partial least squares regression. No DRR generation is needed. The method was validated on 20 cadaveric proximal femurs by performing a leave-one-out study. Qualitative and quantitative results demonstrated the efficacy of the present method. Compared to the existing work, the present method has the advantage of much shorter computing time and can be applied to both DXA images as well as conventional x-ray images, which may hold the potentials to be applied to clinical routine task such as total hip arthroplasty (THA).