Simple virtual reality display of fetal volume ultrasound

Three-dimensional (3D) ultrasound volume acquisition, analysis and display of fetal structures have enhanced their visualization and greatly improved the general understanding of their anatomy and pathology. The dynamic display of volume data generally depends on proprietary software, usually supplied with the ultrasound system, and on the operator's ability to maneuver the dataset digitally. We have used relatively simple tools and an established storage, display and manipulation format to generate non-linear virtual reality object movies of prenatal images (including moving sequences and 3D-rendered views) that can be navigated easily and interactively on any current computer. This approach permits a viewing or learning experience that is superior to watching a linear movie passively.

3D Wavelet-based Fusion Techniques for Biomedical Imaging

Hoy en día las técnicas de adquisición de imágenes tridimensionales son comunes en diversas áreas, pero cabe destacar la relevancia que han adquirido en el ámbito de la imagen biomédica, dentro del cual encontramos una amplia gama de técnicas como la microscopía confocal, microscopía de dos fotones, microscopía de fluorescencia mediante lámina de luz, resonancia magnética nuclear, tomografía por emisión de positrones, tomografía de coherencia óptica, ecografía 3D y un largo etcétera. Un denominador común de todas esas aplicaciones es la constante necesidad por aumentar la resolución y la calidad de las imágenes adquiridas. En algunas de dichas técnicas de imagen tridimensional se da una interesante situación: aunque que cada volumen adquirido no contiene información suficiente para representar el objeto bajo estudio dentro de los parámetros de calidad requeridos por algunas aplicaciones finales, el esquema de adquisición permite la obtención de varios volúmenes que representan diferentes vistas de dicho objeto, de tal forma que cada una de las vistas proporciona información complementaria acerca del mismo. En este tipo de situación es posible, mediante la combinación de varias de esas vistas, obtener una mejor comprensión del objeto que a partir de cada una de ellas por separado. En el contexto de esta Tesis Doctoral se ha propuesto, desarrollado y validado una nueva metodología de proceso de imágenes basada en la transformada wavelet disc¬reta para la combinación, o fusión, de varias vistas con información complementaria de un mismo objeto. El método de fusión propuesto aprovecha la capacidad de descom¬posición en escalas y orientaciones de la transformada wavelet discreta para integrar en un solo volumen toda la información distribuida entre el conjunto de vistas adquiridas. El trabajo se centra en dos modalidades diferentes de imagen biomédica que per¬miten obtener tales adquisiciones multi-vista. La primera es una variante de la micro¬scopía de fluorescencia, la microscopía de fluorescencia mediante lámina de luz, que se utiliza para el estudio del desarrollo temprano de embriones vivos en diferentes modelos animales, como el pez cebra o el erizo de mar. La segunda modalidad es la resonancia magnética nuclear con realce tardío, que constituye una valiosa herramienta para evaluar la viabilidad del tejido miocárdico en pacientes con diversas miocardiopatías. Como parte de este trabajo, el método propuesto ha sido aplicado y validado en am¬bas modalidades de imagen. En el caso de la aplicación a microscopía de fluorescencia, los resultados de la fusión muestran un mejor contraste y nivel de detalle en comparación con cualquiera de las vistas individuales y el método no requiere de conocimiento previo acerca la función de dispersión puntual del sistema de imagen. Además, los resultados se han comparado con otros métodos existentes. Con respecto a la aplicación a imagen de resonancia magnética con realce tardío, los volúmenes fusionados resultantes pre-sentan una mejora cuantitativa en la nitidez de las estructuras relevantes y permiten una interpretación más sencilla y completa de la compleja estructura tridimensional del tejido miocárdico en pacientes con cardiopatía isquémica. Para ambas aplicaciones los resultados de esta tesis se encuentran actualmente en uso en los centros clínicos y de investigación con los que el autor ha colaborado durante este trabajo. Además se ha puesto a libre disposición de la comunidad científica la implementación del método de fusión propuesto. Por último, se ha tramitado también una solicitud de patente internacional que cubre el método de visualización desarrollado para la aplicación de Resonancia Magnética Nuclear. Abstract Nowadays three dimensional imaging techniques are common in several fields, but es-pecially in biomedical imaging, where we can find a wide range of techniques including: Laser Scanning Confocal Microscopy, Laser Scanning Two Photon Microscopy, Light Sheet Fluorescence Microscopy, Magnetic Resonance Imaging, Positron Emission To-mography, Optical Coherence Tomography, 3D Ultrasound Imaging, etc. A common denominator of all those applications being the constant need for further increasing resolution and quality of the acquired images. Interestingly, in some of the mentioned three-dimensional imaging techniques a remarkable situation arises: while a single volume does not contain enough information to represent the object being imaged within the quality parameters required by the final application, the acquisition scheme allows recording several volumes which represent different views of a given object, with each of the views providing complementary information. In this kind of situation one can get a better understanding of the object by combining several views instead of looking at each of them separately. Within such context, in this PhD Thesis we propose, develop and test new image processing methodologies based on the discrete wavelet transform for the combination, or fusion, of several views containing complementary information of a given object. The proposed fusion method exploits the scale and orientation decomposition capabil¬ities of the discrete wavelet transform to integrate in a single volume all the available information distributed among the set of acquired views. The work focuses in two different biomedical imaging modalities which provide such multi-view datasets. The first one is a particular fluorescence microscopy technique, Light-Sheet Fluorescence Microscopy, used for imaging and gaining understanding of the early development of live embryos from different animal models (like zebrafish or sea urchin). The second is Delayed Enhancement Magnetic Resonance Imaging, which is a valuable tool for assessing the viability of myocardial tissue on patients suffering from different cardiomyopathies. As part of this work, the proposed method was implemented and then validated on both imaging modalities. For the fluorescence microscopy application, the fusion results show improved contrast and detail discrimination when compared to any of the individual views and the method does not rely on prior knowledge of the system’s point spread function (PSF). Moreover, the results have shown improved performance with respect to previous PSF independent methods. With respect to its application to Delayed Enhancement Magnetic Resonance Imaging, the resulting fused volumes show a quantitative sharpness improvement and enable an easier and more complete interpretation of complex three-dimensional scar and heterogeneous tissue information in ischemic cardiomyopathy patients. In both applications, the results of this thesis are currently in use in the clinical and research centers with which the author collaborated during his work. An imple¬mentation of the fusion method has also been made freely available to the scientific community. Finally, an international patent application has been filed covering the visualization method developed for the Magnetic Resonance Imaging application.

Robust temporal alignment of multimodal cardiac sequences

Given the dynamic nature of cardiac function, correct temporal alignment of pre-operative models and intraoperative images is crucial for augmented reality in cardiac image-guided interventions. As such, the current study focuses on the development of an image-based strategy for temporal alignment of multimodal cardiac imaging sequences, such as cine Magnetic Resonance Imaging (MRI) or 3D Ultrasound (US). First, we derive a robust, modality-independent signal from the image sequences, estimated by computing the normalized crosscorrelation between each frame in the temporal sequence and the end-diastolic frame. This signal is a resembler for the left-ventricle (LV) volume curve over time, whose variation indicates di erent temporal landmarks of the cardiac cycle. We then perform the temporal alignment of these surrogate signals derived from MRI and US sequences of the same patient through Dynamic Time Warping (DTW), allowing to synchronize both sequences. The proposed framework was evaluated in 98 patients, which have undergone both 3D+t MRI and US scans. The end-systolic frame could be accurately estimated as the minimum of the image-derived surrogate signal, presenting a relative error of 1:6 1:9% and 4:0 4:2% for the MRI and US sequences, respectively, thus supporting its association with key temporal instants of the cardiac cycle. The use of DTW reduces the desynchronization of the cardiac events in MRI and US sequences, allowing to temporally align multimodal cardiac imaging sequences. Overall, a generic, fast and accurate method for temporal synchronization of MRI and US sequences of the same patient was introduced. This approach could be straightforwardly used for the correct temporal alignment of pre-operative MRI information and intra-operative US images.

Estudo do Aborto Recorrente. Ainda há Lugar para a Histerossalpingografia?

Overview and Aims: The investigation of recurrent miscarriage includes the study of uterine morphology. 3D ultrasound allows the evaluation of the morphology (cavity and outer contour), reducing the need for invasive tests such as hystero - salpingography (HSG), hysteroscopy and laparoscopy. We evaluated the diagnostic agreement between HSG and 3D ultrasound in the study of the uterine cavity morphology. Study Design: Prospective study. Population: A total of 34 women referred to our institution with a history of recurrent miscarriage. Methods: To compare the results of 3D ultrasound and HSG, all women underwent both exams. 3D scans were performed by the same operator and HSG were evaluated by the same clinician. The concordance study was performed using the Kappa coefficient. Results: With 3D ultrasound and HSG, uterine anomalies were diagnosed in 52.9% (18/34) and 47% (16/34) of the cases and congenital malformations were the most frequent findings. The agreement between the two techniques was excellent(K = 0.825). The three cases of diagnostic disagreement were analyzed. Conclusion: A high level of diagnostic agreement was observed between HSG and 3D ultrasound. The 3D ultrasound, a low cost and well tolerated technique, when performed by an experienced operator, is the first line exam to study the uterine morphology in women with recurrent miscarriage.

Diagnosi prenatale delle malformazioni fetali: ecografia e risonanza magnetica a confronto in 11 anni di esperienza

Obiettivo: Valutare l’accuratezza reciproca dell’ecografia “esperta” e della risonanza magnetica nelle diagnosi prenatale delle anomalie congenite. Materiali e metodi: Sono stati retrospettivamente valutati tutti i casi di malformazioni fetali sottoposte a ecografia “esperta” e risonanza magnetica nel nostro Policlinico da Ottobre 2001 a Ottobre 2012. L’età gestazionale media all’ecografia e alla risonanza magnetica sono state rispettivamente di 28 e 30 settimane. La diagnosi ecografica è stata confrontata con la risonanza e quindi con la diagnosi postnatale. Risultati: sono stati selezionati 383 casi, con diagnosi ecografica o sospetta malformazione fetale “complessa” o anamnesi ostetrica positiva infezioni prenatali, valutati con ecografia “esperta”, risonanza magnetica e completi di follow up. La popolazione di studio include: 196 anomalie del sistema nervoso centrale (51,2%), 73 difetti toracici (19,1%), 20 anomalie dell’area viso-collo (5,2%), 29 malformazioni del tratto gastrointestinale (7,6%), 37 difetti genito-urinari (9,7%) e 28 casi con altra indicazione (7,3%). Una concordanza tra ecografia, risonanza e diagnosi postnatale è stata osservata in 289 casi (75,5%) ed è stata maggiore per le anomalie del sistema nervoso centrale 156/196 casi (79,6%) rispetto ai difetti congeniti degli altri distretti anatomici 133/187 (71,1%). La risonanza ha aggiunto importanti informazioni diagnostiche in 42 casi (11%): 21 anomalie del sistema nervoso centrale, 2 difetti dell’area viso collo, 7 malformazioni toraciche, 6 anomalie del tratto gastrointestinale, 5 dell’apparato genitourinario e 1 caso di sospetta emivertebra lombare. L’ecografia è stata più accurata della risonanza in 15 casi (3,9%). In 37 casi (9,7%) entrambe le tecniche hanno dato esito diverso rispetto agli accertamenti postnatali. Conclusioni: l’ecografia prenatale rimane a tutt’oggi la principale metodica di imaging fetale. In alcuni casi complessi e/o dubbi sia del sistema nervoso centrale sia degli altri distretti anatomici la risonanza può aggiungere informazioni rilevanti.

Prevalence of rectocele in young nulliparous women

Background: It is generally assumed that fascial defects in the rectovaginal septum are the result of childbirth. However, rectoceles do occur in women who have never delivered vaginally. Aims: To determine the incidence of rectocele in a cohort of asymptomatic, young nulliparous women. Methods: Observational cohort study on 178 nulliparous caucasian women (aged 18-24) recruited for a twin study of pelvic floor dysfunction. All women were interviewed and examined by translabial ultrasound, supine and after voiding. In 52 women, 3D imaging was obtained and 171 datasets were complete and available for analysis. Ultrasound findings were reviewed for rectovaginal septal integrity by an assessor blinded against interview and demographic data for rectovaginal septal integrity. Results: A discontinuity of the anterior rectal wall with extrusion of rectal mucosa or contents (depth of ! 10 mm) was observed in 21/171 (12%). The depth of this herniation ranged from 10 to 25 mm and was filled with stool (n = 10) or rectal mucosa (n = 11). Defects were associated with a higher BMI (P = 0.049), with the complaint of constipation (P = 0.049) and non-significantly with straining at stool (P = 0.09). Descent of the ampulla to beyond the level of the symphysis pubis without fascial defect, that is, significant perineal relaxation, was observed in 23/171 (13%). Conclusions: Twelve percent of 171 young nulligravid caucasian women showed a defect of the rectovaginal septum. Associations were observed with higher body mass index and a history of constipation. It is hypothesised that in some women defects of the rectovaginal septum and perineal hypermobility may be congenital in nature.

Ultrasound evaluation of polymer gel dosimeters

A new method for the evaluation of radiotherapy 3D polymer gel dosimeters has been developed using ultrasound to assess the significant structural changes that occur following irradiation of the dosimeters. The ultrasonic parameters of acoustic speed of propagation, attenuation and transmitted signal intensity were measured as a function of absorbed radiation dose. The dose sensitivities for each parameter were determined as 1.8 x 10(-4) s m(-1) Gy(-1), 3.9 dB m(-1) Gy(-1) and 3.2 V-1 Gy(-1) respectively. All parameters displayed a strong variation with absorbed dose that continued beyond absorbed doses of 15 Gy. The ultrasonic measurements demonstrated a significantly larger dynamic range in dose response curves than that achieved with previously published magnetic resonance imaging (MRI) dose response data. It is concluded that ultrasound shows great potential as a technique for the evaluation of polymer gel dosimeters.

Improving The Robustness Of Interventional 4D Ultrasound Segmentation Through The Use Of Personalized Shape Priors

While fluoroscopy is still the most widely used imaging modality to guide cardiac interventions, the fusion of pre-operative Magnetic Resonance Imaging (MRI) with real-time intra-operative ultrasound (US) is rapidly gaining clinical acceptance as a viable, radiation-free alternative. In order to improve the detection of the left ventricular (LV) surface in 4D ultrasound, we propose to take advantage of the pre-operative MRI scans to extract a realistic geometrical model representing the patients cardiac anatomy. This could serve as prior information in the interventional setting, allowing to increase the accuracy of the anatomy extraction step in US data. We have made use of a real-time 3D segmentation framework used in the recent past to solve the LV segmentation problem in MR and US data independently and we take advantage of this common link to introduce the prior information as a soft penalty term in the ultrasound segmentation algorithm. We tested the proposed algorithm in a clinical dataset of 38 patients undergoing both MR and US scans. The introduction of the personalized shape prior improves the accuracy and robustness of the LV segmentation, as supported by the error reduction when compared to core lab manual segmentation of the same US sequences.

Estimation of 3D shapes using active surface models

This paper addresses the estimation of surfaces from a set of 3D points using the unified framework described in [1]. This framework proposes the use of competitive learning for curve estimation, i.e., a set of points is defined on a deformable curve and they all compete to represent the available data. This paper extends the use of the unified framework to surface estimation. It o shown that competitive learning performes better than snakes, improving the model performance in the presence of concavities and allowing to desciminate close surfaces. The proposed model is evaluated in this paper using syntheticdata and medical images (MRI and ultrasound images).

Minimal Criteria for the Diagnosis of Avulsion of the Puborectalis Muscle by Tomographic Ultrasound

Introduction and hypothesis Puborectalis avulsion is a likely etiological factor for female pelvic organ prolapse(FPOP). We performed a study to establish minimal sonographic criteria for the diagnosis of avulsion. Methods We analysed datasets of 764 women seen at a urogynecological service. Offline analysis of ultrasound datasets was performed blinded to patient data. Tomographic ultrasound imaging (TUI) was used to diagnose avulsion of the puborectalis muscle. Results Logistic regression modelling of TUI data showed that complete avulsion is best diagnosed by requiring the three central tomographic slices to be abnormal. This finding was obtained in 30% of patients and was associated with symptoms and signs of FPOP (P<0.001). Lesser degrees of trauma (‘partial avulsion’) were not associated with symptoms or signs of pelvic floor dysfunction. Conclusions Complete avulsion of the puborectalis muscle is best diagnosed on TUI by requiring all three central slices to be abnormal. Partial trauma seems of limited clinical relevance.

T1-weighted MRI as a substitute to CT for refocusing planning in MR-guided focused ultrasound.

Precise focusing is essential for transcranial MRI-guided focused ultrasound (TcMRgFUS) to minimize collateral damage to non-diseased tissues and to achieve temperatures capable of inducing coagulative necrosis at acceptable power deposition levels. CT is usually used for this refocusing but requires a separate study (CT) ahead of the TcMRgFUS procedure. The goal of this study was to determine whether MRI using an appropriate sequence would be a viable alternative to CT for planning ultrasound refocusing in TcMRgFUS. We tested three MRI pulse sequences (3D T1 weighted 3D volume interpolated breath hold examination (VIBE), proton density weighted 3D sampling perfection with applications optimized contrasts using different flip angle evolution and 3D true fast imaging with steady state precision T2-weighted imaging) on patients who have already had a CT scan performed. We made detailed measurements of the calvarial structure based on the MRI data and compared those so-called 'virtual CT' to detailed measurements of the calvarial structure based on the CT data, used as a reference standard. We then loaded both standard and virtual CT in a TcMRgFUS device and compared the calculated phase correction values, as well as the temperature elevation in a phantom. A series of Bland-Altman measurement agreement analyses showed T1 3D VIBE as the optimal MRI sequence, with respect to minimizing the measurement discrepancy between the MRI derived total skull thickness measurement and the CT derived total skull thickness measurement (mean measurement discrepancy: 0.025; 95% CL (-0.22-0.27); p = 0.825). The T1-weighted sequence was also optimal in estimating skull CT density and skull layer thickness. The mean difference between the phase shifts calculated with the standard CT and the virtual CT reconstructed from the T1 dataset was 0.08 ± 1.2 rad on patients and 0.1 ± 0.9 rad on phantom. Compared to the real CT, the MR-based correction showed a 1 °C drop on the maximum temperature elevation in the phantom (7% relative drop). Without any correction, the maximum temperature was down 6 °C (43% relative drop). We have developed an approach that allows for a reconstruction of a virtual CT dataset from MRI to perform phase correction in TcMRgFUS.

Inexperienced sonographers can successfully visualize and assess a three-dimensional image of the fetal face using a standardized ultrasound protocol

Introduction: A standardized three-dimensional ultrasonographic (3DUS) protocol is described that allows fetal face reconstruction. Ability to identify cleft lip with 3DUS using this protocol was assessed by operators with minimal 3DUS experience. Material and Methods: 260 stored volumes of fetal face were analyzed using a standardized protocol by operators with different levels of competence in 3DUS. The outcomes studied were: (1) the performance of post-processing 3D face volumes for the detection of facial clefts; (2) the ability of a resident with minimal 3DUS experience to reconstruct the acquired facial volumes, and (3) the time needed to reconstruct each plane to allow proper diagnosis of a cleft. Results: The three orthogonal planes of the fetal face (axial, sagittal and coronal) were adequately reconstructed with similar performance when acquired by a maternal-fetal medicine specialist or by residents with minimal experience (72 vs. 76%, p = 0.629). The learning curve for manipulation of 3DUS volumes of the fetal face corresponds to 30 cases and is independent of the operator's level of experience. Discussion: The learning curve for the standardized protocol we describe is short, even for inexperienced sonographers. This technique might decrease the length of anatomy ultrasounds and improve the ability to visualize fetal face anomalies.

Inexperienced sonographers can successfully visualize and assess a three-dimensional image of the fetal face using a standardized ultrasound protocol.

Introduction: A standardized three-dimensional ultrasonographic (3DUS) protocol is described that allows fetal face reconstruction. Ability to identify cleft lip with 3DUS using this protocol was assessed by operators with minimal 3DUS experience. Material and Methods: 260 stored volumes of fetal face were analyzed using a standardized protocol by operators with different levels of competence in 3DUS. The outcomes studied were: (1) the performance of post-processing 3D face volumes for the detection of facial clefts; (2) the ability of a resident with minimal 3DUS experience to reconstruct the acquired facial volumes, and (3) the time needed to reconstruct each plane to allow proper diagnosis of a cleft. Results: The three orthogonal planes of the fetal face (axial, sagittal and coronal) were adequately reconstructed with similar performance when acquired by a maternal-fetal medicine specialist or by residents with minimal experience (72 vs. 76%, p = 0.629). The learning curve for manipulation of 3DUS volumes of the fetal face corresponds to 30 cases and is independent of the operator's level of experience. Discussion: The learning curve for the standardized protocol we describe is short, even for inexperienced sonographers. This technique might decrease the length of anatomy ultrasounds and improve the ability to visualize fetal face anomalies.

Performance evaluation of 3D computer vision techniques

This work presents the implementation and comparison of three different techniques of three-dimensional computer vision as follows: • Stereo vision - correlation between two 2D images • Sensorial fusion - use of different sensors: camera 2D + ultrasound sensor (1D); • Structured light The computer vision techniques herein presented took into consideration the following characteristics: • Computational effort ( elapsed time for obtain the 3D information); • Influence of environmental conditions (noise due to a non uniform lighting, overlighting and shades); • The cost of the infrastructure for each technique; • Analysis of uncertainties, precision and accuracy. The option of using the Matlab software, version 5.1, for algorithm implementation of the three techniques was due to the simplicity of their commands, programming and debugging. Besides, this software is well known and used by the academic community, allowing the results of this work to be obtained and verified. Examples of three-dimensional vision applied to robotic assembling tasks ("pick-and-place") are presented.

Refraction corrected transmission ultrasound computed tomography for application in breast imaging

Purpose: We present an iterative framework for CT reconstruction from transmission ultrasound data which accurately and efficiently models the strong refraction effects that occur in our target application: Imaging the female breast. Methods: Our refractive ray tracing framework has its foundation in the fast marching method (FNMM) and it allows an accurate as well as efficient modeling of curved rays. We also describe a novel regularization scheme that yields further significant reconstruction quality improvements. A final contribution is the development of a realistic anthropomorphic digital breast phantom based on the NIH Visible Female data set. Results: Our system is able to resolve very fine details even in the presence of significant noise, and it reconstructs both sound speed and attenuation data. Excellent correspondence with a traditional, but significantly more computationally expensive wave equation solver is achieved. Conclusions: Apart from the accurate modeling of curved rays, decisive factors have also been our regularization scheme and the high-quality interpolation filter we have used. An added benefit of our framework is that it accelerates well on GPUs where we have shown that clinical 3D reconstruction speeds on the order of minutes are possible.