Free-breathing whole-heart coronary MRA with 3D radial SSFP and self-navigated image reconstruction.

Respiratory motion is a major source of artifacts in cardiac magnetic resonance imaging (MRI). Free-breathing techniques with pencil-beam navigators efficiently suppress respiratory motion and minimize the need for patient cooperation. However, the correlation between the measured navigator position and the actual position of the heart may be adversely affected by hysteretic effects, navigator position, and temporal delays between the navigators and the image acquisition. In addition, irregular breathing patterns during navigator-gated scanning may result in low scan efficiency and prolonged scan time. The purpose of this study was to develop and implement a self-navigated, free-breathing, whole-heart 3D coronary MRI technique that would overcome these shortcomings and improve the ease-of-use of coronary MRI. A signal synchronous with respiration was extracted directly from the echoes acquired for imaging, and the motion information was used for retrospective, rigid-body, through-plane motion correction. The images obtained from the self-navigated reconstruction were compared with the results from conventional, prospective, pencil-beam navigator tracking. Image quality was improved in phantom studies using self-navigation, while equivalent results were obtained with both techniques in preliminary in vivo studies.

On the convergence of EM-like algorithms for image segmentation using Markov random fields.

Inference of Markov random field images segmentation models is usually performed using iterative methods which adapt the well-known expectation-maximization (EM) algorithm for independent mixture models. However, some of these adaptations are ad hoc and may turn out numerically unstable. In this paper, we review three EM-like variants for Markov random field segmentation and compare their convergence properties both at the theoretical and practical levels. We specifically advocate a numerical scheme involving asynchronous voxel updating, for which general convergence results can be established. Our experiments on brain tissue classification in magnetic resonance images provide evidence that this algorithm may achieve significantly faster convergence than its competitors while yielding at least as good segmentation results.

Low-frequency transcranial magnetic stimulation over left dorsal premotor cortex improves the dynamic control of visuospatially cued actions.

Left rostral dorsal premotor cortex (rPMd) and supramarginal gyrus (SMG) have been implicated in the dynamic control of actions. In 12 right-handed healthy individuals, we applied 30 min of low-frequency (1 Hz) repetitive transcranial magnetic stimulation (rTMS) over left rPMd to investigate the involvement of left rPMd and SMG in the rapid adjustment of actions guided by visuospatial cues. After rTMS, subjects underwent functional magnetic resonance imaging while making spatially congruent button presses with the right or left index finger in response to a left- or right-sided target. Subjects were asked to covertly prepare motor responses as indicated by a directional cue presented 1 s before the target. On 20% of trials, the cue was invalid, requiring subjects to readjust their motor plan according to the target location. Compared with sham rTMS, real rTMS increased the number of correct responses in invalidly cued trials. After real rTMS, task-related activity of the stimulated left rPMd showed increased task-related coupling with activity in ipsilateral SMG and the adjacent anterior intraparietal area (AIP). Individuals who showed a stronger increase in left-hemispheric premotor-parietal connectivity also made fewer errors on invalidly cued trials after rTMS. The results suggest that rTMS over left rPMd improved the ability to dynamically adjust visuospatial response mapping by strengthening left-hemispheric connectivity between rPMd and the SMG-AIP region. These results support the notion that left rPMd and SMG-AIP contribute toward dynamic control of actions and demonstrate that low-frequency rTMS can enhance functional coupling between task-relevant brain regions and improve some aspects of motor performance.

Multimodal image registration of the scoliotic torso for surgical planning

Background This paper presents a method that registers MRIs acquired in prone position, with surface topography (TP) and X-ray reconstructions acquired in standing position, in order to obtain a 3D representation of a human torso incorporating the external surface, bone structures, and soft tissues. Methods TP and X-ray data are registered using landmarks. Bone structures are used to register each MRI slice using an articulated model, and the soft tissue is confined to the volume delimited by the trunk and bone surfaces using a constrained thin-plate spline. Results The method is tested on 3 pre-surgical patients with scoliosis and shows a significant improvement, qualitatively and using the Dice similarity coefficient, in fitting the MRI into the standing patient model when compared to rigid and articulated model registration. The determinant of the Jacobian of the registration deformation shows higher variations in the deformation in areas closer to the surface of the torso. Conclusions The novel, resulting 3D full torso model can provide a more complete representation of patient geometry to be incorporated in surgical simulators under development that aim at predicting the effect of scoliosis surgery on the external appearance of the patient’s torso.

Multimodal image fusion of anatomical structures for diagnosis, therapy planning and assistance

This paper provides an overview of work done in recent years by our research group to fuse multimodal images of the trunk of patients with Adolescent Idiopathic Scoliosis (AIS) treated at Sainte-Justine University Hospital Center (CHU). We first describe our surface acquisition system and introduce a set of clinical measurements (indices) based on the trunk's external shape, to quantify its degree of asymmetry. We then describe our 3D reconstruction system of the spine and rib cage from biplanar radiographs and present our methodology for multimodal fusion of MRI, X-ray and external surface images of the trunk We finally present a physical model of the human trunk including bone and soft tissue for the simulation of the surgical outcome on the external trunk shape in AIS.

Development of Techniques for the Automatic Extraction and Grade Detection of Glioma Tumors from Conventional Brain Magnetic Resonant Images

Cerebral glioma is the most prevalent primary brain tumor, which are classified broadly into low and high grades according to the degree of malignancy. High grade gliomas are highly malignant which possess a poor prognosis, and the patients survive less than eighteen months after diagnosis. Low grade gliomas are slow growing, least malignant and has better response to therapy. To date, histological grading is used as the standard technique for diagnosis, treatment planning and survival prediction. The main objective of this thesis is to propose novel methods for automatic extraction of low and high grade glioma and other brain tissues, grade detection techniques for glioma using conventional magnetic resonance imaging (MRI) modalities and 3D modelling of glioma from segmented tumor slices in order to assess the growth rate of tumors. Two new methods are developed for extracting tumor regions, of which the second method, named as Adaptive Gray level Algebraic set Segmentation Algorithm (AGASA) can also extract white matter and grey matter from T1 FLAIR an T2 weighted images. The methods were validated with manual Ground truth images, which showed promising results. The developed methods were compared with widely used Fuzzy c-means clustering technique and the robustness of the algorithm with respect to noise is also checked for different noise levels. Image texture can provide significant information on the (ab)normality of tissue, and this thesis expands this idea to tumour texture grading and detection. Based on the thresholds of discriminant first order and gray level cooccurrence matrix based second order statistical features three feature sets were formulated and a decision system was developed for grade detection of glioma from conventional T2 weighted MRI modality.The quantitative performance analysis using ROC curve showed 99.03% accuracy for distinguishing between advanced (aggressive) and early stage (non-aggressive) malignant glioma. The developed brain texture analysis techniques can improve the physician’s ability to detect and analyse pathologies leading to a more reliable diagnosis and treatment of disease. The segmented tumors were also used for volumetric modelling of tumors which can provide an idea of the growth rate of tumor; this can be used for assessing response to therapy and patient prognosis.

Content Based Image Retrieval of Brain MR Images across Different Classes

Magnetic Resonance Imaging play a vital role in the decision-diagnosis process of brain MR images. For an accurate diagnosis of brain related problems, the experts mostly compares both T1 and T2 weighted images as the information presented in these two images are complementary. In this paper, rotational and translational invariant form of Local binary Pattern (LBP) with additional gray scale information is used to retrieve similar slices of T1 weighted images from T2 weighted images or vice versa. The incorporation of additional gray scale information on LBP can extract more local texture information. The accuracy of retrieval can be improved by extracting moment features of LBP and reweighting the features based on users’ feedback. Here retrieval is done in a single subject scenario where similar images of a particular subject at a particular level are retrieved, and multiple subjects scenario where relevant images at a particular level across the subjects are retrieved

Design of multifunctional magnetic nanomaterials for biomedical applications

Diese Arbeit ist ein Beitrag zu den schnell wachsenden Forschungsgebieten der Nano-Biotechnologie und Nanomedizin. Sie behandelt die spezifische Gestaltung magnetischer Nanomaterialien für verschiedene biomedizinische Anwendungsgebiete, wie beispielsweise Kontrastmittel für die magnetische Resonanztomographie (MRT) oder "theragnostische" Agenzien für simultane optische/MR Detektion und Behandlung mittels photodynamischer Therapie (PDT).rnEine Vielzahl magnetischer Nanopartikel (NP) mit unterschiedlichsten magnetischen Eigenschaften wurden im Rahmen dieser Arbeit synthetisiert und erschöpfend charakterisiert. Darüber hinaus wurde eine ganze Reihe von Oberflächenmodifizierungsstrategien entwickelt, um sowohl die kolloidale als auch die chemische Stabilität der Partikel zu verbessern, und dadurch den hohen Anforderungen der in vitro und in vivo Applikation gerecht zu werden. Diese Strategien beinhalteten nicht nur die Verwendung bi-funktionaler und multifunktioneller Polymerliganden, sondern auch die Kondensation geeigneter Silanverbindungen, um eine robuste, chemisch inerte und hydrophile Siliziumdioxid- (SiO2) Schale um die magnetischen NP auszubilden.rnGenauer gesagt, der Bildungsmechanismus und die magnetischen Eigenschaften monodisperser MnO NPs wurden ausgiebig untersucht. Aufgrund ihres einzigartigen magnetischen Verhaltens eignen sich diese NPs besonders als (positive) Kontrastmittel zur Verkürzung der longitudinalen Relaxationszeit T1, was zu einer Aufhellung im entsprechenden MRT-Bild führt. Tatsächlich wurde dieses kontrastverbessernde Potential in mehreren Studien mit unterschiedlichen Oberflächenliganden bestätigt. Au@MnO „Nanoblumen“, auf der anderen Seite, sind Vertreter einer weiteren Klasse von Nanomaterialien, die in den vergangenen Jahren erhebliches Interesse in der wissenschaftlichen Welt geweckt hat und oft „Nano-hetero-Materialien“ genannt wird. Solche Nano-hetero-partikel vereinen die individuellen physikalischen und chemischen Eigenschaften der jeweiligen Komponenten in einem nanopartikulärem System und erhöhen dadurch die Vielseitigkeit der möglichen Anwendungen. Sowohl die magnetischen Merkmale von MnO, als auch die optischen Eigenschaften von Au bieten die Möglichkeit, diese „Nanoblumen“ für die kombinierte MRT und optische Bildgebung zu verwenden. Darüber hinaus erlaubt das Vorliegen zweier chemisch unterschiedlicher Oberflächen die gleichzeitige selektive Anbindung von Katecholliganden (auf MnO) und Thiolliganden (auf Au). Außerdem wurde das therapeutische Potential von magnetischen NPs anhand von MnO NPs demonstriert, die mit dem Photosensibilisator Protoporhyrin IX (PP) funktionalisiert waren. Bei Bestrahlung mit sichtbarem Licht initiiert PP die Produktion von zytotoxisch-reaktivem Sauerstoff. Wir zeigen, dass Nierenkrebszellen, die mit PP-funktionalisierten MnO NPs inkubiert wurden nach Bestrahlung mit Laserlicht verenden, während sie ohne Bestrahlung unverändert bleiben. In einem ähnlichen Experiment untersuchten wir die Eigenschaften von SiO2 beschichteten MnO NPs. Dafür wurde eigens eine neuartige SiO2-Beschichtungsmethode entwickelt, die einer nachfolgende weitere Anbindung verschiedenster Liganden und die Einlagerung von Fluoreszenzfarbstoffen durch herkömmliche Silan- Sol-Gel Chemie erlaubt. Die Partikel zeigten eine ausgezeichnete Stabilität in einer ganzen Reihe wässriger Lösungen, darunter auch physiologische Kochsalzlösung, Pufferlösungen und humanes Blutserum, und waren weniger anfällig gegenüber Mn-Ionenauswaschung als einfache PEGylierte MnO NPs. Des Weiteren konnte bewiesen werden, dass die dünne SiO2 Schicht nur einen geringen Einfluss auf das magnetische Verhalten der NPs hatte, so dass sie weiterhin als T1-Kontrastmittel verwendet werden können. Schließlich konnten zusätzlich FePt@MnO NPs hergestellt werden, welche die individuellen magnetischen Merkmale eines ferromagnetischen (FePt) und eines antiferromagnetischen (MnO) Materials vereinen. Wir zeigen, dass wir die jeweiligen Partikelgrößen, und damit das resultierende magnetische Verhalten, durch Veränderung der experimentellen Parameter variieren können. Die magnetische Wechselwirkung zwischen beiden Materialien kann dabei auf Spinkommunikation an der Grenzfläche zwischen beiden NP-Sorten zurückgeführt werden.rn

The influence of body temperature on image contrast in post mortem MRI

To assess the temperature dependency of tissue contrast on post mortem magnetic resonance (PMMR) images both objectively and subjectively; and to visually demonstrate the changes of image contrast at various temperatures.

Dynamic Chemical Shift Imaging for Image-Guided Thermal Therapy

Magnetic resonance temperature imaging (MRTI) is recognized as a noninvasive means to provide temperature imaging for guidance in thermal therapies. The most common method of estimating temperature changes in the body using MR is by measuring the water proton resonant frequency (PRF) shift. Calculation of the complex phase difference (CPD) is the method of choice for measuring the PRF indirectly since it facilitates temperature mapping with high spatiotemporal resolution. Chemical shift imaging (CSI) techniques can provide the PRF directly with high sensitivity to temperature changes while minimizing artifacts commonly seen in CPD techniques. However, CSI techniques are currently limited by poor spatiotemporal resolution. This research intends to develop and validate a CSI-based MRTI technique with intentional spectral undersampling which allows relaxed parameters to improve spatiotemporal resolution. An algorithm based on autoregressive moving average (ARMA) modeling is developed and validated to help overcome limitations of Fourier-based analysis allowing highly accurate and precise PRF estimates. From the determined acquisition parameters and ARMA modeling, robust maps of temperature using the k-means algorithm are generated and validated in laser treatments in ex vivo tissue. The use of non-PRF based measurements provided by the technique is also investigated to aid in the validation of thermal damage predicted by an Arrhenius rate dose model.

Image registration for triggered and non-triggered DTI of the human kidney: Reduced variability of diffusion parameter estimation

BACKGROUND: To investigate if non-rigid image-registration reduces motion artifacts in triggered and non-triggered diffusion tensor imaging (DTI) of native kidneys. A secondary aim was to determine, if improvements through registration allow for omitting respiratory-triggering. METHODS: Twenty volunteers underwent coronal DTI of the kidneys with nine b-values (10-700 s/mm2 ) at 3 Tesla. Image-registration was performed using a multimodal nonrigid registration algorithm. Data processing yielded the apparent diffusion coefficient (ADC), the contribution of perfusion (FP ), and the fractional anisotropy (FA). For comparison of the data stability, the root mean square error (RMSE) of the fitting and the standard deviations within the regions of interest (SDROI ) were evaluated. RESULTS: RMSEs decreased significantly after registration for triggered and also for non-triggered scans (P < 0.05). SDROI for ADC, FA, and FP were significantly lower after registration in both medulla and cortex of triggered scans (P < 0.01). Similarly the SDROI of FA and FP decreased significantly in non-triggered scans after registration (P < 0.05). RMSEs were significantly lower in triggered than in non-triggered scans, both with and without registration (P < 0.05). CONCLUSION: Respiratory motion correction by registration of individual echo-planar images leads to clearly reduced signal variations in renal DTI for both triggered and particularly non-triggered scans. Secondarily, the results suggest that respiratory-triggering still seems advantageous.J. Magn. Reson. Imaging 2014. (c) 2014 Wiley Periodicals, Inc.

Diffusion tensor imaging of the human kidney: Does image registration permit scanning without respiratory triggering?

PURPOSE To investigate if image registration of diffusion tensor imaging (DTI) allows omitting respiratory triggering for both transplanted and native kidneys MATERIALS AND METHODS: Nine kidney transplant recipients and eight healthy volunteers underwent renal DTI on a 3T scanner with and without respiratory triggering. DTI images were registered using a multimodal nonrigid registration algorithm. Apparent diffusion coefficient (ADC), the contribution of perfusion (FP ), and the fractional anisotropy (FA) were determined. Relative root mean square errors (RMSE) of the fitting and the standard deviations of the derived parameters within the regions of interest (SDROI ) were evaluated as quality criteria. RESULTS Registration significantly reduced RMSE in all DTI-derived parameters of triggered and nontriggered measurements in cortex and medulla of both transplanted and native kidneys (P < 0.05 for all). In addition, SDROI values were lower with registration for all 16 parameters in transplanted kidneys (14 of 16 SDROI values were significantly reduced, P < 0.04) and for 15 of 16 parameters in native kidneys (9 of 16 SDROI values were significantly reduced, P < 0.05). Comparing triggered versus nontriggered DTI in transplanted kidneys revealed no significant difference for RMSE (P > 0.14) and for SDROI (P > 0.13) of all parameters. In contrast, in native kidneys relative RMSE from triggered scans were significantly lower than those from nontriggered scans (P < 0.02), while SDROI was slightly higher in triggered compared to nontriggered measurements in 15 out of 16 comparisons (significantly for two, P < 0.05). CONCLUSION Registration improves the quality of DTI in native and transplanted kidneys. Diffusion parameters in renal allografts can be measured without respiratory triggering. In native kidneys, respiratory triggering appears advantageous. J. Magn. Reson. Imaging 2016.

Multimodal non-rigid image registration methods for therapy and surgery planning

La planificación pre-operatoria se ha convertido en una tarea esencial en cirugías y terapias de marcada complejidad, especialmente aquellas relacionadas con órgano blando. Un ejemplo donde la planificación preoperatoria tiene gran interés es la cirugía hepática. Dicha planificación comprende la detección e identificación precisa de las lesiones individuales y vasos así como la correcta segmentación y estimación volumétrica del hígado funcional. Este proceso es muy importante porque determina tanto si el paciente es un candidato adecuado para terapia quirúrgica como la definición del abordaje a seguir en el procedimiento. La radioterapia de órgano blando es un segundo ejemplo donde la planificación se requiere tanto para la radioterapia externa convencional como para la radioterapia intraoperatoria. La planificación comprende la segmentación de tumor y órganos vulnerables y la estimación de la dosimetría. La segmentación de hígado funcional y la estimación volumétrica para planificación de la cirugía se estiman habitualmente a partir de imágenes de tomografía computarizada (TC). De igual modo, en la planificación de radioterapia, los objetivos de la radiación se delinean normalmente sobre TC. Sin embargo, los avances en las tecnologías de imagen de resonancia magnética (RM) están ofreciendo progresivamente ventajas adicionales. Por ejemplo, se ha visto que el ratio de detección de metástasis hepáticas es significativamente superior en RM con contraste Gd–EOB–DTPA que en TC. Por tanto, recientes estudios han destacado la importancia de combinar la información de TC y RM para conseguir el mayor nivel posible de precisión en radioterapia y para facilitar una descripción precisa de las lesiones del hígado. Con el objetivo de mejorar la planificación preoperatoria en ambos escenarios se precisa claramente de un algoritmo de registro no rígido de imagen. Sin embargo, la gran mayoría de sistemas comerciales solo proporcionan métodos de registro rígido. Las medidas de intensidad de voxel han demostrado ser criterios de similitud de imágenes robustos, y, entre ellas, la Información Mutua (IM) es siempre la primera elegida en registros multimodales. Sin embargo, uno de los principales problemas de la IM es la ausencia de información espacial y la asunción de que las relaciones estadísticas entre las imágenes son homogéneas a lo largo de su domino completo. La hipótesis de esta tesis es que la incorporación de información espacial de órganos al proceso de registro puede mejorar la robustez y calidad del mismo, beneficiándose de la disponibilidad de las segmentaciones clínicas. En este trabajo, se propone y valida un esquema de registro multimodal no rígido 3D usando una nueva métrica llamada Información Mutua Centrada en el Órgano (Organ-Focused Mutual Information metric (OF-MI)) y se compara con la formulación clásica de la Información Mutua. Esto permite mejorar los resultados del registro en áreas problemáticas incorporando información regional al criterio de similitud, beneficiándose de la disponibilidad real de segmentaciones en protocolos estándares clínicos, y permitiendo que la dependencia estadística entre las dos modalidades de imagen difiera entre órganos o regiones. El método propuesto se ha aplicado al registro de TC y RM con contraste Gd–EOB–DTPA así como al registro de imágenes de TC y MR para planificación de radioterapia intraoperatoria rectal. Adicionalmente, se ha desarrollado un algoritmo de apoyo de segmentación 3D basado en Level-Sets para la incorporación de la información de órgano en el registro. El algoritmo de segmentación se ha diseñado específicamente para la estimación volumétrica de hígado sano funcional y ha demostrado un buen funcionamiento en un conjunto de imágenes de TC abdominales. Los resultados muestran una mejora estadísticamente significativa de OF-MI comparada con la Información Mutua clásica en las medidas de calidad de los registros; tanto con datos simulados (p<0.001) como con datos reales en registro hepático de TC y RM con contraste Gd– EOB–DTPA y en registro para planificación de radioterapia rectal usando OF-MI multi-órgano (p<0.05). Adicionalmente, OF-MI presenta resultados más estables con menor dispersión que la Información Mutua y un comportamiento más robusto con respecto a cambios en la relación señal-ruido y a la variación de parámetros. La métrica OF-MI propuesta en esta tesis presenta siempre igual o mayor precisión que la clásica Información Mutua y consecuentemente puede ser una muy buena alternativa en aplicaciones donde la robustez del método y la facilidad en la elección de parámetros sean particularmente importantes. Abstract Pre-operative planning has become an essential task in complex surgeries and therapies, especially for those affecting soft tissue. One example where soft tissue preoperative planning is of high interest is liver surgery. It involves the accurate detection and identification of individual liver lesions and vessels as well as the proper functional liver segmentation and volume estimation. This process is very important because it determines whether the patient is a suitable candidate for surgical therapy and the type of procedure. Soft tissue radiation therapy is a second example where planning is required for both conventional external and intraoperative radiotherapy. It involves the segmentation of the tumor target and vulnerable organs and the estimation of the planned dose. Functional liver segmentations and volume estimations for surgery planning are commonly estimated from computed tomography (CT) images. Similarly, in radiation therapy planning, targets to be irradiated and healthy and vulnerable tissues to be protected from irradiation are commonly delineated on CT scans. However, developments in magnetic resonance imaging (MRI) technology are progressively offering advantages. For instance, the hepatic metastasis detection rate has been found to be significantly higher in Gd–EOB–DTPAenhanced MRI than in CT. Therefore, recent studies highlight the importance of combining the information from CT and MRI to achieve the highest level of accuracy in radiotherapy and to facilitate accurate liver lesion description. In order to improve those two soft tissue pre operative planning scenarios, an accurate nonrigid image registration algorithm is clearly required. However, the vast majority of commercial systems only provide rigid registration. Voxel intensity measures have been shown to be robust measures of image similarity, and among them, Mutual Information (MI) is always the first candidate in multimodal registrations. However, one of the main drawbacks of Mutual Information is the absence of spatial information and the assumption that statistical relationships between images are the same over the whole domain of the image. The hypothesis of the present thesis is that incorporating spatial organ information into the registration process may improve the registration robustness and quality, taking advantage of the clinical segmentations availability. In this work, a multimodal nonrigid 3D registration framework using a new Organ- Focused Mutual Information metric (OF-MI) is proposed, validated and compared to the classical formulation of the Mutual Information (MI). It allows improving registration results in problematic areas by adding regional information into the similitude criterion taking advantage of actual segmentations availability in standard clinical protocols and allowing the statistical dependence between the two modalities differ among organs or regions. The proposed method is applied to CT and T1 weighted delayed Gd–EOB–DTPA-enhanced MRI registration as well as to register CT and MRI images in rectal intraoperative radiotherapy planning. Additionally, a 3D support segmentation algorithm based on Level-Sets has been developed for the incorporation of the organ information into the registration. The segmentation algorithm has been specifically designed for the healthy and functional liver volume estimation demonstrating good performance in a set of abdominal CT studies. Results show a statistical significant improvement of registration quality measures with OF-MI compared to MI with both simulated data (p<0.001) and real data in liver applications registering CT and Gd–EOB–DTPA-enhanced MRI and in registration for rectal radiotherapy planning using multi-organ OF-MI (p<0.05). Additionally, OF-MI presents more stable results with smaller dispersion than MI and a more robust behavior with respect to SNR changes and parameters variation. The proposed OF-MI always presents equal or better accuracy than the classical MI and consequently can be a very convenient alternative within applications where the robustness of the method and the facility to choose the parameters are particularly important.

Rigid and non-rigid point-based medical image registration

The primary goal of this dissertation is to develop point-based rigid and non-rigid image registration methods that have better accuracy than existing methods. We first present point-based PoIRe, which provides the framework for point-based global rigid registrations. It allows a choice of different search strategies including (a) branch-and-bound, (b) probabilistic hill-climbing, and (c) a novel hybrid method that takes advantage of the best characteristics of the other two methods. We use a robust similarity measure that is insensitive to noise, which is often introduced during feature extraction. We show the robustness of PoIRe using it to register images obtained with an electronic portal imaging device (EPID), which have large amounts of scatter and low contrast. To evaluate PoIRe we used (a) simulated images and (b) images with fiducial markers; PoIRe was extensively tested with 2D EPID images and images generated by 3D Computer Tomography (CT) and Magnetic Resonance (MR) images. PoIRe was also evaluated using benchmark data sets from the blind retrospective evaluation project (RIRE). We show that PoIRe is better than existing methods such as Iterative Closest Point (ICP) and methods based on mutual information. We also present a novel point-based local non-rigid shape registration algorithm. We extend the robust similarity measure used in PoIRe to non-rigid registrations adapting it to a free form deformation (FFD) model and making it robust to local minima, which is a drawback common to existing non-rigid point-based methods. For non-rigid registrations we show that it performs better than existing methods and that is less sensitive to starting conditions. We test our non-rigid registration method using available benchmark data sets for shape registration. Finally, we also explore the extraction of features invariant to changes in perspective and illumination, and explore how they can help improve the accuracy of multi-modal registration. For multimodal registration of EPID-DRR images we present a method based on a local descriptor defined by a vector of complex responses to a circular Gabor filter.