Real-Time Multimodal Retinal Image Registration for a Computer Assisted Laser Photocoagulation System

An algorithm for the real-time registration of a retinal video sequence captured with a scanning digital ophthalmoscope (SDO) to a retinal composite image is presented. This method is designed for a computer-assisted retinal laser photocoagulation system to compensate for retinal motion and hence enhance the accuracy, speed, and patient safety of retinal laser treatments. The procedure combines intensity and feature-based registration techniques. For the registration of an individual frame, the translational frame-to-frame motion between preceding and current frame is detected by normalized cross correlation. Next, vessel points on the current video frame are identified and an initial transformation estimate is constructed from the calculated translation vector and the quadratic registration matrix of the previous frame. The vessel points are then iteratively matched to the segmented vessel centerline of the composite image to refine the initial transformation and register the video frame to the composite image. Criteria for image quality and algorithm convergence are introduced, which assess the exclusion of single frames from the registration process and enable a loss of tracking signal if necessary. The algorithm was successfully applied to ten different video sequences recorded from patients. It revealed an average accuracy of 2.47 ± 2.0 pixels (∼23.2 ± 18.8 μm) for 2764 evaluated video frames and demonstrated that it meets the clinical requirements.

Cardiac image fusion from stand-alone SPECT and CT: clinical experience

Myocardial perfusion imaging with SPECT (SPECT-MPI) and 64-slice CT angiography (CTA) are both established techniques for the noninvasive evaluation of coronary artery disease (CAD). Three-dimensional (3D) SPECT/CT image fusion may offer an incremental diagnostic value by integrating both sets of information. We report our first clinical experiences with fused 3D SPECT/CT in CAD patients. METHODS: Thirty-eight consecutive patients with at least 1 perfusion defect on SPECT-MPI (1-d adenosine stress/rest SPECT with (99m)Tc-tetrofosmin) and 64-slice CTA were included. 3D volume-rendered fused SPECT/CT images were generated and compared with the findings from the side-by-side analysis with regard to coronary lesion interpretation by assigning the perfusion defects to their corresponding coronary lesion. RESULTS: The fused SPECT/CT images added information on pathophysiologic lesion severity in 27 coronary stenoses (22%) of 12 patients (29%) (P<0.001). Among 40 equivocal lesions on side-by-side analysis, the fused interpretation confirmed hemodynamic significance in 14 lesions and excluded functional relevance in 10 lesions. In 3 lesions, assignment of perfusion defect and coronary lesion appeared to be reliable on side-by-side analysis but proved to be inaccurate on fused interpretation. Added diagnostic information by SPECT/CT was more commonly found in patients with stenoses of small vessels (P=0.004) and involvement of diagonal branches (P=0.01). CONCLUSION: In addition to being intuitively convincing, 3D SPECT/CT fusion images in CAD may provide added diagnostic information on the functional relevance of coronary artery lesions.

A Hybrid Multimodal Non-Rigid Registration of MR Images Based on Diffeomorphic Demons

n this paper we present a novel hybrid approach for multimodal medical image registration based on diffeomorphic demons. Diffeomorphic demons have proven to be a robust and efficient way for intensity-based image registration. A very recent extension even allows to use mutual information (MI) as a similarity measure to registration multimodal images. However, due to the intensity correspondence uncertainty existing in some anatomical parts, it is difficult for a purely intensity-based algorithm to solve the registration problem. Therefore, we propose to combine the resulting transformations from both intensity-based and landmark-based methods for multimodal non-rigid registration based on diffeomorphic demons. Several experiments on different types of MR images were conducted, for which we show that a better anatomical correspondence between the images can be obtained using the hybrid approach than using either intensity information or landmarks alone.

Multimodal Registration Procedure for the Initial Spatial Alignment of a Retinal Video Sequence to a Retinal Composite Image

Accurate placement of lesions is crucial for the effectiveness and safety of a retinal laser photocoagulation treatment. Computer assistance provides the capability for improvements to treatment accuracy and execution time. The idea is to use video frames acquired from a scanning digital ophthalmoscope (SDO) to compensate for retinal motion during laser treatment. This paper presents a method for the multimodal registration of the initial frame from an SDO retinal video sequence to a retinal composite image, which may contain a treatment plan. The retinal registration procedure comprises the following steps: 1) detection of vessel centerline points and identification of the optic disc; 2) prealignment of the video frame and the composite image based on optic disc parameters; and 3) iterative matching of the detected vessel centerline points in expanding matching regions. This registration algorithm was designed for the initialization of a real-time registration procedure that registers the subsequent video frames to the composite image. The algorithm demonstrated its capability to register various pairs of SDO video frames and composite images acquired from patients.

Diagnosis of cardiac metastasis from cervical cancer in a 33-year-old patient using multimodal imaging studies: a case report and literature review.

We report a case of a 33-year-old woman with emergency admission due to dyspnoea and fever. History included squamous cell carcinoma of the cervix in complete remission. Contrast-enhanced computed tomography (CT) scanning of the chest, which was indicated to rule out pneumonia, revealed an infiltrative cardiac mass. Further assessment of the tumour by echocardiography and cardiac magnetic resonance imaging (MRI) showed transmural infiltration of the apical interventricular septum with a mass extending into the left and right ventricle cavities. The mass was highly suspicious for a cardiac metastasis. Cardiac metastases from cervical cancer are extremely rare. Recurrence of cervical carcinoma involving the heart should be considered even after a curative therapy approach. Non-invasive imaging plays a paramount role in investigating cardiac masses. Echocardiography, CT and MRI are complementary imaging modalities for complete work-up of intracardiac lesions.

Multimodal target correction by local bone registration: a PET/CT evaluation

PET/CT guidance for percutaneous interventions allows biopsy of suspicious metabolically active bone lesions even when no morphological correlation is delineable in the CT images. Clinical use of PET/CT guidance with conventional step-by-step technique is time consuming and complicated especially in cases in which the target lesion is not shown in the CT image. Our recently developed multimodal instrument guidance system (IGS) for PET/CT improved this situation. Nevertheless, bone biopsies even with IGS have a trade-off between precision and intervention duration which is proportional to patient and personnel exposure to radiation. As image acquisition and reconstruction of PET may take up to 10 minutes, preferably only one time consuming combined PET/CT acquisition should be needed during an intervention. In case of required additional control images in order to check for possible patient movements/deformations, or to verify the final needle position in the target, only fast CT acquisitions should be performed. However, for precise instrument guidance accounting for patient movement and/or deformation without having a control PET image, it is essential to be able to transfer the position of the target as identified in the original PET/CT to a changed situation as shown in the control CT.

Multimodal augmented reality system for surgical microscopy

Image-guided, computer-assisted neurosurgery has emerged to improve localization and targeting, to provide a better anatomic definition of the surgical field, and to decrease invasiveness. Usually, in image-guided surgery, a computer displays the surgical field in a CT/MR environment, using axial, coronal or sagittal views, or even a 3D representation of the patient. Such a system forces the surgeon to look away from the surgical scene to the computer screen. Moreover, this kind of information, being pre-operative imaging, can not be modified during the operation, so it remains valid for guidance in the first stage of the surgical procedure, and mainly for rigid structures like bones. In order to solve the two constraints mentioned before, we are developing an ultrasoundguided surgical microscope. Such a system takes the advantage that surgical microscopy and ultrasound systems are already used in neurosurgery, so it does not add more complexity to the surgical procedure. We have integrated an optical tracking device in the microscope and an augmented reality overlay system with which we avoid the need to look away from the scene, providing correctly aligned surgical images with sub-millimeter accuracy. In addition to the standard CT and 3D views, we are able to track an ultrasound probe, and using a previous calibration and registration of the imaging, the image obtained is correctly projected to the overlay system, so the surgeon can always localize the target and verify the effects of the intervention. Several tests of the system have been already performed to evaluate the accuracy, and clinical experiments are currently in progress in order to validate the clinical usefulness of the system.

Effects of non-ionic iodinated contrast media on patient heart rate and pressures during intra-cardiac or intra-arterial injection

PURPOSE: To compare the effects on heart rate (HR), on left ventricular (LV) or arterial pressures, and the general safety of a non-ionic low-osmolar contrast medium (CM) and a non-ionic iso-osmolar CM in patients undergoing cardiac angiography (CA) or peripheral intra-arterial digital subtraction angiography (IA-DSA). MATERIALS AND METHODS: Two double-blind, randomized studies were conducted in 216 patients who underwent CA (n=120) or peripheral IA-DSA (n=96). Patients referred for CA received a low-osmolar monomeric CM (iomeprol-350, n=60) or an iso-osmolar dimeric CM (iodixanol-320; n=60). HR and LV peak systolic and end-diastolic pressures were determined before and after the first injection during left and right coronary arteriography and left ventriculography. Monitoring for all types of adverse event (AE) was performed for 24 h following the procedure. t-tests were performed to compare CM for effects on HR. Patients referred for IA-DSA received iomeprol-300 (n=49) or iodixanol-320 (n=47). HR and arterial blood pressure (BP) were evaluated before and after the first 4 injections. Monitoring for AE was performed for 4 h following the procedure. Repeated-measures ANOVA was used to compare mean HR changes across the first 4 injections, whereas changes after the first injection were compared using t-tests. RESULTS: No significant differences were noted between iomeprol and iodixanol in terms of mean changes in HR during left coronary arteriography (p=0.8), right coronary arteriography (p=0.9), and left ventriculography (p=0.8). In patients undergoing IA-DSA, no differences between CM were noted for effects on mean HR after the first injection (p=0.6) or across the first 4 injections (p=0.2). No significant differences (p>0.05) were noted in terms of effects on arterial BP in either study or on LV pressures in patients undergoing CA. Non-serious AE considered possibly CM-related (primarily headache and events affecting the cardiovascular and digestive systems) were reported more frequently by patients undergoing CA and more frequently after iodixanol (14/60 [23.3%] and 2/47 [4.3%]; CA and IA-DSA, respectively) than iomeprol (10/60 [16.7%] and 1/49 [2%], respectively). CONCLUSIONS: Iomeprol and iodixanol are safe and have equally negligible effects on HR and LV pressures or arterial BP during and after selective intra-cardiac injection and peripheral IA-DSA. CLINICAL APPLICATION: Iomeprol and iodixanol are safe and equally well tolerated with regard to cardiac rhythm and clinical preference should be based on diagnostic image quality alone.

Evaluation of magnetic resonance colonography at 3.0 Tesla regarding diagnostic accuracy and image quality

OBJECTIVES: To assess magnetic resonance (MR)-colonography (MRC) for detection of colorectal lesions using two different T1w three-dimensional (3D)-gradient-recalled echo (GRE)-sequences and integrated parallel data acquisition (iPAT) at a 3.0 Tesla MR-unit. MATERIALS AND METHODS: In this prospective study, 34 symptomatic patients underwent dark lumen MRC at a 3.0 Tesla unit before conventional colonoscopy (CC). After colon distension with tap water, 2 high-resolution T1w 3D-GRE [3-dimensional fast low angle shot (3D-FLASH), iPAT factor 2 and 3D-volumetric interpolated breathhold examination (VIBE), iPAT 3] sequences were acquired without and after bolus injection of gadolinium. Prospective evaluation of MRC was performed. Image quality of the different sequences was assessed qualitatively and quantitatively. The findings of the same day CC served as standard of reference. RESULTS: MRC identified all polyps >5 mm (16 of 16) in size and all carcinomas (4 of 4) correctly. Fifty percent of the small polyps image quality was ranked lower in the VIBE, the image quality score of both sequences showed no statistical significant difference (chi > 0.6). CONCLUSIONS: MRC using 3D-GRE-sequences and iPAT is feasible at 3.0 T-systems. The high-resolution 3D-FLASH was slightly preferred over the 3D-VIBE because of better image quality, although both used sequences showed no statistical significant difference.

Semi-automatic segmentation of fetal cardiac cavities: progress towards an automated fetal echocardiogram

OBJECTIVE: To develop a novel application of a tool for semi-automatic volume segmentation and adapt it for analysis of fetal cardiac cavities and vessels from heart volume datasets. METHODS: We studied retrospectively virtual cardiac volume cycles obtained with spatiotemporal image correlation (STIC) from six fetuses with postnatally confirmed diagnoses: four with normal hearts between 19 and 29 completed gestational weeks, one with d-transposition of the great arteries and one with hypoplastic left heart syndrome. The volumes were analyzed offline using a commercially available segmentation algorithm designed for ovarian folliculometry. Using this software, individual 'cavities' in a static volume are selected and assigned individual colors in cross-sections and in 3D-rendered views, and their dimensions (diameters and volumes) can be calculated. RESULTS: Individual segments of fetal cardiac cavities could be separated, adjacent segments merged and the resulting electronic casts studied in their spatial context. Volume measurements could also be performed. Exemplary images and interactive videoclips showing the segmented digital casts were generated. CONCLUSION: The approach presented here is an important step towards an automated fetal volume echocardiogram. It has the potential both to help in obtaining a correct structural diagnosis, and to generate exemplary visual displays of cardiac anatomy in normal and structurally abnormal cases for consultation and teaching.

[Neuromonitoring and neuroprotection in cardiac anaesthesia. Nationwide survey conducted by the Cardiac Anaesthesia Working Group of the German Society of Anaesthesiology and Intensive Care Medicine]

OBJECTIVE: The primary objective of this nationwide survey carried out in department of cardiac anesthesia in Germany was to identify current practice with regard to neuromonitoring und neuroprotection. METHODOLOGY: The data are based on a questionnaire sent out to all departments of cardiac anesthesia in Germany between October 2007 und January 2008. The anonymized questionnaire contained 26 questions about the practice of preoperative evaluation of cerebral vessels, intra-operative use of neuromonitoring, the nature und application of cerebral protective measures, perfusion management during cardiopulmonary bypass, postoperative evaluation of neurological status, and training in the field of cerebral monitoring. RESULTS: Of the 80 mailed questionnaires 55% were returned and 90% of department evaluated cerebral vessels preoperatively with duplex ultrasound. The methods used for intra-operative neuromonitoring are electroencephalography (EEG, 60%) for type A dissections (38.1%), for elective surgery on the thoracic and thoraco-abdominal aorta (34.1% and 31.6%, respectively) and in carotid surgery (43.2%) near infrared spectroscopy (40%), evoked potentials (30%) and transcranial Doppler sonography (17.5%), with some centers using combined methods. In most departments the central nervous system is not subjected to monitoring during bypass surgery, heart valve surgery, or minimally invasive surgery. Cerebral protective measures used comprise patient cooling on cardio-pulmonary bypass (CPB 100%), extracorporeal cooling of the head (65%) and the administration of corticosteroids (58%), barbiturates (50%) and antiepileptic drugs (10%). Neuroprotective anesthesia consists of administering inhalation anesthetics (32.5%; sevoflurane 76.5%) and intravenous anesthesia (20%; propofol and barbiturates each accounting for 46.2%). Of the departments 72.5% cool patients as a standard procedure for surgery involving cardiovascular arrest and 37.5% during all surgery using CPB. In 84.6% of department CPB flow equals calculated cardiac output (CO) under normothermia, while the desired mean arterial pressure (MAP) varies between 60 and 70 mmHg (43.9%) and between 50 and 60 mmHg (41.5%), respectively. At body temperatures less than 18 degrees C CPB flow is reduced below the calculated CO (70%) while 27% of departments use normothermic flow rates. The preferred MAP under hypothermia is between 50 and 60 mmHg (59%). The results of intra-operative neuromonitoring are documented on the anesthesia record (77%). In 42.5% of the departments postoperative neurological function is estimated by the anesthesiologist. Continuing education sessions pertaining to neuromonitoring are organized on a regular basis in 32.5% of the departments and in 37.5% individual physicians are responsible for their own neuromonitoring education. CONCLUSION: The present survey data indicate that neuromonitoring and neuroprotective therapy during CPB is not standardized in cardiac anesthesiology departments in Germany. The systemic use of available methods to implement multimodal neuromonitoring would be desirable.

fMRI of Emotion

Recent brain imaging work has expanded our understanding of the mechanisms of perceptual, cognitive, and motor functions in human subjects, but research into the cerebral control of emotional and motivational function is at a much earlier stage. Important concepts and theories of emotion are briefly introduced, as are research designs and multimodal approaches to answering the central questions in the field. We provide a detailed inspection of the methodological and technical challenges in assessing the cerebral correlates of emotional activation, perception, learning, memory, and emotional regulation behavior in healthy humans. fMRI is particularly challenging in structures such as the amygdala as it is affected by susceptibility-related signal loss, image distortion, physiological and motion artifacts and colocalized Resting State Networks (RSNs). We review how these problems can be mitigated by using optimized echo-planar imaging (EPI) parameters, alternative MR sequences, and correction schemes. High-quality data can be acquired rapidly in these problematic regions with gradient compensated multiecho EPI or high resolution EPI with parallel imaging and optimum gradient directions, combined with distortion correction. Although neuroimaging studies of emotion encounter many difficulties regarding the limitations of measurement precision, research design, and strategies of validating neuropsychological emotion constructs, considerable improvement in data quality and sensitivity to subtle effects can be achieved. The methods outlined offer the prospect for fMRI studies of emotion to provide more sensitive, reliable, and representative models of measurement that systematically relate the dynamics of emotional regulation behavior with topographically distinct patterns of activity in the brain. This will provide additional information as an aid to assessment, categorization, and treatment of patients with emotional and personality disorders.