Real-Time Multimodal Retinal Image Registration for a Computer Assisted Laser Photocoagulation System

An algorithm for the real-time registration of a retinal video sequence captured with a scanning digital ophthalmoscope (SDO) to a retinal composite image is presented. This method is designed for a computer-assisted retinal laser photocoagulation system to compensate for retinal motion and hence enhance the accuracy, speed, and patient safety of retinal laser treatments. The procedure combines intensity and feature-based registration techniques. For the registration of an individual frame, the translational frame-to-frame motion between preceding and current frame is detected by normalized cross correlation. Next, vessel points on the current video frame are identified and an initial transformation estimate is constructed from the calculated translation vector and the quadratic registration matrix of the previous frame. The vessel points are then iteratively matched to the segmented vessel centerline of the composite image to refine the initial transformation and register the video frame to the composite image. Criteria for image quality and algorithm convergence are introduced, which assess the exclusion of single frames from the registration process and enable a loss of tracking signal if necessary. The algorithm was successfully applied to ten different video sequences recorded from patients. It revealed an average accuracy of 2.47 ± 2.0 pixels (∼23.2 ± 18.8 μm) for 2764 evaluated video frames and demonstrated that it meets the clinical requirements.

Acute onset incomitant image disparity modifies saccadic and vergence eye movements.

New-onset impairment of ocular motility will cause incomitant strabismus, i.e., a gaze-dependent ocular misalignment. This ocular misalignment will cause retinal disparity, that is, a deviation of the spatial position of an image on the retina of both eyes, which is a trigger for a vergence eye movement that results in ocular realignment. If the vergence movement fails, the eyes remain misaligned, resulting in double vision. Adaptive processes to such incomitant vergence stimuli are poorly understood. In this study, we have investigated the physiological oculomotor response of saccadic and vergence eye movements in healthy individuals after shifting gaze from a viewing position without image disparity into a field of view with increased image disparity, thus in conditions mimicking incomitance. Repetitive saccadic eye movements into a visual field with increased stimulus disparity lead to a rapid modification of the oculomotor response: (a) Saccades showed immediate disconjugacy (p < 0.001) resulting in decreased retinal image disparity at the end of a saccade. (b) Vergence kinetics improved over time (p < 0.001). This modified oculomotor response enables a more prompt restoration of ocular alignment in new-onset incomitance.

Multimodal Registration Procedure for the Initial Spatial Alignment of a Retinal Video Sequence to a Retinal Composite Image

Accurate placement of lesions is crucial for the effectiveness and safety of a retinal laser photocoagulation treatment. Computer assistance provides the capability for improvements to treatment accuracy and execution time. The idea is to use video frames acquired from a scanning digital ophthalmoscope (SDO) to compensate for retinal motion during laser treatment. This paper presents a method for the multimodal registration of the initial frame from an SDO retinal video sequence to a retinal composite image, which may contain a treatment plan. The retinal registration procedure comprises the following steps: 1) detection of vessel centerline points and identification of the optic disc; 2) prealignment of the video frame and the composite image based on optic disc parameters; and 3) iterative matching of the detected vessel centerline points in expanding matching regions. This registration algorithm was designed for the initialization of a real-time registration procedure that registers the subsequent video frames to the composite image. The algorithm demonstrated its capability to register various pairs of SDO video frames and composite images acquired from patients.

SPECTRAL DOMAIN-OPTICAL COHERENCE TOMOGRAPHY IMAGE CONTRAST AND BACKGROUND COLOR SETTINGS INFLUENCE IDENTIFICATION OF RETINAL STRUCTURES.

PURPOSE To evaluate image contrast and color setting on assessment of retinal structures and morphology in spectral-domain optical coherence tomography. METHODS Two hundred and forty-eight Spectralis spectral-domain optical coherence tomography B-scans of 62 patients were analyzed by 4 readers. B-scans were extracted in 4 settings: W + N = white background with black image at normal contrast 9; W + H = white background with black image at maximum contrast 16; B + N = black background with white image at normal contrast 12; B + H = black background with white image at maximum contrast 16. Readers analyzed the images to identify morphologic features. Interreader correlation was calculated. Differences between Fleiss-kappa correlation coefficients were examined using bootstrap method. Any setting with significantly higher correlation coefficient was deemed superior for evaluating specific features. RESULTS Correlation coefficients differed among settings. No single setting was superior for all respective spectral-domain optical coherence tomography parameters (P = 0.3773). Some variables showed no differences among settings. Hard exudates and subretinal fluid were best seen with B + H (κ = 0.46, P = 0.0237 and κ = 0.78, P = 0.002). Microaneurysms were best seen with W + N (κ = 0.56, P = 0.025). Vitreomacular interface, enhanced transmission signal, and epiretinal membrane were best identified using all color/contrast settings together (κ = 0.44, P = 0.042, κ = 0.57, P = 0.01, and κ = 0.62, P ≤ 0.0001). CONCLUSION Contrast and background affect the evaluation of retinal structures on spectral-domain optical coherence tomography images. No single setting was superior for all features, though certain changes were best seen with specific settings.

Inter-observer agreement for spectral- and time-domain optical coherence tomography image grading: a prospective study

The purpose of this study was to compare inter-observer agreement of Stratus™ OCT versus Spectralis™ OCT image grading in patients with neovascular age-related macular degeneration (AMD). Thirty eyes with neovascular AMD were examined with Stratus™ OCT and Spectralis™ OCT. Four different scan protocols were used for imaging. Three observers graded the images for the presence of various pathologies. Inter-observer agreement between OCT models was assessed by calculating intra-class correlation coefficients (ICC). In Stratus™ OCT highest interobserver agreement was found for subretinal fluid (ICC: 0.79), and in Spectralis™ OCT for intraretinal cysts (IRC) (ICC: 0.93). Spectralis™ OCT showed superior interobserver agreement for IRC and epiretinal membranes (ERM) (ICC(Stratus™): for IRC 0.61; for ERM 0.56; ICC(Spectralis™): for IRC 0.93; for ERM 0.84). Increased image resolution of Spectralis™ OCT did improve the inter-observer agreement for grading intraretinal cysts and epiretinal membranes but not for other retinal changes.

Retinal Laser Lesion Visibility in Simultaneous Ultra-High Axial Resolution Optical Coherence Tomography

Ex vivo porcine retina laser lesions applied with varying laser power (20 mW–2 W, 10 ms pulse, 196 lesions) are manually evaluated by microscopic and optical coherence tomography (OCT) visibility, as well as in histological sections immediately after the deposition of the laser energy. An optical coherence tomography system with 1.78 um axial resolution specifically developed to image thin retinal layers simultaneously to laser therapy is presented, and visibility thresholds of the laser lesions in OCT data and fundus imaging are compared. Optical coherence tomography scans are compared with histological sections to estimate the resolving power for small optical changes in the retinal layers, and real-time time-lapse scans during laser application are shown and analyzed quantitatively. Ultrahigh-resolution OCT inspection features a lesion visibility threshold 40–50 mW (17 reduction) lower than for visual inspection. With the new measurement system, 42 of the lesions that were invisible using state-of-the-art ophthalmoscopic methods could be detected.

Retinal slit lamp video mosaicking

Purpose To this day, the slit lamp remains the first tool used by an ophthalmologist to examine patient eyes. Imaging of the retina poses, however, a variety of problems, namely a shallow depth of focus, reflections from the optical system, a small field of view and non-uniform illumination. For ophthalmologists, the use of slit lamp images for documentation and analysis purposes, however, remains extremely challenging due to large image artifacts. For this reason, we propose an automatic retinal slit lamp video mosaicking, which enlarges the field of view and reduces amount of noise and reflections, thus enhancing image quality. Methods Our method is composed of three parts: (i) viable content segmentation, (ii) global registration and (iii) image blending. Frame content is segmented using gradient boosting with custom pixel-wise features. Speeded-up robust features are used for finding pair-wise translations between frames with robust random sample consensus estimation and graph-based simultaneous localization and mapping for global bundle adjustment. Foreground-aware blending based on feathering merges video frames into comprehensive mosaics. Results Foreground is segmented successfully with an area under the curve of the receiver operating characteristic curve of 0.9557. Mosaicking results and state-of-the-art methods were compared and rated by ophthalmologists showing a strong preference for a large field of view provided by our method. Conclusions The proposed method for global registration of retinal slit lamp images of the retina into comprehensive mosaics improves over state-of-the-art methods and is preferred qualitatively.

Multimodal Imaging of Cotton Wool Spots in Branch Retinal Vein Occlusion.

PURPOSE: To describe and follow cotton wool spots (CWS) in branch retinal vein occlusion (BRVO) using multimodal imaging. METHODS: In this prospective cohort study including 24 patients with new-onset BRVO, CWS were described and analyzed in color fundus photography (CF), spectral domain optical coherence tomography (SD-OCT), infrared (IR) and fluorescein angiography (FA) every 3 months for 3 years. The CWS area on SD-OCT and CF was evaluated using OCT-Tool-Kit software: CWS were marked in each single OCT B-scan and the software calculated the area by interpolation. RESULTS: 29 central CWS lesions were found. 100% of these CWS were visible on SD-OCT, 100% on FA and 86.2% on IR imaging, but only 65.5% on CF imaging. CWS were visible for 12.4 ± 7.5 months on SD-OCT, for 4.4 ± 3 months and 4.3 ± 3.4 months on CF and on IR, respectively, and for 17.5 ± 7.1 months on FA. The evaluated CWS area on SD-OCT was larger than on CF (0.26 ± 0.17 mm(2) vs. 0.13 ± 0.1 mm(2), p < 0.0001). The CWS area on SD-OCT and surrounding pathology such as intraretinal cysts, avascular zones and intraretinal hemorrhage were predictive for how long CWS remained visible (r(2) = 0.497, p < 0.002). CONCLUSIONS: The lifetime and presentation of CWS in BRVO seem comparable to other diseases. SD-OCT shows a higher sensitivity for detecting CWS compared to CF. The duration of visibility of CWS varies among different image modalities and depends on the surrounding pathology and the CWS size.

Quantification of retinal layer thickness changes in acute macular neuroretinopathy.

PURPOSE To quantitatively evaluate retinal layer thickness changes in acute macular neuroretinopathy (AMN). METHODS AMN areas were identified using near-infrared reflectance (NIR) images. Intraretinal layer segmentation using Heidelberg software was performed. The inbuilt ETDRS -grid was moved onto the AMN lesion and the mean retinal layer thicknesses of the central grid were recorded and compared with the corresponding area of the fellow eye at initial presentation and during follow-up. RESULTS Eleven patients were included (mean age 26±6 years). AMN lesions at baseline had a significantly thinner outer nuclear layer (ONL) (51±21 µm vs 73±17 µm, p=0.002). The other layers, including inner nuclear layer (37±8 µm vs 38±6 µm, p=0.9) and outer plexiform layer (OPL) (45±19 µm vs 33±16 µm, p=0.1) did not show significant differences between the study eyes and fellow eyes. Adjacent to NIR image lesions, areas of OPL thickening were identified (study eye: 50±14 µm vs fellow eye: 39±16 µm, p=0.005) with corresponding thinning of ONL (study eye: 52±16 µm vs fellow eye: 69±16 µm, p=0.002). CONCLUSIONS AMN presents with characteristic quantitative retinal changes and the extent of the lesion may be more extensive than initially presumed from NIR image lesions.