Eye Fundus Image Analysis for Automatic Detection of Diabetic Retinopathy

Diabetes is a rapidly increasing worldwide problem which is characterised by defective metabolism of glucose that causes long-term dysfunction and failure of various organs. The most common complication of diabetes is diabetic retinopathy (DR), which is one of the primary causes of blindness and visual impairment in adults. The rapid increase of diabetes pushes the limits of the current DR screening capabilities for which the digital imaging of the eye fundus (retinal imaging), and automatic or semi-automatic image analysis algorithms provide a potential solution. In this work, the use of colour in the detection of diabetic retinopathy is statistically studied using a supervised algorithm based on one-class classification and Gaussian mixture model estimation. The presented algorithm distinguishes a certain diabetic lesion type from all other possible objects in eye fundus images by only estimating the probability density function of that certain lesion type. For the training and ground truth estimation, the algorithm combines manual annotations of several experts for which the best practices were experimentally selected. By assessing the algorithm’s performance while conducting experiments with the colour space selection, both illuminance and colour correction, and background class information, the use of colour in the detection of diabetic retinopathy was quantitatively evaluated. Another contribution of this work is the benchmarking framework for eye fundus image analysis algorithms needed for the development of the automatic DR detection algorithms. The benchmarking framework provides guidelines on how to construct a benchmarking database that comprises true patient images, ground truth, and an evaluation protocol. The evaluation is based on the standard receiver operating characteristics analysis and it follows the medical practice in the decision making providing protocols for image- and pixel-based evaluations. During the work, two public medical image databases with ground truth were published: DIARETDB0 and DIARETDB1. The framework, DR databases and the final algorithm, are made public in the web to set the baseline results for automatic detection of diabetic retinopathy. Although deviating from the general context of the thesis, a simple and effective optic disc localisation method is presented. The optic disc localisation is discussed, since normal eye fundus structures are fundamental in the characterisation of DR.

Relationships between fundus image quantification and visual field status in age-related macular degeneration

Presentation Purpose:To relate structural change to functional change in age-related macular degeneration (AMD) in a cross-sectional population using fundus imaging and the visual field status. Methods:10 degree standard and SWAP visual fields and other standard functional clinical measures were acquired in 44 eyes of 27 patients at various stages of AMD, as well as fundus photographs. Retro-mode SLO images were captured in a subset of 29 eyes of 19 of the patients. Drusen area, measured by automated drusen segmentation software (Smith et al. 2005) was correlated with visual field data. Visual field defect position was compared to the position of the imaged drusen and deposits using custom software. Results:The effect of AMD stage on drusen area within the 6000µm was significant (One-way ANOVA: F = 17.231, p < 0.001), however the trend was not strong across all stages. There were significant linear relationships between visual field parameters and drusen area. The mean deviation (MD) declined by 3.00dB and 3.92dB for each log % drusen area for standard perimetry and SWAP, respectively. The visual field parameters of focal loss displayed the strongest correlations with drusen area. The number of pattern deviation (PD) defects increased by 9.30 and 9.68 defects per log % drusen area for standard perimetry and SWAP, respectively. Weaker correlations were found between drusen area and visual acuity, contrast sensitivity, colour vision and reading speed. 72.6% of standard PD defects and 65.2% of SWAP PD defects coincided with retinal signs of AMD on fundus photography. 67.5% of standard PD defects and 69.7% of SWAP PD defects coincided with deposits on retro-mode images. Conclusions:Perimetry exhibited a stronger relationship with drusen area than other measures of visual function. The structure-function relationship between visual field parameters and drusen area was linear. Overall the indices of focal loss had a stronger correlation with drusen area in SWAP than in standard perimetry. Visual field defects had a high coincidence proportion with retinal manifestations of AMD.Smith R.T. et al. (2005) Arch Ophthalmol 123:200-206.

Retinal Image Analysis Using Machine Vision

The topic of this thesis is studying how lesions in retina caused by diabetic retinopathy can be detected from color fundus images by using machine vision methods. Methods for equalizing uneven illumination in fundus images, detecting regions of poor image quality due toinadequate illumination, and recognizing abnormal lesions were developed duringthe work. The developed methods exploit mainly the color information and simpleshape features to detect lesions. In addition, a graphical tool for collecting lesion data was developed. The tool was used by an ophthalmologist who marked lesions in the images to help method development and evaluation. The tool is a general purpose one, and thus it is possible to reuse the tool in similar projects.The developed methods were tested with a separate test set of 128 color fundus images. From test results it was calculated how accurately methods classify abnormal funduses as abnormal (sensitivity) and healthy funduses as normal (specificity). The sensitivity values were 92% for hemorrhages, 73% for red small dots (microaneurysms and small hemorrhages), and 77% for exudates (hard and soft exudates). The specificity values were 75% for hemorrhages, 70% for red small dots, and 50% for exudates. Thus, the developed methods detected hemorrhages accurately and microaneurysms and exudates moderately.

Automatic Optic Disc Boundary Extraction from Color Fundus Images

Efficient optic disc segmentation is an important task in automated retinal screening. For the same reason optic disc detection is fundamental for medical references and is important for the retinal image analysis application. The most difficult problem of optic disc extraction is to locate the region of interest. Moreover it is a time consuming task. This paper tries to overcome this barrier by presenting an automated method for optic disc boundary extraction using Fuzzy C Means combined with thresholding. The discs determined by the new method agree relatively well with those determined by the experts. The present method has been validated on a data set of 110 colour fundus images from DRION database, and has obtained promising results. The performance of the system is evaluated using the difference in horizontal and vertical diameters of the obtained disc boundary and that of the ground truth obtained from two expert ophthalmologists. For the 25 test images selected from the 110 colour fundus images, the Pearson correlation of the ground truth diameters with the detected diameters by the new method are 0.946 and 0.958 and, 0.94 and 0.974 respectively. From the scatter plot, it is shown that the ground truth and detected diameters have a high positive correlation. This computerized analysis of optic disc is very useful for the diagnosis of retinal diseases

Simple and objective method for routine detection of the macular pigment xanthophyll

A new simple method for two-dimensional determination of optical density of macular pigment xanthophyll (ODx) in clinical routine is based on a single blue-reflection fundus image. Individual different vignetting is corrected by a shading function. For its construction, nodes are automatically found in structureless image regions. The influence of stray light in elderly crystalline lenses is compensated by a correction function that depends on age. The reproducibility of parameters in a one-wavelength reflection method determined for three subjects (47, 61, and 78 years old) was: maxODx = 6.3%, meanODx = 4.6%, volume = 6%, and area = 6% already before stray-light correction. ODx was comparable in pseudophakic and in an eye with a crystalline lens of the same 11 subjects after stray-light correction. Significant correlation in ODx was found between the one-wavelength reflection method and the two-wavelength autofluorescence method for pseudophakic and cataract eyes of 19 patients suffering from dry age-related macular degeneration (AMD) (R(2) = 0.855). In pseudophakic eyes, maxODx was significantly lower for dry AMD (n = 45) (ODx = 0.491±0.102 ODU) than in eyes with healthy fundus (n = 22) (ODx = 0.615±0.103 ODU) (p = 0.000033). Also in eyes with crystalline lens, maxODx was lower in AMD (n = 125) (ODx = 0.610±0.093 ODU) than in healthy subjects (n = 45) (ODx = 0.674±0.098 ODU) (p = 0.00019). No dependence on age was found in the pseudophakic eyes both of healthy subjects and AMD patients.

Advanced image processing techniques for detection and quantification of drusen

Dissertation presented to obtain the degree of Doctor of Philosophy in Electrical Engineering, speciality on Perceptional Systems, by the Universidade Nova de Lisboa, Faculty of Sciences and Technology

Development of a fundus camera for analysis of photoreceptor directionality in the healthy retina

The Stiles-Crawford effect (SCE) is the well-known phenomenon in which the brightness of light perceived by the human eye depends upon its entrance point in the pupil. This physiological characteristic is due to the directional sensitivity of the cone photoreceptors in the retina and it displays an approximately Gaussian dependency which is altered in a number of pathologies. Retinal imaging, a widely spread clinical practice, may be used to evaluate the SCE and thus serve as diagnostic tool. Nonetheless, its use for such a purpose is still underdeveloped and far from the clinical reality. In this project a fundus camera was built and used to assess the cone photoreceptor directionality by reflective imaging of the retina in healthy individuals. The physical and physiological implications of its development are addressed in detail in the text: the optical properties of the human eye, illumination issues, acquiring a retinal image formed by the eye, among others. A full description of the developmental process that led to the final measuring method and results is also given. The developed setup was successfully used to obtain high quality images of the eye fundus and in particular the parafoveal cone photoreceptors. The SCE was successfully observed and characterized. Even though considerable improvements could be done to the measurement method, the project showed the feasibility of using retinal imaging to evaluate the SCE thus motivating its usage in a clinical environment.

Comparison of fundus autofluorescence images acquired by the confocal scanning laser ophthalmoscope (488 nm excitation) and the modified Topcon fundus camera (580 nm excitation).

To compare autofluorescence (AF) images obtained with the confocal scanning laser ophthalmoscope (using the Heidelberg retina angiograph; HRA) and the modified Topcon fundus camera, in a routine clinical setting. A prospective comparative study conducted at the Jules-Gonin Eye Hospital. Fifty-six patients from the medical retina clinic. All patients had complete ophthalmic slit-lamp and fundus examinations, colour and red-free fundus photography, AF imaging with both instruments, and fluorescein angiography. Cataract and fixation were graded clinically. AF patterns were analyzed for healthy and pathological features. Differences of image noise were analyzed by cataract grading and fixation. A total of 105 eyes were included. AF patterns discovered by the retina angiograph and the fundus camera images, respectively, were a dark optic disc in 72 % versus 15 %, a dark fovea in 92 % versus 4 %, sub- and intraretinal fluid visible as hyperautofluorescence on HRA images only, lipid exudates visible as hypoautofluorescence on HRA images only. The same autofluorescent pattern was found on both images for geographic atrophy, retinal pigment changes, drusen and haemorrhage. Image noise was significantly associated with the degree of cataract and/or poor fixation, favouring the fundus camera. Images acquired by the fundus camera before and after fluorescein angiography were identical. Fundus AF images differ according to the technical differences of the instruments used. Knowledge of these differences is important not only for correctly interpreting images, but also for selecting the most appropriate instrument for the clinical situation.

Landmark detection for fusion of fundus and MRI toward a patient-specific multimodal eye model.

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise, e.g., Fundus photography, optical coherence tomography, computed tomography, and magnetic resonance imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The goal of this paper is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI that was not visible before like vessels and the macula. This paper contributions include automatic detection of the optic disc, the fovea, the optic axis, and an automatic segmentation of the vitreous humor of the eye.

Comparison of fundus autofluorescence between fundus camera (Topcon) and confocal scanning laser ophthalmoscope (HRA) in various pathologies

Purpose: To investigate the differences between Fundus Camera (Topcon TRC-50X) and Confocal Scanning Laser Ophthalmoscope (Heidelberg retina angiogram (HRA)) on the fundus autofluorescence (FAF) imaging (resolution and FAF characteristics). Methods: 105 eyes of 56 patients with various retinal diseases underwent FAF imaging with HRA (488nm exciter/500nm barrier filter) before fluorescein angiography (FFA) and Topcon Fundus Camera (580nm exciter/695nm barrier filter) before and after FFA. The quality of the FAF images was compared for their resolution and analysed for the influence of fixation stability and cataracts. Hypo-and hyper-FAF behaviour was analysed for the healthy disc, healthy fovea, and a variety of pathological features. Results: HRA images were found to be of superior resolution in 18, while Topcon images were estimated superior in 29 eyes. No difference was found in 58 eyes. Both poor fixation (p=0.009) and more advanced cataract (p=0.013) were found associated with better image quality by Topcon. Images acquired by Topcon before and after FFA were identical (100%). The healthy disc was usually dark on HRA (72%), but showed mild autofluorescence on Topcon (85%). The healthy fovea showed in 100% Hypo-FAF on HRA, while Topcon showed in 53% Iso-FAF, in 43% mild Hypo-FAF, and in 4% Hypo-FAF as on HRA. No difference of FAF was found for geographic atrophy, pigment changes, and drusen, although Topcon images were often more detailed. Hyper-FAF due to serous exudation showed better on HRA. Cystic edema was visible only on HRA in a petaloid hyper-FAF pattern in 83%, while only two eyes (17%) showed similar behavior in both HRA- and Topcon images. Hard exudates caused Hypo-FAF only on HRA, hardly visible on Topcon. Blockage phenomenon by blood however was identical. Conclusions: The filter set of Topcon and the single image acquisition appear to be an advantage for patients with cataract and poor fixation respectively. Preceding FFA does not alter the Topcon FAF image. Regarding the FAF behavior, there are differences between the 2 systems which need to be taken into account when interpreting the images.

Landmark detection for fusion of fundus and MRI toward a patient-specific multimodal eye model.

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise, e.g., Fundus photography, optical coherence tomography, computed tomography, and magnetic resonance imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The goal of this paper is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI that was not visible before like vessels and the macula. This paper contributions include automatic detection of the optic disc, the fovea, the optic axis, and an automatic segmentation of the vitreous humor of the eye.

Comparison of Fundus Autofluorescence Between Fundus Camera (Topcon) and Confocal Scanning Laser Ophthalmoscope (HRA) in Various Pathologies

Purpose: To investigate the differences between the Fundus Camera (Topcon TRC-50X) and Confocal Scanning Laser Ophthalmoscope (Heidelberg retina angiogram (HRA)) on the fundus autofluorescence (FAF) imaging (resolution and FAF characteristics). Methods: Eighty nine eyes of 46 patients with various retinal diseases underwent FAF imaging with HRA (488nm exciter / 500nm barrier filter) before fluorescein angiography (FFA) and Topcon Fundus Camera (580nm exciter / 695nm barrier filter) before and after FFA. The quality of the FAF images was estimated, compared for their resolution and analysed for the influence of fixation stability and cataracts. Hypo- and hyper-FAF behaviour was analysed for the healthy disc, healthy fovea, and a variety of pathological features. Results: HRA images were found to be of superior quality in 18 eyes, while Topcon images were estimated superior in 21 eyes. No difference was found in 50 eyes. Both poor fixation (p=0.009) and more advanced cataract (p=0.013) were found to strongly increase the likelihood of better image quality by Topcon. Images acquired by Topcon before and after FFA were identical (100%). The healthy disc was usually dark on HRA (71%), but showed mild autofluorescence on Topcon (88%). The healthy fovea showed in 100% Hypo-FAF on HRA, while Topcon showed in 52% Iso-FAF, in 43% mild Hypo-FAF, and in 5% Hypo-FAF as on HRA. No difference of FAF was found for geographic atrophy, pigment changes, and drusen, although Topcon images were often more detailed. Hyper-FAF due to exudation showed better on HRA. Pigment epithelium detachment showed identical FAF behaviour on the border, but reduced FAF with Topcon in the center. Cystic edema was visible only on HRA in a petaloid pattern. Hard exsudates caused Hypo-FAF only on HRA, hardly visible on Topcon. Blocage phenomenon by blood however was identical. Conclusions: The filter set of Topcon and the single image acquisition appear to be an advantage for patients with cataract or poor fixation. Preceding FFA does not alter the Topcon FAF image. Regarding the FAF behaviour, there are differences between the two systems which need to be taken into account when interpreting the images.

Landmark Detection for Fusion of Fundus and MRI Towards a Patient-Specific Multi-Modal Eye Model

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise e.g., Fundus photography, Optical Coherence Tomography (OCT), Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The presented article’s goal is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI which was not visible before like vessels and the macula. This article’s contributions include automatic detection of the optic disc, the fovea, the optic axis and an automatic segmentation of the vitreous humor of the eye.

Fusion of fundus images and MRI data of the human eye

Purpose Ophthalmologists are confronted with a set of different image modalities to diagnose eye tumors e.g., fundus photography, CT and MRI. However, these images are often complementary and represent pathologies differently. Some aspects of tumors can only be seen in a particular modality. A fusion of modalities would improve the contextual information for diagnosis. The presented work attempts to register color fundus photography with MRI volumes. This would complement the low resolution 3D information in the MRI with high resolution 2D fundus images. Methods MRI volumes were acquired from 12 infants under the age of 5 with unilateral retinoblastoma. The contrast-enhanced T1-FLAIR sequence was performed with an isotropic resolution of less than 0.5mm. Fundus images were acquired with a RetCam camera. For healthy eyes, two landmarks were used: the optic disk and the fovea. The eyes were detected and extracted from the MRI volume using a 3D adaption of the Fast Radial Symmetry Transform (FRST). The cropped volume was automatically segmented using the Split Bregman algorithm. The optic nerve was enhanced by a Frangi vessel filter. By intersection the nerve with the retina the optic disk was found. The fovea position was estimated by constraining the position with the angle between the optic and the visual axis as well as the distance from the optic disk. The optical axis was detected automatically by fitting a parable on to the lens surface. On the fundus, the optic disk and the fovea were detected by using the method of Budai et al. Finally, the image was projected on to the segmented surface using the lens position as the camera center. In tumor affected eyes, the manually segmented tumors were used instead of the optic disk and macula for the registration. Results In all of the 12 MRI volumes that were tested the 24 eyes were found correctly, including healthy and pathological cases. In healthy eyes the optic nerve head was found in all of the tested eyes with an error of 1.08 +/- 0.37mm. A successful registration can be seen in figure 1. Conclusions The presented method is a step toward automatic fusion of modalities in ophthalmology. The combination enhances the MRI volume with higher resolution from the color fundus on the retina. Tumor treatment planning is improved by avoiding critical structures and disease progression monitoring is made easier.

Use of fundus imaging in quantification of age-related macular change

This review will discuss the use of manual grading scales, digital photography, and automated image analysis in the quantification of fundus changes caused by age-related macular disease. Digital imaging permits processing of images for enhancement, comparison, and feature quantification, and these techniques have been investigated for automated drusen analysis. The accuracy of automated analysis systems has been enhanced by the incorporation of interactive elements, such that the user is able to adjust the sensitivity of the system, or manually add and remove pixels. These methods capitalize on both computer and human image feature recognition and the advantage of computer-based methodologies for quantification. The histogram-based adaptive local thresholding system is able to extract useful information from the image without being affected by the presence of other structures. More recent developments involve compensation for fundus background reflectance, which has most recently been combined with the Otsu method of global thresholding. This method is reported to provide results comparable with manual stereo viewing. Developments in this area are likely to encourage wider use of automated techniques. This will make the grading of photographs easier and cheaper for clinicians and researchers. © 2007 Elsevier Inc. All rights reserved.