Diabetes is caused when pancreas does not produce insulin properly or response of body cells is not adequate to insulin. This directly affects blood vessels in body. In retina it results in exudates, haemorrhages and micro aneurysms. Leakage of fats or lipids from abnormal blood vessels forms exudates. Blood leakage from vessels causes Haemorrhages. Micro aneurysms appear as small round dark red dots. These abnormalities in eye are termed as diabetic retinopathy. It can lead to blindness if not diagnosed properly and timely. The potential risk of blindness is decreased by 50% if
patients are screened for development of diabetic retinopathy [1-3].
Many techniques are used for the detection of these abnormalities. Thomas Walter et al. first found candidate regions; these are regions that possibly contain exudates. Then applied morphological techniques to find the exact contours[4]. D. Kavitha. S. Shenbaga Devi segmented blood vessels using median filtering and found the convergent point (CP) of blood vessels using the least square fitting then extracted brighter regions using thresholding then combined both, determined the location of optic disc and classified the exudates[5]. Akara Sopharak et.al used fuzzy cmean clustering technique to obtain clusters from pre-processed retinal image and then applied four morphological features intensity, standard deviation, hue and number of edge pixels to classify exudate clusters from non-exudates [6]. Chanjira sinthanayothin et.al used a combinational approach by first obtaining pre-processed image and defined two main features optic disc and vessels. Exudates are obtained by recursive region growing and haemorrhages and micro aneurysms are obtained with same features as that of vessels [7]. Saiprasad Ravi Shankar et.al detects proposes a new constraint for optic disk detection. They first detected the major blood vessels and then use the intersection of these to find the approximate location of the optic disk. Exudates are extracted using open and close operations using filters of different sizes While micro aneurysms and haemorrhages are segmented using morphological filters that exploit their local ’dark patch’ property[8]. Akara Sopharak et.al detected exudates by first eliminating optic disc and then detected exudates through morphological filters [9]. Akara Sopharak et.al used naive Bayes classifier for detection of exudates [10].
In this paper we are proposing a method to develop a technique which will detect exudates, haemorrhages and micro aneurysms in retina. We first do pre-processing of image to remove noise and enhance some features of image then find all the connected components in the image. We try to obtain as many blobs as we can an image. Then we apply morphological filters on some features such as area, compactness, contrast intensity and hue to detect the candidate regions. This method is quite simple because we only apply few numbers of morphological filters to pre-processed blobs of an image and detect the suspected anomalies.
This paper is further classified as section B explains the whole methodology. The sub section 1 of methodology explains pre-processing of the original image; sub section 2 gives details about the blobbing of image; sub section 3 explains the morphological threshold applied to obtain the candidates; sub section 4 explains about post-processing. Section C gives detail about the result of tested dataset and finally the section D concludes the whole technique.
The purpose of the pre-processing is to remove noise and obtain maximum blobs from the image regardless of whether its candidate area or not. We take colour image resize it to standard size and convert it to grey scale image shown in fig 1(a) Then we applied adaptive histogram equalization for enhancement of contrast (CLAHE) shown in fig 1(b). As we have to obtain both bright and dark regions from the image so we use different approaches to obtain all. To obtain bright regions from image we apply morphological top hat filtering and bottom hat filtering with disk shape of radius 12. Subtraction of bottom hat filtering from top hat filtering gives us all the bright spots in the image shown in fig 1(c). Adjusting the intensity and then applying morphological closing and opening gives us refine result of bright regions shown in fig 1(d). We call this image suspected exudates image (SEI). To obtain dark spots in image we again apply top hat and bottom hat filtering with disk shape of radius of 12. Subtraction of top hat from bottom hat gives us all the dark regions in image shown in fig 1(e). The contrast is further enhanced and then morphological closing and opening is applied to the image to get a refined result shown in fig 1(f). We call this image as suspected haemorrhages image (SHI). Further processing is separately on these two SEI and SHI.
gives us two binary images. Region based segmentation is applied to both SEI and SHI images separately and all the connected components each image are labelled as single blob.
the components in the image we filtered blobs on basis of Area, compactness, intensity and hue. A cascading decision tree shown in fig 2 is used for filtering out most of the non- candidate blobs.
Area of blob is calculated by calculating actual number of pixels in that area. The area filter removes the blobs having very large area or very small. Blobs having pixels less than 5 and greater than 5000 were marked as non-candidate blobs in area filter. Remaining blobs after applying area filter are shown in fig 3(a). Most of the vessels are removed by applying compactness filter. The blobs having vary high compactness is marked as noncandidates. The minimum and maximum threshold values for SEI image are 0.55 and 9 respectively. While for SHI image is 0.7 and 4 respectively. The blobs which fall outside these thresholds were marked as non-candidate blobs. The candidate blobs after applying compactness filter is shown in fig 3(b). Haemorrhages have low intensity value and exudates have high intensity value [11]. We remove blobs having low mean intensity value from SEI and blobs having high mean intensity value from SHI. For each blob average of the maximum and minimum intensities were found. For SEI image all the blobs having average value less than 90 were marked as non-candidate and for SHI image all the blobs having average value greater than 200 were marked as non-candidate. Resultant blobs after applying intensity filter is shown in fig 3(c). Lastly we apply threshold value to remove blobs having high hue or low hue. Mean hue value of each blob was found. The blobs having mean hue value less than 0.125 and mean value higher than 0.165 in SEI image and mean value less than 0.06 and higher than 0.125 were marked as non-candidate blobs. Resultant blobs after applying hue filter is shown in fig 3(d).
All these thresholds were set so that we should minimize the number of blobs but it should not remove the candidate blobs. These values were after quite lot of experiments on different thresholds.
Results from SEI and SHI images are combined. Centre and orientation of each blob is found. Finally we draw an ellipse according to the orientation around the blob. The ellipse is beneficial than circle because if the blob has stretched shape, the circle misses some parts of the blob while the ellipse surround the whole blob. The resultant image is shown in fig 4.
1( a ). Grey-scale image. 1( b ). Enhanced image
1( c ). Top hat filtering 1( d ). Morphological of enhanced opening and image. closing.
1( e ). Bottom hat 1( f ). Morphological filtering of opening and
Figure 1: Pre-processing
Figure 2. Cascading Decision Tree
3( a ). Area filter 3( b ). Compactness filter
3( c ). Intensity filter 3( d). Hue filter
Figure 3: Combine Result of SEI and SHI after
The final results were checked against ground truths. The results are pixels to pixels comparison of ground truths and our result. Also our focus is on blobs and we extract a large number of blobs from our image so we used a limited dataset of 10 images in result evaluation. We calculated true positive (TP) and true negative (TN) values. The evaluation technique is pixel to pixel comparison because we are focusing only on the sensitivity of this method. To check the performance we calculated the Recall (Sensitivity) of all images.
We finally calculated the mean recall of all the 10 images. The final mean recall is 94.5%. Table 1 shows the number of blobs and recall after Preprocessing, each step of decision tree and post-processing.
This paper concludes that using morphological cascading tree for filtering candidate blobs from pool of blobs has positive impact on overall process
of detection of anomalies in retinal images. The final results have high recall values. The future work includes improvement of morphological cascading tree, its comparison with other morphological techniques on the basis of its accuracy and correctness and also using machine learning approaches to increase the recall as well sensitivity of the whole technique.
This research is financially supported by Thailand Advanced Institute of Science and Technology (TAIST), National Science and Technology Development Agency (NSTDA), Tokyo Institute of Technology, Sirindhorn International Institute of Technology (SIIT), Thammasat University (TU) under the TAIST Tokyo Tech Program.
Table 1. Comparison of number of blobs and recall after each case of cascading decision tree.
[1] B. Ege, O. Hejlesen, O. Larsen, K. Møller, B. Jennings, D. Kerr and D. Cavan, 'Screening for diabetic retinopathy using computer based image analysis and statistical classification', Computer Methods and Programs in Biomedicine, vol. 62, no. 3, pp. 165-175, 2000.
[2] M. Hove, J. Kristensen, T. Lauritzen and T. Bek, 'Quantitative analysis of retinopathy in type 2 diabetes: identification of prognostic parameters for developing visual loss secondary to diabetic maculopathy', Acta Ophthalmol Scand, vol. 82, no. 6, pp. 679-685, 2004.
[3] H. W, P. PMDS, M. Lee and K. Au Eong, 'The role of domain knowledge in the detection of retinal hard exudates', International Conference on Computer Vision and Pattern Recognition IEEE Computer Society, vol. 2, pp. II-246–51, 2001.
[4] T. Walter, J.C. Kein, P. Massin and A. Erginay "A contribution of image processing to the diagnosis of diabetic retinopathy-detection of exudates in color fundus images of the human retina", IEEE Trans. Med. Imag., vol. 21, no. 10, pp.1236 -1243 2002.
[5] Kavitha, D. and S.D. Shenbaga. Automatic detection of optic disc and exudates in retinal images. Proceedings of the International Conference on Intelligent Sensing and Information Processing, Jan. 4-7, IEEE Xplore Press, pp: 502-506.2005.
[6] A. Sopharak, B. Uyyanonvara and S. Barman, 'Automatic Exudate Detection from Non-dilated Diabetic Retinopathy Retinal Images Using Fuzzy C-means Clustering', Sensors, vol. 9, no. 3, pp. 2148-2161, 2009.
[8] S.Ravishankar, S.; Jain, A.; Mittal, A., "Automated feature extraction for early detection of diabetic retinopathy in fundus images," in Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on , vol., no., pp.210-217, 20-25 June 2009.
[9] Akara Sopharak, Bunyarit Uyyanonvara, Sarah Barman, and Thomas H Williamson, "Automatic detection of diabetic retinopathy exudates from non-dilated retinal images using mathematical morphology methods.," Computerized Medical Imaging and Grphics, vol. 32, no. 8, pp. 720-727, Dec 2008.
[10] A. Sopharak, K. Thet Nwe, Y. Aye Moe Matthew N. Dailey and B. Uyyanonvara, “Automatic Exudates Detection with a Naive Bayes Classifier”, Proceedings of the International Conference on Embedded Systems and Intelligent Technology, pp. 139-142, February 27-29, 2008.
[11] E. Lee and S. Lee, “Computer system for analyzing images and detecting early signs of abnormalities,” WO Patent App. PCT/US2000/004,736. Aug. 31, 2000.