Abstract
Retinopathy of prematurity (ROP), is the most common cause of blindness in premature infants. ROP is measured by looking at the width, curvature, and length of the blood vessels map on a retina. So, the quality of the segmented blood vessel map affects how well the quantitative method works. Current vessel segmentation algorithms work well on images of the retina of adults, but they cannot tell the difference between structures of vessels that have not yet grown in images of the fundus of infant. Also, the lack of a dataset of infant fundus images has made it harder to develop data-driven techniques for separating blood vessels. This study shows how to use a Deep Convolutional Neural Network (DCNN)-based vessel segmentation system to determine if a infant has ROP. The proposed method uses a DCNN, Generative Adversarial Network (GAN) Pix2Pix, or U-Net to segment vessels. We trained the proposed system with datasets of fundus images that were available to the public, and we tested it with images of premature infants’ eyes from a nearby hospital. Experimental results show that the proposed method is more robust to noise and inter-class variation. It has a dice coefficient between 0.60 and 0.64 and an average accuracy of 96.69% for vessel segmentation. We have also examined its potential use in the treatment of ROP and Plus disease.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agrawal, R., Kulkarni, S., Walambe, R., Deshpande, M., Kotecha, K.: Deep dive in retinal fundus image segmentation using deep learning for retinopathy of prematurity. Multimed. Tools Appl. 81(8), 11441–11460 (2022). https://doi.org/10.1007/s11042-022-12396-z
Bankhead, P., Scholfield, C.N., McGeown, J.G., Curtis, T.M.: Fast retinal vessel detection and measurement using wavelets and edge location refinement. PLoS ONE 7(3), e32435 (2012)
Brown, J.M., et al.: Automated diagnosis of plus disease in retinopathy of prematurity using deep convolutional neural networks. JAMA Ophthalmol. 136(7), 803–810 (2018)
Budai, A., Bock, R., Maier, A., Hornegger, J., Michelson, G.: Robust vessel segmentation in fundus images. Int. J. Biomed. Imaging 2013 (2013)
Ding, A., Chen, Q., Cao, Y., Liu, B.: Retinopathy of prematurity stage diagnosis using object segmentation and convolutional neural networks. arXiv preprint arXiv:2004.01582 (2020)
Ema, T., Doi, K., Nishikawa, R.M., Jiang, Y., Papaioannou, J.: Image feature analysis and computer-aided diagnosis in mammography: Reduction of false-positive clustered microcalcifications using local edge-gradient analysis. Med. Phys. 22(2), 161–169 (1995)
Fielder, A.R., Wallace, D.K., Stahl, A., Reynolds, J.D., Chiang, M.F., Quinn, G.E.: Describing retinopathy of prematurity: current limitations and new challenges. Ophthalmology 126(5), 652–654 (2019)
Gelman, R., Martinez-Perez, M.E., Vanderveen, D.K., Moskowitz, A., Fulton, A.B.: Diagnosis of plus disease in retinopathy of prematurity using retinal image multiscale analysis. Invest. Ophthalmol. Vis. Sci. 46(12), 4734–4738 (2005)
Gilbert, C., Malik, A.N., Vinekar, A.: Artificial intelligence for ROP screening and to assess quality of care: progress and challenges. Pediatrics 147(3) (2021)
Gojić, G., et al.: Deep learning methods for retinal blood vessel segmentation: evaluation on images with retinopathy of prematurity. In: 2020 IEEE 18th International Symposium on Intelligent Systems and Informatics (SISY), pp. 131–136. IEEE (2020)
Goodfellow, I., et al.: Generative adversarial networks. Commun. ACM 63(11), 139–144 (2020)
Guo, C., Szemenyei, M., Yi, Y., Wang, W., Chen, B., Fan, C.: SA-UNet: spatial attention U-Net for retinal vessel segmentation. arXiv preprint arXiv:2004.03696 (2020)
Guo, X., et al.: Retinal vessel segmentation combined with generative adversarial networks and dense u-net. IEEE Access 8, 194551–194560 (2020)
Guo, X., Kikuchi, Y., Wang, G., Yi, J., Zou, Q., Zhou, R.: Early detection of retinopathy of prematurity (ROP) in retinal fundus images via convolutional neural networks. arXiv preprint arXiv:2006.06968 (2020)
Han, J., Wang, Y., Gong, H.: Fundus retinal vessels image segmentation method based on improved U-Net. IRBM (2022)
Henry, A.G.P., Jude, A.: Convolutional neural-network-based classification of retinal images with different combinations of filtering techniques. Open Comput. Sci. 11(1), 480–490 (2021)
Holm, S., Russell, G., Nourrit, V., McLoughlin, N.: DR HAGIS—a fundus image database for the automatic extraction of retinal surface vessels from diabetic patients. J. Med. Imaging 4(1), 014503 (2017)
Hoover, A.D., Kouznetsova, V., Goldbaum, M.: Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans. Med. Imaging 19(3), 203–210 (2000). https://doi.org/10.1109/42.845178
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks (2018)
Jiang, Y., Liang, J., Cheng, T., Lin, X., Zhang, Y., Dong, J.: Mtpa_UNet: multi-scale transformer-position attention retinal vessel segmentation network joint transformer and CNN. Sensors 22(12), 4592 (2022)
Jiang, Y., Liang, J., Cheng, T., Zhang, Y., Lin, X., Dong, J.: MCPANet: multiscale cross-position attention network for retinal vessel image segmentation. Symmetry 14(7), 1357 (2022)
Kamran, S.A., Hossain, K.F., Tavakkoli, A., Zuckerbrod, S.L., Sanders, K.M., Baker, S.A.: RV-GAN: segmenting retinal vascular structure in fundus photographs using a novel multi-scale generative adversarial network. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12908, pp. 34–44. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87237-3_4
Karaali, A., Dahyot, R., Sexton, D.J.: DR-VNet: retinal vessel segmentation via dense residual UNet. In: El Yacoubi, M., Granger, E., Yuen, P.C., Pal, U., Vincent, N. (eds.) ICPRAI 2022. LNCS, vol. 13363, pp. 198–210. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-09037-0_17
Karmakar, R., Nooshabadi, S., Eghrari, A.: Mobile-RetinaNet: a computationally efficient deepnet for retinal fundus image segmentation for use in low-resource settings. Invest. Ophthalmol. Vis. Sci. 63(7), 2064–F0053 (2022)
Kazeminia, S., et al.: GANs for medical image analysis. Artif. Intell. Med. 109, 101938 (2020)
Kumar, A., Agrawal, R., Joseph, L.: IterMiUnet: a lightweight architecture for automatic blood vessel segmentation. arXiv e-prints, pp. arXiv-2208 (2022)
Kumar, V., Patel, H., Paul, K., Surve, A., Azad, S., Chawla, R.: Deep learning assisted retinopathy of prematurity screening technique. In: Proceedings of the 14th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 5: HEALTHINF, pp. 234–243. INSTICC, SciTePress (2021). https://doi.org/10.5220/0010322102340243
Kumar, V., Patel, H., Paul, K., Surve, A., Azad, S., Chawla, R.: Improved blood vessels segmentation of retinal image of infants. In: HEALTHINF, pp. 142–153 (2022)
Kumar, V., Paul, K.: mNetra: a fundoscopy based optometer. In: HEALTHINF, pp. 83–92 (2016)
Li, L., Verma, M., Nakashima, Y., Nagahara, H., Kawasaki, R.: IterNet: retinal image segmentation utilizing structural redundancy in vessel networks. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 3656–3665 (2020)
Li, M., Zhou, S., Chen, C., Zhang, Y., Liu, D., Xiong, Z.: Retinal vessel segmentation with pixel-wise adaptive filters. In: 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), pp. 1–5. IEEE (2022)
Luo, Y., Chen, K., Mao, J., Shen, L., Sun, M.: A fusion deep convolutional neural network based on pathological features for diagnosing plus disease in retinopathy of prematurity. Invest. Ophthalmol. Vis. Sci. 61(7), 2017 (2020)
Lyu, J., Zhang, Y., Huang, Y., Lin, L., Cheng, P., Tang, X.: AADG: automatic augmentation for domain generalization on retinal image segmentation. IEEE Trans. Med. Imaging 41, 3699–3711 (2022)
Megrabov, E., Jamshidi, A., Patange, S.: Retinel vessel segmentation using U-Net and GANs
Moshfeghi, D.M., Capone, A.: Economic barriers in retinopathy of prematurity management. Ophthalmol. Retina 2(12), 1177–1178 (2018)
World Health Organization, et al.: World report on vision. Technical report. World Health Organization, Geneva (2019)
Patel, T.P., et al.: Smartphone-based fundus photography for screening of plus-disease retinopathy of prematurity. Graefes Arch. Clin. Exp. Ophthalmol. 257(11), 2579–2585 (2019). https://doi.org/10.1007/s00417-019-04470-4
Paul, K., Kumar, V.: Fundus imaging based affordable eye care. In: HEALTHINF, pp. 634–641 (2015)
Qi, X., Wu, Z., Ren, M., Sun, M., Sun, Z.: Robust and efficient segmentation of cross-domain medical images. arXiv preprint arXiv:2207.12995 (2022)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation (2015)
Staal, J., Abramoff, M., Niemeijer, M., Viergever, M., van Ginneken, B.: Ridge based vessel segmentation in color images of the retina. IEEE Trans. Med. Imaging 23(4), 501–509 (2004)
Ting, D.S.W., et al.: Artificial intelligence and deep learning in ophthalmology. Br. J. Ophthalmol. 103(2), 167–175 (2019)
Uysal, E.S., Bilici, M.Ş., Zaza, B.S., Özgenç, M.Y., Boyar, O.: Exploring the limits of data augmentation for retinal vessel segmentation. arXiv preprint arXiv:2105.09365 (2021)
Wallace, D.K., Jomier, J., Aylward, S.R., Landers, M.B., III.: Computer-automated quantification of plus disease in retinopathy of prematurity. J. Am. Assoc. Pediatr. Ophthalmol. Strabismus 7(2), 126–130 (2003)
Wang, J., Zhao, Y., Qian, L., Yu, X., Gao, Y.: EAR-NET: error attention refining network for retinal vessel segmentation. In: 2021 Digital Image Computing: Techniques and Applications (DICTA), pp. 1–7. IEEE (2021)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004). https://doi.org/10.1109/TIP.2003.819861
Wang, Z., She, Q., Ward, T.E.: Generative adversarial networks in computer vision: a survey and taxonomy. ACM Comput. Surv. (CSUR) 54(2), 1–38 (2021)
Yildiz, V.M., et al.: Plus disease in retinopathy of prematurity: convolutional neural network performance using a combined neural network and feature extraction approach. Transl. Vis. Sci. Technol. 9(2), 10 (2020)
Zhang, Y., et al.: Development of an automated screening system for retinopathy of prematurity using a deep neural network for wide-angle retinal images. IEEE Access 7, 10232–10241 (2018)
Acknowledgements
We acknowledge key insights received from Prof. Rohan Chawla and Dr. Abhidnya Surve in discussion that we have done related to this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kumar, V., Patel, H., Azad, S., Paul, K. (2023). Improved Blood Vessels Segmentation of Infant Retinal Image. In: Roque, A.C.A., et al. Biomedical Engineering Systems and Technologies. BIOSTEC 2022. Communications in Computer and Information Science, vol 1814. Springer, Cham. https://doi.org/10.1007/978-3-031-38854-5_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-38854-5_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-38853-8
Online ISBN: 978-3-031-38854-5
eBook Packages: Computer ScienceComputer Science (R0)