[go: up one dir, main page]
Skip to main content

Advertisement

Springer Nature Link
Log in

Delineation of ischemic lesion from brain MRI using attention gated fully convolutional network

  • Original Article
  • Published:
Biomedical Engineering Letters Aims and scope Submit manuscript

Abstract

Precise delineation of the ischemic lesion from unimodal Magnetic Resonance Imaging (MRI) is a challenging task due to the subtle intensity difference between the lesion and normal tissues. Hence, multispectral MRI modalities are used for characterizing the properties of brain tissues. Traditional lesion detection methods rely on extracting significant hand-engineered features to differentiate normal and abnormal brain tissues. But the identification of those discriminating features is quite complex, as the degree of differentiation varies according to each modality. This can be addressed well by Convolutional Neural Networks (CNN) which supports automatic feature extraction. It is capable of learning the global features from images effectively for image classification. But it loses the context of local information among the pixels that need to be retained for segmentation. Also, it must provide more emphasis on the features of the lesion region for precise reconstruction. The major contribution of this work is the integration of attention mechanism with a Fully Convolutional Network (FCN) to segment ischemic lesion. This attention model is applied to learn and concentrate only on salient features of the lesion region by suppressing the details of other regions. Hence the proposed FCN with attention mechanism was able to segment ischemic lesion of varying size and shape. To study the effectiveness of attention mechanism, various experiments were carried out on ISLES 2015 dataset and a mean dice coefficient of 0.7535 was obtained. Experimental results indicate that there is an improvement of 5% compared to the existing works.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Cheng NT, Kim AS. Intravenous thrombolysis for acute ischemic stroke within 3 hours versus between 3 and 4.5 hours of symptom onset. Neurohospitalist. 2015;5(3):101–9.

    Article  Google Scholar 

  2. Karthik R, Menaka R. Computer-aided detection and characterization of stroke lesion—a short review on the current state-of-the art methods. Imaging Sci J. 2018;66(1):1–22.

    Article  Google Scholar 

  3. Artzi M, Aizenstein O, Jonas-Kimchi T, Myers V, Hallevi H, Ben Bashat D. FLAIR lesion segmentation: application in patients with brain tumors and acute ischemic stroke. Eur J Radiol. 2013;82(9):1512–8.

    Article  Google Scholar 

  4. Karthik R, Menaka R. A multi-scale approach for detection of ischemic stroke from brain MR images using discrete curvelet transformation. Measurement. 2017;100:223–32.

    Article  Google Scholar 

  5. Karthik R, Menaka R. Statistical characterization of ischemic stroke lesions from MRI using discrete wavelet transformation. Trans Electr Eng Electron Commun. 2016;14(2):57–64.

    Google Scholar 

  6. Karthik R, Menaka R. A novel brain MRI analysis system for detection of stroke lesions using discrete wavelets. J Telecommun Electron Comput Eng. 2016;8(5):49–53.

    Google Scholar 

  7. Karthik R, Menaka R. A critical appraisal on wavelet based features from brain MR images for efficient characterization of ischemic stroke injuries. Electron Lett Comput Vis Image Anal. 2016;15(3):1–16.

    Google Scholar 

  8. Mitra J, Bourgeat P, Fripp J, Ghose S, Rose S, Salvado O, Connelly A, Campbell B, Palmer S, Sharma G, Christensen S, Carey L. Lesion segmentation from multimodal MRI using random forest following ischemic stroke. NeuroImage. 2014;98:324–35.

    Article  Google Scholar 

  9. Sivakumar P, Ganeshkumar P. An efficient automated methodology for detecting and segmenting the ischemic stroke in brain MRI images. Int J Imaging Syst Technol. 2017;27(3):265–72.

    Article  Google Scholar 

  10. Maier O, Wilms M, von der Gablentz J, Krämer U, Münte T, Handels H. Extra Tree forests for sub-acute ischemic stroke lesion segmentation in MR sequences. J Neurosci Methods. 2015;240:89–100.

    Article  Google Scholar 

  11. Kajbakhsh N, Shin JY, Gurudu S, Hurst RT, Kendall CB, Gotway MB, Liang J. Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imaging. 2016;35(5):1299–312.

    Article  Google Scholar 

  12. Chin C et al. An automated early ischemic stroke detection system using CNN deep learning algorithm. In: 2017 IEEE 8th International conference on awareness science and technology (iCAST), Taichung, 2017. pp. 368–72.

  13. Mohsen H, El-Dahshan E, El-Horbaty E, Salem A. Classification using deep learning neural networks for brain tumors. Future Comput Inform J. 2018;3(1):68–71.

    Article  Google Scholar 

  14. Diniz P, Valente T, Diniz J, Silva A, Gattass M, Ventura N, Muniz B, Gasparetto E. Detection of white matter lesion regions in MRI using SLIC0 and convolutional neural network. Comput Methods Programs Biomed. 2018;167:49–63.

    Article  Google Scholar 

  15. Pereira DR, Filho PPR, de Rosa GH, Papa JP, de Albuquerque VHC. Stroke lesion detection using convolutional neural networks. In: 2018 International joint conference on neural networks (IJCNN), Rio de Janeiro, 2018, pp. 1–6.

  16. Cui S, Mao L, Xiong S. Brain tumor automatic segmentation using fully convolutional networks. J Med Imaging Health Inform. 2017;7(7):1641–7.

    Article  Google Scholar 

  17. WangY, Sun Z, Liu V, Peng V, Zhang J. MRI image segmentation by fully convolutional networks. In: 2016 IEEE international conference on mechatronics and automation, Harbin, 2016. pp. 1697–702.

  18. Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells W, Frangi A, editors. Medical image computing and computer-assisted intervention—MICCAI 2015. MICCAI 2015, vol. 9351., Lecture notes in computer scienceCham: Springer; 2015.

    Google Scholar 

  19. Shaikh M, Anand G, Acharya G, Amrutkar A, Alex V, Krishnamurthi G. Brain tumor segmentation using dense fully convolutional neural network. In: Crimi A, Bakas S, Kuijf H, Menze B, Reyes M, editors. Brainlesion: Glioma, multiple sclerosis, stroke and traumatic brain injuries. BrainLes 2017, vol. 10670., Lecture notes in computer scienceCham: Springer; 2018.

    Google Scholar 

  20. Shen H, Wang R, Zhang J, McKenna SJ. Boundary-aware fully convolutional network for brain tumor segmentation. In: Descoteaux M, Maier-Hein L, Franz A, Jannin P, Collins D, Duchesne S, editors. Medical image computing and computer-assisted intervention—MICCAI 2017, vol. 10434., Lecture notes in computer scienceCham: Springer; 2017.

    Google Scholar 

  21. Chen L, Bentley P, Rueckert D. Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks. Neuro image Clin. 2017;15:633–43.

    Google Scholar 

  22. Kamnitsas K, Chen L, Ledig C, Rueckert D, Glocker B. Multi-scale 3D convolutional neural networks for lesion segmentation in brain MRI. In: Proc of ISLES-MICCAI, 2015.

  23. Karthik R, Gupta U, Jha A, Rajalakshmi R, Menaka R. A deep supervised approach for ischemic lesion segmentation from multimodal MRI using fully convolutional network. Appl Soft Comput. 2019;84:105685. https://doi.org/10.1016/j.asoc.2019.105685.

    Article  Google Scholar 

  24. Liu S, Shen F, Komandur Elayavilli R, Wang Y, Rastegar-Mojarad M, Chaudhary, V, Liu H. Extracting chemical–protein relations using attention-based neural networks. Database, 2018.

  25. Chen Y, Zhao D, Lv L, Li C. A visual attention based convolutional neural network for image classification. In: 2016 12th World congress on intelligent control and automation (WCICA), Guilin, 2016. pp. 764–69.

  26. Yu D, Fu , Mei T, Rui Y. Multi-level attention networks for visual question answering. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, 2017. pp. 4187–95.

  27. Jetley S, Lord NA, Lee N, Torr P. Learn to pay attention. In: International conference on learning representations, 2018.

  28. Wang F et al. Residual attention network for image classification. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, 2017. pp. 6450–58.

  29. Guan Q, Huang Y. Multi-label chest x-ray image classification via category-wise residual attention learning. Pattern Recognit Lett. 2020;130:259–66.

    Article  Google Scholar 

  30. Schlemper J, Oktay O, Schaap M, Heinrich M, Kainz B, Glocker B, Rueckert D. Attention gated networks: learning to leverage salient regions in medical images. Med Image Anal. 2019;53:197–207. https://doi.org/10.1016/j.media.2019.01.012.

    Article  Google Scholar 

  31. Maier O, Schröder C, Forkert ND, Martinetz T, Handels H. Classifiers for ischemic stroke lesion segmentation: a comparison study. PLoS ONE. 2015;10(12):e0145118.

    Article  Google Scholar 

  32. Maier O, Menze BH, von der Gablentz J, H¨ani L, Heinrich MP, Liebrand M, Winzeck S, Basit A, Chen L, et al. Isles 2015-A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI. Med Image Anal. 2017;35:250–69.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India

    R. Karthik & Menaka Radhakrishnan

  2. School of Computing Sciences and Engineering, Vellore Institute of Technology, Chennai, Chennai, India

    R. Rajalakshmi & Joel Raymann

Authors
  1. R. Karthik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Menaka Radhakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. R. Rajalakshmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Joel Raymann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Menaka Radhakrishnan.

Ethics declarations

Conflict of interest

The authors do not have any conflict of interest.

Ethical approval

This article does not contain any studies with animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karthik, R., Radhakrishnan, M., Rajalakshmi, R. et al. Delineation of ischemic lesion from brain MRI using attention gated fully convolutional network. Biomed. Eng. Lett. 11, 3–13 (2021). https://doi.org/10.1007/s13534-020-00178-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13534-020-00178-1

Keywords