[go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Efficient Pediatric Pneumonia Diagnosis Using Depthwise Separable Convolutions

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Pneumonia is the leading cause of death in children worldwide. A fast and accurate pneumonia diagnosis system can be helpful in saving a pediatric patient’s life and ensuring their long-term health. In recent years, A.I. research has attempted to develop reliable deep learning models for detecting pneumonia in chest X-ray images. The objective of this paper is to demonstrate that the use of depthwise separable convolutions provides an efficient pneumonia detection model. For this purpose, a novel 21-layer convolutional neural network, called PneumoniaNet, is presented. Most of the convolutional layers of PneumoniaNet use depthwise separable convolutions. Eight other customized pneumonia detection models, based on ImageNet pre-trained models, are also evaluated and compared with PneumoniaNet. PneumoniaNet is shown to be highly efficient without compromising effectiveness. In addition, the author demonstrates that the customized VGG16 has produced the highest test-set accuracy of 95.83%. In addition, and for completeness, PneumoniaNet’s robustness in case of "noisy" chest X-ray images is also analyzed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data Availability

The data used to support the findings of this study are included within the article.

Notes

  1. Customized DenseNet121 also has the same, highest sensitivity value (i.e. 0.985).

References

  1. Le Roux DM, Myer L, Nicol MP, Zar HJ. Incidence and severity of childhood pneumonia in the first year of life in a South African birth cohort: the Drakenstein Child Health Study. The Lancet Global Health. 2015;3:e95–e103. https://doi.org/10.1016/S2214-109X(14)70360-2.

    Article  Google Scholar 

  2. Wang H, Liddell CA, Coates MM, et al. Global, regional, and national levels of neonatal, infant, and under-5 mortality during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. The Lancet. 2014;384:957–79. https://doi.org/10.1016/S0140-6736(14)60497-9.

    Article  Google Scholar 

  3. Liu L, Johnson HL, Cousens S, et al. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. The Lancet. 2012;379:2151–61. https://doi.org/10.1016/S0140-6736(12)60560-1.

    Article  Google Scholar 

  4. Fischer Walker CL, Rudan I, Liu L, et al. Global burden of childhood pneumonia and diarrhoea. The Lancet. 2013;381:1405–16. https://doi.org/10.1016/S0140-6736(13)60222-6.

    Article  Google Scholar 

  5. Edmond K, Scott S, Korczak V, et al. Long term sequelae from childhood pneumonia: systematic review and meta-analysis. PLoS ONE. 2012;7:e31239. https://doi.org/10.1371/journal.pone.0031239.

    Article  Google Scholar 

  6. Qin C, Yao D, Shi Y, Song Z. Computer-aided detection in chest radiography based on artificial intelligence: a survey. BioMedEngOnLine. 2018;17:113. https://doi.org/10.1186/s12938-018-0544-y.

    Article  Google Scholar 

  7. Stephen O, Sain M, Maduh UJ, Jeong DU. An efficient deep learning approach to pneumonia classification in healthcare. J HealthcEng. 2019. https://doi.org/10.1155/2019/4180949.

    Article  Google Scholar 

  8. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) ImageNet: A large-scale hierarchical image database. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2009.5206848

  9. Chollet F. Xception: deep learning with depthwise separable convolutions. In: Proc. IEEE Conference on computer vision and pattern recognition (CVPR). 2017. https://doi.org/10.1109/CVPR.2017.195

  10. Simonyan K, Zisserman A (2015) Very Deep Convolutional Networks for Large-Scale Image Recognition. 2015. arXiv:1409.1556

  11. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proc. IEEE Conference on computer vision and pattern recognition (CVPR). 2016. https://doi.org/10.1109/CVPR.2016.90

  12. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the Inception Architecture for Computer Vision. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016.https://doi.org/10.1109/CVPR.2016.308

  13. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA. Inception-v4, Inception-ResNet and the impact of residual connections on learning. In: Proc. Thirty-First AAAI Conference on artificial intelligence, 2017.

  14. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H. MobileNets: efficient convolutional neural networks for mobile vision applications. 2017. arXiv:1704.04861

  15. Huang G, Liu Z, Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proc. IEEE Conference on computer vision and pattern recognition (CVPR). 2017. https://doi.org/10.1109/CVPR.2017.243

  16. Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC. MobileNetV2: inverted residuals and linear bottlenecks. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2018. https://doi.org/10.1109/CVPR.2018.00474

  17. Rajpurkar P, Irvin J, Zhu K et al. CheXNet: radiologist-level pneumonia detection on chest x-rays with deep learning. 2017. arXiv:1711.05225

  18. Guan Q, Huang Y, Zhong Z, Zheng Z, Zheng L, Yang Y. Diagnose like a radiologist: attention guided convolutional neural network for thorax disease classification. 2018. arXiv:1801.09927

  19. Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. ChestX-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: Proc. IEEE Conference on computer vision and pattern recognition (CVPR). 2017. https://doi.org/10.1109/CVPR.2017.369

  20. Kermany DS, Goldbaum M, Cai W, et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 2018;172:1122–31. https://doi.org/10.1016/j.cell.2018.02.010.

    Article  Google Scholar 

  21. Siddiqi R. Automated pneumonia diagnosis using a customized sequential convolutional neural network. In: Proc. 3rd International Conference on Deep Learning Technologies. 2019. https://doi.org/10.1145/3342999.3343001

  22. Ayan E, Ünver HM. Diagnosis of pneumonia from chest x-ray images using deep learning. In: Proc. Scientific Meeting on electrical-electronics & biomedical engineering and computer science (EBBT). 2019.https://doi.org/10.1109/EBBT.2019.8741582

  23. Rajaraman S, Candemir S, Kim I, Thoma G, Antani S. Visualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs. Appl Sci. 2018. https://doi.org/10.3390/app8101715.

    Article  Google Scholar 

  24. Liang G, Zheng L. A transfer learning method with deep residual network for pediatric pneumonia diagnosis. Comput Methods Programs Biomed. 2019. https://doi.org/10.1016/j.cmpb.2019.06.023.

    Article  Google Scholar 

  25. Kermany D, Zhang K, Goldbaum M. Labeled optical coherence tomography (OCT) and chest X-Ray images for classification. Mendeley Data, v2. https://doi.org/10.17632/rscbjbr9sj.2

  26. Summers R (2018) National Institutes of Health Chest X-Ray Dataset. https://nihcc.app.box.com/v/ChestXray-NIHCC/folder/36938765345. Accessed 1 Nov 2019.

  27. Chollet F. Deep learning for computer vision. In: Arritola T, Gaines J, Dragosavljevic A, Taylor T, editors. Deep learning with python. New York, USA: Manning Publications; 2018. p. 119–77.

    Google Scholar 

  28. Perez L, Wang J. The effectiveness of data augmentation in image classification using deep learning. 2017. arXiv:1712.04621

  29. Wong SC, Gatt A, Stamatescu V, McDonnell MD. Understanding data augmentation for classification: when to warp? In: International Conference on digital image computing: techniques and applications (DICTA). 2016. https://doi.org/10.1109/DICTA.2016.7797091

  30. Kingma DP, Ba J (2017) Adam: a method for stochastic optimization. arXiv:1412.6980

  31. Michelucci U. Training neural networks. In: John CS, Moodie M, Mirashi A, editors. Applied deep learning: a case- based approach to understanding deep neural networks. New York: Apress; 2018. p. 137–79.

    Chapter  Google Scholar 

  32. Guo J, Li Y, Lin W, Chen Y, Li J. Network decoupling: from regular to depthwise separable convolutions. 2018. arXiv:1808.05517

  33. Glorot X, Bengio Y. Understanding the difficulty of training deep feedforward neural networks. In: Proc. 13th International Conference on artificial intelligence and statistics, 2010, pp. 249–256.

  34. Michelucci U. Metric analysis. In: John CS, Moodie M, Mirashi A, editors. Applied deep learning: a case- based approach to understanding deep neural networks. 1st ed. New York: Apress; 2010. p. 217–70.

    Google Scholar 

  35. Boisberranger JD. Precision-Recall. scikit-learn documentation. 2019. https://scikit-learn.org/stable/auto_examples/model_selection/plot_precision_recall.html. Accessed 20 Jan 2020.

  36. Michelucci U. Histology tissue classification. In: John CS, Moodie M, Mirashi A, editors. Advanced applied deep learning: convolutional neural networks and object detection. 1st ed. New York: Apress; 2019. p. 243–76.

    Chapter  Google Scholar 

  37. Chollet F. Keras documentation–image preprocessing. 2020. https://keras.io/preprocessing/image/. Accessed 22 Jan 2020.

  38. Thakur S, Goplani Y, Arora S, Upadhyay R, Sharma G (2020) Chest X-Ray Images Based Automated Detection of Pneumonia Using Transfer Learning and CNN. In: Bansal P, Tushir M, Balas V, Srivastava R, editors. Proceedings of International Conference on Artificial Intelligence and Applications. Advances in Intelligent Systems and Computing, vol 1164. Singapore: Springer; 2020. https://doi.org/10.1007/978-981-15-4992-2_31

  39. SirishKaushik V, Nayyar A, Kataria G, Jain R. Pneumonia detection using convolutional neural networks (CNNs). In: Singh P, Pawłowski W, Tanwar S, Kumar N, Rodrigues J, Obaidat M, editors. Proceedings of First International Conference on computing, communications, and cyber-security (IC4S 2019). Lecture Notes in Networks and Systems, vol 121. Singapore: Springer; 2020. https://doi.org/10.1007/978-981-15-3369-3_36

  40. Luján-García JE, Yáñez-Márquez C, Villuendas-Rey Y, Camacho-Nieto O. A transfer learning method for pneumonia classification and visualization. Applied Sciences. 2020;10(8):2908. https://doi.org/10.3390/app10082908.

    Article  Google Scholar 

  41. Tang Y, Tang Y, Peng Y, et al. Automated abnormality classification of chest radiographs using deep convolutional neural networks. npj Digit Med. 2020;3:70. https://doi.org/10.1038/s41746-020-0273-z.

    Article  Google Scholar 

  42. Bernal J, Kushibar K, Asfaw DS, Valverde S, Oliver A, Martí R, Lladó X. Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review. ArtifIntell Med. 2019;95:64–81. https://doi.org/10.1016/j.artmed.2018.08.008.

    Article  Google Scholar 

  43. Hu M, Lin H, Fan Z, Gao W, Yang L, Liu C, Song Q. Learning to recognize chest X-ray images faster and more efficiently based on multi-kernel depthwise convolution. IEEE Access. 2020;8:37265–74. https://doi.org/10.1109/ACCESS.2020.2974242.

    Article  Google Scholar 

  44. Heaven D. Why deep-learning AIs are so easy to fool. Nature. 2019;574:163–6. https://doi.org/10.1038/d41586-019-03013-5.

    Article  Google Scholar 

Download references

Acknowledgements

The author would like to thank Dr Christopher J Harrison for proof reading the article as well as providing some useful suggestions regarding the research work undertaken.

Funding

The research did not receive any funding.

Author information

Authors and Affiliations

  1. Department of Computer Science, Bahria University (Karachi Campus), 13 National Stadium Road, Karachi, Pakistan

    Raheel Siddiqi

Authors
  1. Raheel Siddiqi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Raheel Siddiqi.

Ethics declarations

Conflicts of Interest

The author declares that there are no conflicts of interest regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Siddiqi, R. Efficient Pediatric Pneumonia Diagnosis Using Depthwise Separable Convolutions. SN COMPUT. SCI. 1, 343 (2020). https://doi.org/10.1007/s42979-020-00361-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-020-00361-2

Keywords