Abstract
This paper aims to identify uncommon cardiothoracic diseases and patterns on chest X-ray images. Training a machine learning model to classify rare diseases with multi-label indications is challenging without sufficient labeled training samples. Our model leverages the information from common diseases and adapts to perform on less common mentions. We propose to use multi-label few-shot learning (FSL) schemes including neighborhood component analysis loss, generating additional samples using distribution calibration and fine-tuning based on multi-label classification loss. We utilize the fact that the widely adopted nearest neighbor-based FSL schemes like ProtoNet are Voronoi diagrams in feature space. In our method, the Voronoi diagrams in the features space generated from multi-label schemes are combined into our geometric DeepVoro Multi-label ensemble. The improved performance in multi-label few-shot classification using the multi-label ensemble is demonstrated in our experiments (The code is publicly available at https://github.com/Saurabh7/Few-shot-learning-multilabel-cxray).
D. Moukheiber and S. Mahindre—Equal contributions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bendou, Y., et al.: Easy-ensemble augmented-shot-Y-shaped learning: state-of-the-art few-shot classification with simple components. J. Imaging 8(7), 179 (2022)
Boots, B., Sugihara, K., Chiu, S.N., Okabe, A.: Spatial tessellations: concepts and applications of Voronoi diagrams (2009)
Chauhan, G., et al.: Joint modeling of chest radiographs and radiology reports for pulmonary edema assessment. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12262, pp. 529–539. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59713-9_51
Chen, H., Miao, S., Xu, D., Hager, G.D., Harrison, A.P.: Deep hierarchical multi-label classification of chest X-ray images. In: Cardoso, M.J., et al. (eds.) Proceedings of the 2nd International Conference on Medical Imaging with Deep Learning. Proceedings of Machine Learning Research, 08–10 July 2019, vol. 102, pp. 109–120. PMLR (2019)
Dhillon, G.S., Chaudhari, P., Ravichandran, A., Soatto, S.: A baseline for few-shot image classification. In: International Conference on Learning Representations (2020)
Dvornik, N., Schmid, C., Mairal, J.: Diversity with cooperation: ensemble methods for few-shot classification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3723–3731 (2019)
Finn, C., Abbeel, P., Levine, S.: Model-agnostic meta-learning for fast adaptation of deep networks. In: International Conference on Machine Learning, pp. 1126–1135. PMLR (2017)
Goldberger, J., Hinton, G.E., Roweis, S., Salakhutdinov, R.R.: Neighbourhood components analysis. In: Advances in Neural Information Processing Systems, vol. 17 (2004)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016
Ji, Z., Shaikh, M.A., Moukheiber, D., Srihari, S.N., Peng, Y., Gao, M.: Improving joint learning of chest X-ray and radiology report by word region alignment. In: Lian, C., Cao, X., Rekik, I., Xu, X., Yan, P. (eds.) MLMI 2021. LNCS, vol. 12966, pp. 110–119. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87589-3_12
Johnson, A.E., et al.: MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci. Data 6(1), 1–8 (2019)
Laenen, S., Bertinetto, L.: On episodes, prototypical networks, and few-shot learning. In: Advances in Neural Information Processing Systems, vol. 34, pp. 24581–24592 (2021)
Lakhani, P.: Deep convolutional neural networks for endotracheal tube position and X-ray image classification: challenges and opportunities. J. Digit. Imaging 30(4), 460–468 (2017)
Ma, C., Huang, Z., Gao, M., Xu, J.: Few-shot learning as cluster-induced Voronoi diagrams: a geometric approach. arXiv preprint arXiv:2202.02471 (2022)
Ma, C., Huang, Z., Gao, M., Xu, J.: Few-shot learning via dirichlet tessellation ensemble. In: International Conference on Learning Representations (2022)
Rajpurkar, P., et al.: CheXNet: radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv preprint arXiv:1711.05225 (2017)
Seastedt, K.P., et al.: A scoping review of artificial intelligence applications in thoracic surgery. Eur. J. Cardiothorac. Surg. 61(2), 239–248 (2022)
Snell, J., Swersky, K., Zemel, R.: Prototypical networks for few-shot learning. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Tang, Y.X., et al.: Automated abnormality classification of chest radiographs using deep convolutional neural networks. NPJ Digit. Med. 3(1), 1–8 (2020)
Wang, S., Lin, M., Ding, Y., Shih, G., Lu, Z., Peng, Y.: Radiology text analysis system (RadText): architecture and evaluation. arXiv preprint arXiv:2204.09599 (2022)
Wang, Y., Chao, W.L., Weinberger, K.Q., van der Maaten, L.: SimpleShot: revisiting nearest-neighbor classification for few-shot learning. arXiv preprint arXiv:1911.04623 (2019)
Weng, W.H., Deaton, J., Natarajan, V., Elsayed, G.F., Liu, Y.: Addressing the real-world class imbalance problem in dermatology. In: Machine Learning for Health, pp. 415–429. PMLR (2020)
Yang, S., Liu, L., Xu, M.: Free lunch for few-shot learning: distribution calibration. In: International Conference on Learning Representations (2021)
Acknowledgments
This material is based upon work supported by the National Library of Medicine under Award No. 4R00LM013001, and National Science Foundation under Grant No. 2145640 and No. 1910492.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Moukheiber, D. et al. (2022). Few-Shot Learning Geometric Ensemble for Multi-label Classification of Chest X-Rays. In: Nguyen, H.V., Huang, S.X., Xue, Y. (eds) Data Augmentation, Labelling, and Imperfections. DALI 2022. Lecture Notes in Computer Science, vol 13567. Springer, Cham. https://doi.org/10.1007/978-3-031-17027-0_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-17027-0_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-17026-3
Online ISBN: 978-3-031-17027-0
eBook Packages: Computer ScienceComputer Science (R0)
