Login Register Cart 0
Generic placeholder image

Current Medical Imaging

Editor-in-Chief

ISSN (Print): 1573-4056
ISSN (Online): 1875-6603

Back
Journal Home About Journal Editorial Board Journal Insight Current Issue Volumes/Issues
Subscribe
Research Article

Automatic Localization and Identification of Thoracic Diseases from Chest X-rays with Deep Learning

Author(s): Shuai Zhang, Tianyi Tang, Xin Peng, Yanqiu Zhang, Wen Yang, Wenfei Li, Xiaoyan Xin*, Jian Zhang*, Wei Wang* and Bing Zhang*

Volume 18, Issue 13, 2022

Published on: 01 August, 2022

Article ID: e180522204968 Pages: 10

DOI: 10.2174/1573405618666220518110113

Price: $65

Open Access Journals Promotions 2
conference banner
Abstract

Background: There are numerous difficulties in using deep learning to automatically locate and identify diseases in chest X-rays (CXR). The most prevailing two are the lack of labeled data of disease locations and poor model transferability between different datasets. This study aims to tackle these problems.

Methods: We built a new form of bounding box dataset and developed a two-stage model for disease localization and identification of CXRs based on deep learning. The dataset marks anomalous regions in CXRs but not the corresponding diseases, different from all previous datasets. The advantages of this design are reduced labor of annotation and fewer possible errors associated with image labeling. The two-stage model combines the robustness of the region proposal network, feature pyramid network, and multi-instance learning techniques. We trained and validated our model with the new bounding box dataset and the CheXpert dataset. Then, we tested its classification and localization performance on an external dataset, which is the official split test set of ChestX-ray14.

Results: For classification result, the mean area under the receiver operating characteristic curve (AUC) metrics of our model on the CheXpert validation dataset was 0.912, which was 0.021, superior to the baseline model. The mean AUC of our model on an external testing set was 0.784, whereas the state-of-the-art model got 0.773. The localization results showed comparable performance to the stateof- the-art models.

Conclusion: Our model exhibits a good transferability between datasets. The new bounding box dataset is proven to be useful and shows an alternative technique for compiling disease localization datasets.

Keywords: Chest X-ray, Disease localization, CNN, Deep learning, Region proposal, Computer aided diagnosis.

Graphical Abstract

[1]
Hwang EJ, Park CM. Clinical implementation of deep learning in thoracic radiology: Potential applications and challenges. Korean J Radiol 2020; 21(5): 511-25.
[http://dx.doi.org/10.3348/kjr.2019.0821] [PMID: 32323497]
[2]
Moses DA. Deep learning applied to automatic disease detection using chest X-rays. J Med Imaging Radiat Oncol 2021; 65(5): 498-517.
[http://dx.doi.org/10.1111/1754-9485.13273] [PMID: 34231311]
[3]
Wang X, Peng Y, Lu L, et al. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. Proceedings of the IEEE conference on computer vision and pattern recognition. 2097-106.
[http://dx.doi.org/10.1109/CVPR.2017.369]
[4]
Irvin J, Rajpurkar P, Ko M, et al. Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. Proc Conf AAAI Artif Intell 2019; 33: 590-7.
[http://dx.doi.org/10.1609/aaai.v33i01.3301590]
[5]
Johnson AEW, Pollard TJ, Berkowitz SJ, et al. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data 2019; 6(1): 317.
[http://dx.doi.org/10.1038/s41597-019-0322-0] [PMID: 31831740]
[6]
Rajpurkar P, Irvin J, Zhu K, et al. Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning 2017.
[7]
Yan C, Yao J, Li R, Xu Z, Huang J. Weakly supervised deep learning for thoracic disease classification and localization on chest x-rays. Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. 103-10.
[http://dx.doi.org/10.1145/3233547.3233573]
[8]
Li Z, Wang C, Han M, et al. Thoracic disease identification and localization with limited supervision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8290-9.
[http://dx.doi.org/10.1109/CVPR.2018.00865]
[9]
Guan Q, Huang Y, Zhong Z, et al. Diagnose like a radiologist: Attention guided convolutional neural network for thorax disease classification. 2018.
[10]
Yao L, Prosky J, Poblenz E, Covington B, Lyman K. Weakly supervised medical diagnosis and localization from multiple resolutions 2018.
[11]
Tang Y, Wang X, Harrison AP, et al. Attention-guided curriculum learning for weakly supervised classification and localization of thoracic diseases on chest radiographs. In: Shi Y, Suk HI, Liu M, Eds. International Workshop on Machine Learning in Medical Imaging. 249-58.
[http://dx.doi.org/10.1007/978-3-030-00919-9_29]
[12]
Hwang EJ, Park S, Jin K-N, et al. Development and validation of a deep learning–based automated detection algorithm for major thoracic diseases on chest radiographs. JAMA Netw Open 2019; 2(3): e191095-95.
[http://dx.doi.org/10.1001/jamanetworkopen.2019.1095] [PMID: 30901052]
[13]
Nam JG, Park S, Hwang EJ, et al. Development and validation of deep learning–based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 2019; 290(1): 218-28.
[http://dx.doi.org/10.1148/radiol.2018180237] [PMID: 30251934]
[14]
Pant H, Lohani MC, Bhatt AK, Pant J, Sharma RK. Thoracic Disease Detection using Deep Learning. 2021; 5th International Conference on Computing Methodologies and Communication (ICCMC). 1197-203.
[http://dx.doi.org/10.1109/ICCMC51019.2021.9418343]
[15]
Islam MT, Aowal MA, Minhaz AT, Ashraf K. Abnormality detection and localization in chest x-rays using deep convolutional neural networks 2017.
[16]
Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. Proceedings of the IEEE conference on computer vision and pattern recognition. 2921-9.
[http://dx.doi.org/10.1109/CVPR.2016.319]
[17]
Wang H, Xia Y. Chestnet: A deep neural network for classification of thoracic diseases on chest radiography 2018.
[18]
Selvaraju RR, Cogswell M, Das A, et al. Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE international conference on computer vision. 618-26.
[http://dx.doi.org/10.1109/ICCV.2017.74]
[19]
Demner-Fushman D, Kohli MD, Rosenman MB, et al. Preparing a collection of radiology examinations for distribution and retrieval. J Am Med Inform Assoc 2016; 23(2): 304-10.
[http://dx.doi.org/10.1093/jamia/ocv080] [PMID: 26133894]
[20]
Pooch E, Ballester PL, Barros RC. Can we trust deep learning models diagnosis? The impact of domain shift in chest radiograph classification. Springer International Publishing 2019.
[http://dx.doi.org/10.1007/978-3-030-62469-9_7]
[21]
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition. 4700-8.
[http://dx.doi.org/10.1109/CVPR.2017.243]
[22]
Ren S, He K, Girshick R, Sun J. Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 2017; 39(6): 1137-49.
[http://dx.doi.org/10.1109/TPAMI.2016.2577031] [PMID: 27295650]
[23]
Lin T-Y, Dollár P, Girshick R, et al. Feature pyramid networks for object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. 2117-25.
[http://dx.doi.org/10.1109/CVPR.2017.106]
[24]
Girshick R. Fast r-cnn. Proceedings of the IEEE international conference on computer vision. 1440-8.
[http://dx.doi.org/10.1109/ICCV.2015.169]
[25]
Maron O, Lozano-Pérez T. A framework for multiple-instance learning. Adv Neural Inf Process Syst 1997; 10: 570-6.
[http://dx.doi.org/10.1007/BF0119316]
[26]
Ray S, Craven M. Supervised versus multiple instance learning: An empirical comparison. Proceedings of the 22nd international conference on Machine learning. 697-704.
[http://dx.doi.org/10.1145/1102351.1102439]
[27]
Wang X, Peng Y, Lu L, Lu Z, Summers RM. Tienet: Text-image embedding network for common thorax disease classification and reporting in chest x-rays. Proceedings of the IEEE conference on computer vision and pattern recognition. 9049-58.
[http://dx.doi.org/10.1109/CVPR.2018.00943]
[28]
Zhang S, Xin X, Wang Y, et al. Automated Radiological Report Generation For Chest X-Rays With Weakly-Supervised End-to- End Deep Learning 2020.

Rights & Permissions Print Cite
Article Metrics
28
3
Wayfinder Image
Open Access Journals Promotions
© 2024 Bentham Science Publishers | Privacy Policy