NEURAL NETWORK BASED REAL TIME PNEUMONIA DETECTION USING TRANSFER LEARNING AND IMAGE AUGMENTATION

Anup Kumar  Paul; Joya Khan  Mou; Tasmia  Turna

doi:10.53808/KUS.2022.ICSTEM4IR.0093-se

Authors

Anup Kumar Paul East West University, Dhaka, Bangladesh
Joya Khan Mou East West University, Dhaka, Bangladesh
Tasmia Turna East West University, Dhaka, Bangladesh

DOI:

https://doi.org/10.53808/KUS.2022.ICSTEM4IR.0093-se

Keywords:

Pneumonia, Deep Learning, CNN, X-ray, Transfer Learning, Augmentation, Machine Learning

Abstract

This paper aims to identify the detection of pneumonia disease using chest x-ray images by applying deep learning methods. Deep learning methods have tracked down their applications in different areas, and they are in effect broadly utilized in clinical medicines and diagnostics. To analyze viral/bacterial infections such as pneumonia, the assessment of chest X-ray images is frequently used, and the productivity of diagnosis can be altogether improved with the utilization of Computer-Aided Diagnostic (CAD) frameworks. Deep learning method such as Convolutional Neural Network (CNN) architecture is utilized in this paper for the characterization of chest X-ray images to analyze pneumonia. We have used the chest X-ray image dataset from Kaggle consisting of 4110 images. Image augmentations were performed on the dataset to oversample the dataset for the model to perform better. Then, at that point, we have built a custom CNN model and, also, we have utilized the transfer learning mechanism with CNN by using MobileNetV2 as the base model for the image classification problems. The average classification accuracy for our proposed CNN and MobileNetV2 based transfer learning method was 97%, and 97% for unbalanced and 97%, and 97%, for balanced datasets respectively. The satisfactory outcome of both models can significantly improve the accuracy and speed of pneumonia diagnosis. This would be very helpful in this pandemic situation in developing countries with limited resources and capabilities in the healthcare sector.

Downloads

Download data is not yet available.

References

Abbas, A., Abdelsamea, M. M., & Gaber, M. M. (2021). 4s-dt: Self-supervised super sample decomposition for transfer learning with application to covid-19 detection. IEEE Transactions on Neural Networks and Learning Systems, 32(7), 2798–2808. https://doi.org/10.1109/TNNLS.2021.3082015

Anaya-Isaza, A., & Mera-Jiménez, L. (2022). Data augmentation and transfer learning for brain tumor detection in magnetic resonance imaging. IEEE Access, 10, 23217–23233. https://doi.org/10.1109/ACCESS.2022.3154061

Bisong, E. (2019). Google colaboratory. Building machine learning and deep learning models on google cloud platform: A comprehensive guide for beginners (pp. 59–64). Apress. https://doi.org/10.1007/978-1-4842-4470-8_7

Chandra, T. B., & Verma, K. (2020). Pneumonia detection on chest x-ray using machine learning paradigm. In B. B. Chaudhuri, M. Nakagawa, P. Khanna, & S. Kumar (Eds.), Proceedings of 3rd international conference on computer vision and image processing (pp. 21–33). Springer Singapore.

Chest x-ray (covid-19 & pneumonia) [Accessed: 2022-03-12]. (n.d.). https : / / www . kaggle . com / datasets/prashant268/chest-xray-covid19-pneumonia

Chhowa, T. T., Rahman, M. A., Paul, A. K., & Ahmmed, R. (2019). A narrative analysis on deep learning in iot based medical big data analysis with future perspectives. 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE), 1–6. https://doi.org/10.1109/ECACE.2019.8679200

Chollet, F. et al. (2015). Keras. https://github.com/fchollet/keras

Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative adversarial nets. In Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, & K. Weinberger (Eds.), Advances in neural information processing systems. Curran Associates, Inc. https://proceedings.neurips.cc/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf

Jain, R., Nagrath, P., Kataria, G., Sirish Kaushik, V., & Jude Hemanth, D. (2020). Pneumonia detection in chest x-ray images using convolutional neural networks and transfer learning. Measurement, 165, 108046. https://doi.org/https://doi.org/10.1016/j.measurement.2020.108046

Kermany, D. S., Goldbaum, M., Cai, W., Valentim, C. C. S., Liang, H., Baxter, S. L., McKeown, A., Yang, G., Wu, X., Yan, F., Dong, J., Prasadha, M. K., Pei, J., Ting, M. Y. L., Zhu, J., Li, C., Hewett, S., Dong, J., Ziyar, I., … Zhang, K. (2018). Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell, 172(5), 1122–1131. https://doi.org/10.

/j.cell.2018.02.010

Khan, W., Zaki, N., & Ali, L. (2021). Intelligent pneumonia identification from chest x-rays: A systematic literature review. IEEE Access, 9, 51747–51771. https://doi.org/10.1109/ACCESS.2021.3069937

Kotsiantis, S. B., Kanellopoulos, D. N., & Pintelas, P. E. (2006). Handling imbalanced datasets: A review. GESTS Int. Trans. Comput. Sci. Eng., 30(1), 25–36.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). Imagenet classification with deep convolutional neural networks. Commun. ACM, 60(6), 84–90. https://doi.org/10.1145/3065386

Ma, T., Benon, K., Arnold, B., Yu, K., Yang, Y., Hua, Q., Wen, Z., & Paul, A. K. (2020). Bottleneck feature extraction-based deep neural network model for facial emotion recognition.

Mardani, M., Gong, E., Cheng, J. Y., Vasanawala, S. S., Zaharchuk, G., Xing, L., & Pauly, J. M. (2019).Deep generative adversarial neural networks for compressive sensing mri. IEEE Transactions on Medical Imaging, 38(1), 167–179. https://doi.org/10.1109/TMI.2018.2858752

Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Jia, Y., Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, … Xiaoqiang Zheng. (2015). TensorFlow: Large-scale machine learning on heterogeneous systems [Software available from tensorflow.org]. https://www.tensorflow.org/

Minaee, S., Kafieh, R., Sonka, M., Yazdani, S., & Jamalipour Soufi, G. (2020). Deep-covid: Predicting covid-19 from chest x-ray images using deep transfer learning. Medical Image Analysis,65, 101794. https://doi.org/https://doi.org/10.1016/j.media.2020.101794

Oates, A., Halliday, K., Offiah, A., Landes, C., Stoodley, N., Jeanes, A., Johnson, K., Chapman, S., Stivaros, S., Fairhurst, J., Watt, A., Paddock, M., Giles, K., McHugh, K., & Arthurs, O.(2019). Shortage of paediatric radiologists acting as an expert witness: Position statement from the british society of paediatric radiology (bspr) national working group on imaging in suspected physical abuse (spa). Clinical Radiology. https://doi.org/10.1016/j.crad.2019.04. 016

Pneumonia [Accessed: 2022-05-18]. (n.d.). https://www.who.int/news-room/fact-sheets/detail/pneumonia

Rajaraman, S., Candemir, S., Thoma, G., & Antani, S. (2019). Visualizing and explaining deep learning predictions for pneumonia detection in pediatric chest radiographs. In K. Mori & H. K. Hahn (Eds.), Medical imaging 2019: Computer-aided diagnosis (pp. 200–211). SPIE.https://doi.org/10.1117/12.2512752

Rajasenbagam, T., Jeyanthi, S., & Pandian, J. (2021). Detection of pneumonia infection in lungs from chest x-ray images using deep convolutional neural network and content-based image retrieval techniques. Journal of Ambient Intelligence and Humanized Computing, 1–8. https ://doi.org/https://doi.org/10.1007/s12652-021-03075-2

Rajinikanth, V., Kadry, S., Damasevicius, R., Taniar, D., & Rauf, H. T. (2021). Machine-learningscheme to detect choroidal-neovascularization in retinal oct image. 2021 Seventh International conference on Bio Signals, Images, and Instrumentation (ICBSII), 1–5. https://doi.org/10.1109/ICBSII51839.2021.9445134

Sandler, M., Howard, A. G., Zhu, M., Zhmoginov, A., & Chen, L. (2018). Inverted residuals and linear bottlenecks: Mobile networks for classification, detection and segmentation. CoRR, abs/1801.04381. http://arxiv.org/abs/1801.04381

Siddiqi, R. (2019). Automated pneumonia diagnosis using a customized sequential convolutional neural network. Proceedings of the 2019 3rd International Conference on Deep Learning Technologies, 64–70. https://doi.org/10.1145/3342999.3343001

Stephen, O., Sain, M., Maduh, U., & Jeong, D. (2019). An efficient deep learning approach to pneumonia classification in healthcare. Journal of Healthcare Engineering, 2019, 1–7.

Verma, D., Bose, C., Tufchi, N., Pant, K., Tripathi, V., & Thapliyal, A. (2020). An efficient framework for identification of tuberculosis and pneumonia in chest x-ray images using neural network. Procedia Comput. Sci., 171, 217–224.

Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., & Summers, R. M. (2017). Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. CoRR, abs/1705.02315. http://arxiv.org/abs/1705.02315

Zhang, J., Yu, K., Wen, Z., Qi, X., & Paul, A. K. (2021). 3d reconstruction for motion blurred images using deep learning-based intelligent systems. Computers, Materials & Continua, 66(2), 2087– 2104. https://doi.org/10.32604/cmc.2020.014220