Performance analysis for COVID-19 diagnosis using custom and state-of-the-art deep learning models
File(s)
Published version
Author(s)
Type
Journal Article
Abstract
The modern scientific world continuously endeavors to battle and devise solutions for newly arising pandemics. One such pandemic which has turned the world’s accustomed routine upside down is COVID-19: it has devastated the world economy and destroyed around 45 million lives, globally. Governments and scientists have been on the front line, striving towards the diagnosis and engineering of a vaccination for the said virus. COVID-19 can be diagnosed using artificial intelligence more accurately than traditional methods using chest X-rays. This research involves an evaluation of the performance of deep learning models for COVID-19 diagnosis using chest X-ray images from a dataset containing the largest number of COVID-19 images ever used in the literature, according to the best of the authors’ knowledge. The size of the utilized dataset is about 4.25 times the maximum COVID-19 chest X-ray image dataset used in the explored literature. Further, a CNN model was developed, named the Custom-Model in this study, for evaluation against, and comparison to, the state-of-the-art deep learning models. The intention was not to develop a new high-performing deep learning model, but rather to evaluate the performance of deep learning models on a larger COVID-19 chest X-ray image dataset. Moreover, Xception- and MobilNetV2- based models were also used for evaluation purposes. The criteria for evaluation were based on accuracy, precision, recall, F1 score, ROC curves, AUC, confusion matrix, and macro and weighted averages. Among the deployed models, Xception was the top performer in terms of precision and accuracy, while the MobileNetV2-based model could detect slightly more COVID-19 cases than Xception, and showed slightly fewer false negatives, while giving far more false positives than the other models. Also, the custom CNN model exceeds the MobileNetV2 model in terms of precision. The best accuracy, precision, recall, and F1 score out of these three models were 94.2%, 99%, 95%, and 97%, respectively, as shown by the Xception model. Finally, it was found that the overall accuracy in the current evaluation was curtailed by approximately 2% compared with the average accuracy of previous work on multi-class classification, while a very high precision value was observed, which is of high scientific value.
Date Issued
2022-07
Date Acceptance
2022-06-19
Citation
Applied Sciences, 2022, 12 (13)
ISSN
2076-3417
Publisher
MDPI AG
Journal / Book Title
Applied Sciences
Volume
12
Issue
13
Copyright Statement
© 2022 by the authors.
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://
creativecommons.org/licenses/by/
4.0/).
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://
creativecommons.org/licenses/by/
4.0/).
License URL
Identifier
https://www.mdpi.com/2076-3417/12/13/6364
Subjects
artificial Intelligence
Chemistry
Chemistry, Multidisciplinary
chest X-ray
convolutional neural networks
COVID-19
deep learning
Engineering
Engineering, Multidisciplinary
lung opacity
Materials Science
Materials Science, Multidisciplinary
mobilenetv2
Physical Sciences
Physics
Physics, Applied
pneumonia
Science & Technology
Technology
transfer learning
Xception
Publication Status
Published
Article Number
6364
Date Publish Online
2022-06-22