Abstract This work introduces SqueezeViT (Squeeze Vision Transformers), a compact yet effective architecture based on Vision Transformers (ViT) designed for chest X-ray (CXR) image classification. In contrast to traditional ViT architectures, which are computationally demanding, SqueezeViT employs a novel squeezing procedure that effectively lowers token dimensions without compromising important visual components, leading to expedited inference and decreased memory consumption. The designed model is tested for two commonly used public datasets, NIH Chest X-ray and CheXpert, providing a diverse range of thoracic pathologies. SqueezeViT reduces the number of parameters by 43.2% compared to the baseline MobileViT1, and up to 95.4% compared to other state-of-the-art (SOTA) models. The suggested model offers up to 16.5% improvement in the area under the receiver operating characteristic curve (AUROC) compared to SOTA models, and it is, in general, superior to the baseline and effective convolutional neural networks CNNs2 in numerous tasks. Such developments make the proposed SqueezeViT approach an attractive option for a wide variety of applications. The findings indicate that SqueezeViT outperforms the current SOTA classifiers while maintaining a lightweight model architecture. In turn, such results emphasize the possibilities of using SqueezeViT in real clinical environment, where the amount of computational resources can be constrained. Similar content being viewed by others Data availability The datasets used in this work are available at: [https://www.kaggle.com/datasets/nih-chest-xrays/data](https:/www.kaggle.com/datasets/nih-chest-xrays/data)[https://aimi.stanford.edu/datasets/chexpert-chest-x-rays](https:/aimi.stanford.edu/datasets/chexpert-chest-x-rays)The model of the proposed SqueezeViT is available on the link: [https://github.com/vijay13787/SqueezeVIT.git](https:/github.com/vijay13787/SqueezeVIT.git). References Wang, X. et al. ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. in. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017. (2017). Haritha, D., Pranathi, M. K. & Reethika, M. COVID detection from chest X-rays with DeepLearning: CheXNet. in 5th international conference on computing, communication and security (ICCCS). 2020. IEEE. 2020. IEEE. (2020). Hasanah, U. et al. CheXNet and feature
Efficient SqueezeViT: A lightweight vision transformer framework for chest X-ray <b>image classification</b>
Read the original article
nature.com →