Hybrid ResNet50 with Convolutional Block Attention Module (CBAM) for Image Classification using Fine-Tuning
DOI:
https://doi.org/10.31961/eltikom.v10i1.2089Keywords:
attention mechanism, convolutional block attention module (CBAM), fine-tuning, image classification, ResNet50Abstract
Image classification is a crucial area in digital image processing that requires models capable of robust and stable feature representation. The main challenges in this study include variations between visual classes, di-verse image quality, and limited labeled data, which often hinder the model’s ability to generalize optimally. This study proposes a hybrid ResNet50-CBAM approach, which integrates the strengths of the ResNet50 archi-tecture in deep feature extraction with the Convolutional Block Attention Module (CBAM) attention mecha-nism to improve the model’s focus on the most informative areas of the image. The training process was carried out in two phases, namely transfer learning to utilize the initial representation from the ImageNet dataset, fol-lowed by fine-tuning to adjust the network weights to the image characteristics of the research dataset. The datasets were reorganized and split into 70% training, 15% validation, and 15% testing subsets to ensure a balanced distribution of samples. In addition, various augmentation techniques were applied to increase data diversity and improve the model’s generalization capability. The evaluation results showed that this hybrid approach achieved an overall accuracy of 99%, indicating very high and consistent performance across the entire dataset. The integration of CBAM into the ResNet50 architecture was proven to strengthen the feature extraction process by highlighting the most relevant areas, resulting in a more accurate, stable, and effective image classification model for a wide range of artificial intelligence image processing applications.
Downloads
References
[1] A. Özcan, M. Ünver, and A. Ergüzen, “Deep learning applications in medical image processing,” Int. J. Trend Sci. Res. Dev., vol. 5, no. 2, pp. 459–474, 2022.
[2] L. Alzubaidi et al., “A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications,” J. Big Data, vol. 10, no. 1, 2023.
[3] F. Ben Nasr Barber and A. Elloumi Oueslati, “Human exons and introns classification using pre-trained Resnet-50 and GoogleNet models and 13-layers CNN model,” J. Genet. Eng. Biotechnol., vol. 22, no. 1, p. 100359, 2024.
[4] O. Elharrouss, Y. Akbari, N. Almadeed, and S. Al-Maadeed, “Backbones-review: Feature extractor networks for deep learning and deep reinforcement learning approaches in computer vision,” Comput. Sci. Rev., vol. 53, 2024.
[5] S. Shivadekar, B. Kataria, S. Hundekari, K. Wanjale, V. P. Balpande, and R. Suryawanshi, “Deep Learning Based Image Classification of Lungs Radiography for Detecting COVID-19 using a Deep CNN and ResNet 50,” Int. J. Intell. Syst. Appl. Eng., vol. 11, no. 1s, pp. 241–250, 2023.
[6] A. Younesi, M. Ansari, M. Fazli, A. Ejlali, M. Shafique, and J. Henkel, “A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends,” IEEE Access, vol. 12, pp. 41180–41218, 2024.
[7] X. Zhao, L. Wang, Y. Zhang, X. Han, M. Deveci, and M. Parmar, A review of convolutional neural networks in computer vision, vol. 57, no. 4. Springer Netherlands, 2024.
[8] L. Zewen, L. Fan, Y. Wenjie, P. Shouheng, and Z. Jun, “A survey of convolutional neural networks: analysis, applications, and prospects,” IEEE Trans. neural networks Learn. Syst., vol. 33, no. 12, pp. 6999–7019, 2021.
[9] M. Krichen, “Convolutional Neural Networks: A Survey,” Computers, vol. 12, no. 8, pp. 1–41, 2023.
[10] K. W. Goh et al., “Comparison of Activation Functions in Convolutional Neural Network for Poisson Noisy Image Classification,” Emerg. Sci. J., vol. 8, no. 2, pp. 592–602, 2024.
[11] L. Alzubaidi et al., Review of deep learning: concepts, CNN architectures, challenges, applications, future directions, vol. 8, no. 1. Springer International Publishing, 2021.
[12] M. Feng, Y. Cai, and S. Yan, “Enhanced ResNet50 for Diabetic Retinopathy Classification: External Attention and Modified Residual Branch,” Mathematics, vol. 13, no. 10, 2025.
[13] S. S. Sumit, S. Anavatti, M. Tahtali, S. Mirjalili, and U. Turhan, “ResNet-Lite: On Improving Image Classification with a Lightweight Network,” Procedia Comput. Sci., vol. 246, no. C, pp. 1488–1497, 2024, doi: 10.1016/j.procs.2024.09.597.
[14] L. Zhang, Y. Bian, P. Jiang, and F. Zhang, “A Transfer Residual Neural Network Based on ResNet-50 for Detection of Steel Surface Defects,” Appl. Sci., vol. 13, no. 9, 2023.
[15] L. E. MacDonald, J. Valmadre, H. Saratchandran, and S. Lucey, “On skip connections and normalisation layers in deep optimisation,” Adv. Neural Inf. Process. Syst., vol. 36, no. NeurIPS, 2023.
[16] J. Zhu, Y. Zhang, C. Ma, J. Wu, X. Wang, and D. Kong, “GM-CBAM-ResNet: A Lightweight Deep Learning Network for Diagnosis of COVID-19,” J. Imaging, vol. 11, no. 3, pp. 1–27, 2025.
[17] Y. Zhang et al., “Deep-Learning Model of ResNet Combined with CBAM for Malignant–Benign Pulmonary Nodules Classification on Computed Tomography Images,” Med., vol. 59, no. 6, 2023.
[18] B. Guo et al., “WaveAttention-ResNet: a deep learning-based intelligent diagnostic model for the auxiliary diagnosis of multiple retinal diseases,” Front. Radiol., vol. 5, no. July, pp. 1–18, 2025.
[19] H. E. Kim, A. Cosa-Linan, N. Santhanam, M. Jannesari, M. E. Maros, and T. Ganslandt, “Transfer learning for medical image classification: a literature review,” BMC Med. Imaging, vol. 22, no. 1, pp. 1–13, 2022.
[20] I. D. Mienye, T. G. Swart, G. Obaido, M. Jordan, and P. Ilono, “Deep Convolutional Neural Networks in Medical Image Analysis: A Review,” Inf., vol. 16, no. 3, pp. 1–28, 2025.
[21] V. Anand, S. Gupta, D. Koundal, W. Y. Alghamdi, and B. M. Alsharbi, “Deep learning-based image annotation for leukocyte segmentation and classification of blood cell morphology,” BMC Med. Imaging, vol. 24, no. 1, pp. 1–15, 2024.
[22] N. Sapkota, K. B. Khattri, and D. Aryal, “Modeling Precipitation: A Statistical and Machine Learning Approach,” Int. J. Eng. Technol., vol. 2, no. 2, pp. 188–203, 2025.
[23] R. K. Hapsari, A. H. Salim, B. D. Meilani, T. Indriyani, and A. Rachman, Comparison of the Normalization Method of Data in Classifying Brain Tumors with the k-NN Algorithm, vol. 1. Atlantis Press International BV, 2023.
[24] H. Henderi, “Comparison of Min-Max normalization and Z-Score Normalization in the K-nearest neighbor (kNN) Algorithm to Test the Accuracy of Types of Breast Cancer,” IJIIS Int. J. Informatics Inf. Syst., vol. 4, no. 1, pp. 13–20, 2021.
[25] A. Tawakuli, B. Havers, V. Gulisano, D. Kaiser, and T. Engel, “Survey:Time-series data preprocessing: A survey and an empirical analysis,” J. Eng. Res., vol. 13, no. 2, pp. 674–711, 2025.
[26] K. Maharana, S. Mondal, and B. Nemade, “A review: Data pre-processing and data augmentation techniques,” Glob. Transitions Proc., vol. 3, no. 1, pp. 91–99, 2022.
[27] E. W. Ghindawi, “Advanced Computer Vision Alignment Technique Using Preprocessing Filters and Deep Learning,” Ing. des Syst. d’Information, vol. 29, no. 4, pp. 1493–1499, 2024.
[28] Y. Fu, M. Nguyen, and W. Q. Yan, “Grading Methods for Fruit Freshness Based on Deep Learning,” SN Comput. Sci., vol. 3, no. 4, pp. 1–13, 2022.
[29] C. Hahne et al., “Isometric Transformations for Image Augmentation in Mueller Matrix Polarimetry,” IEEE Trans. Image Process., vol. 14, no. 8, pp. 1–9, 2025.
[30] B. A. Awaluddin, C. T. Chao, and J. S. Chiou, “Investigating Effective Geometric Transformation for Image Augmentation to Improve Static Hand Gestures with a Pre-Trained Convolutional Neural Network,” Mathematics, vol. 11, no. 23, 2023.
[31] F. A. Damayanti, R. Andri Asmara, and G. B. Prasetyo, “Residual Network Deep Learning Model with Data Augmentation Effects in the Implementation of Iris Recognition,” Int. J. Front. Technol. Eng., vol. 2, no. 2, pp. 79–86, 2024.
[32] A. Kunlerd, A. Ritthiron, B. Nabumroong, S. Luangmaneerote, A. Chaiwachirakhampon, and J. Kaewyotha, “A New Data Preprocessing Framework to Enhance the Accuracy of Herbal Plants Classification Using Deep Learning,” J. Appl. Data Sci., vol. 6, no. 3, pp. 1723–1740, 2025.
[33] L. I. Kesuma and R. Rudiansyah, “Classification of Covid-19 Diseases Through Lung CT-Scan Image Using the ResNet-50 Architecture,” Comput. Eng. Appl. J., vol. 12, no. 1, pp. 11–30, 2023.
[34] T. Perumal, N. Mustapha, R. Mohamed, and F. M. Shiri, “A Comprehensive Overview and Comparative Analysis on Deep Learning Models,” J. Artif. Intell., vol. 6, no. 1, pp. 301–360, 2024.
[35] G. Habib and S. Qureshi, “GAPCNN with HyPar: Global Average Pooling convolutional neural network with novel NNLU activation function and HYBRID parallelism,” Front. Comput. Neurosci., vol. 16, 2022.
[36] B. Mandal, A. Okeukwu, and Y. Theis, “Masked Face Recognition using ResNet-50,” 2021, [Online]. Available: http://arxiv.org/abs/2104.08997.
[37] Ş. Kılıç, “Deep feature engineering for accurate sperm morphology classification using CBAM-enhanced ResNet50,” PLoS One, vol. 20, no. 9 September, pp. 1–26, 2025.
[38] A. Çı, M. Yıldırı, and Y. Eroğlu, “Traitement du Signal Classification of Pneumonia Cell Images Using Improved ResNet50 Model,” Int. Inf. Eng. Technol. Assoc., vol. 38, no. 1, pp. 165–173, 2021.
[39] A. Mujhid, S. Surono, N. Irsalinda, and A. Thobirin, “Comparison and Combination of Leaky ReLU and ReLU Activation Function and Three Optimizers on Deep CNN for COVID-19 Detection,” Front. Artif. Intell. Appl., vol. 358, pp. 50–57, 2022.
[40] R. T. Wahyunigrum, I. A. Siradjuddin, T. D. Farawati, I. S. Faradisa, A. Bauravindah, and D. A. Dewi, “Implementation of an EfficientNet-B4 Model Architecture with a Convolutional Block Attention Module (CBAM) for Betel Leaf Disease Classification,” Eng. Technol. Appl. Sci. Res., vol. 15, no. 5, pp. 26722–26730, 2025.
[41] W. Islam, M. Jones, R. Faiz, N. Sadeghipour, Y. Qiu, and B. Zheng, “Improving Performance of Breast Lesion Classification Using a ResNet50 Model Optimized with a Novel Attention Mechanism,” Tomography, vol. 8, no. 5, pp. 2411–2425, 2022.
[42] Q. Wang, Y. Ma, K. Zhao, and Y. Tian, “A Comprehensive Survey of Loss Functions in Machine Learning,” Ann. Data Sci., vol. 9, no. 2, pp. 187–212, 2022.
[43] H. Sun et al., “An Improved Medical Image Classification Algorithm Based on Adam Optimizer,” Mathematics, vol. 12, no. 16, pp. 1–14, 2024.
[44] S. Hira, A. Bai, and S. Hira, “An automatic approach based on CNN architecture to detect Covid-19 disease from chest X-ray images,” Appl. Intell., vol. 51, no. 5, pp. 2864–2889, 2021.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Aulya Rachma Dewi, Aris Thobirin, Sugiyarto Surono
This work is licensed under a Creative Commons Attribution 4.0 International License.
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
