A Hybrid Deep Learning Model with Self-Attention for the Classification of Lung Cancer Using Histopathology Image
DOI:
https://doi.org/10.14500/aro.12355Keywords:
Deep learning, Histopathology images, Lung cancer classification, Model evaluation, Primary lung cancerAbstract
Lung cancer remains a prevalent health burden and is one of the leading causes of cancer mortality worldwide. Its high mortality rate is partly attributable to histological heterogeneity and the difficulty of detecting it at early stages. An accurate distinction of lung cancer subtypes in histopathological images is crucial for improving the accuracy of diagnosis and planning an appropriate treatment to improve the quality of life of patients. This study proposes a hybrid deep-learning model for classifying cancer types using histopathology images. The ConvNeXt-Tiny is an extension of the ResNet-50 base architecture. This architecture is inspired by both models and introduces self-attention layers to improve both feature extraction and classification performance, leading to a unique model design. The proposed model and two other deep learning models were trained and tested using the public Lung and Colon Cancer Histopathological Image (LC25000) dataset and a private clinical dataset, and their effectiveness was evaluated. The proposed model outperformed the best classification accuracy among the other architectures (98.73% public and 93.17% private), outperforming baseline models, such as ConvNeXt-Tiny (96.27% public and 89.33% private) and ResNet-50 (94.00% public and 87.67% private). The results confirm the robustness and generalization ability of the proposed architecture.
Downloads
References
Ahmed, S., Shaikh, A., Alshahrani, H., Alghamdi, A., Alrizq, M., Baber, J., and Bakhtyar, M., 2021. Transfer learning approach for classification of histopathology whole slide images. Sensors, 21(16), p.5361.
Anjum, S., Ahmed, I., Asif, M., Aljuaid, H., Alturise, F., Ghadi, Y.Y., and Elhabob, R., 2023. Lung cancer classification in histopathology images using multiresolution efficient nets. Computational Intelligence and Neuroscience, 2023, pp.7282944.
Borkowski, A.A., Bui, M.M., Thomas, L.B., Wilson, C.P., DeLand, L.A., and Mastorides, S.M., 2019. Lung and Colon Cancer Histopathological Image Dataset (LC25000). [Preprint].
Devi, B.R., Sharma, A., Ramesh, S., and Kumar, R., 2024. Efficient NetB3 for enhanced lung cancer detection: Histopathological image study with augmentation. Journal of Information Technology Management, 16(1), pp.98-117.
El-Ghany, S.A., Azad, M., and Elmogy, M., 2023. Robustness fine-tuning deep learning model for cancers diagnosis based on histopathology image analysis. Diagnostics, 13(4), p.699.
Gong, W., Liu, X., Wang, Y., Zhang, H., and Zhao, J., 2025. Evaluation of an enhanced ResNet-18 classification model for rapid on-site diagnosis in respiratory cytology. BMC Cancer, 25(1), p.10.
Gowthamy, J., and Ramesh, S., 2024. A novel hybrid model for lung and colon cancer detection using pre-trained deep learning and KELM. Expert Systems with Applications, 252, p.124114.
Hattori, H., Morikawa, T., Matsumoto, T., Shibata, H., Yamamoto, K., Takeda, Y., Nakamura, S., Fujita, T., and Nakano, T., 2023. Tumor-identification method for predicting recurrence of early-stage lung adenocarcinoma using digital pathology images by machine learning. Journal of Pathology Informatics, 14, p.100175.
Hatuwal, B.K., and Thapa, H.C., 2020. Lung cancer detection using convolutional neural network on histopathological images. International Journal of Computer Trends and Technology, 68(10), pp.21-24.
Howlader, N., Noone, A.M., Krapcho, M., Miller, D., Brest, A., Yu, M., Ruhl, J., Tatalovich, Z., Mariotto, A., Lewis, D.R., Chen, H.S., Feuer, E.J., and Cronin, K.A., 2020. The effect of advances in lung-cancer treatment on population mortality. New England Journal of Medicine, 383(7), pp.640-649.
Hua, W., Li, C., and Wang, X., 2024. Review of convolutional neural network models and image classification. Academic Journal of Science and Technology, 10(3), pp.178-184.
Ijaz, M., Qureshi, S.A., Khan, M.A., Ashraf, I., Zahid, U., Yasin, A., Zhang, Y.D., and Wang, S., 2023. DS²LC³Net: A decision support system for lung colon cancer classification using fusion of deep neural networks and normal distribution based gray wolf optimization. ACM Transactions on Asian and Low-Resource Language Information Processing. New York: ACM Publications, p.3625096.
Kanavos, A., and Mylonas, P., 2023. Deep learning analysis of Histopathology images for breast cancer Detection: A Comparative Study of ResNet and VGG Architectures. In: 2023 18th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP). IEEE, pp.1-6.
Khan, S., Naseer, M., Hayat, M., Zamir, S.W., Khan, F.S., and Shah, M., 2022. Transformers in vision: A survey. ACM Computing Surveys, 54(10), p.200.
Komura, D., and Ishikawa, S., 2018. Machine learning methods for histopathological image analysis. Computational and Structural Biotechnology Journal, 16, pp.34-42.
Kriegsmann, M., Haag, C., Weis, C.A., Steinbuss, G., Warth, A., Zgorzelski, C., Muley, T., Winter, H., Eichhorn, M.E., Eichhorn, F., Kriegsmann, J., Christopolous, P., Thomas, M., Witzens-Harig, M., Sinn, P., Von Winterfeld, M., Heussel, C.P., Herth, F.J.F., Klauschen, F., Stenzinger, A., and Kriegsmann, K., 2020. Deep learning for the classification of small-cell and non-small-cell lung cancer. Cancers, 12(6), p.1604.
Kumar, N., Sharma, M., Singh, V.P., Madan, C., and Mehandia, S., 2022. An empirical study of handcrafted and dense feature extraction techniques for lung and colon cancer classification from histopathological images. Biomedical Signal Processing and Control, 75, p.103596.
Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S., 2022. A ConvNet for the 2020s. In: Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp.11966-11976.
Masud, M., Sikder, N., Abdullah-Al Nahid, A., Bairagi, A.K., and AlZain, M.A., 2021. A machine learning approach to diagnosing lung and colon cancer using a deep learning-based classification framework. Sensors (Basel, Switzerland), 21(3), p.748.
Mehmood, S., Ghazal, T.M., Khan, M.A., Zubair, M., Naseem, M.T., Faiz, T., and Ahmad, M., 2022. Malignancy detection in lung and colon histopathology images using transfer learning with class selective image processing. IEEE Access, 10, pp.25657-25668.
Nicholson, A.G., Tsao, M.S., Beasley, M.B., Borczuk, A.C., Brambilla, E., Cooper, W.A., Dacic, S., Jain, D., Kerr, K.M., Lantuejoul, S., Noguchi, M., Papotti, M., Rekhtman, N., Scagliotti, G., Van Schil, P., Sholl, L., Yatabe, Y., Yoshida, A., and Travis, W.D., 2022. The 2021 WHO classification of lung tumors: Impact of advances since 2015. Journal of Thoracic Oncology, 17(3), pp.362-387.
Rajasekar, V., Vaishnnave, M.P., Premkumar, S., Sarveshwaran, V., and Rangaraaj, V., 2023. Lung cancer disease prediction with CT scan and histopathological images feature analysis using deep learning techniques. Results in Engineering, 18, p.101111.
Raschka, S., Mirjalili, V., and Raschka, J., 2022. Machine Learning with PyTorch and Scikit-Learn: Develop Machine Learning and Deep Learning Models with Scikit-Learn and PyTorch. Packt Publishing, Birmingham. Siegel, R.L., Giaquinto, A.N., and Jemal, A., 2024. Cancer statistics, 2024. CA: A Cancer Journal for Clinicians, 74(1), pp.12-49.
Sumon, R.I., Mazumdar, M.A.I., Uddin, S.M.I., and Kim, H.C., 2024. Exploring Deep Learning and Machine Learning Techniques for Histopathological Image Classification in Lung Cancer Diagnosis. In: 2024 International Conference on Electrical, Computer, and Energy Technologies (ICECET). IEEE, pp.1-6. Tortora, M., Cordelli, E., Sicilia, R., Nibid, L., Ippolito, E., Perrone, G., Ramella, S., and Soda, P., 2023.
RadioPathomics: Multimodal learning in non-small cell lung cancer for adaptive radiotherapy. IEEE Access, 11, pp.47563-47578.
Tummala, S., Yedla, R.N., Ahmed, K., Katukojwala, A., Vankayalapati, S.L.V., and Garikapati, V., 2023. An explainable classification method based on complex scaling in histopathology images for lung and colon cancer. Diagnostics, 13(9), p.1594.
Wei, J.W., Tafe, L.J., Linnik, Y.A., Vaickus, L.J., Tomita, N., and Hassanpour, S., 2019. Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networks. Scientific Reports, 9, p.3358.
Yang, H., Chen, L., Cheng, Z., Yang, M., Wang, J., Lin, C., Wang, Y., Huang, L., Chen, Y., Peng, S., Ke, Z., and Li, W., 2021. Deep learning-based six-type classifier for lung cancer and mimics from histopathological whole slide images: A retrospective study. BMC Medicine, 19, p.80.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Lana L. Nahmatwlla, Abbas M. Ali
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors who choose to publish their work with Aro agree to the following terms:
-
Authors retain the copyright to their work and grant the journal the right of first publication. The work is simultaneously licensed under a Creative Commons Attribution License [CC BY-NC-SA 4.0]. This license allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
-
Authors have the freedom to enter into separate agreements for the non-exclusive distribution of the journal's published version of the work. This includes options such as posting it to an institutional repository or publishing it in a book, as long as proper acknowledgement is given to its initial publication in this journal.
-
Authors are encouraged to share and post their work online, including in institutional repositories or on their personal websites, both prior to and during the submission process. This practice can lead to productive exchanges and increase the visibility and citation of the published work.
By agreeing to these terms, authors acknowledge the importance of open access and the benefits it brings to the scholarly community.
Accepted 2025-08-21
Published 2025-09-01
ARO Journal is a scientific, peer-reviewed, periodical, and diamond OAJ that has no APC or ASC.