Acta Informatica Pragensia X:X | DOI: 10.18267/j.aip.32752

Enhancing Fraud Detection Performance on Imbalanced Datasets: A ResNet-Based Approach Integrating Multi-Attention Techniques and SMOTE-ENN

Mohammed Khaldoon Altalib ORCID...1, Karam Abdullah ORCID...1, Naomie Salim ORCID...2
1 Department of Computer Science, ‎‏College of Education for Pure Science, University of Mosul, Mosul, Nineveh, Iraq
2 UTM Big Data Center, Universiti Teknologi Malaysia, Skudai, Johor, Malaysia

Background: The detection of financial fraud has become increasingly significant because electronic transactions and advanced frauds have been growing rapidly, leading to huge losses for the economy. Yet, significant class imbalance, data heterogeneity, evolving fraud trends, and a small number of labelled samples remain as challenges for building effective fraud detection systems.

Objective: This article assesses an integrated approach to a fraud-detection framework based on residual networks (ResNet), different attention mechanisms, and class-imbalance handling techniques across heterogeneous financial datasets.

Methods: The proposed experimental framework combined ResNet with self-attention, channel attention, gated attention and multihead attention. Class imbalance was addressed using the synthetic minority oversampling technique (SMOTE) and edited nearest neighbours (ENN). The model was evaluated on the European Credit Card Fraud dataset, the UCI Taiwan dataset, and the combined dataset to assess its performance across both transactional and demographic feature spaces.

Results: On the European Credit Card Fraud dataset, the ResNet multihead attention model outperformed all other models, while on the UCI Taiwan dataset, the ResNet gated-attention model had the best F1 performance. The channel-attention model performed the best in terms of accuracy and AUC for the merged data. AUC was not always the best choice for the various experimental setups, but the most consistent improvements were in F1 score and ranking stability.

Conclusion: The integrated ResNet-attention framework achieved competitive performance on fraud detection in imbalanced and heterogeneous financial datasets, particularly in terms of F1 score. The results show that the utility of single attention mechanisms varies across datasets and does not indicate that any single architecture is superior. The framework should be tested on other real-world financial datasets, and further optimisation should be explored to enhance its generalisability and robustness.

Keywords: Deep learning; ResNet; Attention mechanisms; Class imbalance; Synthetic minority oversampling technique; Edited nearest neighbours; Data merging.

Received: January 4, 2026; Revised: July 26, 2026; Accepted: August 9, 2026; Prepublished online: October 2, 2026 

Download citation
  • BibTeX (.bib)
  • Bookends (.ris)
  • EasyBib (.ris)
  • EndNote (.enw)
  • EndNote 8 (.xml)
  • ISI WoS (.isi)
  • Medlars (.medlars)
  • Mendeley (.ris)
  • MODS (.xml)
  • Papers (.ris)
  • RefWorks (.txt)
  • RefManager (.ris)
  • RIS (.ris)
  • MS Word (.xml)
  • Zotero (.ris)
    • Open full article

    References

    1. Alarfaj, F. K., Malik, I., Khan, H. U., Almusallam, N., Ramzan, M., & Ahmed, M. (2022). Credit card fraud detection using state-of-the-art machine learning and deep learning algorithms. IEEE Access, 10, 39700-39715. https://doi.org/10.1109/ACCESS.2022.3166891 Go to original source...
    2. Ali, A., Abd Razak, S., Othman, S. H., Eisa, T. A. E., Al-Dhaqm, A., Nasser, M., Elhassan, T., Elshafie, H., & Saif, A. (2022). Financial fraud detection based on machine learning: a systematic literature review. Applied Sciences, 12(19), 9637. https://doi.org/10.3390/app12199637 Go to original source...
    3. Almazroi, A. A., & Ayub, N. (2023). Online payment fraud detection model using machine learning techniques. IEEE Access, 11, 137188-137203. https://doi.org/10.1109/ACCESS.2023.3339226 Go to original source...
    4. Altalib, M. K., & Salim, N. (2022). Hybrid-Enhanced Siamese Similarity Models in Ligand-Based Virtual Screen. Biomolecules, 12(11), 1719. https://doi.org/10.3390/biom12111719 Go to original source...
    5. Azhar, N. A., Pozi, M. S. M., Din, A. M., & Jatowt, A. (2022). An investigation of SMOTE based methods for imbalanced datasets with data complexity analysis. IEEE Transactions on Knowledge and Data Engineering, 35(7), 6651-6672. https://doi.org/10.1109/TKDE.2022.3179381 Go to original source...
    6. Bhandary, R., & Ghosh, B. K. (2025). Credit Card Default Prediction: An Empirical Analysis on Predictive Performance Using Statistical and Machine Learning Methods. Journal of Risk and Financial Management, 18(1), 23. https://doi.org/10.3390/jrfm18010023 Go to original source...
    7. Bonde, L., & Bichanga, A. K. (2025). Improving Credit Card Fraud Detection with Ensemble Deep Learning-Based Models: A Hybrid Approach Using SMOTE-ENN. Journal of Computing Theories and Applications, 2(3), 384. https://doi.org/10.62411/jcta.12021 Go to original source...
    8. Bounab, R., Zarour, K., Guelib, B., & Khlifa, N. (2024). Enhancing Medicare fraud detection through Machine Learning: Addressing class imbalance with SMOTE-ENN. IEEE Access, 12, 54399-54413. https://doi.org/10.1109/access.2024.3385781 Go to original source...
    9. Cao, R., Liu, G., Xie, Y., & Jiang, C. (2021). Two-Level Attention Model of Representation Learning for Fraud Detection. IEEE Transactions on Computational Social Systems, 8(6), 1291-1301. https://doi.org/10.1109/tcss.2021.3074175 Go to original source...
    10. Chen, Y., Zhao, C., Xu, Y., & Nie, C. (2025). Year-over-Year Developments in Financial Fraud Detection via Deep Learning: A Systematic Literature Review. arXiv preprint arXiv:2502.00201. https://doi.org/10.48550/arXiv.2502.00201 Go to original source...
    11. Dauphin, Y. N., Fan, A., Auli, M., & Grangier, D. (2017). Language modeling with gated convolutional networks. In Proceedings of the 34th International Conference on Machine Learning, (pp. 933-941). JMLR.
    12. Emmanuel, I., Sun, Y., & Wang, Z. (2024). A machine learning-based credit risk prediction engine system using a stacked classifier and a filter-based feature selection method. Journal of Big Data, 11(1), 23. https://doi.org/10.1186/s40537-024-00882-0 Go to original source...
    13. Esenogho, E., Mienye, I. D., Swart, T. G., Aruleba, K., & Obaido, G. (2022). A neural network ensemble with feature engineering for improved credit card fraud detection. IEEE Access, 10, 16400-16407. https://doi.org/10.1109/access.2022.3148298 Go to original source...
    14. Eteng, I. E., Chinedu, U. L., & Ibor, A. E. (2025). A stacked ensemble approach with resampling techniques for highly effective fraud detection in imbalanced datasets. Journal of the Nigerian Society of Physical Sciences, 7(1), 2066. https://doi.org/10.46481/jnsps.2025.2066 Go to original source...
    15. Hairani, H., & Priyanto, D. (2023). A new approach of hybrid sampling SMOTE and ENN to the accuracy of machine learning methods on unbalanced diabetes disease data. International Journal of Advanced Computer Science and Applications, 14(8), 585-590. https://doi.org/10.14569/IJACSA.2023.0140864 Go to original source...
    16. Hu, J., Shen, L. and Sun, G. (2018) Squeeze-and-Excitation Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp. 7132-7141). IEEE. https://doi.org/10.1109/CVPR.2018.00745 Go to original source...
    17. Huang, H., Wang, P., Pei, J., Wang, J., Alexanian, S., & Niyato, D. (2025). Deep Learning Advancements in Anomaly Detection: A Comprehensive survey. IEEE Internet of Things Journal, 12(21), 44318-44342. https://doi.org/10.1109/jiot.2025.3585884 Go to original source...
    18. Ileberi, E., & Sun, Y. (2024). A hybrid deep learning ensemble model for credit card fraud detection. IEEE Access, 12, 175829-175838. https://doi.org/10.1109/access.2024.3502542 Go to original source...
    19. Jiang, S., Dong, R., Wang, J., & Xia, M. (2023). Credit card fraud detection based on unsupervised attentional anomaly detection network. Systems, 11(6), 305. https://doi.org/10.3390/systems11060305 Go to original source...
    20. Khalid, A. R., Owoh, N., Uthmani, O., Ashawa, M., Osamor, J., & Adejoh, J. (2024). Enhancing credit card fraud detection: an ensemble machine learning approach. Big Data and Cognitive Computing, 8(1), 6. https://doi.org/10.3390/bdcc8010006 Go to original source...
    21. Lindemulder, G. (2024). What is fraud detection. IBM. https://www.ibm.com/think/topics/fraud-detection
    22. Mandal, P. K., & Mahto, R. V. (2023). Deep multi-branch CNN architecture for early Alzheimer's detection from brain MRIs. Sensors, 23(19), 8192. https://doi.org/10.3390/s23198192 Go to original source...
    23. Mienye, I. D., & Jere, N. (2024). Deep Learning for Credit Card Fraud Detection: A review of Algorithms, challenges, and solutions. IEEE Access, 12, 96893-96910. https://doi.org/10.1109/access.2024.3426955 Go to original source...
    24. Mienye, I. D., & Sun, Y. (2023). A deep learning ensemble with data resampling for credit card fraud detection. IEEE Access, 11, 30628-30638. https://doi.org/10.1109/access.2023.3262020 Go to original source...
    25. MLG. (2017). Credit Card Fraud Detection. Kaggle. https://www.kaggle.com/datasets/mlg-ulb/creditcardfraud
    26. Nishat, M. M., Faisal, F., Ratul, I. J., Al-Monsur, A., Ar-Rafi, A. M., Nasrullah, S. M., Reza, M. T., & Khan, M. R. H. (2022). A Comprehensive Investigation of the Performances of Different Machine Learning Classifiers with SMOTE-ENN Oversampling Technique and Hyperparameter Optimization for Imbalanced Heart Failure Dataset. Scientific Programming, 2022, 1-17. https://doi.org/10.1155/2022/3649406 Go to original source...
    27. Nguyen, T., Khadka, R., Phan, N., Yazidi, A., Halvorsen, P., & Riegler, M. A. (2023). Combining datasets to improve model fitting. In 2023 International Joint Conference on Neural Networks (IJCNN). IEEE. https://doi.org/10.1109/IJCNN54540.2023.10191273 Go to original source...
    28. Saeed, A. Q., Aldulaimi, M. H., Ismail, I. A., Ahmed, I. M., Yahya, Y. A., Kharma, Q. M., & Ghazal, T. M. (2024). Integrating Three Machine Learning Algorithms in Ensemble Learning Model for Improving Content-based Spam Email Recognition. Journal of Soft Computing and Data Mining, 5(2), 188-196. Go to original source...
    29. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, £., & Polosukhin, I. (2017). Attention is all you need. In 31st Conference on Neural Information Processing Systems (NIPS 2017). NIPS.
    30. Wang, X., Ross, G., Gupta, A., & He, K. (2018). Non-Local Neural Networks. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE. https://doi.org/10.1109/CVPR.2018.00813 Go to original source...
    31. Yeh, I. (2009). Default of Credit Card Clients [Dataset]. UCI Machine Learning Repository. https://doi.org/10.24432/C55S3H Go to original source...
    32. Younis, M. C., Fadil, Z. J., & Bahnam, B. S. (2025). IoT-Based System for Human Localization Activity Recognition Using Hybrid Deep Learning Techniques. Inteligencia Artificial, 28(75), 298-314. https://doi.org/10.4114/intartif.vol28iss75pp298-314 Go to original source...
    33. Zhao, X., & Guan, S. (2023). CTCN: a novel credit card fraud detection method based on Conditional Tabular Generative Adversarial Networks and Temporal Convolutional Network. PeerJ Computer Science, 9, e1634. https://doi.org/10.7717/peerj-cs.1634 Go to original source...

    This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.


    Return