A Comprehensive Review of Data Balancing Techniques in Machine Learning: Methods, Challenges, and Future Directions
Article Sidebar
Main Article Content
Abstract
The problem of class imbalance is an important problem in machine learning (ML), leading to bias in the trained models and poor accuracy, especially for the minority classes. This review performs a thorough characterization of Under-sampling, over-sampling, algorithm-level, and their hybrid techniques. It evaluates popular techniques such as Random Under-sampling (RUS), Synthetic Minority Over-sampling Technique (SMOTE), and Cost-Sensitive Learning (CSL), and explores advanced hybrid strategies like SMOTE-ENN and SMOTE+Tomek Links. The effectiveness of these approaches is compared across a wide range of datasets and ML techniques, highlighting their advantages, trade-offs, and practical limitations, including risks of overfitting, information loss, and computational complexity. This paper also discusses challenges in multi-class imbalance scenarios and high-dimensional data. Finally, it discusses future research directions including balancing with Deep Learning (DL), AutoML, and fairness-aware modeling. It provides a reliable overview of the state of the art by presenting a summary of literature and details gaps, serving as a blueprint for researchers and potential users who are interested in accurate strategies to solve the class imbalance problem in various real-world applications.
Article Details
Issue
Section
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
References
[1] A. G. N. Alsaedi, M. J. Varnamkhasti, H. J. Mohammed, and M. Aghajani, “Data Mining Classification Techniques to Improve Decision-Making Processes,” International Journal of Mathematical Modelling & Computations, vol. 14, no. 4, pp. 363–380, 2024.
[2] K. Razzaq and M. Shah, “Machine learning and deep learning paradigms: From techniques to practical applications and research frontiers,” Computers, vol. 14, no. 3, p. 93, 2025.
[3] A. A. Rabaan et al., “Unleashing the power of artificial intelligence for diagnosing and treating infectious diseases: A comprehensive review,” J Infect Public Health, vol. 16, no. 11, pp. 1837–1847, 2023.
[4] A. K. Jain, “Data clustering: 50 years beyond K-means,” Pattern Recognition Letters, vol. 31, no. 8, pp. 651–666, 2010, doi: 10.1016/j.patrec.2009.09.011.
[5] A. K. Kareem and K. M. A. Alheeti, “Hybrid Approach for Fall Detection Based on Machine Learning,” in International Conference on New Trends in Information and Communications Technology Applications, Springer, 2021, pp. 111–130.
[6] A. K. Kareem, A. M. Shaban, A. A. Nafea, M. Aljanabi, S. A. S. Aliesawi, and M. Mal-Ani, “Detecting Routing Protocol Low Power and Lossy Network Attacks Using Machine Learning Techniques,” in 2024 21st International Multi-Conference on Systems, Signals & Devices (SSD), IEEE, 2024, pp. 57–62.
[7] A. R. Salehi and M. Khedmati, “A cluster-based SMOTE both-sampling (CSBBoost) ensemble algorithm for classifying imbalanced data,” Sci Rep, vol. 14, no. 1, p. 5152, 2024.
[8] H. Kaur, H. S. Pannu, and A. K. Malhi, “A systematic review on imbalanced data challenges in machine learning: Applications and solutions,” ACM computing surveys (CSUR), vol. 52, no. 4, pp. 1–36, 2019.
[9] M. Koziarski and M. Woźniak, “Local neighborhood encodings for imbalanced data classification,” Mach Learn, vol. 113, no. 10, pp. 7421–7449, 2024.
[10] W. Chen, K. Yang, Z. Yu, Y. Shi, and C. L. P. Chen, “A survey on imbalanced learning: latest research, applications and future directions,” Artif Intell Rev, vol. 57, no. 6, p. 137, 2024.
[11] P. Kaur and A. Gosain, “Robust hybrid data-level sampling approach to handle imbalanced data during classification,” Soft comput, vol. 24, no. 20, pp. 15715–15732, 2020.
[12] M. Altalhan, A. Algarni, and M. Turki-Hadj Alouane, “Imbalanced data problem in machine learning: A review,” IEEE Access, vol. 13, pp. 13686–13699, 2025, doi: 10.1109/ACCESS.2025.3531662.
[13] N. Junsomboon and T. Phienthrakul, “Combining over-sampling and under-sampling techniques for imbalance dataset,” in Proceedings of the 9th international conference on machine learning and computing, 2017, pp. 243–247.
[14] G. Parmar, R. Gupta, T. Bhatt, G. J. Sahani, B. Y. Panchal, and H. Patel, “A review on data balancing techniques and machine learning methods,” in 2023 5th International Conference on Smart Systems and Inventive Technology (ICSSIT), IEEE, 2023, pp. 1004–1008.
[15] C.-Y. Peng and Y.-J. Park, “A new hybrid under-sampling approach to imbalanced classification problems,” Applied Artificial Intelligence, vol. 36, no. 1, p. 1975393, 2022.
[16] M. Peng et al., “Trainable undersampling for class-imbalance learning,” in Proceedings of the AAAI conference on artificial intelligence, 2019, pp. 4707–4714.
[17] N. M. Mqadi, N. Naicker, and T. Adeliyi, “Solving misclassification of the credit card imbalance problem using near miss,” Math Probl Eng, vol. 2021, no. 1, p. 7194728, 2021.
[18] F. Sağlam, “DatRel: a noise-tolerant data relocation approach for effective synthetic data generation in imbalanced classifiers,” Mach Learn, vol. 114, no. 5, p. 126, 2025.
[19] R. Alejo, J. M. Sotoca, R. M. Valdovinos, and P. Toribio, “Edited nearest neighbor rule for improving neural networks classifications,” in International Symposium on Neural Networks, Springer, 2010, pp. 303–310.
[20] S. Chatterjee and Y.-C. Byun, “Highly imbalanced fault classification of wind turbines using data resampling and hybrid ensemble method approach,” Eng Appl Artif Intell, vol. 126, p. 107104, 2023.
[21] Q. Leng, J. Guo, J. Tao, X. Meng, and C. Wang, “OBMI: oversampling borderline minority instances by a two-stage Tomek link-finding procedure for class imbalance problem,” Complex & Intelligent Systems, vol. 10, no. 4, pp. 4775–4792, 2024.
[22] G. Tuysuzoglu et al., “Joint Tomek Links (JTL): An Innovative Approach to Noise Reduction for Enhanced Classification Performance,” IEEE Access, 2025.
[23] Z. Salekshahrezaee, J. L. Leevy, and T. M. Khoshgoftaar, “A reconstruction error-based framework for label noise detection,” J Big Data, vol. 8, no. 1, p. 57, 2021.
[24] S. El Hajjami, J. Malki, A. Bouju, and M. Berrada, “Machine learning facing behavioral noise problem in an imbalanced data using one side behavioral noise reduction: application to a fraud detection,” Int J Comput Info Eng, vol. 15, no. 3, pp. 194–205, 2021.
[25] A. Kim and I. Jung, “Optimal selection of resampling methods for imbalanced data with high complexity,” PLoS One, vol. 18, no. 7, p. e0288540, 2023.
[26] T. Elhassan and M. Aljurf, “Classification of imbalance data using tomek link (t-link) combined with random under-sampling (rus) as a data reduction method,” Global J Technol Optim S, vol. 1, no. S1, 2016.
[27] F. Angiulli, “Fast nearest neighbor condensation for large data sets classification,” IEEE Trans Knowl Data Eng, vol. 19, no. 11, pp. 1450–1464, 2007.
[28] F. R. Adi Pratama and S. I. Oktora, “Synthetic Minority Over-sampling Technique (SMOTE) for handling imbalanced data in poverty classification,” Stat J IAOS, vol. 39, no. 1, pp. 233–239, 2023.
[29] A. D. Saputra, D. Arifianto, and R. Umilasari, “Effect Of Random Under Sampling and Random Over Sampling Method On Svm Performance,” Computing and Information System Journal, vol. 1, no. 2, pp. 78–86, 2025.
[30] J. Zhang and L. Chen, “Clustering-based undersampling with random over sampling examples and support vector machine for imbalanced classification of breast cancer diagnosis,” Computer Assisted Surgery, vol. 24, no. sup2, pp. 62–72, 2019.
[31] M. G. Karthik and M. B. M. Krishnan, “Hybrid random forest and synthetic minority over sampling technique for detecting internet of things attacks,” J Ambient Intell Humaniz Comput, pp. 1–11, 2021.
[32] R. M. Mathew and R. Gunasundari, “A review on handling multiclass imbalanced data classification in education domain,” in 2021 International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), IEEE, 2021, pp. 752–755.
[33] C.-C. Chang, Y.-Z. Li, H.-C. Wu, and M.-H. Tseng, “Melanoma detection using XGB classifier combined with feature extraction and K-means SMOTE techniques,” Diagnostics, vol. 12, no. 7, p. 1747, 2022.
[34] K. Swain et al., “Enhancing Stroke Prediction Using LightGBM With SMOTE-ENN and Fine-Tuning: A Comprehensive Analysis,” Cureus Journals, vol. 1, no. 1, 2024.
[35] R. Obiedat et al., “Sentiment analysis of customers’ reviews using a hybrid evolutionary SVM-based approach in an imbalanced data distribution,” IEEE Access, vol. 10, pp. 22260–22273, 2022.
[36] T. Wongvorachan, S. He, and O. Bulut, “A comparison of undersampling, oversampling, and SMOTE methods for dealing with imbalanced classification in educational data mining,” Information, vol. 14, no. 1, p. 54, 2023.
[37] M. Khairy, T. M. Mahmoud, and T. Abd-El-Hafeez, “The effect of rebalancing techniques on the classification performance in cyberbullying datasets,” Neural Comput Appl, vol. 36, no. 3, pp. 1049–1065, 2024.
[38] M. S. Mohammed, A. Al-Dhamari, W. Saeed, F. N. Al-Aswadi, S. A. M. Saleh, and M. N. Marsono, “Motion pattern-based scene classification using adaptive synthetic oversampling and fully connected deep neural network,” IEEE Access, vol. 11, pp. 119659–119675, 2023.
[39] P. Ewert, T. Orlowska-Kowalska, and K. Jankowska, “Effectiveness analysis of PMSM motor rolling bearing fault detectors based on vibration analysis and shallow neural networks,” Energies (Basel), vol. 14, no. 3, p. 712, 2021.
[40] H. A. H. Al-Najjar, B. Pradhan, R. Sarkar, G. Beydoun, and A. Alamri, “A new integrated approach for landslide data balancing and spatial prediction based on generative adversarial networks (GAN),” Remote Sens (Basel), vol. 13, no. 19, p. 4011, 2021.
[41] H. Shao, X. Liu, D. Zong, and Q. Song, “Optimization of diabetes prediction methods based on combinatorial balancing algorithm,” Nutr Diabetes, vol. 14, no. 1, p. 63, 2024.
[42] R. Hassanzadeh, M. Farhadian, and H. Rafieemehr, “Hospital mortality prediction in traumatic injuries patients: comparing different SMOTE-based machine learning algorithms,” BMC Med Res Methodol, vol. 23, no. 1, p. 101, 2023.
[43] J. Zhu et al., “Processing imbalanced medical data at the data level with assisted-reproduction data as an example,” BioData Min, vol. 17, no. 1, p. 29, 2024.
[44] L. Zhang and H. Sun, “ESA-GCN: An Enhanced Graph-Based Node Classification Method for Class Imbalance Using ENN-SMOTE Sampling and an Attention Mechanism,” Applied Sciences, vol. 14, no. 1, p. 111, 2024, doi: 10.3390/app14010111.
[45] D. Subitha and G. N. Nimeshika, “Mitigating imbalance: Cost-sensitive learning for enhanced weather prediction in imbalanced datasets,” in 2024 10th International Conference on Advanced Computing and Communication Systems (ICACCS), IEEE, 2024, pp. 1695–1698.
[46] A. Majeed and S. O. Hwang, “Solving truthfulness-privacy trade-off in mixed data outsourcing by using data balancing and attribute correlation-aware differential privacy,” IEEE Access, 2025.
[47] N. Mohanty, B. K. Behera, C. Ferrie, and P. Dash, “A quantum approach to synthetic minority oversampling technique (SMOTE),” Quantum Mach Intell, vol. 7, no. 1, p. 38, 2025.
[48] A. F. A. Alshamrani and F. Alshomran, “Optimizing Breast Cancer Mammogram Classification through a Dual Approach: A Deep Learning Framework Combining ResNet50, SMOTE, and Fully Connected Layers for Balanced and Imbalanced Data,” IEEE Access, 2024.
[49] I. Senyer Yapici and R. Uzun Arslan, “Predictive analytics for thyroid cancer recurrence: a feature selection and data balancing approach,” Eur Phys J Spec Top, pp. 1–21, 2025.
[50] F. U. Zaman, M. Z. Hossain, and M. K. Bhuiyan, “An Empirical Study on the Impact of SMOTE on Imbalanced Text Features for Review Rating Prediction in Bengali,” in 2023 26th International Conference on Computer and Information Technology (ICCIT), IEEE, 2023, pp. 1–5.
[51] L. Shen, “Prediction of Distribution Transformer Faults by Logistic Regression Models Based on Cost-Sensitive Learning,” in 2024 IEEE 7th International Conference on Information Systems and Computer Aided Education (ICISCAE), IEEE, 2024, pp. 510–515.
[52] S. Soleimani, M. Bahrami, and M. Vali, “Survival prediction from imbalanced colorectal cancer dataset using hybrid sampling methods and tree-based classifiers,” Sci Rep, vol. 15, no. 1, p. 14554, 2025.
[53] K. Omari, C. Taoussi, and A. Oukhatar, “Comparative Analysis of Undersampling, Oversampling, and SMOTE Techniques for Addressing Class Imbalance in Phishing Website Detection.,” International Journal of Advanced Computer Science & Applications, vol. 16, no. 2, 2025.
[54] A. Kanwal, N. Masood, G. Mustafa, M. A. Ghafoor, and S. Ayaz, “Mk-smote and m-smote: enhanced techniques for handling class imbalance problem,” Iran Journal of Computer Science, pp. 1–19, 2025.
[55] M. R. Islam, A. I. Chowdhury, S. Shama, and M. M. H. Lamyea, “Enhanced thyroid disease prediction using ensemble machine learning: a high-accuracy approach with feature selection and class balancing,” Discover Artificial Intelligence, vol. 5, no. 1, p. 9, 2025.
[56] G. Yang, G. Wang, L. Wan, X. Wang, and Y. He, “Utilizing SMOTE-TomekLink and machine learning to construct a predictive model for elderly medical and daily care services demand,” Sci Rep, vol. 15, no. 1, p. 8446, 2025.
[57] M. Mujahid et al., “Data oversampling and imbalanced datasets: an investigation of performance for machine learning and feature engineering,” J Big Data, vol. 11, no. 1, p. 87, 2024.
[58] M. Carvalho, A. J. Pinho, and S. Brás, “Resampling approaches to handle class imbalance: a review from a data perspective,” J Big Data, vol. 12, no. 1, p. 71, 2025.
[59] N. A. Firdausanti, T. N. Fatyanosa, M. Data, I. Mendonça, and M. Aritsugi, “Two-stage sampling: A framework for imbalanced classification with overlapped classes,” in 2022 IEEE International Conference on Big Data (Big Data), IEEE, 2022, pp. 271–280.
[60] W. C. Sleeman IV and B. Krawczyk, “Imbalanced Big Data Oversampling: Taxonomy, Algorithms, Software, Guidelines and Future Directions,” arXiv preprint arXiv:2107.11508, 2021.
[61] B. Krawczyk, “Learning from imbalanced data: open challenges and future directions,” Progress in artificial intelligence, vol. 5, no. 4, pp. 221–232, 2016.
[62] M. V. C. Aragão, M. de Freitas Carvalho, T. de Morais Pereira, F. A. P. de Figueiredo, and S. B. Mafra, “Enhancing AutoML Performance for Imbalanced Tabular Data Classification: A Self-Balancing Pipeline,” 2024.
[63] L. Ran, H. Sun, L. Gao, Y. Dong, and Y. Lu, “Meta-Hybrid: Integrate Meta-Learning to Enhance Class Imbalance Graph Learning,” Electronics (Basel), vol. 13, no. 18, p. 3769, 2024.
[64] A. M. Rahmani et al., “Artificial intelligence approaches and mechanisms for big data analytics: a systematic study,” PeerJ Comput Sci, vol. 7, p. e488, 2021.
[65] K. Lammers, V. Vaquet, and B. Hammer, “Continuous Fair SMOTE--Fairness-Aware Stream Learning from Imbalanced Data,” arXiv preprint arXiv:2505.13116, 2025.