Optimizing Classification Algorithms With Smote And Metaheuristic Optimization For Imbalanced Breast Cancer Data

Authors

  • Yusup Maolani Magister Ilmu Komputer, Universitas Budi Luhur, Indonesia
  • Samidi Magister Ilmu Komputer, Universitas Budi Luhur, Indonesia

DOI:

https://doi.org/10.52436/1.jutif.2026.7.5.5307

Keywords:

Breast Cancer Diagnosis, Imbalanced Data, Metaheuristic Optimization, Random Forest, SMOTE

Abstract

Class imbalance remains a critical challenge in medical classification, particularly in breast cancer diagnosis, where misclassification of the minority class can have severe clinical consequences. This study investigates the impact of combining the Synthetic Minority Over-sampling Technique (SMOTE) and metaheuristic optimization on the performance of three traditional classifiers: Support Vector Machine (SVM), Naïve Bayes, and Random Forest, using the Wisconsin Diagnostic Breast Cancer (WDBC) dataset. Four experimental scenarios were evaluated, including baseline models, models with SMOTE, models with metaheuristic optimization, and a hybrid approach integrating both techniques. Performance was assessed using accuracy, precision, recall, F1-score, and Area Under the Curve (AUC). The results indicate that the effectiveness of the hybrid approach is highly model-dependent. SVM demonstrated the most consistent improvement, particularly when combined with SMOTE and Simulated Annealing, achieving a balanced performance across evaluation metrics with an AUC of 0.9960. In contrast, Random Forest exhibited stable performance across all scenarios with limited sensitivity to additional optimization, while Naïve Bayes showed performance degradation when combined with SMOTE, indicating potential disruption of the feature independence assumption due to synthetic data generation. These findings highlight that SMOTE and metaheuristic optimization are not universally beneficial but can enhance classification performance under specific conditions. This study provides empirical evidence to support the selective application of hybrid optimization strategies for imbalanced medical data and contributes to the advancement of intelligent classification methods in the field of artificial intelligence.

Downloads

Download data is not yet available.

References

M. I. C. Rachmatullah, "The Application of Repeated SMOTE for Multi Class Classification on Imbalanced Data," MATRIK: Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer, vol. 22, no. 1, pp. 13–24, 2022, doi: 10.30812/matrik.v22i1.1803

W. Satriaji and R. Kusumaningrum, "Effect of Synthetic Minority Oversampling Technique (SMOTE), Feature Representation, and Classification Algorithm on Imbalanced Sentiment Analysis," in 2018 2nd International Conference on Informatics and Computational Sciences (ICICoS), pp. 99–103, 2018, doi: 10.1109/ICICOS.2018.8621648.

X. Liu et al., "Intelligent fault diagnosis methods toward gas turbine: A review," Chinese Journal of Aeronautics, vol. 37, no. 4, pp. 93–120, 2024, doi: 10.1016/j.cja.2023.09.024.

E. A. Mahareek, A. S. Desuky, and H. A. El-Zhni, "Simulated annealing for svm parameters optimization in student’s performance prediction," Bulletin of Electrical Engineering and Informatics, vol. 10, no. 3, pp. 1211–1219, 2021, doi: 10.11591/eei.v10i3.2855.

D. Saputra, W. S. Dharmawan, and W. Irmayani, "Performance Comparison of the SVM and SVM-PSO Algorithms for Heart Disease Prediction," International Journal of Advanced Data and Information Systems, vol. 3, no. 2, pp. 74–86, 2022, doi: 10.25008/ijadis.v3i2.1243.

I. Taufiq, T. A. Y. Siswa, and W. J. Pranoto, "Model Optimasi Random Forest dengan PSO-CHI-SM dalam Mengatasi High Dimensional dan Imbalanced Data Banjir Kota Samarinda," Jurnal Teknologi Sistem Informasi dan Aplikasi, vol. 7, no. 3, pp. 1267–1279, 2024, doi: 10.32493/jtsi.v7i3.41632.

M. I. C. Rachmatullah, “Penerapan SMOTE untuk Meningkatan Kinerja Klasifikasi Penilaian Kredit,” JURIKOM (Jurnal Riset Komputer), vol. 10, no. 1, pp. 302–309, Feb. 2023, doi: 10.30865/jurikom.v10i1.5612.

A. Damari, T. A. Y. Siswa, and W. J. Pranoto, “Implementation of the PSO-SMOTE Method on the Naive Bayes Algorithm to Address Class Imbalance in Landslide Disaster Data,” Jurnal Inovtek Polbeng – Seri Informatika, vol. 10, no. 1, Mar. 2025, doi: 10.35314/7wcvrb72

F. O. Awalullaili, D. Ispriyanti, and T. Widiharih, "Klasifikasi Penyakit Hipertensi Menggunakan Metode Svm Grid Search Dan Svm Genetic Algorithm (Ga)," Jurnal Gaussian, vol. 11, no. 4, pp. 488–498, 2023, doi: 10.14710/j.gauss.11.4.488-498.

B. K. Khotimah, M. Miswanto, and H. Suprajitno, "Optimization of feature selection using genetic algorithm in naïve Bayes classification for incomplete data," International Journal of Intelligent Engineering and Systems, vol. 13, no. 1, pp. 334–343, 2020, doi: 10.22266/ijies2020.0229.31.

M. Nkongolo, J. P. van Deventer, S. M. Kasongo, S. R. Zahra, and J. Kipongo, “A cloud-based optimization method for zero-day threats detection using genetic algorithm and ensemble learning,” Electronics, vol. 11, no. 11, Art. no. 1749, 2022, doi: 10.3390/electronics11111749.

Y. Religia and Amali, “Perbandingan optimasi feature selection pada Naïve Bayes untuk klasifikasi kepuasan airline passenger,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 5, no. 3, pp. 527–533, 2021, doi: 10.29207/resti.v5i3.3086.

Y. Zhang, L. Deng, and B. Wei, "Imbalanced Data Classification Based on Improved Random-SMOTE and Feature Standard Deviation," Mathematics, vol. 12, no. 11, pp. 1–17, 2024, doi: 10.3390/math12111709.

B. Nemade, V. Bharadi, S. S. Alegavi, and B. Marakarkandy, “A comprehensive review: SMOTE-based oversampling methods for imbalanced classification techniques, evaluation, and result comparisons,” International Journal of Intelligent Systems and Applications in Engineering, vol. 11, no. 9s, pp. 790–803, 2023. [Online]. Available: https://www.ijisae.org/index.php/IJISAE/article/view/3268

Y. Yang, H. A. Khorshidi, and U. Aickelin, "A review on over-sampling techniques in classification of multi-class imbalanced datasets: insights for medical problems," Frontiers in Digital Health, vol. 6, 2024, doi: 10.3389/fdgth.2024.1430245.

M. Carvalho, A. J. Pinho, and S. Brás, "Resampling approaches to handle class imbalance: a review from a data perspective," Journal of Big Data, vol. 12, no. 1, 2025, doi: 10.1186/s40537-025-01119-4..

D. S. Assyifa and A. Luthfiarta, "SMOTE-Tomek Re-sampling Based on Random Forest Method to Overcome Unbalanced Data for Multi-class Classification," Inform: Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi, vol. 9, no. 2, pp. 151–160, 2024, doi: 10.25139/inform.v9i2.8410.

M. Mujahid et al., "Data oversampling and imbalanced datasets: an investigation of performance for machine learning and feature engineering," Journal of Big Data, vol. 11, no. 1, 2024, doi: 10.1186/s40537-024-00943-4.

B. Benaissa, M. Kobayashi, M. Al Ali, T. Khatir, and M. E. A. E. Elmeliani, "Metaheuristic optimization algorithms: An overview," HCMCOU Journal of Science – Advances in Computational Structures, vol. 14, no. 1, pp. 33–61, 2024, doi: 10.46223/hcmcoujs.acs.en.14.1.47.2024.

G. S. Kashyap, M. T. Nafis, and S. Wazir, “A study of hybrid and evolutionary metaheuristics for single hidden layer feedforward neural network architecture,” Journal of Experimental & Theoretical Artificial Intelligence, vol. 38, no. 3, pp. 309–330, 2026, doi: 10.1080/0952813X.2026.2634167

F. Zito, E. G. Talbi, C. Cavallaro, V. Cutello, and M. Pavone, "Metaheuristics in automated machine learning: Strategies for optimization," Intelligent Systems with Applications, vol. 26, p. 200532, 2025, doi: 10.1016/j.iswa.2025.200532.

B. F. Azevedo, A. M. A. C. Rocha, and A. I. Pereira, Hybrid approaches to optimization and machine learning methods: a systematic literature review, vol. 113, no. 7. Springer US, 2024, doi: 10.1007/s10994-023-06467-x.

M. M. Hossin et al., "Breast cancer detection: an effective comparison of different machine learning algorithms on the Wisconsin dataset," Bulletin of Electrical Engineering and Informatics, vol. 12, no. 4, pp. 2446–2456, 2023, doi: 10.11591/eei.v12i4.4448.

A. I. Jony and A. K. B. Arnob, "Deep Learning Paradigms for Breast Cancer Diagnosis: A Comparative Study on Wisconsin Diagnostic Dataset," Malaysian Journal of Science and Advanced Technology, vol. 4, no. 2, pp. 109–117, 2024, doi: 10.56532/mjsat.v4i2.245.

A. Tawakuli, B. Havers, V. Gulisano, D. Kaiser, and T. Engel, "Survey: Time-series data preprocessing: A survey and an empirical analysis," Journal of Engineering Research, vol. 13, no. 2, pp. 674–711, 2025, doi: 10.1016/j.jer.2024.02.018.

B. L. Ortiz et al., "Data Preprocessing Techniques for AI and Machine Learning Readiness: Scoping Review of Wearable Sensor Data in Cancer Care," JMIR mHealth and uHealth, vol. 12, p. e59587, 2024, doi: 10.2196/59587

R. Guido, S. Ferrisi, D. Lofaro, and D. Conforti, "An Overview on the Advancements of Support Vector Machine Models in Healthcare Applications: A Review," Information, vol. 15, no. 4, 2024, doi: 10.3390/info15040235.

I. Malashin, V. Tynchenko, A. Gantimurov, V. Nelyub, and A. Borodulin, "Support Vector Machines in Polymer Science: A Review," Polymers, vol. 17, no. 4, pp. 1–26, 2025, doi: 10.3390/polym17040491.

I G. A. N. Lestari and I K. A. A. Aryanto, "Peningkatan Akurasi Klasifikasi Kualitas Udara melalui Oversampling dengan Metode Support Vector Machine dan Random Forest," Jurnal Sistem dan Informatika, vol. 18, no. 1, pp. 1–9, 2023, doi: 10.30864/jsi.v18i1.596.

S. A. Wicaksono et al., "Naive Bayes Analysis for Nutritional Fulfillment Prediction in Children," Journal of Applied Engineering and Technological Science, vol. 6, no. 2, pp. 1135–1147, 2025, doi: 10.37385/jaets.v6i2.6105.

W. William and T. Handhayani, "Perbandingan Kinerja Naïve Bayes dan Random Forest dalam Mendeteksi Berita Palsu," JISKA (Jurnal Informatika Sunan Kalijaga), vol. 10, no. 2, pp. 137–144, 2025, doi: 10.14421/jiska.2025.10.2.137-144.

E. R. Arumi, S. A. Subrata, and A. Rahmawati, "Implementation of Naïve bayes Method for Predictor Prevalence Level for Malnutrition Toddlers in Magelang City," JURNAL RESTI, vol. 5, no. 158, pp. 201–207, 2026.

M. C. Untoro et al., "Evaluation of Decision Tree, K-NN, Naive Bayes and SVM with MWMOTE on UCI Dataset," Journal of Physics: Conference Series, vol. 1477, no. 3, p. 032005, 2020, doi: 10.1088/1742-6596/1477/3/032005

Y. Zhang, L. Luo, X. Ji, and Y. Dai, "Improved random forest algorithm based on decision paths for fault diagnosis of chemical process with incomplete data," Sensors, vol. 21, no. 20, p. 6715, 2021, doi: 10.3390/s21206715.

R. Widyastuti et al., "Performance Analysis of Random Forest Algorithm in Automatic Building Segmentation with Limited Data," ISPRS International Journal of Geo-Information, vol. 13, no. 7, p. 235, 2024, doi: 10.3390/ijgi13070235.

S. D. Amalia, M. A. Barata, and P. E. Yuwita,“Optimization of Random Forest algorithm with backward elimination method in classification of academic stress levels,”Journal of Applied Informatics and Computing, vol. 9, no. 3, pp. 633–641, Jun. 2025, doi: 10.30871/jaic.v9i3.9280.

G. Papazoglou and P. Biskas, "Review and Comparison of Genetic Algorithm and Particle Swarm Optimization in the Optimal Power Flow Problem," Energies, vol. 16, no. 3, p. 1152, 2023, doi: 10.3390/en16031152.

A. U. Dullah, A. Y. Darmawan, D. A. A. Pertiwi, and J. Unjung, "Extreme Gradient Boosting Model with SMOTE for Heart Disease Classification," JISKA (Jurnal Informatika Sunan Kalijaga), vol. 10, no. 1, pp. 48–62, 2025, doi: 10.14421/jiska.2025.10.1.48-62

M. Heydarian, T. E. Doyle, and R. Samavi, "MLCM: Multi-Label Confusion Matrix," IEEE Access, vol. 10, pp. 19083–19095, 2022, doi: 10.1109/ACCESS.2022.3151048

S. Sathyanarayanan, "Confusion Matrix-Based Performance Evaluation Metrics," African Journal of Biomedical Research, vol. 27, no. 4, pp. 4023–4031, 2024, doi: 10.53555/ajbr.v27i4s.4345

G. Rawashdeh, R. Bin Mamat, Z. B. A. Bakar, and N. H. A. Rahim, "Comparative between optimization feature selection by using classifiers algorithms on spam email," International Journal of Electrical and Computer Engineering (IJECE), vol. 9, no. 6, pp. 5479–5485, 2019, doi: 10.11591/ijece.v9i6.pp5479-5485

S. M. Abd El-Salam et al., "Performance of machine learning approaches on prediction of esophageal varices for Egyptian chronic hepatitis C patients," Informatics in Medicine Unlocked, vol. 17, p. 100267, 2019, doi: 10.1016/j.imu.2019.100267.

Additional Files

Published

2026-10-10

How to Cite

[1]
Y. . Maolani and S. Samidi, “Optimizing Classification Algorithms With Smote And Metaheuristic Optimization For Imbalanced Breast Cancer Data”, J. Tek. Inform. (JUTIF), vol. 7, no. 5, pp. 4600–4620, Oct. 2026.