IMPROVED SUPPORT VECTOR MACHINE PERFORMANCE USING PARTICLE SWARM OPTIMIZATION IN CREDIT RISK CLASSIFICATION

Aditiarno Manik; Erna Budhiarti Nababan; Tulus Tulus

doi:10.20884/1.jutif.2022.3.6.615

Aditiarno Manik Faculty of Computer Science and Information Technology, Universitas Sumatera Utara, Indonesia
Erna Budhiarti Nababan Faculty of Computer Science and Information Technology, Universitas Sumatera Utara, Indonesia
Tulus Faculty of Mathematics and Natural Sciences, Universitas Sumatera Utara, Indonesia

DOI: https://doi.org/10.20884/1.jutif.2022.3.6.615

Keywords: Classification, Credit Data, Particle Swarm Optimization, Support Vector Machine, SVM Parameter

Abstract

In Classification using Support Vector Machine (SVM), each kernel has parameters that affect the classification accuracy results. This study examines the improvement of SVM performance by selecting parameters using Particle Swarm Optimization (PSO) on credit risk classification, the results of which are compared with SVM with random parameter selection. The classification performance is evaluated by applying the SVM classification to the Credit German benchmark credit data set and the private credit data set which is a credit data set issued from a local bank in North Sumatra. Although it requires a longer execution time to achieve optimal accuracy values, the SVM+PSO combination is quite effective and more systematic than trial and error techniques in finding SVM parameter values, so as to produce better accuracy. In general, the test results show that the RBF kernel is able to produce higher accuracy and f1-scores than linear and polynomial kernels. SVM classification with optimization using PSO can produce better accuracy than classification using SVM without optimization, namely the determination of parameters randomly. Credit data classification accuracy increased to 92.31%.

Downloads

Download data is not yet available.

References

M.A. Mukid, T. Widiharih, A. Rusgiono, and A. Prahutama, “Credit Scoring Analysis Using Weighted K Nearest Neighbor,” Journal of Physics: Conference Series 1025, 2018.

H. Leidiyana, “Penerapan Algoritma K-Nearest Neighbor untuk Penentuan Resiko Kredit Kepemilikan Kendaraan Bermotor,” Jurnal Penelitian Ilmu Komputer, System Embedded & Logic, Vol. 1, Issue: 1, pp: 65-76, 2013.

M.F. Pasha, M.D. Sikder, A. Rana, M.S. Lidya, R. Purba, & R. Budiarto, “Experimenting Diabetic Retinopathy Classification Using Retinal Images,” Data Science: Journal of Computing and Applied Informatics, vol. 5, no. 1, pp. 28-38, 2021.

J. Abellán and J.G. Castellano, “A Comparative Study on Base Classifiers in Ensemble Methods For Credit Scoring,” Expert Systems with Applications, Vol. 73, pp: 1-10, 2017.

B. Baesens, T.V. Gestel, S. Viaene, and M. Stepanova, “Benchmarking State-Of-The-Art Classification Algorithms for Credit Scoring,” Journal of the Operational Research Society, Vol. 54, Issue: 6, pp: 627-635, 2003.

Sudianto, P. Wahyuningtias, H. W. Utami, U. A. Raihan, H. N. Hanifah, and Y. N. Adanson, “COMPARISON OF RANDOM FOREST AND SUPPORT VECTOR MACHINE METHODS ON TWITTER SENTIMENT ANALYSIS (CASE STUDY: INTERNET SELEBGRAM RACHEL VENNYA ESCAPE FROM QUARANTINE)”, J. Tek. Inform. (JUTIF), vol. 3, no. 1, pp. 141-145, Feb. 2022.

T. Moro, G. Tinsley, A. Bianco, G. Marcolin, Q.F Pacelli, G. Battaglia, A. Palma, P. Gentil, M. Neri, and A. Paoli, “Effects of eight weeks of time-restricted feeding (16/8) on basal metabolism, maximal strength, body composition, inflammation, and cardiovascular risk factors in resistance-trained males,” Journal of Translational Medicine, Vol 14, Issue: 1, pp: 1-10, 2016.

H.A. Alakaa, L.O. Oyedele, H.A. Owolabi, V. Kumar, O. Saheed, S.O. Ajayi, O.O. Akinadef, and M. Bilal, “Systematic Review of Bankruptcy Prediction Models: Towards A Framework For Tool Selection,” Expert Systems with Applications, Vol. 94, pp: 164-184, 2018.

S. Yenaeng, S. Saelee, and W. Samai, “Automatic Medical Case Study Essay Scoring by Support Vector Machine and Genetic Algorithms,” International Journal of Information and Education Technology, Vol. 4, Issue 2, pp: 132-137, 2014.

C. Huang and C. Wang, “A GA-Based Feature Selection and Parameters Optimizationfor Support Vector Machines,” Expert Systems with Applications, Vol. 31, Issue 2, pp: 231-240, 2006.

A.T. Abolhassani and M. Yaghoobi, “Stock Price Forecasting Using PSO SVM,” Advanced Computer Theory and Engineering, pp. 352-356, 2010.

R. Habibi, “SVM Performance Optimization Using PSO for Breast Cancer Classification,” Budapest International Research in Exact Science, Vol. 3, No. 1, 2021.

Y. Tang, and J. Zhou, “The Performance of PSO-SVM in Inflation Forecasting,” International Conference on Service Systems and Service Management (ICSSSM) IEEE, 2015.

P. Danenas & G. Garsva, “Credit Risk Evaluation Using SVM-Based Classifier,” Lecture Notes in Business Information Processing, pp: 7–12, 2010.

P. Li and H. Xiao, “An Improved Quantum-Behaved Particle Swarm Optimization Algorithm,” Applied Intelligence, Vol. 40, Issue 3, pp: 479–496, 2013.

Ivandari, T. Chasanah, S. Binabar, and M. Karomi, “Data Attribute Selection with Information Gain to Improve Credit Approval Classification Performance using K-Nearest Neighbor Algorithm,” International Journal of Islamic Business and Economics (IJIBEC), Vol. 13, 2017.

L. Gafarova, “Usage of Artificial Neural Network and Support Vector Machine model for classification of Credit Scores,” Tesis, Khazar University, Azerbaijan, 2017.

S. Maldonado, C. Bravo, J. López, and J. Péreza, “Integrated Framework For Profit-Based Feature Selection And SVM Classification In Credit Scoring,” Decision Support Systems, Vol. 104, pp: 113-121, 2017.

Hartono, O.S. Sitompul, Tulus, and E.B. Nababan, “Biased Support Vector Machine and Weighted-Smote In Handling Class Imbalance Problem,” International Journal of Advances in Intelligent Informatics, Vol. 4, no. 1, pp: 21–27, 2018.

L. Yu, R. Zhou, L. Tang, and R. Chen, “A DBN-Based Resampling SVM Ensemble Learning Paradigm for Credit Classification With Imbalanced Data,” Applied Soft Computing, Vol. 69, pp: 192-202, 2018.

J. Han, W. Jiang, C. Dai, and H. Ma, “The Design of Diabetic Retinopathy Classifier Based on Parameter Optimization SVM,” International Conference on Intelligent Informatics and Biomedical Sciences, Vol. 3, pp: 52–58, 2018.

Y. Xie, Y. L. Murphey, and D.S. Kochhar, “SVM Parameter Optimization Using Swarm Intelligence for Learning from Big Data,” International Conference on Computational Collective Intelligence (ICCCI): Lecture Notes in Computer Science, Vol. 11055, pp: 469-478, 2018.

E. Prasetyo, “Data Mining – Mengolah Data Menjadi Informasi Menggunakan Matlab,” Edisi 1, Penerbit Andi, Yogyakarta, 2014.

H. Al-Azies, D. Trishnanti, and E. Mustikawati, “Comparison of Kernel Support Vector Machine (SVM) in Classification of Human Development Index (HDI),” IPTEK Journal of Proceedings Series, No. 6, ISSN (2354-6026) 53, The 1st International Conference on Global Development - ICODEV, November 19th, 2019, Rectorate Building, ITS Campus, Sukolilo, Surabaya, Indonesia, 2019.