Neural Network Performance Enhancement Using the Modified Orca Predation Algorithm for Time Series Forecasting: A Comparative Review

Syaharuddin Syaharuddin; Mariono Mariono; Alfiana Sahraini; Saba Mehmood; Wasim Raza

doi:10.52436/1.jutif.2026.7.4.4951

Authors

Syaharuddin Mathematics Education, Universitas Muhammadiyah Mataram, Indonesia
Mariono Mathematics Education, Universitas Muhammadiyah Mataram, Indonesia
Alfiana Sahraini Mathematics Education, Universitas Muhammadiyah Mataram, Indonesia
Saba Mehmood Department of Mathematics, University of Management and Technology, Pakistan
Wasim Raza Department of Applied Mathematics, University of Sargodha, Pakistan

DOI:

https://doi.org/10.52436/1.jutif.2026.7.4.4951

Keywords:

Neural Network, Orca Predation Algorithm, Forecasting, Time Series, Metaheuristic Optimization

Abstract

Neural Networks (NNs) are extensively used in time series forecasting due to their ability to learn nonlinear and complex temporal relationships. However, NN performance is frequently limited by training challenges, including slow convergence and suboptimal parameter optimization. This study aims to systematically examine the role of the Modified Orca Predation Algorithm (MOPA) in enhancing neural network performance for time series forecasting, particularly in comparison with other metaheuristic optimization approaches. This research employed a qualitative method using a Systematic Literature Review (SLR) approach. Relevant journal and conference articles published between 2015 and 2025 were collected from reputable scientific databases. The selected studies were analyzed thematically and bibliometrically using VOSviewer to identify research trends, application domains, and performance characteristics of MOPA-based neural network optimization. The results indicate that the integration of MOPA into neural network training consistently improves convergence speed, forecasting accuracy, and model stability across various application domains. Compared to conventional optimization methods, MOPA demonstrates superior capability in handling nonlinear and volatile time series data, particularly in energy forecasting, financial time series analysis, and climate-related prediction. The findings also reveal that MOPA-based optimization contributes to better generalization performance by reducing prediction error and output variance. This study provides a structured synthesis of recent research on MOPA-enhanced neural networks and contributes to the understanding of metaheuristic optimization strategies in time series forecasting. The results serve as a reference for researchers in selecting effective optimization methods for neural network-based forecasting models.

Downloads

Download data is not yet available.

References

X. Kong, Z. Chen, W. Liu, et al., “Deep learning for time series forecasting: a survey,” Int. J. Mach. Learn. Cybern., vol. 16, pp. 5079–5112, 2025, doi: 10.1007/s13042-025-02560-w.

B. Akay, D. Karaboga, and R. Akay, “A comprehensive survey on optimizing deep learning models by metaheuristics,” Artif. Intell. Rev., vol. 55, no. 2, pp. 829–894, 2022, doi: 10.1007/s10462-021-09992-0

G. Yan, J. Wang, and M. Thwin, “A new Frontier in electric load forecasting: The LSV/MOPA model optimized by modified orca predation algorithm,” Heliyon, vol. 10, no. 2, 2024, doi: 10.1016/j.heliyon.2024.e24183

M. M. Emam, H. A. El-Sattar, E. H. Houssein, and S. Kamel, “Modified orca predation algorithm: developments and perspectives on global optimization and hybrid energy systems,” Neural Comput. Appl., vol. 35, no. 20, pp. 15051–15073, 2023, doi: 10.1007/s00521-023-08492-2

M. E. Hamzehie, M. Fattahi, H. Najibi, B. Van der Bruggen, and S. Mazinani, “Application of artificial neural networks for estimation of solubility of acid gases (H2S and CO2) in 32 commonly ionic liquid and amine solutions,” J. Nat. Gas Sci. Eng., vol. 24, pp. 106–114, 2015, doi: 10.1016/j.jngse.2015.03.014

B. Pashshoev and D. A. Petrusevich, “Neural network analysis in time series forecasting,” Russ. Technol. J., vol. 12, no. 4, pp. 106–116, 2024, doi: 10.32362/2500-316X

L.-Y. Niu, Y. Wei, W.-B. Liu, J.-Y. Long, and T. Xue, “Research Progress of spiking neural network in image classification: a review,” Appl. Intell., vol. 53, no. 16, pp. 19466–19490, 2023, doi: 10.1007/s10489-023-04553-0

S. Syaharuddin, F. Fatmawati, and H. Suprajitno, “A meta-analysis of the implementation of ANN back propagation methods in time series data forecasting: Case studies in Indonesia,” in AIP Conference Proceedings, AIP Publishing, 2022, doi: 10.1063/5.0102174

C. Lv, Y. Wang, D. Han, X. Zheng, X. Huang, and D. Li, “Efficient and effective time-series forecasting with spiking neural networks,” arXiv Prepr. arXiv2402.01533, 2024, doi: 10.48550/arXiv.2402.01533

A. B. Putra, “PSO-based hyperparameter tuning of CNN multivariate time-series analysis,” J. Online Inform., vol. 7, no. 2, pp. 193–202, 2022, doi: 10.15575/join.v7i2.858

P. P. P. A. N. W. F. Ilmi, R. H. Zer, and F. N. Tambunan, “Optimization of backpropagation method with PSO to improve prediction of land area and rice productivity,” SinkrOn, vol. 8, no. 4, pp. 2503–2509, Oct. 2024, doi: 10.33395/sinkron.v8i4.14142.

S. Surono et al., “Optimization of Markov weighted fuzzy time series forecasting using genetic algorithm (GA) and particle swarm optimization (PSO),” Emerg. Sci. J., vol. 6, no. 6, pp. 1375–1393, 2022, doi: 10.28991/ESJ-2022-06-06-010.

R. Alkanhel, E.-S. M. El-kenawy, D. L. Elsheweikh, A. A. Abdelhamid, A. Ibrahim, and D. S. Khafaga, “Metaheuristic optimization of time series models for predicting networks traffic,” C. Mater. Contin., vol. 75, no. 1, pp. 427–442, 2023, doi: 10.32604/cmc.2023.032885

R. Abdulkadirov, P. Lyakhov, and N. Nagornov, “Survey of optimization algorithms in modern neural networks,” Mathematics, vol. 11, no. 11, p. 2466, 2023, doi: 10.3390/math11112466.

Y.-T. Bai, W. Jia, X.-B. Jin, T.-L. Su, J.-L. Kong, and Z.-G. Shi, “Nonstationary time series prediction based on deep echo state network tuned by Bayesian optimization,” Mathematics, vol. 11, no. 6, p. 1503, 2023, doi: 10.3390/math11061503.

H. Yun et al., “Accurate prediction and reliable parameter optimization of neural network for semiconductor process monitoring and technology development,” Adv. Intell. Syst., vol. 5, no. 9, p. 2300089, 2023, doi: 10.1002/aisy.202300089.

H. Zhang, K. Hao, L. Gao, B. Wei, and X. Tang, “Optimizing deep neural networks through neuroevolution with stochastic gradient descent,” IEEE Trans. Cogn. Dev. Syst., vol. 15, no. 1, pp. 111–121, 2022 doi: 10.1109/TCDS.2022.3146327.

G. Yenurkar and S. Mal, “Future forecasting prediction of Covid-19 using hybrid deep learning algorithm,” Multimed. Tools Appl., vol. 82, no. 15, pp. 22497–22523, 2023, doi: 10.1007/s11042-022-14219-7.

M. Kaveh and M. S. Mesgari, “Application of meta-heuristic algorithms for training neural networks and deep learning architectures: A comprehensive review,” Neural Process. Lett., vol. 55, no. 4, pp. 4519–4622, 2023, doi: 10.1007/s11063-022-11055-6.

F. Zito, E.-G. Talbi, C. Cavallaro, V. Cutello, and M. Pavone, “Metaheuristics in automated machine learning: strategies for optimization,” Intell. Syst. Appl., vol. 26, p. 200532, 2025, doi: 10.1016/j.iswa.2025.200532.

Sonia and R. Nath, “A systematic review of various load balancing approaches in cloud computing utilizing machine learning and deep learning,” Int. J. Data Sci. Anal., pp. 1–23, 2025, doi: 10.1007/s41060-025-00718-x.

M. Najamuddin and S. Fatima, “A Hybrid BRNN-ARIMA Model for financial time series forecasting,” Sukkur IBA J. Comput. Math. Sci., vol. 6, no. 1, pp. 62–71, 2022, doi: 10.30537/sjcms.v6i1.1027.

C. Han, H. Park, Y. Kim, and G. Gim, “Hybrid CNN-LSTM based time series data prediction model study,” in IEEE/ACIS International Conference on Big Data, Cloud Computing, and Data Science Engineering, Springer, pp. 43–54, 2022, doi: 10.1007/978-3-031-19608-9_4

G. Li and N. Yang, “A hybrid sarima‐lstm model for air temperature forecasting,” Adv. Theory Simulations, vol. 6, no. 2, p. 2200502, 2023, doi: 10.1002/adts.202200502.

S. Anuyah, M. K. Singh, and H. Nyavor, “Advancing clinical trial outcomes using deep learning and predictive modelling: Bridging precision medicine and patient-centered care,” arXiv Prepr. arXiv2412.07050, 2024, doi: 10.48550/arXiv.2412.07050.

O. Efthimiou et al., “Measuring the performance of prediction models to personalize treatment choice,” Stat. Med., vol. 42, no. 8, pp. 1188–1206, 2023, doi: 10.1002/sim.9665.

Z. Wang, Y. Song, L. Pang, S. Li, and G. Sun, “Attention-enhanced CNN-LSTM model for exercise oxygen consumption prediction with multi-source temporal features,” Sensors, vol. 25, no. 13, p. 4062, 2025, doi: 10.3390/s25134062.

M. Jaloli, W. Lipscomb, and M. Cescon, “Incorporating the effect of behavioral states in multi-step ahead deep learning based multivariate predictors for blood glucose forecasting in type 1 diabetes,” BioMedInformatics, vol. 2, no. 4, pp. 715–726, 2022, doi: 10.3390/biomedinformatics2040048.

A. V Panteleev, I. A. Belyakov, and A. A. Kolessa, “Comparative analysis of optimization strategies by software complex ‘Metaheuristic nature-inspired methods of global optimization,’” in Journal of Physics: Conference Series, IOP Publishing, p. 12002, 2022, doi: 10.1088/1742-6596/2308/1/012002

S. Bashetty, K. Raja, S. Adepu, and A. Jain, “Optimizers in Deep Learning: A Comparative Study and Analysis,” Int J Res Appl Sci Eng Technol, vol. 10, no. 12, pp. 1032–1039, 2022, doi: 10.22214/ijraset.2022.48050.

H. Y. Chong, H. J. Yap, S. C. Tan, K. S. Yap, and S. Y. Wong, “Advances of metaheuristic algorithms in training neural networks for industrial applications,” Soft Comput., vol. 25, no. 16, pp. 11209–11233, 2021, doi: 10.1007/s00500-021-05886-z.

M. Abd Elaziz et al., “Advanced metaheuristic optimization techniques in applications of deep neural networks: a review,” Neural Comput. Appl., pp. 1–21, 2021, doi: 10.1007/s00521-021-05960-5.

J. Yan, G. Hu, H. Jia, A. G. Hussien, and L. Abualigah, “GPSOM: group-based particle swarm optimization with multiple strategies for engineering applications,” J. Big Data, vol. 12, no. 1, p. 114, 2025, doi: 10.1186/s40537-025-01140-7.

J. Lacotte and M. Pilanci, “Adaptive and oblivious randomized subspace methods for high-dimensional optimization: Sharp analysis and lower bounds,” IEEE Trans. Inf. Theory, vol. 68, no. 5, pp. 3281–3303, 2022, doi: 10.1109/TIT.2022.3146206.

H. Abbaszadehpeivasti, E. de Klerk, and M. Zamani, “Convergence rate analysis of randomized and cyclic coordinate descent for convex optimization through semidefinite programming,” arXiv Prepr. arXiv2212.12384, 2022, doi: 10.48550/arXiv.2212.12384.

X. Jin, L. Fan, and Y. Yao, “Convolutional neural network optimization algorithm‐based magnetic resonance imaging in analysis of chronic pain caused by the myofascial trigger point,” Sci. Program., vol. 2021, no. 1, p. 4505147, 2021, doi: 10.1155/2021/4505147.

Y. A. Singgalen, J. J. Sudirman No, K. Semanggi, K. Setiabudi, and K. Jakarta Selatan, “Social network and sentiment analysis of product reviews (case of smartwatch product content),” Int. J. Soc. Sci., vol. 13, no. 4, pp. 255–267, 2024. https://ijosea.isha.or.id/index.php/ijosea/article/download/426/122/1703

S. Manoochehri, M. Zamani, M. Afshari, A. R. Soltanian, and Z. Manoochehri, “Evaluating the performance of different machine learning algorithms based on SMOTE in predicting musculoskeletal disorders in elementary school students,” BMC Med. Res. Methodol., vol. 25, no. 1, p. 227, 2025, doi: 10.1186/s12874-025-02654-7.

W. Pannakkong, K. Thiwa-Anont, K. Singthong, P. Parthanadee, and J. Buddhakulsomsiri, “Hyperparameter tuning of machine learning algorithms using response surface methodology: A case study of ANN, SVM, and DBN,” Math. Probl. Eng., vol. 2022, no. 1, p. 8513719, 2022, doi: 10.1155/2022/8513719.

R. Wen, M. Wang, W. Bian, et al., “Machine learning-based prediction of early neurological deterioration after intravenous thrombolysis for stroke: insights from a large multicenter study,” Front. Neurol., vol. 15, p. 1408457, 2024, doi: 10.3389/fneur.2024.1408457.

Y. Yennimar, A. Rasid, and S. Kenedy, “Implementation of support vector machine algorithm with hyper-tuning randomized search in stroke prediction,” J. Sist. Inf. dan Ilmu Komput., vol. 6, no. 2, pp. 61–65, 2023, doi: 10.34012/jurnalsisteminformasidanilmukomputer.v6i2.3479.

A. Saekhu, B. Berlilana, and D. I. S. Saputra, “Comparative analysis of data balancing techniques for machine learning classification on imbalanced student perception datasets,” J. Tek. Inform., vol. 6, no. 2, pp. 627–640, 2025, doi: 10.52436/1.jutif.2025.6.2.4286.

G. Yan, J. Wang, and M. Thwin, “A new frontier in electric load forecasting: the LSV/MOPA model optimized by modified orca predation algorithm,” Heliyon, vol. 10, no. 2, 2024, doi: 10.1016/j.heliyon.2024.e24183.

M. M. Emam, H. A. El-Sattar, E. H. Houssein, and S. Kamel, “Modified orca predation algorithm: developments and perspectives on global optimization and hybrid energy systems,” Neural Comput. Appl., vol. 35, no. 20, pp. 15051–15073, 2023, doi: 10.1007/s00521-023-08492-2.

G. H. H. Nayak et al., “Meta-transformer: leveraging metaheuristic algorithms for agricultural commodity price forecasting,” J. Big Data, vol. 12, no. 1, p. 138, 2025, doi: 10.1186/s40537-025-01196-5.