Hybrid Neural Network-Based Road Damage Detection Using CNN-RNN and CNN-MLP Models
DOI:
https://doi.org/10.52436/1.jutif.2025.6.3.4435Keywords:
Convolutional Neural Network, Damaged Road Detection, MultiLayer Perceptron, Recurrent Neural NetworkAbstract
Currently, there are many applications of image processing in various fields. One of them is the recognition of paved road images. Detection through images helps in handling infrastructure development roads. With the advancement of technology, especially in the field of deep learning, the process of detecting road damage can be done automatically and more efficiently. The road damage detection system can be integrated into the smart city system to monitor infrastructure conditions in real time. This study will use a combined deep learning algorithm between Convolutional Neural Network- Recurrent Neural Network (CNN-RNN) and as a comparison using Convolutional Neural Network- MultiLayer Perceptrons (CNN-MLP). The study aims to analyze the accuracy of using the CNN-RNN and CNN-MLP algorithms for detecting paved roads that have categories of undamaged roads, damaged roads, and damaged roads with holes. The detection of paved roads has complex details so an algorithm that has good performance with high accuracy is needed. The results of the study showed that the CNN-RNN hybrid had a better accuracy of 96.59 percent than the CNN-MLP hybrid model of 95.9 percent.
Downloads
References
E. E. Alahi et al., “Integration of IoT-Enabled Technologies and Artificial Advancements and Future Trends,” Sensors (Switzerland), vol. 23, no. 5206, 2023.
A. Ullah et al., “Smart cities: the role of Internet of Things and machine learning in realizing a data-centric smart environment,” Complex Intell. Syst., vol. 10, no. 1, pp. 1607–1637, 2024, doi: 10.1007/s40747-023-01175-4.
L. Alzubaidi et al., Review of deep learning: concepts, CNN architectures, challenges, applications, future directions, vol. 8, no. 1. Springer International Publishing, 2021.
W. Liu, Z. Wang, X. Liu, N. Zeng, Y. Liu, and F. E. Alsaadi, “A survey of deep neural network architectures and their applications,” Neurocomputing, vol. 234, no. November 2016, pp. 11–26, 2017, doi: 10.1016/j.neucom.2016.12.038.
A. Patil and M. Rane, “Convolutional Neural Networks: An Overview and Its Applications in Pattern Recognition,” Smart Innov. Syst. Technol., vol. 195, pp. 21–30, 2021, doi: 10.1007/978-981-15-7078-0_3.
C. Shorten, T. M. Khoshgoftaar, and B. Furht, “Deep Learning applications for COVID-19,” J. Big Data, vol. 8, no. 1, 2021, doi: 10.1186/s40537-020-00392-9.
Y. Benhammou, B. Achchab, F. Herrera, and S. Tabik, “BreakHis based breast cancer automatic diagnosis using deep learning: Taxonomy, survey and insights,” Neurocomputing, vol. 375, pp. 9–24, 2020, doi: 10.1016/j.neucom.2019.09.044.
E. Wulczyn et al., “Deep learning-based survival prediction for multiple cancer types using histopathology images,” PLoS One, vol. 15, no. 6, pp. 1–18, 2020, doi: 10.1371/journal.pone.0233678.
S. Zaheer, N. Anjum, S. Hussain, A. D. Algarni, and J. Iqbal, “A Multi Parameter Forecasting for Stock Time Series Data Using LSTM and Deep Learning Model,” Math. Program. Comput., vol. 11, pp. 1–24, 2023, doi: https://doi.org/10.3390/ math11030590.
R. K. V, J. M. K, and K. R. V, “Measurement : Sensors Modelling a deep network using CNN and RNN for accident classification,” Meas. Sensors, vol. 27, no. May, p. 100794, 2023, doi: 10.1016/j.measen.2023.100794.
J. Yu, A. de Antonio, and E. Villalba-Mora, “Deep Learning ( CNN , RNN ) Applications for Smart Homes : A Systematic Review,” computers, vol. 11, no. Ml, pp. 1–32, 2022, doi: https:// doi.org/10.3390/computers11020026.
M. Ashraf et al., “Hybrid CNN and RNN Variant Model for Music Classification,” Appl. Sci. MDPI, vol. 13, 2023, doi: https://doi.org/10.3390/ app13031476.
P. Raja, A. Mathew, P. V Yeswanth, and S. Deivalakshmi, “A combined deep CNN-RNN network for rainfall-runoff modelling in Bardha Watershed , India,” Artif. Intell. Geosci., vol. 5, no. February, p. 100073, 2024, doi: 10.1016/j.aiig.2024.100073.
G. Yao, T. Lei, and J. Zhong, “A review of Convolutional-Neural-Network-based action recognition,” Pattern Recognit. Lett., vol. 118, pp. 14–22, 2019, doi: 10.1016/j.patrec.2018.05.018.
J. Gu et al., “Recent advances in convolutional neural networks,” Pattern Recognit., vol. 77, pp. 354–377, 2018, doi: 10.1016/j.patcog.2017.10.013.
B. Y. D. H. Hubel and A. D. T. N. Wiesel, “AND FUNCTIONAL ARCHITECTURE IN THE CAT ’ S VISUAL CORTEX From the Neurophysiolojy Laboratory , Department of Pharmacology central nervous system is the great diversity of its cell types and inter- receptive fields of a more complex type ( Part I ) and to make additional This approach is necessary in order to understand the behaviour of,” pp. 106–154, 1962.
S. Zhang, C. Liu, H. Jiang, S. Wei, L. Dai, and Y. Hu, “Feedforward Sequential Memory Networks : A New Structure to Learn Long-term Dependency,” arXiv Prepr. arXiv, 1512, p. 08301, 2015.
A. A. Alsumaiei, “Short-term forecasting of monthly water consumption in hyper-arid climate using recurrent neural networks,” J. Eng. Res., vol. 9, no. September, pp. 56–69, 2021, doi: https://dx.doi.org/10.36909/jer.v9i3B.10893.
M. Ibrahim and R. Elhafiz, “Modeling an intrusion detection using recurrent neural networks,” J. Eng. Res., vol. 11, no. 1, p. 100013, 2023, doi: 10.1016/j.jer.2023.100013.
G. Bebis and M. Georgiopoulos, “OPTIMAL FEED-FORWARD NEURAL NETWORK ARCHITECTURES,” in IEEE Potentials, 1994, pp. 27–31.
J. T. Connor, R. D. Martin, L. E. Atlas, and M. Ieee, “Recurrent Neural Networks and Robust Time Series Prediction,” in IEEE Transaction on Neural Networks, 1994, vol. 5, no. 2, pp. 240–254.
P. Dey, E. Hossain, I. Hossain, and M. A. Chowdhury, “Comparative Analysis of Recurrent Neural Networks in Stock Price Prediction for Different Frequency Domains,” Algorithms, vol. 14, pp. 1–20, 2021, doi: https://doi.org/10.3390/a14080251.
F. Mei, H. Chen, and Y. Lei, “Blind Recognition of Forward Error Correction Codes Based on Recurrent Neural Network,” sensors, vol. 21, 3884, 2021, doi: https://doi.org/10.3390/ s21113884.
Svozil D, V. Kvasnicka, and J. Pospı´chal, “Introduction to multilayer feed-forward neural networks,” Chemom Intell Lab Syst, vol. 39, no. 1, pp. 43–62, 1997.
C. Do Xuan, “A novel approach for APT attack detection based on combined deep learning model,” Neural Comput. Appl., vol. 5, 2021, doi: 10.1007/s00521-021-05952-5.
C. Zhang et al., “A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification,” ISPRS J. Photogramm. Remote Sens., 2017, doi: 10.1016/j.isprsjprs.2017.07.014.
F. Paci, M. Chini, and W. J. Emery, “A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classi fi cation,” vol. 113, pp. 1276–1292, 2009, doi: 10.1016/j.rse.2009.02.014.
I. A. Pradana, A. D. Rahajoe, and A. N. Sihananto, “PENGEMBANGAN APLIKASI PENDETEKSI KERETAKAN JALAN BERBASIS ANDROID DENGAN IMPLEMENTASI ALGORITMA HYBRID CNN-LSTM,” vol. 5, no. 2, pp. 1–10, 2024.
M. Reyad and A. M. Sarhan, “A modified Adam algorithm for deep neural network optimization,” Neural Comput. Appl., vol. 0123456789, 2023, doi: 10.1007/s00521-023-08568-z.
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Ani Dijah Rahajoe, Muhammad Suriansyah, Angelo A. Beltran Jr
This work is licensed under a Creative Commons Attribution 4.0 International License.
