Artificial Intelligence-Based Aircraft Detection for Enhanced Aviation Safety and Air Traffic Management

Authors

  • Astika Ayuningtyas Departement of Informatics, Adisutjipto Institute of Aerospace Technology, DI Yogyakarta, Indonesia
  • Saomi Novelia Gunawan Departement of Informatics, Adisutjipto Institute of Aerospace Technology, DI Yogyakarta, Indonesia
  • Puspa Ira Candra Dewi Wulan Departement of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taiwan
  • Rully Medianto Departement of Aerospace Engineering, Adisutjipto Institute of Aerospace Technology, DI Yogyakarta, Indonesia
  • Sri Winiarti Departement of Informatics, Universitas Ahmad Dahlan, DI Yogyakarta, Indonesia
  • Aris Rakhmadi Departement of Informatics Engineering, Universitas Muhammadiyah Surakarta, Jawa Tengah, Indonesia

DOI:

https://doi.org/10.52436/1.jutif.2026.7.3.5661

Keywords:

Aviation Safety, Computer Vision, Deep Learning, Manned Aircraft Detection

Abstract

The rapid growth of international air traffic has made maintaining aviation safety and managing air traffic efficiently increasingly complex, particularly in identifying aircraft in constantly changing airspace. Traditional monitoring systems such as radar and Automatic Dependent Surveillance-Broadcast (ADS-B) have limitations in operating at low altitudes, in adverse weather, and in overcrowded environments, which can reduce the ability to understand surrounding conditions. This research proposes an artificial intelligence-based visual detection system aimed at enhancing real-time aircraft identification and improving air traffic monitoring. The system uses a YOLO-based deep learning model enhanced with a special attention mechanism and data augmentation to increase accuracy, flexibility, and operational resilience. The dataset used covers various flight situations, such as variations in light, viewing angles, and background complexity, to train the model. The model's test results show that it can correctly identify 95.24% of passenger planes, 92.4% of blimps, and 90% of fighter planes. The average overall precision (mAP) is over 90%. This system is also capable of real-time inference with precision and recall consistently above 85% under various conditions. Compared with conventional vision-based detection methods, this system demonstrates superior localization capabilities and robustness, making it suitable for use in real-world flight surveillance and air traffic management. In conclusion, this AI-based framework provides a practical and scalable solution that can improve flight safety and promote smarter air traffic management.

Downloads

Download data is not yet available.

References

U. Kale, I. Jankovics, A. Nagy, and D. Rohács, “Towards sustainability in air traffic management,” Sustainability, vol. 13, no. 10, p. 5451, 2021, https://doi.org/10.3390/su13105451.

F. P. Moreno, V. F. G. Comendador, R. D.-A. Jurado, M. Z. Suárez, D. Janisch, and R. M. A. Valdés, “Methodology of air traffic flow clustering and 3-D prediction of air traffic density in ATC sectors based on machine learning models,” Expert Syst. Appl., vol. 223, p. 119897, 2023, https://doi.org/10.1016/j.eswa.2023.119897.

A. Hamissi and A. Dhraief, “A survey on the unmanned aircraft system traffic management,” ACM Comput. Surv., vol. 56, no. 3, pp. 1–37, 2023, https://doi.org/10.1145/3617992.

M. K. Singh, N. S. Singha, and V. D. Prabhakar, “Advanced AI-enabled UAV Swarms for Real-time Air Traffic Surveillance,” 2026, https://doi.org/10.1108/978-1-80592-062-520251006.

G. Maalouf, K. Jensen, and J. H. Jepsen, “Airspace Situational Awareness: Proposed Airspace Safety Concepts & State-of-the-art Review of UAS Aircraft Detection Technologies,” in International Conference on Unmanned Aircraft Systems, 2024, https://doi.org/10.1109/icuas60882.2024.10557082.

W. Ahmed, A. Masood, and J. Manzoor, “Towards Secure Air Traffic Surveillance: A Survey on ADS-B Threats, Existing Solutions, and Future Research,” IEEE Open Journal of the Computer Society, vol. 7, pp. 290–313, 2026, https://doi.org/10.1109/ojcs.2026.3651384.

Y. Chi, J. Nie, L. Zhong, Y. Wang, and D. Delahaye, “A review of situational awareness in air traffic control,” IEEE Access, vol. 11, pp. 134040–134057, 2023, https://doi.org/10.1109/access.2023.3336415.

W. Li, P. Kearney, J. Zhang, Y. Hsu, and G. Braithwaite, “The analysis of occurrences associated with air traffic volume and air traffic controllers’ alertness for fatigue risk management,” Risk analysis, vol. 41, no. 6, pp. 1004–1018, 2021, https://doi.org/10.1111/risa.13594.

W. Ahmed, A. Masood, and J. Manzoor, “Towards Secure Air Traffic Surveillance: A Survey on ADS-B Threats, Existing Solutions, and Future Research,” IEEE Open Journal of the Computer Society, vol. 7, pp. 290–313, 2026, https://doi.org/10.1109/ojcs.2026.3651384.

H. A. Khan, H. Khan, S. Ghafoor, and M. A. Khan, “A survey on security of automatic dependent surveillance-broadcast (ADS-B) protocol: Challenges, potential solutions and future directions,” IEEE Communications Surveys & Tutorials, 2024, https://doi.org/10.1109/comst.2024.3513213.

T. Aliyev and I. Isgandarov, “Analysis of Negative Impacts On Air Traffic Control Radar Systems and Modern Methods for Their Elimination,” International Journal of Aviation Science and Technology, vol. 6, no. 01, pp. 45–59, 2025, https://doi.org/10.23890/ijast.vm06is01.0105.

Q. U. Ain, A. A. A. Jilani, N. A. Butt, S. U. Rehman, and H. A. Alhulayyil, “Anomaly detection for aviation cyber-physical system: Opportunities and challenges,” IEEE Access, vol. 12, pp. 175905–175925, 2024, https://doi.org/10.1109/access.2024.3495519.

F. Alamri, “Comprehensive study on object detection for security and surveillance: A concise review,” Multimed. Tools Appl., pp. 1–32, 2025, https://doi.org/10.1007/s11042-025-20801-6.

C. P. Ranjith, B. M. Hardas, M. S. K. Mohideen, N. N. Raj, N. R. Robert, and P. Mohan, “Robust deep learning empowered real time object detection for unmanned aerial vehicles-based surveillance applications,” Journal of Mobile Multimedia, vol. 19, no. 2, pp. 451–476, 2023, https://doi.org/10.13052/jmm1550-4646.1925.

G. A. Vaidya, “Object Detection In Video Streaming Using Machine Learning And Cnn Techniques.,” Journal of Advanced Zoology, vol. 45, 2024, https://doi.org/10.53555/jaz.v45is4.4183.

P. Thai, S. Alam, N. Lilith, and B. T. Nguyen, “A computer vision framework using convolutional neural networks for airport-airside surveillance,” Transp. Res. Part C Emerg. Technol., vol. 137, p. 103590, 2022, https://doi.org/10.1016/j.trc.2022.103590.

D. K. Pramudito, “Enhancing real-time object detection in autonomous systems using deep learning and computer vision techniques,” The Journal of Academic Science, vol. 1, no. 6, pp. 788–804, 2024, https://doi.org/10.59613/v3015d10.

L. Du and Y. Wang, “Bi-YOLO: A novel object detection network and dataset for components of China heritage buildings,” Journal of Building Engineering, p. 110817, 2024, https://doi.org/10.1016/j.jobe.2024.110817.

B. Cheng, B. Wang, Z. Liu, Q. Wang, T. Shen, and Y. Gu, “Airplane symmetry-based convolutional neural network for airplane detection in remote sensing image,” 2023, https://doi.org/10.1049/icp.2024.1726.

M. Wang et al., “FE-YOLOv5: Feature enhancement network based on YOLOv5 for small object detection,” J. Vis. Commun. Image Represent., vol. 90, p. 103752, 2023, doi: https://doi.org/10.1016/j.jvcir.2023.103752.

C. Xiaoming et al., “An improved algorithm based on YOLOv5 for detecting Ambrosia trifida in UAV images,” Front. Plant Sci., vol. 15, May 2024, doi: https://doi.org/10.3389/fpls.2024.1360419.

D. Tian, J. Chen, and X. Wang, “Application research of UAV infrared diagnosis technology in intelligent inspection of substations,” Energy Informatics, vol. 7, no. 1, Dec. 2024, doi: https://doi.org/10.1186/s42162-024-00364-w.

J. Wang, T. Zhang, and Y. Cheng, “Deep Learning for Object Detection: A Survey.,” Computer Systems Science & Engineering, vol. 38, no. 2, 2021, doi: https://doi.org/10.1186/s42162-024-00364-w.

M. H. Hamzenejadi and H. Mohseni, “Fine-tuned YOLOv5 for real-time vehicle detection in UAV imagery: Architectural improvements and performance boost,” Expert Syst. Appl., vol. 231, p. 120845, 2023, https://doi.org/10.1016/j.eswa.2023.120845.

A. Ayuningtyas, I. Riadi, and A. Yudhana, “Analisis Sistem Deteksi Citra untuk Optimalisasi Pengawasan Lalu Lintas Udara Menggunakan Algoritma YOLOv5,” JISKA (Jurnal Informatika Sunan Kalijaga), vol. 10, no. 3, pp. 364–376, Sep. 2025, doi: https://doi.org/10.14421/jiska.2025.10.3.364-376.

A. Ayuningtyas, I. Riadi, and A. Yudhana, “Analisis Sistem Deteksi Citra untuk Optimalisasi Pengawasan Lalu Lintas Udara Menggunakan Algoritma YOLOv5,” 2025, https://doi.org/10.14421/jiska.2025.10.3.364-376.

A. Ayuningtyas, I. Riadi, and A. Yudhana, “The Effect of Light Intensity, Camera Pixel Quality, Camera Distance, and Object Altitude on Detection Accuracy in a Real-Time Drone Surveillance System Using YOLOv5,” Journal of Innovation Information Technology and Application (JINITA), vol. 7, no. 2, pp. 234–246, Dec. 2025, doi: https:/doi.org/10.35970/jinita.v7i2.2843.

M. Naranjo et al., “Object detection-based system for traffic signs on drone-captured images,” Drones, vol. 7, no. 2, p. 112, 2023, https://doi.org/10.3390/drones7020112.

J. Sandino, F. Maire, P. Caccetta, C. Sanderson, and F. Gonzalez, “Drone-based autonomous motion planning system for outdoor environments under object detection uncertainty,” Remote Sens. (Basel)., vol. 13, no. 21, p. 4481, 2021, https://doi.org/10.3390/rs13214481.

X. Zhu, S. Lyu, X. Wang, and Q. Zhao, “TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 2778–2788, https://doi.org/10.1109/iccvw54120.2021.00312.

J. Han, R. Cao, A. Brighente, and M. Conti, “Light-YOLOv5: A Lightweight Drone Detector for Resource-Constrained Cameras,” IEEE Internet Things J., vol. 11, no. 6, pp. 11046–11057, 2023, https://doi.org/10.1109/jiot.2023.3329221.

S. Singha and B. Aydin, “Automated drone detection using YOLOv4,” Drones, vol. 5, no. 3, p. 95, 2021, https://doi.org/10.3390/drones5030095.

Q. Zhang, H. Han, F. Li, and Y. Du, “Attention-Aware Based Differentiable Architecture Search Network for Waste Recognition,” in 2023 IEEE 13th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), IEEE, Jul. 2023, pp. 408–412. doi: https://doi.org/10.1109/CYBER59472.2023.10256542.

Anupriya and R. Kumar, “Attention-based Improved YOLOv5 for Effective Waste Detection and Classification System,” in 2024 International Conference on Electrical Electronics and Computing Technologies (ICEECT), IEEE, Aug. 2024, pp. 1–6. doi: https://doi.org/10.1109/ICEECT61758.2024.10739282.

Z. Cao, C. Fu, J. Ye, B. Li, and Y. Li, “SiamAPN++: Siamese attentional aggregation network for real-time UAV tracking,” in 2021 IEEE/RSJ international conference on intelligent robots and systems (IROS), IEEE, 2021, pp. 3086–3092, https://doi.org/10.1109/IROS51168.2021.9636309.

D. Yang et al., “An efficient multi-task learning CNN for driver attention monitoring,” Journal of Systems Architecture, vol. 148, p. 103085, 2024, doi: https://doi.org/10.1016/j.sysarc.2024.103085.

F. S. Alrayes, M. Zakariah, S. U. Amin, Z. I. Khan, and J. S. Alqurni, “CNN Channel Attention Intrusion Detection System Using NSL-KDD Dataset,” Computers, Materials and Continua, vol. 79, no. 3, pp. 4319–4347, 2024, doi: https://doi.org/10.32604/cmc.2024.050586.

R. Szeliski, Computer vision: algorithms and applications. Springer Nature, 2022, https://doi.org/10.1007/978-3-030-34372-9.

M. Farhadmanesh, A. Rashidi, A. K. Subedi, and N. Marković, “A computer vision-based standalone system for automated operational data collection at non-towered airports,” IEEE Access, 2024, https://doi.org/10.1109/access.2024.3425572.

M. Farhadmanesh, A. Rashidi, and N. Marković, “General aviation aircraft identification at non-towered airports using a two-step computer vision-based approach,” IEEE Access, vol. 10, pp. 48778–48791, 2022, https://doi.org/10.1109/access.2022.3172963.

K. Man and J. Chahl, “A Review of Synthetic Image Data and Its Use in Computer Vision,” J. Imaging, vol. 8, no. 11, p. 310, Nov. 2022, doi: https://doi.org/10.3390/jimaging8110310.

I. Shad, Z. Zhang, M. Asim, M. Al-habib, S. Chelloug, and A. El-latif, “Deep learning-based image processing framework for efficient surface litter detection in Computer Vision applications,” J. Radiat. Res. Appl. Sci., vol. null, p. null, 2025, doi: https://doi.org/10.1016/j.jrras.2025.101534.

Y. Zhang, H. Zhu, and S. Yu, “Adaptive Data Augmentation for Contrastive Learning,” in ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, Jun. 2023, pp. 1–5. doi: https://doi.org/10.1109/ICASSP49357.2023.10095350.

B. Zoph, E. D. Cubuk, G. Ghiasi, T.-Y. Lin, J. Shlens, and Q. V Le, “Learning data augmentation strategies for object detection,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXVII 16, Springer, 2020, pp. 566–583, https://doi.org/10.1007/978-3-030-58583-9_34.

S. Arezoomandan, J. Klohoker, and D. K. Han, “Data Augmentation Pipeline for Enhanced UAV Surveillance,” 2025, pp. 366–380. doi: https://doi.org/10.1007/978-3-031-78172-8_24.

A. Mumuni, F. Mumuni, and N. K. Gerrar, “A Survey of Synthetic Data Augmentation Methods in Machine Vision,” Machine Intelligence Research, vol. 21, no. 5, pp. 831–869, Oct. 2024, doi: https://doi.org/10.1007/s11633-022-1411-7.

G. H. Rishi, P. R. Kumar, N. C. Varshit, and K. Sailaja, “Real-time military aircraft detection using YOLOv5,” in 2024 Second International Conference on Data Science and Information System (ICDSIS), IEEE, 2024, pp. 1–7, https://doi.org/10.1109/icdsis61070.2024.10594590.

H. R. Alsanad, A. Z. Sadik, O. N. Ucan, M. Ilyas, and O. Bayat, “YOLO-V3 based real-time drone detection algorithm,” Multimed. Tools Appl., vol. 81, no. 18, pp. 26185–26198, 2022, https://doi.org/10.1007/s11042-022-12939-4.

D. J. N. Patel and D. S. B. Patel, “Real-Time Object Detection: A Benchmarking Study of Yolo Versions.,” Journal of Scholastic Engineering Science and Management, vol. 3, no. 8, pp. 1–6, 2024, doi: https://doi.org/10.47738/jads.v6i2.587.

J. Liu and X. Dai, “Real-time object detection for UAVs images based on improved YOLOv5,” in Third International Conference on Computer Vision and Pattern Analysis (ICCPA 2023), SPIE, 2023, pp. 45–51, https://doi.org/10.1117/12.2684359.

G. Cheng et al., “Towards large-scale small object detection: Survey and benchmarks,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 11, pp. 13467–13488, 2023, https://doi.org/10.1109/tpami.2023.3290594.

W. Chen, J. Luo, F. Zhang, and Z. Tian, “A review of object detection: Datasets, performance evaluation, architecture, applications and current trends,” Multimed. Tools Appl., vol. 83, no. 24, pp. 65603–65661, 2024, https://doi.org/10.1007/s11042-023-17949-4.

S. K. Radha, A. Kuehlkamp, and J. Nabrzyski, “Advancing transparency and responsibility in machine learning: The critical role of FAIR principles-A comprehensive review,” ACM Journal on Responsible Computing, vol. 2, no. 4, pp. 1–38, 2025, https://doi.org/10.1145/3768151.

K. B. Shiferaw, I. Balaur, D. Welter, D. Waltemath, and A. A. Zeleke, “CALIFRAME: a proposed method of calibrating reporting guidelines with FAIR principles to foster reproducibility of AI research in medicine,” JAMIA Open, vol. 7, no. 4, p. ooae105, 2024, https://doi.org/10.1093/jamiaopen/ooae105.

J. Zhang, Y. Zhang, J. Liu, Y. Lan, and T. Zhang, “Human figure detection in Han portrait stone images via enhanced YOLO-v5,” Herit. Sci., vol. 12, no. 1, p. 119, 2024, doi: https://doi.org/10.1186/s40494-024-01232-2.

B. Jiang, H. Jiang, H. Zhang, Q. Zhang, Z. Li, and L. Huang, “4AC-YOLOv5: an improved algorithm for small target face detection,” EURASIP J. Image Video Process., vol. 2024, no. 1, Dec. 2024, doi: https://doi.org/10.1186/s13640-024-00625-4.

W. Zhan et al., “An improved Yolov5 real-time detection method for small objects captured by UAV,” Soft comput., vol. 26, no. 1, pp. 361–373, 2022, https://doi.org/10.1007/s00500-021-06407-8.

B. Ghari, A. Tourani, A. Shahbahrami, and G. Gaydadjiev, “Pedestrian detection in low-light conditions: A comprehensive survey,” Image Vis. Comput., p. 105106, 2024, https://doi.org/10.1016/j.imavis.2024.105106.

M. Krišto, M. Ivasic-Kos, and M. Pobar, “Thermal object detection in difficult weather conditions using YOLO,” IEEE access, vol. 8, pp. 125459–125476, 2020, doi: https://doi.org/10.1109/access.2020.3007481.

T. Abekoon, H. Sajindra, J. Jayakody, E. Samarakoon, and U. Rathnayake, “Image processing techniques to identify tomato quality under market conditions,” Smart Agricultural Technology, vol. 7, p. 100433, 2024, doi: https://doi.org/10.1016/j.atech.2024.100433.

H.-K. Jung and G.-S. Choi, “Improved yolov5: Efficient object detection using drone images under various conditions,” Applied Sciences, vol. 12, no. 14, p. 7255, 2022, https://doi.org/10.3390/app12147255.

Z. Hu, Y. Jing, and G. Wu, “Decision-level fusion detection method of visible and infrared images under low light conditions,” EURASIP J. Adv. Signal Process., vol. 2023, no. 1, Dec. 2023, doi: https://doi.org/10.1186/s13634-023-01002-5.

Additional Files

Published

2026-06-15

How to Cite

[1]
A. Ayuningtyas, S. Novelia Gunawan, P. Ira Candra Dewi Wulan, R. Medianto, S. Winiarti, and A. Rakhmadi, “Artificial Intelligence-Based Aircraft Detection for Enhanced Aviation Safety and Air Traffic Management”, J. Tek. Inform. (JUTIF), vol. 7, no. 3, pp. 2734–2745, Jun. 2026.