Modification Of Yolov11 Nano And Small Architecture For Improved Accuracy In Motorcycle Riders Face Recognition Based On Eye
DOI:
https://doi.org/10.52436/1.jutif.2025.6.5.4535Keywords:
Face Recognition, mAP50, mAP50-95, Nano, Small, YOLOv11Abstract
Face recognition still faces challenges in identifying faces covered by masks and helmets with open visors, such as those commonly used by motorcyclists, especially when entering parking areas. To improve the accuracy of face recognition in these conditions, this study proposes nano and small versions of the YOLOv11 modification, which is an internal version. Modifications are made to the neck section and the DySample module is added in place of the UpSample module to improve the model's capabilities. Experiments were conducted using a self-generated dataset consisting of 50 classes. The results show that the modified nano version achieves 99.3% accuracy at the same mAP50 as YOLOv11n and YOLOv12n. At mAP50-95, it shows a 1.6% accuracy improvement compared to YOLOv11n and YOLOv12n with 75% accuracy. Meanwhile, the modified small version achieved an accuracy improvement of 1.3% and 1.2% compared to YOLOv11n and YOLOv12n, respectively, reaching 76.1% on mAP50-95, although the accuracy on mAP50 remained the same as YOLOv11n and 0.1% superior to YOLOv12n. However, recall and precision did not show significant improvement in both as well as the increase in model parameters. However, the model is still in the nano and small versions. Therefore, the model can be implemented on edge devices. This research is important for the field of computer vision, especially in the context of face recognition. The contribution of this research is the improvement of the accuracy of the mAP50-95 metric in eye-based face recognition, which is relevant for intelligent security systems with limited resources.
Downloads
References
X. Qi, C. Wu, Y. Shi, H. Qi, K. Duan, and X. Wang, “A Convolutional Neural Network Face Recognition Method Based on BiLSTM and Attention Mechanism,” Comput. Intell. Neurosci., vol. 2023, no. 1, pp. 1–14, 2023, doi: 10.1155/2023/2501022.
W. C. Cheng, H. C. Hsiao, and L. H. Li, “Deep Learning Mask Face Recognition with Annealing Mechanism,” Appl. Sci., vol. 13, no. 2, p. 732, 2023, doi: 10.3390/app13020732.
B. Bazatbekov, C. Turan, S. Kadyrov, and A. Aitimov, “2D face recognition using PCA and triplet similarity embedding,” Bull. Electr. Eng. Informatics, vol. 12, no. 1, pp. 580–586, 2023, doi: 10.11591/eei.v12i1.4162.
H. Benradi, A. Chater, and A. Lasfar, “A hybrid approach for face recognition using a convolutional neural network combined with feature extraction techniques,” IAES Int. J. Artif. Intell., vol. 12, no. 2, pp. 627–640, 2023, doi: 10.11591/ijai.v12.i2.pp627-640.
G. Rajeshkumar et al., “Smart office automation via faster R-CNN based face recognition and internet of things,” Meas. Sensors, vol. 27, no. November 2022, p. 100719, 2023, doi: 10.1016/j.measen.2023.100719.
A. Shah, B. Ali, M. Habib, J. Frnda, I. Ullah, and M. Shahid Anwar, “An ensemble face recognition mechanism based on three-way decisions,” J. King Saud Univ. - Comput. Inf. Sci., vol. 35, no. 4, pp. 196–208, 2023, doi: 10.1016/j.jksuci.2023.03.016.
D. Sunaryono, J. Siswantoro, and R. Anggoro, “An android based course attendance system using face recognition,” J. King Saud Univ. - Comput. Inf. Sci., vol. 33, no. 3, pp. 304–312, 2021, doi: 10.1016/j.jksuci.2019.01.006.
M. Alansari, O. A. Hay, S. Javed, A. Shoufan, Y. Zweiri, and N. Werghi, “GhostFaceNets: Lightweight Face Recognition Model From Cheap Operations,” IEEE Access, vol. 11, no. March, pp. 35429–35446, 2023, doi: 10.1109/ACCESS.2023.3266068.
A. T. Putra, K. Usman, and S. Saidah, “Webinar Student Presence System Based on Regional Convolutional Neural Network Using Face Recognition,” J. Tek. Inform., vol. 2, no. 2, pp. 109–118, 2021, doi: 10.20884/1.jutif.2021.2.2.82.
E. Tanuwijaya, A. S. A. Setiawan, A. R. Arianindita, and T. Kristanto, “Human Face Recognition on Image Video Conference Application Using Siamese Network With Skip Connection Smaller Vgg Model,” J. Tek. Inform., vol. 4, no. 5, pp. 1119–1125, 2023, doi: 10.52436/1.jutif.2023.4.5.981.
E. Tanuwijaya, R. L. Lordianto, and R. A. Jasin, “Recognition of Human Faces in Video Conference Applications Using the Cnn Pipeline Pengenalan Wajah Manusia Pada Aplikasi Video Conference Menggunakan Metode Pipeline Cnn,” J. Tek. Inform., vol. 3, no. 2, pp. 421–427, 2022, doi: 10.20884/1.jutif.2022.3.2.219.
H. O. Ikromovich and B. B. Mamatkulovich, “FACIAL RECOGNITION USING TRANSFER LEARNING IN THE DEEP CNN,” Web Sci. Int. Sci. Res. J., vol. 5, no. 3, pp. 1–14, 2023, doi: 10.17605/OSF.IO/NRMK2.
O. A. Naser, S. M. S. Ahmad, K. Samsudin, M. Hanafi, S. M. B. Shafie, and N. Z. Zamri, “Facial recognition for partially occluded faces,” Indones. J. Electr. Eng. Comput. Sci., vol. 30, no. 3, pp. 1846–1855, 2023, doi: 10.11591/ijeecs.v30.i3.pp1846-1855.
F. Firdaus and R. Munir, “Masked Face Recognition using Deep Learning based on Unmasked Area,” in 2022 Second International Conference on Power, Control and Computing Technologies (ICPC2T), 2022, pp. 1–6. doi: 10.1109/ICPC2T53885.2022.9776651.
M. Zhang, R. Liu, D. Deguchi, and H. Murase, “Masked Face Recognition With Mask Transfer and Self-Attention Under the COVID-19 Pandemic,” IEEE Access, vol. 10, no. January, pp. 20527–20538, 2022, doi: 10.1109/ACCESS.2022.3150345.
Y. Ge, H. Liu, J. Du, Z. Li, and Y. Wei, “Masked face recognition with convolutional visual self-attention network,” Neurocomputing, vol. 518, no. C, pp. 496–506, 2023, doi: 10.1016/j.neucom.2022.10.025.
S. Ramachandra and S. Ramachandran, “Region specific and subimage based neighbour gradient feature extraction for robust periocular recognition,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 10, pp. 7961–7973, 2022, doi: 10.1016/j.jksuci.2022.07.013.
R. Lionnie, C. Apriono, and D. Gunawan, “Eyes versus Eyebrows: A Comprehensive Evaluation Using the Multiscale Analysis and Curvature-Based Combination Methods in Partial Face Recognition,” Algorithms, vol. 15, no. 6, p. 208, 2022, doi: 10.3390/a15060208.
S. Noris and A. Waluyo, “Penerapan Deep Learning untuk Klasifikasi Buah Menggunakan Algoritma Convolutional Neural Network (CNN),” J. Teknol. Sist. Inf. dan Apl., vol. 6, no. 1, pp. 39–46, 2023, doi: 10.32493/jtsi.v6i1.29648.
L. Zhang, B. Verma, D. Tjondronegoro, and V. Chandran, “Facial expression analysis under partial occlusion: A survey,” ACM Comput. Surv., vol. 51, no. 2, pp. 1–49, 2018, doi: 10.1145/3158369.
P. Hidayatullah, Buku Sakti Deep Learning: Computer Vision Menggunakan YOLO Untuk Pemula. Bandung: Informatika, 2021.
X. Mao et al., “COCO-O: A Benchmark for Object Detectors under Natural Distribution Shifts,” Proc. IEEE Int. Conf. Comput. Vis., no. 2020, pp. 6316–6327, 2023, doi: 10.1109/ICCV51070.2023.00583.
Z. Li, Q. He, and W. Yang, “E-FPN: an enhanced feature pyramid network for UAV scenarios detection,” Vis. Comput., vol. 41, no. 1, pp. 675–693, 2025, doi: 10.1007/s00371-024-03355-w.
X. Zhu, S. Lyu, X. Wang, and Q. Zhao, “TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios,” Proc. IEEE Int. Conf. Comput. Vis., vol. 2021-Octob, pp. 2778–2788, 2021, doi: 10.1109/ICCVW54120.2021.00312.
P. Hidayatullah et al., “Computer Methods and Programs in Biomedicine DeepSperm : A robust and real-time bull sperm-cell detection in densely populated semen videos,” Comput. Methods Programs Biomed., vol. 209, no. C, p. 106302, 2021, doi: 10.1016/j.cmpb.2021.106302.
Z. Lin, B. Yun, and Y. Zheng, “LD-YOLO: A Lightweight Dynamic Forest Fire and Smoke Detection Model with Dysample and Spatial Context Awareness Module,” Forests, vol. 15, no. 9, p. 1630, 2024, doi: 10.3390/f15091630.
W. Liu, H. Lu, H. Fu, and Z. Cao, “Learning to Upsample by Learning to Sample,” in 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023, pp. 6004–6014. doi: 10.1109/ICCV51070.2023.00554.
Z. Chen, J. Feng, K. Zhu, Z. Yang, Y. Wang, and M. Ren, “YOLOv8-ACCW: Lightweight Grape Leaf Disease Detection Method Based on Improved YOLOv8,” IEEE Access, vol. 12, no. June, pp. 123595–123608, 2024, doi: 10.1109/ACCESS.2024.3453379.
L. He, Y. Zhou, and L. Liu, “Research and Application of YOLOv11-Based Object Segmentation in Intelligent Recognition at Construction Sites,” Buildings, vol. 14, no. 12, p. 3777, 2024, doi: 10.3390/buildings14123777.
Perez and Caldentey, “A Novel YOLOv10-DECA Model for Real-Time Detection of Concrete Cracks Chaokai,” Buildings, vol. 14, no. 10, p. 3230, 2024, doi: 10.3390/buildings14103230.
T.-H. Tsai, J.-X. Lu, X.-Y. Chou, and C.-Y. Wang, “Joint Masked Face Recognition and Temperature Measurement System Using Convolutional Neural Networks,” Sensors, vol. 23, no. 6, p. 2901, Mar. 2023, doi: 10.3390/s23062901.
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Randy Ardiansyah, I Gde Putu Wirarama WW, Ario Yudo Husodo
This work is licensed under a Creative Commons Attribution 4.0 International License.
