Single-Image Face Recognition For Student Identification Using Facenet512 And Yolov8 In Academic Environtment With Limited Dataset
DOI:
https://doi.org/10.52436/1.jutif.2025.6.5.3908Keywords:
Face Detection, Face Recognition, FaceNet512, Image Augmentation, Limited Dataset, YOLOv8Abstract
Face recognition has become one of the most significant research areas in image processing and computer vision, mainly due to its wide applications in security, identity verification, and human and machine interaction. In this study, FaceNet512 and YOLOv8 models are used to overcome the challenges in face recognition with a limited dataset, which is only one formal photo per individual. The application of image augmentation to the model achieved 90% accuracy and ROC curve of 0.82, while the model without augmentation achieved 89% accuracy and ROC curve of 0.79. FaceNet512 showed superiority in producing more accurate and detailed facial representations compared to other models, such as ArcFace and FaceNet, especially in handling minimal facial variations. Meanwhile, YOLOv8 provides efficient face detection across various lighting conditions and viewing angles. The main challenge in this research is the low quality of the original image, which can reduce the accuracy of face recognition. These results show the great potential of using deep learning-based face recognition systems in the real world, especially for automatic attendance applications in academic environments.
Downloads
References
I. Adjabi, A. Ouahabi, A. Benzaoui, and A. Taleb-Ahmed, “Past, Present, and Future of Face Recognition: A Review,” Electronics 2020, Vol. 9, Page 1188, vol. 9, no. 8, p. 1188, Jul. 2020, doi: 10.3390/ELECTRONICS9081188.
M. O. Oloyede, G. P. Hancke, and H. C. Myburgh, “A review on face recognition systems: recent approaches and challenges,” Multimed Tools Appl, vol. 79, no. 37–38, pp. 27891–27922, Oct. 2020, doi: 10.1007/S11042-020-09261-2/TABLES/15.
R. Min, S. Xu, and Z. Cui, “Single-sample face recognition based on feature expansion,” IEEE Access, vol. 7, pp. 45219–45229, 2019, doi: 10.1109/access.2019.2909039.
N. Kumar and V. Garg, “Single sample face recognition in the last decade: A survey,” Intern J Pattern Recognit Artif Intell, vol. 33, no. 13, p. 1956009, Dec. 2019, doi: 10.1142/s0218001419560093.
V. Tomar, N. Kumar, and A. R. Srivastava, “Single sample face recognition using deep learning: a survey,” Artificial Intelligence Review 2023 56:1, vol. 56, no. 1, pp. 1063–1111, Jul. 2023, doi: 10.1007/S10462-023-10551-Y.
Y. Wen, H. Yi, Z. Fan, Z. Xu, Y. Xue, and Y. Li, “Gallery-sensitive single sample face recognition based on domain adaptation,” Neurocomputing, vol. 458, pp. 626–638, Oct. 2021, doi: 10.1016/j.neucom.2020.06.136.
F. Liu, F. Wang, Y. Wang, J. Zhou, and F. Xu, “Cycle-autoencoder based block-sparse joint representation for single sample face recognition,” Computers and Electrical Engineering, vol. 101, Jul. 2022, doi: 10.1016/j.compeleceng.2022.108003.
J. Deng, J. Guo, J. Yang, N. Xue, I. Kotsia, and S. Zafeiriou, “ArcFace: Additive Angular Margin Loss for Deep Face Recognition,” IEEE Trans Pattern Anal Mach Intell, vol. 44, no. 10, pp. 5962–5979, Oct. 2022, doi: 10.1109/TPAMI.2021.3087709.
J. Terven, D. M. Córdova-Esparza, and J. A. Romero-González, “A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS,” Mach Learn Knowl Extr, vol. 5, no. 4, pp. 1680–1716, 2023, doi: 10.3390/make5040083.
Y. Zhao, F. Sun, and X. Wu, “FEB-YOLOv8: A multi-scale lightweight detection model for underwater object detection,” PLoS One, vol. 19, no. 9, p. e0311173, Sep. 2024, doi: 10.1371/JOURNAL.PONE.0311173.
B. Ríos-Sánchez, D. Costa-da-Silva, N. Martín-Yuste, and C. Sánchez-Ávila, “Deep learning for facial recognition on single sample per person scenarios with varied capturing conditions,” Applied Sciences, vol. 9, no. 24, p. 5474, Dec. 2019, doi: 10.3390/app9245474.
C. Shorten and T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,” J Big Data, vol. 6, no. 1, pp. 1–48, Dec. 2019, doi: 10.1186/S40537-019-0197-0/FIGURES/33.
S. I. Serengil and A. Ozpinar, “LightFace: A Hybrid Deep Face Recognition Framework,” Proceedings - 2020 Innovations in Intelligent Systems and Applications Conference, ASYU 2020, Oct. 2020, doi: 10.1109/ASYU50717.2020.9259802.
A. Makalesi, R. Article Şefik İlkin SERENGİL, and A. Özpinar, “A Benchmark of Facial Recognition Pipelines and Co-Usability Performances of Modules,” Journal of Information Technologies, vol. 17, no. 2, pp. 95–107, Apr. 2024, doi: 10.17671/GAZIBTD.1399077.
P. Chlap, H. Min, N. Vandenberg, J. Dowling, L. Holloway, and A. Haworth, “A review of medical image data augmentation techniques for deep learning applications,” J Med Imaging Radiat Oncol, vol. 65, no. 5, pp. 545–563, Aug. 2021, doi: 10.1111/1754-9485.13261.
N. Kadek, D. A. Putri, A. Luthfiarta, P. Langgeng, and W. E. Putra, “OPTIMIZING BUTTERFLY CLASSIFICATION THROUGH TRANSFER LEARNING: FINE-TUNING APPROACH WITH NASNETMOBILE AND MOBILENETV2,” Jurnal Teknik Informatika (JUTIF), vol. 5, no. 3, pp. 685–692, 2024, doi: 10.52436/1.jutif.2024.5.3.1583.
Y. Xu, H. Kan, and G. Han, “Fourier-Reflexive Partitions and Group of Linear Isometries with Respect to Weighted Poset Metric,” in IEEE International Symposium on Information Theory - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 1975–1980. doi: 10.1109/ISIT50566.2022.9834567.
A. Jung, “imgaug — imgaug 0.4.0 documentation.” Accessed: Sep. 13, 2024. [Online]. Available: https://imgaug.readthedocs.io/en/latest/index.html
S. I. Serengil and A. Ozpinar, “HyperExtended LightFace: A Facial Attribute Analysis Framework,” 7th International Conference on Engineering and Emerging Technologies, ICEET 2021, 2021, doi: 10.1109/ICEET53442.2021.9659697.
F. Schroff, D. Kalenichenko, and J. Philbin, “FaceNet: A unified embedding for face recognition and clustering,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 07-12-June-2015, pp. 815–823, Oct. 2015, doi: 10.1109/CVPR.2015.7298682.
“GitHub - davidsandberg/facenet: Face recognition using Tensorflow.” Accessed: Sep. 13, 2024. [Online]. Available: https://github.com/davidsandberg/facenet
T. Baltrusaitis, P. Robinson, and L. P. Morency, “OpenFace: An open source facial behavior analysis toolkit,” 2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016, May 2016, doi: 10.1109/WACV.2016.7477553.
Y. Zhong, W. Deng, J. Hu, D. Zhao, X. Li, and D. Wen, “SFace: Sigmoid-Constrained Hypersphere Loss for Robust Face Recognition,” IEEE Transactions on Image Processing, vol. 30, pp. 2587–2598, 2021, doi: 10.1109/TIP.2020.3048632.
G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, “Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments.” [Online]. Available: http://vis-www.cs.umass.edu/lfw/.
C. Ferrari, S. Berretti, and A. Del Bimbo, “Extended YouTube Faces: A Dataset for Heterogeneous Open-Set Face Identification,” Proceedings - International Conference on Pattern Recognition, vol. 2018-August, pp. 3408–3413, Nov. 2018, doi: 10.1109/ICPR.2018.8545642.
A. Firmansyah, T. F. Kusumasari, and E. N. Alam, “Comparison of Face Recognition Accuracy of ArcFace, Facenet and Facenet512 Models on Deepface Framework,” in ICCoSITE 2023 - International Conference on Computer Science, Information Technology and Engineering: Digital Transformation Strategy in Facing the VUCA and TUNA Era, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 535–539. doi: 10.1109/ICCoSITE57641.2023.10127799.
I. William, D. R. Ignatius Moses Setiadi, E. H. Rachmawanto, H. A. Santoso, and C. A. Sari, “Face Recognition using FaceNet (Survey, Performance Test, and Comparison),” Proceedings of 2019 4th International Conference on Informatics and Computing, ICIC 2019, Oct. 2019, doi: 10.1109/ICIC47613.2019.8985786.
N. Mardiana, R. D. Dana, Faisal, I. Farida, A. G. Azwar, and Nurwathi, “Similarity Measures Implementation on Face Authentication using Indonesian Citizen ID Card,” Proceeding of 2023 17th International Conference on Telecommunication Systems, Services, and Applications, TSSA 2023, 2023, doi: 10.1109/TSSA59948.2023.10366880.
T. Wu and Y. Dong, “YOLO-SE: Improved YOLOv8 for Remote Sensing Object Detection and Recognition,” Applied Sciences 2023, Vol. 13, Page 12977, vol. 13, no. 24, p. 12977, Dec. 2023, doi: 10.3390/APP132412977.
J. Torres, “YOLOv8 Documentation: A Deep Dive into the Documentation - YOLOv8.” Accessed: Sep. 13, 2024. [Online]. Available: https://yolov8.org/yolov8-documentation/
J. Straka and I. Gruber, “Object Detection Pipeline Using YOLOv8 for Document Information Extraction,” 2023. [Online]. Available: https://github.com/strakaj/YOLOv8-for-document-understanding.git.
“GitHub - derronqi/yolov8-face: yolov8 face detection with landmark.” Accessed: Sep. 19, 2024. [Online]. Available: https://github.com/derronqi/yolov8-face?tab=readme-ov-file
Y. Li, J. Wang, B. Pullman, N. Bandeira, and Y. Papakonstantinou, “Index-based, High-dimensional, Cosine Threshold Querying with Optimality Guarantees,” Theory of Computing Systems / Mathematical Systems Theory, vol. 65, no. 1, pp. 42–83, Jan. 2021, doi: 10.1007/S00224-020-10009-6.
J. Deng, J. Guo, X. An, Z. Zhu, and S. Zafeiriou, “Masked Face Recognition Challenge: The InsightFace Track Report,” Proceedings of the IEEE International Conference on Computer Vision, vol. 2021-October, pp. 1437–1444, Aug. 2021, doi: 10.1109/ICCVW54120.2021.00165.
Y. Shi and A. Jain, “Probabilistic face embeddings,” in Proceedings of the IEEE International Conference on Computer Vision, Institute of Electrical and Electronics Engineers Inc., Oct. 2019, pp. 6901–6910. doi: 10.1109/ICCV.2019.00700.
J. H. Grabman and C. S. Dodson, “Stark Individual Differences: Face Recognition Ability Influences the Relationship Between Confidence and Accuracy in a Recognition Test of Game of Thrones Actors,” J Appl Res Mem Cogn, vol. 9, no. 2, pp. 254–269, Jun. 2020, doi: 10.1016/j.jarmac.2020.02.007.
Jamal Rosid, “Face Recognition Dengan Metode Haar Cascade dan Facenet,” Indonesian Journal of Data and Science, vol. 3, no. 1, pp. 30–34, 2022, doi: 10.56705/ijodas.v3i1.38.
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Almas Najiib Imam Muttaqin, Ardytha Luthfiarta, Adhitya Nugraha, Pramesya Mutia Salsabila
This work is licensed under a Creative Commons Attribution 4.0 International License.
