FACIAL PHOTO AUTHENTICITY DETECTION USING FACE RECOGNITION AND LIVENESS DETECTION

Bimo Vallentino Achmad; Supatman Supatman

doi:10.52436/1.jutif.2024.5.5.2328

Bimo Vallentino Achmad Informatics, Universitas Mercu Buana Yogyakarta, Indonesia
Supatman Informatics, Universitas Mercu Buana Yogyakarta, Indonesia

DOI: https://doi.org/10.52436/1.jutif.2024.5.5.2328

Keywords: convolutional neural network, CNN, face recognition, liveness detection

Abstract

Facial recognition has been widely adopted by many systems as authentication. However, relying on facial photos for authentication is insufficient, as these can be manipulated using printed or digital photos. One method that can be used to prevent this is to integrate face recognition with liveness detection. In this research, face recognition and liveness detection are implemented using a Convolutional Neural Network (CNN) because CNN has the ability to process and extract features from photos effectively. There are two types of datasets used, namely CelebA-Spoof for liveness detection and lfw-deepfunneled for face recognition. The face recognition model achieved good accuracy and loss results of 0.9153 and 0.0514, very promising. Meanwhile, the liveness detection accuracy and loss were 0.8633 and 0.7166.

Downloads

Download data is not yet available.

References

A. K. Jain, D. Deb, and J. J. Engelsma, “Biometrics: Trust, But Verify,” IEEE Trans. Biom. Behav. Identity Sci., vol. 4, no. 3, pp. 303–323, Jul. 2022, doi: 10.1109/TBIOM.2021.3115465.

P. Datta, S. Bhardwaj, S. N. Panda, S. Tanwar, and S. Badotra, “Survey of Security and Privacy Issues on Biometric System,” in Handbook of Computer Networks and Cyber Security, B. B. Gupta, G. M. Perez, D. P. Agrawal, and D. Gupta, Eds., Cham: Springer International Publishing, 2020, pp. 763–776. doi: 10.1007/978-3-030-22277-2_30.

I. Adjabi, A. Ouahabi, A. Benzaoui, and A. Taleb-Ahmed, “Past, Present, and Future of Face Recognition: A Review,” Electronics, vol. 9, no. 8, p. 1188, Jul. 2020, doi: 10.3390/electronics9081188.

Y. Kortli, M. Jridi, A. Al Falou, and M. Atri, “Face Recognition Systems: A Survey,” Sensors, vol. 20, no. 2, p. 342, Jan. 2020, doi: 10.3390/s20020342.

Y. Moon, I. Ryoo, and S. Kim, “Face Antispoofing Method Using Color Texture Segmentation on FPGA,” Security and Communication Networks, vol. 2021, pp. 1–11, May 2021, doi: 10.1155/2021/9939232.

E. A. Raheem, S. M. S. Ahmad, and W. A. W. Adnan, “Insight on face liveness detection: A systematic literature review,” IJECE, vol. 9, no. 6, p. 5865, Dec. 2019, doi: 10.11591/ijece.v9i6.pp5865-5175.

M. Basurah, W. Swastika, and O. H. Kelana, “IMPLEMENTATION OF FACE RECOGNITION AND LIVENESS DETECTION SYSTEM USING TENSORFLOW.JS,” JIP, vol. 9, no. 4, pp. 509–516, Aug. 2023, doi: 10.33795/jip.v9i4.1332.

S. R. Akhdan, R. Supriyanti, and A. S. Nugroho, “Face recognition with anti spoofing eye blink detection,” Perlis, Malaysia, 2023, p. 020006. doi: 10.1063/5.0113512.

M. Zhou et al., “Securing Face Liveness Detection Using Unforgeable Lip Motion Patterns,” 2021, doi: 10.48550/ARXIV.2106.08013.

R. J. Raghavendra and R. S. Kunte, “A Novel Feature Descriptor for Face Anti-Spoofing Using Texture Based Method,” Cybernetics and Information Technologies, vol. 20, no. 3, pp. 159–176, Sep. 2020, doi: 10.2478/cait-2020-0035.

S. Rao, Y. Huang, K. Cui, and Y. Li, “Anti-spoofing face recognition using a metasurface-based snapshot hyperspectral image sensor,” Optica, vol. 9, no. 11, p. 1253, Nov. 2022, doi: 10.1364/OPTICA.469653.

X. Liu, Z. Deng, and Y. Yang, “Recent progress in semantic image segmentation,” Artif Intell Rev, vol. 52, no. 2, pp. 1089–1106, Aug. 2019, doi: 10.1007/s10462-018-9641-3.

Khatina Sari, Jasmir, and Y. Arvita, “Perancangan Sistem Absensi Facial Recognition Menggunakan CNN dan Liveness Detector pada BPR Central Dana Mandiri,” JAKAKOMUNAMA, vol. 2, no. 1, pp. 70–80, Apr. 2022, doi: 10.33998/jakakom.2022.2.1.63.

S. Liu, Y. Song, M. Zhang, J. Zhao, S. Yang, and K. Hou, “An Identity Authentication Method Combining Liveness Detection and Face Recognition,” Sensors, vol. 19, no. 21, p. 4733, Oct. 2019, doi: 10.3390/s19214733.

X. Liu, Z. Deng, and Y. Yang, “Recent progress in semantic image segmentation,” Artif Intell Rev, vol. 52, no. 2, pp. 1089–1106, Aug. 2019, doi: 10.1007/s10462-018-9641-3.

L. Chen, S. Li, Q. Bai, J. Yang, S. Jiang, and Y. Miao, “Review of Image Classification Algorithms Based on Convolutional Neural Networks,” Remote Sensing, vol. 13, no. 22, p. 4712, Nov. 2021, doi: 10.3390/rs13224712.

Y. Zhang et al., “CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotations,” 2020, doi: 10.48550/ARXIV.2007.12342.

G. Huang, M. Mattar, H. Lee, and E. G. Learned-miller, “Learning to Align from Scratch,” neural information processing systems, vol. 25, pp. 764–772, Dec. 2012.

D. Bhatt et al., “CNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope,” Electronics, vol. 10, no. 20, p. 2470, Oct. 2021, doi: 10.3390/electronics10202470.

L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” J Big Data, vol. 8, no. 1, p. 53, Mar. 2021, doi: 10.1186/s40537-021-00444-8.

B. I. Hairab, M. Said Elsayed, A. D. Jurcut, and M. A. Azer, “Anomaly Detection Based on CNN and Regularization Techniques Against Zero-Day Attacks in IoT Networks,” IEEE Access, vol. 10, pp. 98427–98440, 2022, doi: 10.1109/ACCESS.2022.3206367.

S. Sharma and V. Kumar, “3D landmark‐based face restoration for recognition using variational autoencoder and triplet loss,” IET Biometrics, vol. 10, no. 1, pp. 87–98, Jan. 2021, doi: 10.1049/bme2.12005.

Y. Wang, Z. Xiao, and G. Cao, “A convolutional neural network method based on Adam optimizer with power-exponential learning rate for bearing fault diagnosis,” J. vibroeng., vol. 24, no. 4, pp. 666–678, Jun. 2022, doi: 10.21595/jve.2022.22271.

N. Surantha and B. Sugijakko, “Lightweight face recognition-based portable attendance system with liveness detection,” Internet of Things, vol. 25, p. 101089, Apr. 2024, doi: 10.1016/j.iot.2024.101089

J. Sen, B. Sarkar, A. Hena, and Md. H. Rahman, “Face Recognition Using Deep Convolutional Network and One-shot Learning,” SSRG - IJCSE, vol. 7, no. 4, pp. 23–29, Apr. 2020, doi: 10.14445/23488387/IJCSE-V7I4P107.