Real-Time Halal Product Ingredient Classification based on Bilingual Text using Optical Character Recognition and One-Dimensional Convolutional Neural Network

Muhammad  Thohir; Muhammad  Irfan Karim; Vitri  Tundjungsari

doi:10.52436/1.jutif.2026.7.4.5638

Authors

Muhammad Thohir Faculty of Computer Science, Esa Unggul University, Indonesia
Muhammad Irfan Karim Faculty of Computer Science, Esa Unggul University, Indonesia
Vitri Tundjungsari Faculty of Computer Science, Esa Unggul University, Indonesia

DOI:

https://doi.org/10.52436/1.jutif.2026.7.4.5638

Keywords:

Convolutional Neural Network, Deep Learning, Halal-Haram Classification, Mobile Application, Optical Character Recognition, TensorFlow Lite

Abstract

Instant verification of halal status for food ingredients remains a significant challenge for Muslim consumers, particularly when facing complex compositions and foreign-language labels without internet access. This study aims to develop an offline, real-time mobile application for halal ingredient classification by implementing lightweight deep learning models on edge devices. The proposed system integrates Google ML Kit for text extraction and evaluates five neural network architectures: FastText, 1D-CNN, LSTM, GRU, and Multi-CNN trained on a balanced, bilingual (Indonesian–English) dataset comprising 123,449 ingredient samples. Experimental results demonstrate that the 1D-CNN model was the optimal choice, achieving an average accuracy of 99.72%, an average inference time of 60.99 ms, and a compact model size of 719.2 KB. Although the GRU model achieved marginally higher accuracy, the 1D-CNN provided a superior efficiency trade-off with a 2.6× faster training time and lower computational complexity. The primary scientific contribution of this research lies in demonstrating that lightweight 1D-CNN architectures can deliver high-precision, fully offline text-based classification on mobile edge devices, offering a robust alternative to latency-constrained cloud-based verification systems.

Downloads

Download data is not yet available.

References

S. Tarannum, Md. S. Jalal, and M. N. Huda, “HALALCheck: A Multi-Faceted Approach for Intelligent Halal Packaged Food Recognition and Analysis,” IEEE Access, vol. 12, pp. 28462–28474, 2024, doi: 10.1109/ACCESS.2024.3367983.

D. Kim, S.-Y. Kim, R. Yoo, J. Choo, and H. Yang, “Innovative AI methods for monitoring front-of-package information: A case study on infant foods,” PLoS ONE, vol. 19, no. 5, p. e0303083, May 2024, doi: 10.1371/journal.pone.0303083.

A. B. Altemimi et al., “AI‐Powered Advancements in Food Analysis and Safety: Ensuring Quality, Protection, and Precision in Modern Food Systems: A Review,” eFood, vol. 6, no. 4, p. e70076, Aug. 2025, doi: 10.1002/efd2.70076.

P. H. D. Santos, R. F. Ramos, J. E. Cruz, and P. C. Brom, “Traceability in sustainable agribusiness: A systematic review and future research directions,” Sustainable Production and Consumption, vol. 63, pp. 124–137, Mar. 2026, doi: 10.1016/j.spc.2026.01.005.

M. J. Rasyadi and A. Kurniawardhani, “Systematic Literature Review of Mobile Halal Product Verification Applications: Analysis of Methods, Features, and Innovation Potential,” Terapan Informatika Nusantara, vol. 6, no. 3, pp. 331–344, 2025, doi: 10.47065/tin.v6i3.8174.

D. Khairani, D. A. Bangkit, N. F. Rozi, S. U. Masruroh, S. Oktaviana, and T. Rosyadi, “Named-Entity Recognition and Optical Character Recognition for Detecting Halal Food Ingredients: Indonesian Case Study,” in 2022 10th International Conference on Cyber and IT Service Management (CITSM), Yogyakarta, Indonesia: IEEE, Sep. 2022, pp. 01–05. doi: 10.1109/CITSM56380.2022.9935966.

S. S. More, N. Patil, V. B. Lobo, N. Shet, D. Goswami, and P. Rane, “Empowering the Visually Impaired: YOLOv8-based Object Detection in Android Applications,” Procedia Computer Science, vol. 252, pp. 457–469, 2025, doi: 10.1016/j.procs.2025.01.005.

C. Singla et al., “An Optimized Deep Learning Model for Emotion Classification in Tweets,” Computers, Materials & Continua, vol. 70, no. 3, pp. 6365–6380, 2022, doi: 10.32604/cmc.2022.020480.

F. Y. Assiri, M. D. Alahmadi, M. A. Almuashi, and A. M. Almansour, “Extract Nutritional Information from Bilingual Food Labels Using Large Language Models,” Journal of Imaging, vol. 11, no. 8, p. 271, Aug. 2025, doi: 10.3390/jimaging11080271.

F. T. Boyrusbianto et al., “A simplex and multiplex PCR assay for simultaneous detection of beef, pork, and chicken meat in sausages based on mitochondrial DNA Cytochrome oxidase sub-unit I,” Food Research, vol. 7, no. 3, pp. 188–193, Jun. 2023, doi: 10.26656/fr.2017.7(3).084.

N. A. Nikmatullah and E. D. Permanasari, “Detection and quantification of pork and rat DNA in processed meats using multiplex quantitative Real‐Time PCR (m‐qPCR),” Indonesian Journal of Biotechnology, vol. 29, no. 3, p. 169, Sep. 2024, doi: 10.22146/ijbiotech.94212.

B. M. Adenuga, A. Spychaj, and M. Montowska, “A new nuclear marker for quantitative analysis of wild boar and domestic pig meat in game meat products using PLAG1 zinc finger gene,” Scientific Reports, vol. 15, no. 1, p. 20454, Jul. 2025, doi: 10.1038/s41598-025-05167-x.

M. H. Yuswan et al., “Non-Halal Gelatin Prediction: A Comparative Machine Learning Analysis between OPLS–DA and ANN Models,” Sains Malaysiana, vol. 54, no. 8, pp. 1913–1925, Aug. 2025, doi: 10.17576/jsm-2025-5408-04.

A. Nafi’, S. Avivi, B. Kuswandi, and A. Rohman, “E-nose for halal food authentication: a review,” Food Research, vol. 9, no. 3, pp. 235–244, Jun. 2025, doi: 10.26656/fr.2017.9(3).061.

A. Mustapha, I. Ishak, N. N. M. Zaki, M. R. Ismail-Fitry, S. Arshad, and A. Q. Sazili, “Application of machine learning approach on halal meat authentication principle, challenges, and prospects: A review,” Heliyon, vol. 10, no. 12, p. e32189, Jun. 2024, doi: 10.1016/j.heliyon.2024.e32189.

J. Zhao, W. Yang, H. Cai, G. Cao, and Z. Li, “Current Progress and Future Trends of Genomics-Based Techniques for Food Adulteration Identification,” Foods, vol. 14, no. 7, p. 1116, Mar. 2025, doi: 10.3390/foods14071116.

E. Yohannis, T. A. Teka, and M. M. Urugo, “Advancements in foodomics: Transformative applications in enhancing food processing, ensuring quality, safety, traceability, and verifying authenticity,” Food Chemistry Advances, vol. 9, p. 101138, Dec. 2025, doi: 10.1016/j.focha.2025.101138.

A. Karamoutsios et al., “Innovations in Proteomic Technologies and Artificial Neural Networks: Unlocking Milk Origin Identification,” BioTech, vol. 14, no. 2, p. 33, Apr. 2025, doi: 10.3390/biotech14020033.

W. B. Zulfikar, M. Irfan, and A. R. Atmadja, “A Deep Learning Approach Using VGG16 to Classify Beef and Pork Images”.

D. Purnamasari, K. Bachrudin, D. H. Suryana, and R. Robert, “Classification of meat using the convolutional neural network,” IJ-AI, vol. 12, no. 4, p. 1845, Dec. 2023, doi: 10.11591/ijai.v12.i4.pp1845-1853.

K. R. Mahmudah, M. K. Biddinika, D. C. Hakika, W. P. Tresna, I. T. Sugiarto, and I. Syafarina, “Automated Detection of Porcine Gelatin Using Deep Learning-Based E-Nose to Support Halal Authentication,” j.electron.electromedical.eng.med.inform, vol. 7, no. 1, pp. 220–230, Jan. 2025, doi: 10.35882/jeeemi.v7i1.654.

G. A. Francis, S. S. Jeyakumar, S. Ray, S. Supreethee, and R. Vashishth, “Emerging roles of FTIR spectroscopy in toxic metal profiling: innovations for food safety monitoring,” Food saf. and Risk, vol. 12, no. 1, p. 9, Sep. 2025, doi: 10.1186/s40550-025-00119-9.

S. Zhang, J. Chen, F. Gao, W. Su, T. Li, and Y. Wang, “Foodomics as a Tool for Evaluating Food Authenticity and Safety from Field to Table: A Review,” Foods, vol. 14, no. 1, p. 15, Dec. 2024, doi: 10.3390/foods14010015.

A. O. Ige and M. Sibiya, “State-of-the-Art in 1D Convolutional Neural Networks: A Survey,” IEEE Access, vol. 12, pp. 144082–144105, 2024, doi: 10.1109/ACCESS.2024.3433513.

D. Sunaryono et al., “Augmented Data Low Confidence (ADLC): A Confidence-Driven Data Augmentation Framework With Ensemble Optimization for Enhanced Machine Learning Performance,” IEEE Access, vol. 13, pp. 201439–201459, 2025, doi: 10.1109/ACCESS.2025.3636729.

I. A. Habibi, “Food Ingredients Dataset with Halal Label.” Kaggle, 2023. Accessed: Dec. 01, 2025. [Online]. Available: https://www.kaggle.com/datasets/irfanakbarihabibi/food-ingredients-dataset-with-halal-label

A. Apriani, I. N. Switrayana, R. Hammad, P. Irfan, and G. Y. Pratama, “Data Augmentation-Driven Predictive Performance Refinement in Multi-Model Convolutional Neural Network for Cocoa Ripeness Prediction,” Jurnal Teknik Informatika (JUTIF), vol. 6, no. 5, pp. 3871–3885, Oct. 2025, doi: 10.52436/1.jutif.2025.6.5.5298.

A. Q. Munir, R. Wardani, R. Setiyawan, and Z. Mustofa, “Deep Learning Rnn-Lstm Model For Forecasting Tourist Visits In Yogyakarta Using Bps Time-Series Data,” Jurnal Teknik Informatika (JUTIF), vol. 6, no. 6, pp. 5916–5929, 2025.

R. Khanam, M. Hussain, R. Hill, and P. Allen, “A Comprehensive Review of Convolutional Neural Networks for Defect Detection in Industrial Applications,” IEEE Access, vol. 12, pp. 94250–94295, 2024, doi: 10.1109/ACCESS.2024.3425166.

T. D. Salka, M. B. Hanafi, S. M. S. A. A. Rahman, D. B. M. Zulperi, and Z. Omar, “Plant leaf disease detection and classification using convolution neural networks model: a review,” Artificial Intelligence Review, vol. 58, no. 10, p. 322, Jul. 2025, doi: 10.1007/s10462-025-11234-6.

T. P. Tran, F. U. Din, L. Brankovic, C. Sanin, and S. M. Hester, “Med Herb Lens: A Prototype AI App for Medicinal Plant Identification,” Procedia Computer Science, vol. 270, pp. 2603–2612, 2025, doi: 10.1016/j.procs.2025.09.382.

D. Novaliendry, A. Permana, N. Dwiyani, N. Ardi, C.-H. Yang, and F. M. Saragih, “Development of a Semantic Text Classification Mobile Application Using TensorFlow Lite and Firebase ML Kit,” JESA, vol. 57, no. 6, pp. 1603–1611, Dec. 2024, doi: 10.18280/jesa.570607.

H. Hidayat and A. Imanullah, “Application System for Checking Halal Product Status Using QR-Code Based on Android and Web,” Jurnal Komputer Terapan, vol. 8, no. 1, pp. 46–54, May 2022, doi: 10.35143/jkt.v8i1.5309.

D. Ngo, H.-C. Park, and B. Kang, “Edge Intelligence: A Review of Deep Neural Network Inference in Resource-Limited Environments,” Electronics, vol. 14, no. 12, p. 2495, Jun. 2025, doi: 10.3390/electronics14122495.

M. Z. M. Al-Helali, N. Palanichamy, and K. Revathi, “Implementation of Lightweight Machine Learning Models for Real-time Text Classification on Resource-Constrained Devices,” Journal of Informatics and Web Engineering, vol. 4, no. 3, pp. 126–139, Oct. 2025, doi: 10.33093/jiwe.2025.4.3.7.

H. B. Firmansyah, A. Afriansyah, and V. Lorini, “Comparing BERTBase, DistilBERT and RoBERTa in Sentiment Analysis for Disaster Response,” Jurnal Teknik Informatika (JUTIF), vol. 6, no. 5, pp. 3419–3429, Oct. 2025, doi: 10.52436/1.jutif.2025.6.5.4766.