Enhancing Diagnostic Accuracy of Polycystic Ovary Syndrome Classification in Ultrasound Images Using a Hybrid Deep Learning Model of VGG16 and AlexNet

Authors

  • Hj. Maisarah Informatics Engineering, Universitas Dian Nuswantoro, Semarang, Indonesia
  • M. Arief Soeleman Informatics Engineering, Universitas Dian Nuswantoro, Semarang, Indonesia
  • Pujiono Informatics Engineering, Universitas Dian Nuswantoro, Semarang, Indonesia
  • Iqbal Firdaus Information Technology, Institut Bisnis dan Teknologi Kalimantan, Banjarmasin, Indonesia
  • Gusti Aditya Aromatica Firdaus Information Technology, Institut Bisnis dan Teknologi Kalimantan, Banjarmasin, Indonesia

DOI:

https://doi.org/10.52436/1.jutif.2026.7.2.4932

Keywords:

Convolutional Neural Network (CNN), Deep Learning, Hybrid CNN, Polycystic Ovary Syndrome (PCOS), Ultrasound Imaging, VGG16-AlexNet

Abstract

Diagnosis of Polycystic Ovary Syndrome (PCOS) using ultrasound (USG) imaging still faces a major challenge in the form of inter-observer variability, which can lead to inconsistent diagnostic outcomes and increase the risk of misclassification. This limitation highlights the urgent need for an automated artificial intelligence (AI)–based system capable of performing ultrasound image classification with greater objectivity, accuracy, and consistency. This study aims to develop an automated PCOS classification model based on a hybrid Convolutional Neural Network (CNN) architecture that integrates VGG16 and AlexNet through a feature concatenation mechanism, following preprocessing and data augmentation steps to enhance model generalization. The model’s performance was evaluated using accuracy, precision, recall, F1-score, and specificity as key metrics. Experimental results demonstrate that the VGG16–AlexNet hybrid model achieved the best performance, with an accuracy of 98.26%, precision of 97.90%, recall of 97.90%, F1-score of 97.90%, and specificity of 98.52%. These results outperform other hybrid configurations such as VGG16–MobileNetV2, VGG16–ResNet50, and VGG16–InceptionV3, each of which achieved accuracies above 96%. These findings confirm that combining the feature depth of VGG16 with the computational efficiency of AlexNet enables more comprehensive extraction of spatial and textural patterns in ultrasound images. Consequently, the proposed hybrid model offers a promising AI-driven diagnostic support system that not only enhances the accuracy of PCOS detection but also assists clinicians in making faster, more objective, and consistent medical decisions.

Downloads

Download data is not yet available.

References

R. Deswal, V. Narwal, A. Dang, and C. S. Pundir, “The Prevalence of Polycystic Ovary Syndrome: A Brief Systematic Review,” J. Hum. Reprod. Sci., vol. 13, no. 4, pp. 261–271, 12 2020, doi: 10.4103/jhrs.JHRS_95_18.

H. J. Teede et al., “Recommendations from the international evidence-based guideline for the assessment and management of polycystic ovary syndrome,” Fertil. Steril., vol. 110, no. 3, pp. 364–379, Aug. 2018, doi: 10.1016/j.fertnstert.2018.05.004.

K. M. Jakubowska-Kowal, K. J. Skrzynska, and A. M. Gawlik-Starzyk, “Prevalence and diagnosis of polycystic ovary syndrome (PCOS) in adolescents what’s new in 2023? Systematic review,” Ginekol. Pol., vol. 95, pp. 643–649, 2024, doi: 10.5603/gpl.98849.

Y. Hasegawa et al., “Impact of the difference in diagnostic criteria for adolescent polycystic ovary syndrome excluding polycystic ovarian morphology,” J. Obstet. Gynaecol. Res., vol. 50, no. 8, pp. 1289–1294, Aug. 2024, doi: 10.1111/jog.15975.

A. Ghafari, M. Maftoohi, M. E. Samarin, S. Barani, M. Banimohammad, and R. Samie, “The last update on polycystic ovary syndrome(PCOS), diagnosis criteria, and novel treatment,” Endocr. Metab. Sci., vol. 17, p. 100228, Mar. 2025, doi: 10.1016/j.endmts.2025.100228.

J. P. Christ and M. I. Cedars, “Current Guidelines for Diagnosing PCOS,” Diagnostics, vol. 13, no. 6, p. 1113, Mar. 2023, doi: 10.3390/diagnostics13061113.

D. Fahs, D. Salloum, M. Nasrallah, and G. Ghazeeri, “Polycystic Ovary Syndrome: Pathophysiology and Controversies in Diagnosis,” Diagnostics, vol. 13, no. 9, p. 1559, Apr. 2023, doi: 10.3390/diagnostics13091559.

T. Baba, “Polycystic ovary syndrome: Criteria, phenotypes, race and ethnicity,” John Wiley Sons Aust. Ltd Behalf Jpn. Soc. Reprod. Med., p. 12, Jan. 2025, doi: 10.1002/rmb2.12630.

J. Parker, C. O’Brien, C. Yeoh, F. Gersh, and S. Brennecke, “Reducing the Risk of Pre-Eclampsia in Women with Polycystic Ovary Syndrome Using a Combination of Pregnancy Screening, Lifestyle, and Medical Management Strategies,” J. Clin. Med., vol. 13, no. 6, p. 1774, Mar. 2024, doi: 10.3390/jcm13061774.

G. E. Colombo, S. Pirotta, and A. Sabag, “Diet and Exercise in the Management of Polycystic Ovary Syndrome: Practical Considerations for Person-Centered Care,” Semin. Reprod. Med., vol. 41, no. 01/02, pp. 026–036, Mar. 2023, doi: 10.1055/s-0043-1777116.

The Rotterdam ESHRE/ASRM-sponsored PCOS consensus workshop group, “Revised 2003 consensus on diagnostic criteria and long-term health risks related to polycystic ovary syndrome (PCOS),” Hum. Reprod., vol. 19, no. 1, pp. 41–47, Jan. 2004, doi: 10.1093/humrep/deh098.

D. J. Patel, K. Chaudhari, N. Acharya, D. Shrivastava, and S. Muneeba, “Artificial Intelligence in Obstetrics and Gynecology: Transforming Care and Outcomes,” Cureus, July 2024, doi: 10.7759/cureus.64725.

F. Nasir, R. Shanur, and N. Nasir, “Breast Cancer Detection Using Convolutional Neural Networks: A Deep Learning-Based Approach,” Springer Nat., vol. 17, no. 5, May 2025, doi: 10.7759/cureus.83421.

I. Nurcahyati, T. Hamonangan Saragih, A. Farmadi, D. Kartini, and Muliadi, “Classification of Lung Disease in X-Ray Images Using Gray Level Co-Occurrence Matrix Method and Convolutional Neural Network,” J. Electron. Electromed. Eng. Med. Inform., vol. 6, no. 4, pp. 332–342, Aug. 2024, doi: https://doi.org/10.35882/jeeemi.v6i4.457.

C. Yin, H. Zhang, J. Du, Y. Zhu, H. Zhu, and H. Yue, “Artificial intelligence in imaging for liver disease diagnosis,” Front. Med., vol. 12, p. 1591523, Apr. 2025, doi: 10.3389/fmed.2025.1591523.

A. K. M. S. Hosain, M. H. K. Mehedi, and I. E. Kabir, “PCONet: A Convolutional Neural Network Architecture to Detect Polycystic Ovary Syndrome (PCOS) from Ovarian Ultrasound Images,” Oct. 02, 2022, arXiv: arXiv:2210.00407. doi: 10.48550/arXiv.2210.00407.

S. S., S. Umapathy, O. Alhajlah, F. Almutairi, S. Aslam, and A. R. K., “F-Net: Follicles Net an efficient tool for the diagnosis of polycystic ovarian syndrome using deep learning techniques,” PLOS ONE, vol. 19, no. 8, p. e0307571, Aug. 2024, doi: 10.1371/journal.pone.0307571.

P. Moral, D. Mustafi, A. Mustafi, and S. K. Sahana, “CystNet: An AI driven model for PCOS detection using multilevel thresholding of ultrasound images,” Sci. Rep., vol. 14, no. 1, p. 25012, Oct. 2024, doi: 10.1038/s41598-024-75964-3.

P. Chitra, K. Srilatha, M. Sumathi, F. V. Jayasudha, T. Bernatin, and M. Jagadeesh, “Classification of Ultrasound PCOS Image using Deep Learning based Hybrid Models,” in 2023 Second International Conference on Electronics and Renewable Systems (ICEARS), Tuticorin, India: IEEE, Mar. 2023, pp. 1389–1394. doi: 10.1109/ICEARS56392.2023.10085400.

L. Wang, “Mammography with deep learning for breast cancer detection,” Front. Oncol., vol. 14, p. 1281922, Feb. 2024, doi: 10.3389/fonc.2024.1281922.

K. Simonyan and A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” Apr. 10, 2015, arXiv: arXiv:1409.1556. doi: 10.48550/arXiv.1409.1556.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Commun. ACM, vol. 60, no. 6, pp. 84–90, May 2017, doi: 10.1145/3065386.

F. Alshagathrh et al., “Hybrid Deep Learning and Machine Learning for Detecting Hepatocyte Ballooning in Liver Ultrasound Images,” Diagnostics, vol. 14, no. 23, p. 2646, Nov. 2024, doi: 10.3390/diagnostics14232646.

M. Abdullah, F. B. Abrha, B. Kedir, and T. Tamirat Tagesse, “A Hybrid Deep Learning CNN model for COVID-19 detection from chest X-rays,” Heliyon, vol. 10, no. 5, p. e26938, Mar. 2024, doi: 10.1016/j.heliyon.2024.e26938.

A. Hanzala, T. Akter, and Md. S. Rahman, “A hybrid approach for cervical cancer detection: Combining D-CNN, transfer learning, and ensemble models,” Array, vol. 27, p. 100434, Sept. 2025, doi: 10.1016/j.array.2025.100434.

S. M. Shafi and S. K. Chinnappan, “Hybrid transformer-CNN and LSTM model for lung disease segmentation and classification”, doi: DOI%2010.7717/peerj-cs.2444.

M. Kaddes, Y. M. Ayid, A. M. Elshewey, and Y. Fouad, “Breast cancer classification based on hybrid CNN with LSTM model,” Sci. Rep., vol. 15, Feb. 2025, doi: doi.org/10.1038/s41598-025-88459-6.

J. D. Miller, V. A. Arasu, A. X. Pu, L. R. Margolies, W. Sieh, and L. Shen, “Self-Supervised Deep Learning to Enhance Breast Cancer Detection on Screening Mammography,” Mar. 2022, doi: 10.48550/arXiv.2203.08812.

D. Gambhir, D. Aggarwal, and Sadhan02, “KaggleDelhi : PCOS Detection From Ultrasound Images.” [Online]. Available: https://www.kaggle.com/datasets/divyangambhir1/kaggledelhi

ibadeus, “PCOS-XAI Ultrasound Dataset.” [Online]. Available: https://www.kaggle.com/datasets/ibadeus/pcos-xai-ultrasound-dataset)

M. Buda, A. Maki, and M. A. Mazurowski, “A systematic study of the class imbalance problem in convolutional neural networks,” Neural Netw., vol. 106, pp. 249–259, Oct. 2018, doi: 10.1016/j.neunet.2018.07.011.

A. Mumuni and F. Mumuni, “Data augmentation: A comprehensive survey of modern approaches,” Array, vol. 16, p. 100258, Dec. 2022, doi: 10.1016/j.array.2022.100258.

N. Tajbakhsh et al., “Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?,” IEEE Trans. Med. Imaging, vol. 35, no. 5, pp. 1299–1312, May 2016, doi: 10.1109/TMI.2016.2535302.

S. R. P M, V. S, S. R P, A. S, R. K, and R. K, “Advances in Multimodal Fusion of EHR and Medical Imaging Data Using deep learning techniques for advanced treatment of brain cancer,” in Proceedings of the 2024 8th International Conference on Algorithms, Computing and Systems, Hong Kong NB China: ACM, Oct. 2024, pp. 104–109. doi: 10.1145/3708597.3708613.

M. Reyad, A. M. Sarhan, and M. Arafa, “A modified Adam algorithm for deep neural network optimization,” Neural Comput. Appl., vol. 35, no. 23, pp. 17095–17112, Aug. 2023, doi: 10.1007/s00521-023-08568-z.

A. J. Aiya et al., “Optimized deep learning for brain tumor detection: a hybrid approach with attention mechanisms and clinical explainability,” Sci. Rep., vol. 15, no. 1, p. 31386, Aug. 2025, doi: 10.1038/s41598-025-04591-3.

D. Muller, I. Soto-Rey, and F. Kramer, “An Analysis on Ensemble Learning Optimized Medical Image Classification With Deep Convolutional Neural Networks,” IEEE Access, vol. 10, pp. 66467–66480, 2022, doi: 10.1109/ACCESS.2022.3182399.

D. Chicco and G. Jurman, “The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation,” BMC Genomics, vol. 21, no. 1, p. 6, Dec. 2020, doi: 10.1186/s12864-019-6413-7.

B. Kocak et al., “Evaluation metrics in medical imaging AI: fundamentals, pitfalls, misapplications, and recommendations,” Eur. J. Radiol. Artif. Intell., vol. 3, p. 100030, Sept. 2025, doi: 10.1016/j.ejrai.2025.100030.

A. Marvellous, B. Matthew, M. Pezzè, and S. Abrahão, “Statistical Significance Testing in ML Model Comparisons: Beyond p-values and t-tests,” researchgate, June 2025, [Online]. Available: https://www.researchgate.net/publication/392727623

D. Singh, V. Kumar, Vaishali, and M. Kaur, “Classification of COVID-19 patients from chest CT images using multi-objective differential evolution–based convolutional neural networks,” Eur. J. Clin. Microbiol. Infect. Dis., vol. 39, no. 7, pp. 1379–1389, July 2020, doi: 10.1007/s10096-020-03901-z.

X. Li, X. Shen, Y. Zhou, X. Wang, and T.-Q. Li, “Classification of breast cancer histopathological images using interleaved DenseNet with SENet (IDSNet),” PLOS ONE, vol. 15, no. 5, p. e0232127, May 2020, doi: 10.1371/journal.pone.0232127.

P. E. Susanto, A. Kurniawardhan, D. H. Fudholi, and R. Rahmadi, “A Mobile Deep Learning Model on Covid-19 CT-Scan Classification,” Int. J. Artif. Intell. Res., vol. 6, no. 2, July 2022, doi: 10.29099/ijair.v6i1.257.

Y. Wang, X. Liao, D. Qiao, and J. Wu, “A Hybrid Classification Method of Medical Image Based on Deep Learning,” Aug. 24, 2021. doi: 10.21203/rs.3.rs-836474/v1.

Additional Files

Published

2026-04-15

How to Cite

[1]
H. Maisarah, M. A. . Soeleman, P. Pujiono, I. . Firdaus, and G. A. A. . Firdaus, “Enhancing Diagnostic Accuracy of Polycystic Ovary Syndrome Classification in Ultrasound Images Using a Hybrid Deep Learning Model of VGG16 and AlexNet”, J. Tek. Inform. (JUTIF), vol. 7, no. 2, pp. 760–777, Apr. 2026.