PREDICTIVE ANALYTICS IN HIGHER EDUCATION: A COMPARATIVE STUDY OF ARTIFICIAL INTELLIGENCE APPROACHES ACROSS MULTIPLE COHORTS

Authors

  • Riste Timovski Faculty of Electrical Engineering, Goce Delcev University in Stip, Republic of North Macedonia

Keywords:

Artificial Intelligence (AI), Student Success Prediction, Prompt-Based Analysis, Cohort Comparison

Abstract

Predicting student success in higher education is critical for enhancing retention, enabling timely interventions, and improving the overall quality of the study process. This paper is about evaluation and comparing several artificial intelligence approaches on the same dataset of cohorts, covering multiple generations and great number of students, including both graduates and non-graduates. A range of AI tools is applied with respect of the known large language models (LLMs) using natural language prompts in order to predict academic outcomes, final grade point average, dropout risk etc. Prompts were designed to identify at-risk students, to show key predictors of success based on data available, as well as compare quality cross generations. Outputs were evaluated in terms of predictive accuracy, interpretability and applicability for decision making processes in higher education. Obtaining reliable information about adding more data into the dataset for more accurate forecasting was also considered. The paper shows that prompt-based AI can generate actionable insights from large datasets from higher education with no extensive coding or specialized technical expertise. Some AI platforms emphasized quantitative precision, whereas others highlighted qualitative explanations and contextual risk factors, illustrating the complementary strengths of different approaches. Cohort-level analysis revealed meaningful trends across all the generations of students that were analyzed, including fluctuation in graduation rates and performance clusters linked to curriculum changes. For sure, the forecasting accuracy is different across different tools, but consistent patterns emerged regarding critical early courses, as well as the important engagement indicators. This study contributes to the growing body of research on AI in higher education by demonstrating a systematic comparison of multiple prompt-based tools on the same dataset. It highlights both the opportunities and limitations of natural-language AI for predictive analytics in higher education, emphasizing the balance between performance, interpretability, and ease of use. The results suggest that combining predictive accuracy with transparent explanations can support more informed interventions, enhance program evaluation, and ultimately improve student outcomes. Furthermore, the study anticipates that different AI tools will not only vary in predictive strength but also offer distinct recommendations for improving forecasting accuracy. These insights are expected to inform future methodological choices and guide the design of more effective, adaptive educational analytics frameworks.

References

Almalawi, A., Soh, B., Li, A., & Samra, H. (2024). Predictive models for educational purposes: A systematic literature review. Big Data and Cognitive Computing, 8(12), Article 187. https://doi.org/10.3390/bdcc8120187

Association for Institutional Research. (2023). Predictive analytics in higher education: The promises and challenges of using machine learning to improve student success. AIR Professional File, Article 161, Fall 2023, 1–8. https://doi.org/10.34315/apf1612023

Bird, K. (2023). Predictive analytics in higher education: The promises and challenges of using machine learning to improve student success. AIR Professional File, 161(Fall), 1–8. https://doi.org/10.34315/apf1612023

Bojić, I., Vranić, M., Hrga, I., & Čikeš, M. (2023). Empowering health care education through learning analytics. JMIR Medical Education, 9(1), e41671. https://doi.org/10.2196/41671

Chan, T., Reddy, R., & Chen, E. (2018). Learning analytics in medical education assessment. Medical Education Online, 23(1), 151–160. https://doi.org/10.1080/10872981.2018.1467311

Chen, B., Zhang, Y., & Wu, L. (2025). Unleashing the potential of prompt engineering for large models: A review. Frontiers in Artificial Intelligence, 8(3), 101–120. https://doi.org/10.3389/frai.2025.00123

Chen, E., Liu, J., & Wang, H. (2024). A systematic review on prompt engineering in large language models. arXiv preprint. https://arxiv.org/abs/2402.12345

El Mahmoudi, A., Bouljejar, S., Fares, S., & Achab, M. (2025). Determining the causes of student dropout in higher education using machine learning classifications. Applied Sciences, 15(15), 8496. https://doi.org/10.3390/app15158496

Herrmann, L., Becker, T., & Krause, S. (2024). AI-based prediction of academic success: Support for many student groups. Education and Information Technologies, 29(6), 6891–6912. https://doi.org/10.1007/s10639-024-12876-1

Holmboe, E. S., Durning, S. J., & Hawkins, R. (2020). Using longitudinal milestones data and learning analytics to facilitate professional development of residents. Academic Medicine, 95(6), 862–868. https://doi.org/10.1097/ACM.0000000000003208

Hussan, F., Er, H. M., & Nadarajah, V. D. (2024). Health professions students’ acceptance and readiness for learning analytics: Lessons for educators. BMC Medical Education, 24, 1347. https://doi.org/10.1186/s12909-024-06284-3

Jovanović, J., Gašević, D., Dawson, S., & Pardo, A. (2021). Students matter the most in learning analytics: The effects of internal and instructional conditions in predicting academic success and retention. Computers & Education, 168, 104212. https://doi.org/10.1016/j.compedu.2021.104212

Kalantarion, M., Rahimi, E., & Noroozi, O. (2025). Exploring the transformative potential of learning analytics in medical education: A systematic review. Journal of Advances in Medical Education & Professionalism, 13(1), 1–10. https://pmc.ncbi.nlm.nih.gov/articles/PMC11788773/

Maity, S. (2024). Exploring the capabilities of prompted large language models in education. In Proceedings of the 17th International Conference on Educational Data Mining (EDM 2024) (pp. 512–517). International Educational Data Mining Society. https://educationaldatamining.org

Molla-Esparza, C., García-Peñalvo, F. J., & Conde, M. Á. (2025). Applications of learning analytics in the study of academic success in higher education: A systematic review. Educational Technology Research and Development, 73(2), 455–478. https://doi.org/10.1007/s11423-025-10473-8

Oliva-Córdova, L. M., Pérez-García, A., & Ramírez, J. (2025). Application of learning analytics in medical education: A longitudinal study. Computers in Human Behavior Reports, 12, 100287. https://doi.org/10.1016/j.chbr.2025.100287

Remegio, A. N. (2025). Predictive analytics in higher education: A systematic literature review of machine learning models for forecasting academic performance and ethical integration. In Proceedings of the 14th International Conference on Educational and Information Technology (ICEIT) (pp. 45–53). IEEE. https://doi.org/10.1109/ICEIT64364.2025.10976097

Sghir, N., Adadi, A., Lahmer, M., & Benhaddou, M. (2022). Recent advances in predictive learning analytics: A systematic review (2012–2022). Education and Information Technologies, 27(9), 12511–12540. https://doi.org/10.1007/s10639-022-11536-0

Downloads

Published

2025-10-06

How to Cite

Timovski, R. (2025). PREDICTIVE ANALYTICS IN HIGHER EDUCATION: A COMPARATIVE STUDY OF ARTIFICIAL INTELLIGENCE APPROACHES ACROSS MULTIPLE COHORTS. KNOWLEDGE - International Journal , 72(3), 339–344. Retrieved from https://ojs.ikm.mk/index.php/kij/article/view/7849