INTEGRATION OF TWO-SIDED EVALUATION OF A STUDY PROGRAM TOWARDS A SINGLE QUALITATIVE REPORT
Keywords:
AHP – Analytic Hierarchy Process, QA –Quality Assurance, HE – Higher education, EHEA – European Higher Education AreaAbstract
Quality assurance in higher education is a complex multifaceted process. Based on the legislative in the European Higher Education Area (EHEA) and worldwide, it is focused on the study program as pillar of the HE system that integrates the influence of all stakeholders regarding the quality in itself. After completion of the study program, graduates are provided with the appropriate qualifications defined with the study program official approval (which is decision for accreditation from the state officials). In order to be as efficient as it is possible, it has to be directly related to two important topics in terms of qualifications delivery: what types of qualifications are delivered (types and their essence) and how are those qualifications delivered (what methods and techniques are used)? The answer of the question what is delivered is related to the substantive (essential) aspect of the study program, referring to the qualifications that are expected to be gained in terms of skills, knowledge and competencies at the very end of the study process. The answer of the question how the qualifications are delivered is related to the teachers themselves and their work during the classes, their engagement, technologies used, methods applied, specific approach etc. The qualifications that are evaluated in this work are part of the elaborate for accreditation of the study program as official document, showing exactly what is to be expected essentially from each graduate in terms of qualifications gained. On the other side, the criteria referring to the methodological part of the study program (how things are done) are part of broader analysis in another research, dealing with qualitative assessment work and model proposals related to the teachers work. There are really many aspects and criteria describing the methodological aspect of the teachers work. Related to this paper, four are evaluated: planning and organization activities, encouraging practical application of the study program during the course, application of new technologies, approaches and tools in teaching (digital per se) and direct support of the student, such as readiness to mentor each student. The idea is to combine these aspects (substantial and methodological aspect of the study program) towards generation of one single quality report. Both aspects are evaluated using optimization MCDM technique Analytic Hierarchy Process (AHP) related to a specific study program, that enables transition from qualitative to quantitative aspect, with objectivity included, thus enabling data processing and generating readable reports. One basic assumption in this paper is that the importance of the substantial and methodological part of the study program conduction is equal, meaning they equally participate in the process of formation of the educated stuff. But, the model itself proposes possibility of different approach towards their importance, depending on the needs and the estimates. At the very end, results are combined in one final report showing the efficiency scale of the courses related to the both aspects evaluated with the AHP method, leading to conclusions about the individual and also, overall efficiency of the study program.
References
Chen, L., & Wang, J. (2024). Application of mathematical modeling in analyzing and optimizing English teaching methods in vocational education. Applied mathematics and Nonlinear Sciences 9(1). DOI: http://dx.doi.org/10.2478/amns-2024-2522
Gass, S. (2001). The Analytic Hierarchy Process-An Exposition. Operations Research. 49. 469-486. DOI: http://dx.doi.org/10.1287/opre.49.4.469.11231.
Grifoll, J., Hopbach, A., Kekalainen, H., Lugano, N., Rozsnyai, C., & Shopov, T. (2012). Quality procedures in the European higher education area and beyond – visions for the future. Third ENQUA survey
Hussein Suleima, A. (2023). Quality Assurance Strategies in Higher Education Institutions. IOSR Journal of Research & Method in Education (IOSRJRME) 13(5):29-37 DOI: http://dx.doi.org/10.9790/7388-1305012936
Hwang C.L., & Yoon K. (1981). Multiple Attribute Decision Making: Methods and Applications: A State-of-the-Art Survey. Springer-Verlag, New York, NY.
Kundu, Goutam Kumar (2016). Higher Education Quality: A Literature Review. ICTACT JOURNAL ON MANAGEMENT STUDIES, MAY 2016, VOLUME: 02, ISSUE: 02 DOI: http://dx.doi.org/10.21917/ijms.2016.0037
Madu, Christian N., & Kuei, Chu Hua (1993). Dimensions of Quality Teaching in Higher Institutions. Total Quality Management, Vol. 4, No. 3, pp. 325-338.
Mustafa, Sameer T. & Chiang, Dalen (2006). Dimensions of Quality in Higher Education: how Academic Performance Affects University Students Teacher Evaluations. Journal of American Academy of Business, Vol. 8, No. 1, pp. 294- 303.
Newby, P. (1999). Culture and quality in higher education. Higher Education Policy, Vol. 12 No. 3, pp. 261-75.
Nguyen, G.H. (2014). The Analytic Hierarchy Process: A Mathematical Model for Decision Making Problems. Senior Independent Study These. Paper 6054
Nicholson, K. (2011). Quality Assurance in Higher Education; A Review of the Literature. Council of Ontario Universities Degree Level Expectations Project, McMaster University.
Saaty, R.W. (1987). The analytic hierarchy process – what it is and how it is used. Math Modelling, Vol. 9, No. 3-5, pp 161-176. 0270-0255/87
Saaty, T. (1994). How to Make a Decision: The Analytic Hirarchy Process. Interfaces, 24, 19-43.
Salehzadeh, R., & Ziaeian, M. (2024). Decision making in human resource management: a systematic review of the applications of analytic hierarchy process. Frontiers in Psychology 15. DOI: http://dx.doi.org/10.3389/fpsyg.2024.1400772
Salomon, V., & Flavio Autran Monteiro Gomes, Luiz. (2024). Consistency Improvement in the Analytic Hierarchy Process. Mathematics 12 (6): 828. DOI: http://dx.doi.org/10.3390/math12060828
Sriana Umbase, R. (2023). Management of quality assurance and development of the quality culture of higher education in Indonesia. Multidisciplinary Reviews 6(4):2023032 DOI: http://dx.doi.org/10.31893/multirev.2023032
Thi Thanh Hang, P., & Thi Hue, T. (2024). Drivers of sustainable entrepreneurship education: An analytic hierarchy process. VNU University of Economics and Business 4(2). DOI: http://dx.doi.org/10.57110/vnu-jeb.v4i2.256
