1. Introduction
1.1. Prerequisites and History of the Issue: Scientific and Legislative Aspects
The formation, development, and improvement of global education systems takes place in different ways, but the common principles are (1) the interest of the applicants and employers in the quality of education, (2) the autonomy of institutions, and (3) the involvement of stakeholders in the quality of education assurance. It is significant that today, researchers from different continents state both the necessity and inevitability of changes in the field of higher education and a certain inertia in this field [
1,
2].
However, significant changes in other areas of human life: social, economic, media, etc., lead to a constant review of the role and place of higher education in social processes, and hence to other approaches to ensuring its quality, which, in turn, require technology and improvement mechanisms, including the qualitative formation of the study program (SP). A milestone for the development of common approaches to higher education reforms in Europe was the development of Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG), the key objective of which is to contribute to the common understanding of quality assurance for learning and teaching across borders and among all stakeholders [
3] (p. 6). In particular, this document contains guidelines for the formation of the SP (standard 1.2) [
3] (pp. 11–12).
The qualitative organization of the study program contains the maximum involvement of all stakeholders, both external and internal ones: employers, the higher education institution (HEI), each of the teachers and departments (laboratories, clinics, centers, etc.) that will be involved in the implementation of the SP, and an established system of communication between those responsible for the preparation of the SP. Given the above, our article suggests an approach to the study program creation, which involves the consideration of this process as a system: an explanation of the necessary steps, components, and parameters of its formation.
Understanding quality education essence as the social unity and consolidation objective of national educational systems in the context of radical changes in the Ukrainian educational sphere is at the epicenter of each higher education branch representative’s scientific interests. This set of problems requires consideration not only in a purely pedagogical or scientific aspect, but also requires consideration of its social, ideological, and managerial component.
The first attempts to comprehend the latest trends in the study programs appeared in Ukraine before the regulation of the transition of the higher education system to European requirements in the law “On Higher Education” (2014). The article by I. Nesterenko “Designing study programs in the context of the functioning of the Polish qualifications framework” (2013) [
4] analyzed that in accordance with the reform of approaches to study programs in Polish universities, the method of designing a new curriculum consists of five stages: conceptual, planning and defining requirements, design, implementation, testing, and evaluation. The author emphasizes the current practice in Poland of involving all stakeholders in each stage, without which it is impossible to not only develop a clear description of learning outcomes but also to predict further implementation stages of the SP.
After 2014, scientific and methodological studies have mainly outlined general approaches to the implementation of educational reforms that would bring Ukraine closer to the European educational area. Thus, in 2015, a team of authors [
5] conducted an informational analytical review for the development of the Ukrainian higher education quality assurance system. This review was prepared to facilitate the process of establishing the National Agency for Quality Assurance in Higher Education of Ukraine, establishing its effective activities and forming a new culture of quality improvement in the national area of higher education in Ukraine on the basis of objectivity, transparency, trust and subsidiarity, partnership, and collegiality. A collection of articles, biographical materials, speeches, reviews, and essays,
The Battlefront of Civilizations: Education in Ukraine, designed to inform about events in higher education in Ukraine from 2008 to 2015, was compiled and published by Serhiy Kvit [
6].
The analysis of the leading Ukrainian and foreign experience in assessing the quality of higher education in European integration was prepared in 2019 and was based on the results of the second stage of research from “Analysis of the leading domestic and foreign experience in assessing the quality of higher education in the context of European integration (mechanisms for assessing the quality of higher education in European integration)”, which was conducted by a team of scientists from the Institute of Higher Education of Ukraine [
7]. The researchers identified practical approaches to implementing mechanisms for assessing the quality of higher education. The paper comprehends domestic and foreign experience and conducted a systematic classification of the mechanisms used for assessing the quality of higher education in the context of European integration and globalization. The criteria and indicators for creating mechanisms for assessing the quality of higher education are summarized. The principles of effective policy and strategy for building a system of ensuring and improving the quality of higher education and the transformation of higher education management in the context of forming a leadership culture of competitive quality of higher education in Ukraine are substantiated.
Scientific and methodological generalization upon the issues of content and certain procedures for the formation of study programs is reflected in the work of well-known educational experts, the work of scientists from the Institute of Higher Education, in the results of international projects, etc. Yu. Rashkevych thoroughly systematizes the requirements for the construction of SP, starting, in fact, from the time of the introduction of the very concept of the study program, and in particular, emphasizes the need to comply with the standard and the general regulatory framework. In this regard, his well-known monograph,
The Bologna Process and the New Paradigm of Higher Education, is his most significant work [
8]. The methodological recommendations for the “development of study programs” refer to the construction of study programs through the approaches of student-centered learning [
9]. “Modern approaches to the construction of study programs” [
10] are mainly focused on identifying and showing the results of the educational process.
Certain methodological achievements in this direction were observed in the first years of implementation of the law “On Higher Education” (2014), when Ukrainian teachers considered the creation of study programs in both scientific and methodological publications [
11,
12] It is significant that despite the authors’ appeal to the relevance of the European paradigm of quality assurance in higher education and compliance with its individual provisions, it is those provisions of the ESG that relate to the formation of the SP, and they are not used in these publications. In the article “Study program as a tool to ensure the quality of training future professionals in higher education institutions”, Olga Naboka conducts a general analysis of the main approaches to the formation of the SP [
13]. In the investigation of O. Ishchenko “Basic approaches to the development of study programs” [
14], the main development stages of the study program are given, and the main formal parameters of its formation are determined.
Current issues upon the quality assurance of the study programs and aspects of evaluating their functioning are reflected in the publication of S. Kvit “Higher Education in Ukraine in the Time of Independence: Between Brownian Motion and Revolutionary Reforms” [
15].
The work of A. Butenko and O. Yeremenko is devoted to the preparation of the study program for accreditation in terms of institutional cooperation as well as the delineation of the legal status, the development of the professional and demographic portrait of the study program guarantor, and its role in quality assurance processes at the study program formation stage [
16,
17,
18].
Recently, we have also seen the emergence of publications about the role of employers in shaping the study program. Researchers not only analyze the typology of stakeholders [
19], but also emphasize the significant changes in the strategy resulting from their involvement in all stages of the educational activities, which took place in 2020–2021 in connection with the orientation of Ukrainian higher education to the standards of the European educational area [
20].
It should be emphasized that the definition of “study program formation” is mostly found in Eastern Europe, while the works of scholars from Western European prefer the term “Curriculum Design”. Given the need to update approaches to the development of study programs, the article by E. Brenner and J. Niehs “Curricula Development based on Learning Outcomes—An Austrian Case” [
21] focuses on the development of SP in terms of learning outcomes.
Note that European quality assurance systems in universities have taken the appropriate path to the formation and evaluation of study programs in the early 21st century, and it is during this period that the maximum publishing activity related to the relevant issues occurs. Content published in this domain typically refers to the experience of ensuring the quality of higher education in specific HEIs in individual countries. Thus, Stefan Cronholm’s article “Nine Principles for Designing a Study Program” is interesting not only because it highlights the principles themselves: Vision; Traceability; Progression and Integration; Manning the development project and anchoring decisions; Pedagogy; Mandatory vs. free choice of courses; Implementation; and Evaluation and Marketing, but also that the SP is suggested to be designed according to their further evaluation according to the criteria of the Swedish National Agency for Higher Education [
22]. Many publications are applied, as they study construction patterns of study programs in specific fields of knowledge and specialties, such as Amparo Hurtado Albir’s article “Competence-based Curriculum Design for Training Translators, The Interpreter and Translator Trainer”, which shows a balanced approach to the system development and the components of the SP for the training of translators [
23].
In fact, the analyzed works show that the issue of forming a quality study program in the context of ESG compliance was not given due attention.
1.2. Relevance, Purpose of the Study and Its Implementation
The adaptation of Ukrainian higher education to the standards of education adopted in the single European educational area has been going on for more than a year, but the lack of harmonized approaches and practices to implement the recommendations and criteria set out in ESG 2015 has led to some formalism. The lack of a unified approach in the practical application of these principles and recommendations has led to a literal implementation of the law, without a significant understanding of the value and content that is behind such an approach. For example, the transformation of specializations for training in educational institutions into study programs mainly took place without changing the compilation process, without taking into account the needs of the students, employers, and other stakeholders as well as sectoral and regional needs, without a proper internal quality assurance system, including analysis tasks and the content of the study program with the involvement of specialists.
From 2018 until the full functioning of the National Agency for Quality Assurance in Higher Education, study program accreditation was conducted by the Ministry of Education and Science of Ukraine using the parameters of licensing conditions rather than requirements for quality assurance due to the lack of proper regulations. Most free educational institutions reacted to the essence of the phenomenon of “study program” quite formally. In practice, there was either a renaming of specializations as being part of the specialties in the study programs or the identification of the study programs with the specialty itself, while the essence of training has not changed. The amount of theoretical and methodological knowledge of the participants in regard to the educational process concerning study programs and the specifics of improving their parameters did not meet the requirements of legislation or European practice.
In 2019, the full-fledged accreditation of the study programs began, which revealed that a significant number of study programs, which are trained by Ukrainian higher education institutions, quality criteria for assessing SP, controlled by the Regulation on Accreditation of Study Programs (2019), only achieved partial compliance [
24].
According to the results of the accreditation examinations of the study programs, a significant number of them had problems with inconsistencies in terms of the content of various parts of the study program, the formal implementation of the structural requirements, and the superficial description of the elements without taking into account real market requirements, industry features, and current legislation. This situation was confirmed by the following statistical data: in the period from 1 September 2019 to 31 December 2020, out of a total of 1400 SPs submitted for examination, 332 (24%) received conditional accreditation for 1 year, and 33 were denied accreditation (2%) [
25].
The reason for such shortcomings, according to the authors of the article, is the lack of clear organization of the study program, in particular, the lack of the real coordination of its elements with different groups of stakeholders and the proper awareness of the real tasks of the project team.
Normative acts, explanations, and recommendations of the central authorities of Ukraine define the concept of the study program, define its purpose and tasks, and give recommendations for its structure and design. In particular: the Law of Ukraine “On Higher Education” (paragraph 17 of the first part of Article 1) [
26]; (Order of the Ministry of Education and Science of Ukraine of 01.02.2021 №128 “On Approval of Requirements for Interdisciplinary Educational (Scientific) Programs”) [
27]; MES advisory letters 2017 №1/9-239 “Sample study program (recommendations of the Ministry of Education and Science of Ukraine)” [
28]; a letter dated 05.06.2018 №1/9-377 “Regarding the provision of explanations regarding study programs” [
29]; and a letter dated 09.07.2018 №1/9-434 “Regarding recommendations for educational and methodological support”) [
30]. At the same time, none of these documents provide clear answers on how to effectively design and implement a study program.
Therefore, the purpose of this research is to analyze the prerequisites for the formation, to determine the structural and semantic parameters, and to offer a model for concluding a quality study program in accordance with the guidelines of the ESG.
Achieving the goal requires solving the following tasks:
Summarizing the main scientific and methodological achievements and the national and local regulatory framework for the formation of SPs;
Determining the preconditions for the formation of a quality study program in the paradigm of new approaches to higher education in Ukraine;
Clarifying the conceptual apparatus related to the formation of the study program;
Finding out the potential impact of ESG standards on the formation of a quality study program;
Defining the role and place of stakeholders in the process of forming a quality study program;
Offering a model of study program formation with the outline of its stages correlated with ESG standards and Developing a set of measures aimed at forming a study program in accordance with the suggested model.
The lack of scientific, practical, and methodological developments of this nature has led to the need to describe the formation of a quality study program in the context of ESG compliance and to determine the relevance of this study and solutions for the following research objectives (research questions):
To characterize the scientific, methodological, and recommendatory works of Ukrainian researchers related to the initiation and conclusion of study programs in terms of educational reforms and their approximation to the requirements of the European educational area;
To single out an array of documents regulating the issues of higher education quality assurance in the design and approval of study programs and to identify problems that are not regulated by it in the Ukrainian legislation and normative base of higher education institutions;
To systematize the regularities of implementation of new approaches to higher education in Ukraine, which were introduced as a result of the laws “On Higher Education” (2014) and “On Education” (2017) and that are related to ESG 2015;
To structure the concepts and definitions related to the formation of study programs in Ukrainian universities and to outline the problems related to their definition;
To substantiate the effectiveness of the application of ESG guidelines in the SP design by providing examples of best practices;
To demonstrate how each provision of the 1.2 ESG standard determines the stages of a quality study program formation process;
To trace the need to involve stakeholders in the process of forming a quality study program;
To determine the necessary stages for the formation of the study program;
To generalize the institutional parameters of determining the ability of HEI to initiate the SP;
To emphasize the role of the guarantor and the project team in the formation of the study program;
To provide all of the necessary actions, procedures, and technologies in the system of measures aimed at the formation of a quality study program;
To outline the prospects for the implementation of the developed model.
3. Results
During the research, a significant amount of information on the accreditation of the study programs of Ukrainian HEIs was analyzed. The materials of the accreditation examinations revealed a certain pattern—the formation of the highest quality study programs in the different HEIs were developed in accordance with and effectively applied the internal rules of design and approval for all of the necessary documents for the implementation of the SP.
The authors summarized the information for the cases from 2019, a decision on which was made by NAQA (
Table 1).
In particular, we wanted to pay attention to the following examples (according to
Table 2). During the accreditation of the study program “Philosophy” for the first (bachelor’s) level of higher education at Borys Grinchenko Kyiv University, experts and members of the expert council branch noted the approach of the HEI, according to which the design of SPs is part of the process used to form a unified corporate culture based on clearly defined common values and guidelines for their implementation in practice in “Manifesto of Leadership as Service” and the Code of Corporate Culture of the HEI. Additionally, the strengths of both this study program in particular and the HEI in general, according to criterion 8, which assesses the internal quality assurance of the study program, include:
“the existence of clear and regulated procedures for reviewing the SP; internal quality assurance of the educational process on the basis of involvement in the relevant procedures of monitoring and decision-making of participants in the educational process upon different levels; clarity and transparency of internal standards for education inner quality assurance; involvement of employers in assessing the quality of student training (management of internships from practice bases; participation in the work of examination commissions; co-management of qualifying works; participation in the employers’ council in the format of analysis of current “cases” and focus groups” [
32].
The analysis of the regulations on the competitive selection of scientific and pedagogical workers showed that the transparency of competitive selection procedures provided during the formation of the study program and their standardization [
33] ensures the required level of professionalism of scientific and pedagogical workers at the time of when the study program is implemented. Thus, the competitive selection of staff provided by the SP “Cybersecurity” for the first (bachelor’s) higher education level at Simon Kuznets Kharkiv National Economic University clearly defined and took the requirements and professional activities of the teachers of the SP into account. These requirements include the following parameters: scientific degree (depending on the position), academic title (depending on the position), experience with scientific and pedagogical work in accordance with the profile of the study program in higher education institutions, and availability of scientific-methodical and scientific works [
34]. That is, they demonstrated the ability to provide quality applicant training in accordance with the acquired level of higher education, professional, and scientific qualifications, etc. To ensure transparency and publicity, the announcement of the competition to fill vacant research and teaching staff positions was posted on the university website [
35].
The key figure in the composition of scientific and pedagogical leaders is the guarantor of the study program, but so far, no normative act approves its status, powers, etc., except for the Glossary, which is of a recommendatory nature [
36]. The organization, formation, and quality control of the study program depends on the guarantor. The article by A. Butenko and O. Yeremenko “The role of the guarantor in the formation of the study program” highlights some developments of Ukrainian HEIs, in particular those of Sumy State University, Simon Kuznets Kharkiv National University of Economics, Lviv Polytechnic National University. According to the authors, the local normative act of the Ivan Chernyakhovsky National University of Defense of Ukraine deserves special attention: the idea of the act and initiation of formation with the separation of functional possibilities of all of the involved people are detailed (Methodical recommendations for realization of study programs, 2020). Such materials can be presented as requirements for the structure of the study program and its search algorithm (Methodical instruction, 2017) and the selectivity of the organization (Organization of the educational process, 2017). Complex documents in which the further implementation of study programs with a certain mechanism of changes made to them is determined are optimal (Regulations on formation, approval and renewal, 2017) [
18] (p. 47).
In order to study the activities of guarantors as key figures in the formation of the study program, their survey was conducted on certain parameters of this process, which are partially described in the publications of A. Butenko and O. Yeremenko [
18]. In particular, it was found that the initiative to start SPs in Ukrainian universities mainly belonged to the academic community (89% of respondents), including the administration of the HEI (28.8% of respondents), the department as the main structural unit responsible for implementing the SPs (31.8% of respondents), and the faculty (14.2% of respondents). Only 11% of the SPs were initiated solely at the initiative of the stakeholders (employers or educators).
An important component in building a quality study program is the experience analysis of the educational activities/practices of foreign universities. Thanks to the survey, we can state that in general, higher education institutions study this experience. Study program guarantors determined both which foreign study programs are worth considering in the context of the formation of their SP (75% of respondents) and personally analyzed foreign study programs in respect to the formation of the planned SP (73.6% of respondents). Most of the interviewed guarantors were only interested in educational components (79.3%), which shows that the general approach in studying the experience of other SPs [
18] (pp. 52–53). In view of this, it is worth noting the institutional support policy for the formation of the regulatory framework for SPs of the Vasyl Stus Donetsk National University, where the regulations on the mandatory analysis of such study programs by foreign universities were determine, indicate that the initiators form a package of project documents, which, among other things, includes a justification of the draft of the study program “which indicates the benefits of introducing a new study program, its features and differences from those in Ukraine and the world” [
37] (p. 5). Experts evaluating the study program “Economics” of the third (educational and scientific level) implemented in this HEI noted that “The University policy on the development and renewal of SSPs (study and scientific program) stipulates that each of them is annually monitored and changed in accordance with global, European, and domestic trends in the specialty and industry, as evidenced by joint research, joint partnership agreements and joint SPs, and the implementation of a functional internationalization strategy” [
38]. Regarding the research of Ukrainian study programs, the survey of the guarantors of the study programs shows an even higher percentage compared to the study of the experience of foreign universities (more than 90%), noting that the main subjects of the research were educational components (86.6%), program learning outcomes (66.3%), and systems of organization highlighting the free choice of disciplines (47.9%). This situation is also confirmed by the conclusions of the expert group on the above-mentioned study program “Economics”, where the experts state that “studying the experience of similar domestic and foreign study programs, the SSP developers of the Vadym Hetman Kyiv National University of Economics, Simon Kuznets Kharkiv National University of Economics; partner universities of Eastern Europe: the D.A. Tsenov Academy of Economics (Svishtov, Bulgaria) and the Poznan University of Economics and Business (Poland), clearly indicate that the self-assessment data, which from this experience is rethought and applied (“compliance with modern approaches to the training of doctors of philosophy; the formation of the educational component content and the use of innovative teaching methods; combination for the innovative research and teaching component of the program; the social competencies to be acquired by a doctor of philosophy in economics, etc.)” [
38].
Therefore, a prerequisite for the quality formation of the study program and its further continuous modernization is the study and use of experience of leading universities around the world—recognized authorities in the field, which would help to develop relevant approaches to education and training students to maintain international competitiveness in the contemporary labor market. However, in general, the self-assessment data from Ukrainian higher education institutions submitted for accreditation in 2019–2021 mostly indicate a very superficial study of this experience or even its complete absence, as the vast majority of information on self-assessment only names the experience of the university being studied and not identifying what components of study programs or educational activities under these programs were analyzed and used and for what purpose.
There is a similar situation with regard to the involvement of employers as the main external stakeholders in the formation of study programs, as the guarantors of study programs in the survey declare a high level of appeal to employers (89.9% of respondents). It is expected that the remarks of employers to the draft of the study program concerned practical training (54.6%) as a component of the SP (number of hours for internships, their content, indicative bases, etc.). The analysis of the documentation of the leading HEIs shows the normative basis for cooperation with employers and includes the professional practitioners, who are involved in classroom activities and organization, conducting internships, which are proposed during the formation of the study program, providing further “feedback”, and the timely receipt of comments and suggestions for improving the practice-oriented component of the educational process. Most reputable freelancers have developed and approved the regulations on the so-called Employers’ Councils. This document is designed to regulate the formation and functioning of expert councils of faculties/institutes/training centers employers in the relevant HEI. Among the tasks of such councils, the most important are processing suggestions and making recommendations while developing and/or changing study programs by taking into account current labor market trends and the needs of employers [
39]; participation in the development of study programs in terms of defining the objectives of the program, program competencies, and program learning outcomes and improving the content of study programs and curricula [
40]; and strengthening the role of employers (representatives of employers, employer organizations, their associations, etc.) in the professional training system—from the formation of the content of the study programs to the evaluation of learning outcomes [
41]. At the same time, information on self-assessment and examination results (expert group reports) indicate a vague understanding of the role of employers in shaping the study program. In particular, an unreasonable choice of employer representatives for a specific study program and failure to take into account regional, sectoral, economic, and other criteria in attracting employers were common problems. Feedback and reviews were formal or too complementary, and they did not contain suggestions, comments, requirements. In many cases, their real impact on the formation of a quality study program was questionable.
Creating a quality study program is a long and multi-vector process, as the project team has the task of creating a competitive study program that meets the standards set in ESG 2015, and in particular, that takes into account the interests of all stakeholders and that correlates with the mission and strategy of a particular HEI. It is important that the study program meets the requirements of national legislation, sectoral and regional contexts, and other factors.
To achieve this compliance with the standard ESG 2015 p.1.2., each university must have clearly defined procedures for developing its own study programs; therefore, productive sources of the current state analysis of the study program formation process and participation of guarantors are the normative documents of higher education institutions, which, in turn, synthesize previous and current experiences.
It is noteworthy that the vast majority of scientists and practitioners who offer the phased design of the SP in their work mostly focus on the recommendations of the Tuning project [
42] (p. 14) in the conclusion of the study program, which are quite complete and methodologically clear; however, they do not always correlate with the guidelines of the ESG, and in particular, more emphasis is placed on the formal component and less communication and cooperation with stakeholders is emphasized.
In order to clarify the model developed by us, the provisions of the study programs of twelve universities in Ukraine with different regional representation were analyzed according to the following parameters (
Table 3):
- (1)
The stakeholder involvement mechanism;
- (2)
The study of the best practices;
- (3)
The determination of institutional capacity;
- (4)
The structure requirements;
- (5)
The discussion of the project;
- (6)
The monitoring of the proposals at all stages;
- (7)
The approval and coordination procedures.
Table 3: A four-step evaluation of these documents was applied at the following levels:
High (H): the procedure is available, structured, and implemented at all stages to which it applies;
Sufficient (S): the procedure is available, structured, and implemented sporadically;
Medium (M): the procedure is available and partially structured;
Low (L): the procedure is only mentioned in the document.
The analysis of the assessments shows that the parameters (structure requirements, adjustment and approval procedure) that focus on the formal components of the SP are implemented much better than those related to the strategic vision, long-term planning, and comprehensive cooperation with stakeholders (mechanism for involving stakeholders, studying best practices, monitoring proposals at all stages, in part determining institutional capacity).
In general, the positive dynamics of ensuring the local regulatory framework of HEIs in these years (2019–2020) is explained by the introduction of a new procedure for accreditation of an SP under the already mentioned regulation “On Accreditation of Educational Programs” (2019) [
24], which is provided by almost all of the analyzed provisions of the HEI.
An analysis of the accreditation experience as an external evaluation of the quality of study programs in Ukraine and the best practices of Ukrainian universities allow us to offer a generalized model for forming a quality study program, which is aimed at practical use.
The first organizational stage after the decision to launch a study program should be the creation of a project team that performs the main organizational and analytical work and that coordinates and structures all of the available materials, in particular by forming the necessary package of documents.
The study program is a complex and multi-vector document, so the project team must offer an effective way to achieve the planned learning outcomes. In addition to regulations and recommendations in the field of higher education, it is essential to take into account ESG 2015 (requirements for the formation of the study program laid down in Standard 1.2 [
3] (pp. 11–12), Development and approval of programs), standards of higher education in the specialty, professional standards, and internal policies of the university.
Necessary steps for the formation of a quality study program are:
1. Taking into account the interests of the main groups of stakeholders, especially potential employers and students.
The qualitative, rather than formal, involvement of interested representatives of these groups in the project group will help the project work better and will help avoid meaningful distortions, creating a more competitive study program.
According to ESG 2015, one of the principles of quality assurance in higher education in the European Higher Education Area is that “quality assurance takes into account the needs and expectations of students, all other stakeholders and society” [
3] (p. 8). Thus, we state that cooperation with stakeholders is an important component of study program formation because it determines the validity of the opening of the SP, affects the formation of the project group, determines its focus, and lays the content of the future SP.
2. The next step of the project group; in our opinion, the study programs of other study programs should be analyzed by taking into account not only domestic experience but also foreign experience. This is extremely important for the formation of study programs in Ukraine, as domestic programs have quite significant similarities, so while trying to create an original study program, one should carefully examine the experiences of other HEIs, bearing in mind the need to adapt the components of the SP to the current legislation.
As already mentioned, when studying the content of study programs, the vast majority of project groups only take into account the structure of the curriculum and the list of educational disciplines being studied. The involvement of experience is rather limited, and it is necessary to pay more attention to the content of educational components, methods of forming professional competences, and the combination of theory and practice when studying other components. Obviously, reproducing the list of educational components from a successful program does not guarantee the creation of a quality SP.
3. Information should be collected from stakeholders while other project groups are simultaneously researching other study programs. When working with groups of stakeholders, it should be taken into account that most members of these groups are not educators and cannot deeply understand the peculiarities of the educational process. Therefore, for high-quality cooperation with stakeholder groups, it is optimal to not only use queries with broad open questions to also conduct questionnaires with specific questions, such as possible types of practices, their content, or a list of additional competencies, etc. Qualitative sampling involves working with a sufficient number of and appropriate level stakeholders. The analysis the self-assessment information of higher education institutions from Ukraine submitted during the study program accreditation process revealed the involvement of representatives of small businesses or regional institutions as stakeholders, with the focus of the study program aimed at the national broad market. Thus, it is necessary to remember the need for cooperation both with representatives of small business and with representatives of large formal associations of this branch members. Stakeholder engagement segments are quite individual for different industries.
Surveying students from such study programs will help gather information for the formation of a study program that is not only useful but that is also convenient to consider study programs from the point of view of applicants. According to paragraph 1.3 of ESG15, it is recommended to assess /…/ the expectations, needs, and satisfaction of students regarding the program [
3] (p. 16).
Members of the project team representing these categories of stakeholders should assist in structuring and adapting the materials obtained from the study program survey and their harmonious implementation. Foreign researchers confirm the importance of involving students in modern quality assurance processes, for example, Ella Kahu notes that “student engagement is a current buzzword in higher education, increasingly researched, theorized, and debated with growing evidence of its critical role in achievement and learning” [
56].
4. Study programs, in accordance with standard 1.2 ESG, are developed on the basis of the general program objectives, which are consistent with the institutional strategy and have defined expected learning outcomes. Therefore, in cooperation with the administration of the educational institution, the project team should comprehensively assess the institutional capacity, starting with the correlation of the mission and strategy of the university and the goals of the SP; determine the relevance of the focus of the SP plan for the development of HEIs based on the study of the experience of the same or similar study programs; and assess the necessary material and human resources (in particular, financial, human, and other needs for the implementation of this study program). If the institutional capacity is potentially confirmed, the project team can conduct further steps.
5. The next step is to form a profile of the study program, its purpose, and to determine the program and additional competencies, program learning outcomes, and the content structure of the study program (list and sequence of study of educational components).
This task is possible by performing the actions mentioned in paragraphs 1–4, which will gather the necessary material to form a quality profile of the study program. The specifics of the study program and curriculum profile must also meet the requirements of standard 1.2, which specifies that the study program is “designed so that they enable smooth student progression” [
3] (p. 12). To implement this principle, it is advisable to use the matrix of correspondence as one of the important elements of the design work and the structural logical scheme. It is the matrices that allow us to show the relationship of general and professional competencies with the program learning outcomes as well as with the educational components that ensure their formation and achievement. The sequence and interdependence of educational components is laid down in the structural and logical scheme, with the study program and the curriculum as its component “define the expected student workload, e.g., in ECTS” [
3] (p. 12).
Other documents may be added to the package of documents at the discretion of the developers, in particular, on the study of the experience of other SPs, the wishes of stakeholders, materials of working groups, round tables, etc.
6. The next important step in the formation of a study program is to discuss its project. It is important to hold both internal discussions (within the university) and to involve representatives of the general academic community, employers, and students in the discussion of the draft study program. One of the obligatory events is the public announcement and invitation of stakeholders to discuss the draft study program [
24]. The data from the broad discussion will help to identify possible errors and shortcomings of the project and will to help refine it.
7. Only after the analysis and consideration (or reasonable disregard) of the wishes and comments of the internal and external discussion, the study program (SP) can be suggested for formal approval in the manner prescribed by the university (HEI) in accordance with standard 1.2 ESG 2015, which states that study programs “are subject to a formal institutional approval process” [
3] (p. 12).
4. Discussion
The complex process of Ukrainian higher education entering the European educational area is due not only due to the requirements of the time and the realities of the crisis in the quality of Ukrainian education at the beginning of the 21st century, but it is also due to rapid worldviews and economic changes in society, in particular, the inevitable awareness of the importance of quality practice-oriented education with mandatory consideration of the formation of soft skills as a component. Therefore, understanding and substantiating the curriculum design model in the context of ESG compliance has become an urgent need of modern Ukrainian higher education.
Systematizing scientific, methodical, and recommendatory works of Ukrainian researchers concerning the conclusion of study programs in terms of educational reforms and approximation to the requirements of the European educational area, the authors drew attention to the lack of research on certain parameters of the process of initiating and modeling study programs, which led both to a distortion of the understanding of the principles of concluding study programs and to an underestimation of accreditation as an external mechanism for ensuring the quality of study programs.
In 2019, before the introduction of the new accreditation procedure, researchers expressed doubts about the effectiveness of the accreditation procedure, stating that “Ukraine suffers from an underdeveloped culture of evaluation, provision and improvement of higher education” [
7] (p. 178). Today the Ukrainian educational community is gradually changing this point of view in general, and the most progressive part of the community is already convinced of the need for accreditation as an assessment of the quality of study programs, and its representatives become “agents of change” to promote it. At the same time, the presence of progressive teachers in the HEI and the creation of a sectoral expert environment improves the quality of institutional processes related to the design of the SP.
Introduced in 2019, the regulation “On the accreditation of study programs”, which provides training for higher education, has a regulatory status, implementing not only other approaches but also new categories, which cannot be said about most of the documents governing the quality of higher education when designing and approving a study program. At present, most of them do not perform a regulatory function but are advisory in nature. The regulation “On Accreditation” (2019) is based on the law “On Higher Education” (2014), which, according to S. Kvit, “breathed life into higher education” [
6]. In fact, at that time, it was a very progressive document that set the guidelines for Ukrainian higher education to be integrated with European education, in terms of designing study programs in particular. The ESG 2015 guidelines correlate with the following patterns of implementation of new approaches to higher education in Ukraine, which were introduced as a result of the Law on Higher Education (2014), which emphasizes the protection of higher education seekers, accountability, orientation of the study program to ensure its quality, and the conclusion of programs, in the selection of educational components and ways to improve the SP in particular. At the time that ESG 2015 was adopted, Ukrainian scholars interpreted this system of approaches primarily as reconciling the positions of HEIs and independent agencies [
5] (p. 10), which is a fair but partial understanding of this important document. First of all, it is positive in terms of the structure of the guidelines for the various stages of the SP and the specificity and balance of the terminology.
While working on this article, we used a number of terms that do not always have a fixed meaning and that can be interpreted differently depending on the context. Thus, we consider it necessary to set out and comment on the main terms mentioned and their meaning within the study.
Most of the terms and concepts in the article are defined in the interpretation of the Law of Ukraine “On Higher Education” [
26], the Law of Ukraine “On Education” [
57], and the Regulation “On Accreditation of Study Programs” [
24]. However, some of these definitions need to be clarified, which will help to eliminate discrepancies and unjustified coincidences in the long term.
Study program accreditation, according to item 4. part 1 of Art. 1 of the Law of Ukraine “On Higher Education” is defined as the “evaluation of the study program and/or educational activities of higher education institutions under this program to ensure and improve the quality of higher education”, which is currently implemented in practice through accreditation procedures [
26].
The accreditation of study programs is a part of the system of external quality assurance of education, which may include tools, procedures, and measures to ensure and improve the quality of education.
The external quality assurance system cannot be implemented without the full functioning of internal quality assurance systems in higher education institutions, which constitute a balanced institutional mechanism that provides the interconnection of these components of educational quality.
As a phenomenon, a study program is a single set of educational components (disciplines, individual tasks, practices, tests, etc.) aimed at achieving the learning outcomes provided by such a program, which gives a student the right to obtain certain educational and professional (professional) qualifications) [
26]. At the same time, in Art. 91 of the same law, a study program is defined as a document that must contain “a list of educational components; their logical sequence; requirements for the education level of people who can start training under this program; the number of ECTS credits required to complete the program, as well as the expected program learning outcomes (competencies) that the applicant has to master” [
26]. That is, the homonymy of these terms is already laid down in the provisions of the Law on Higher Education. Despite these contradictions, within the limits of our article, we consider the study program more broadly than these documents, considering it to be a complex of stages, actions, activities, and components directed effecting the corresponding result. No less important for outlining the quality processes is the concept of a stakeholder, which is not regulated by Ukrainian educational legislation. However, we use this term to mainly mean the “stakeholder”. Thus, in the research, we suggest using this term in such a sense.
Additionally, it is necessary to define and establish the concept of study program formation, and we suggest understanding it as the first stage of a continuous process of its creation by taking into account the regulatory requirements for its form and content and the planning of educational activities under the program that will provide constant internal and external monitoring of its quality.
We may consider the process to be divided into the phases of “starting an SP”, “designing an SP”, “developing an SP”, and “concluding an SP”, as these phrases contain certain temporal or semantic accents; for example, “designing” will refer to more structural components. Concerning the decision to introduce an SP, such uncertainty is lacking in specific scientific and methodological developments, such as “Theoretical and methodological principles of study programs” (2016), which only detailed comments on the mandatory components of the SP—the result, although they declare a theoretical and methodological approach to the process [
58].
The National Agency for Higher Education Quality Assurance approaches evaluating SPs according to qualitative rather than quantitative criteria after discussions and clarifications allow us to primarily focus on the parameters that are important for ensuring the quality of the SP, which are in line with the ESG guidelines. This is especially emphasized in the appendix to the Regulations on Accreditation of Study Programs, 2019—Criteria for evaluating study programs. It should be noted that the evaluation of the study program and educational activities of the study program is conducted according to each criterion and to the evaluation scale, which includes four levels of compliance: level “F”—the study program and/or educational activities under this program do not meet certain criteria, and the identified deficiencies are fundamental and/or cannot be remedied within one year; level “E”—the study program and/or educational activities under this program generally do not meet the defined criteria, but the identified shortcomings can be eliminated within one year; level “B”—the study program and educational activities under this program generally meet a certain criterion with shortcomings that are not significant; level “A”—the study program and educational activities under this program fully meet the defined criteria, including having an innovative/exemplary nature [
24].
For example, criterion 1 “Design and goals of the study program” refers to the promotion of the SP, and the sub-criteria that make it up [
24] are aimed at clarifying the processes and procedures of stakeholders, studying foreign and domestic experience, the clear inclusion of the SP in the development of the HEI, etc. During the implementation of accreditation procedures, which were conducted in the period from 01.09.2019 to 31.12.2020, out of 1400 SPs submitted for examination, only 75 (5.3%) SPs demonstrated the exemplary level of assessment A according to this criterion. We note that these best practices confirm the effectiveness of the application of ESG recommendations in the formation of an SP. Thus, the National Pirogov Memorial Medical University (Vinnytsia) (SP “Pediatrics”) confirms exemplary practices for studying Ukrainian and foreign experiences of similar SPs. Thus, the HEI states that “studying the recommendations of the EUA Council for Doctoral Education provided an opportunity to develop the individual educational trajectory of the applicant with the formation of self-control skills, which is realized in increasing the number of hours for self-work”. The experience of Maastricht University provided an opportunity to introduce problem-oriented approaches for a number of academic disciplines. For instance, the “System of 7 steps”, developed by the specialists of this university during the study of disciplines, “Publication activity and scientometric databases”, “Academic integrity”, etc., is actively implemented, which made it possible to strengthen the problem-oriented content of education [
59].
However, such detailing of the actual monitoring of related SPs is rather isolated and is mostly not provided by the local regulatory framework of universities, which is shown by the analysis of the internal provisions of the Law on Study Programs. If we turn to
Table 1, then indicator 2, The study of best practices, only one meets the regulations for HEI programs at a high level, two correspond to a medium level, and the rest correspond to a low level.
In fact, we see a problem in terms of the institutional polices of HEIs regarding the formation of a separate SP that is not sufficiently focused on attracting both internal and external stakeholders. Thus, in the methodological materials “Modern approaches to the construction of study programs” (2014) it is emphasized that “every teacher should know how learning outcomes are determined and how study programs will be formed” [
10] (p. 3), but mechanisms for how to achieve this are not suggested; therefore, this important thesis remains only declarative.
It is not without reason that the Recommendations on the Application of Criteria for Evaluating the Quality of the Study Program of the National Agency, 2020, emphasize that “during the evaluation it should be taken into account that the circle of stakeholders will differ depending on the specifics of a particular program. It is important to find out the position of (potential) employers or the relevant professional community” [
60]. Therefore, at each step of the formation of a separate SP, it is necessary to involve those groups of stakeholders whose participation will be most influential in this process.
The study “Stakeholders and Quality Assurance in Higher Education” rightly states that “students as stakeholders are supposed to be involved in evaluation of courses and to participate in internal quality assurance via decision-making and quality management processes at higher education institutions as equal partners. According to the ESG, the role of employers is more ambiguous. The ESG emphasizes the role of stakeholders in internal quality assurance in terms of representation as well as participation in study program development” [
61] (pp. 3–4). Thus, despite the obvious interest of employers as a result of SP graduates—the university does not always realize the opportunity to involve employers to design a SP at the appropriate level. However, an HEI can mainly only attract a student after the introduction of educational activities under the SP. That is, we observe a collision when it is not so easy to determine the sequence and system of inclusion of stakeholders in the formation of the SP, even taking into account the guidelines of the ESG.
The reason why the study program formation model offered by the authors of the article resonates is debatable to some extent, especially concerning the harmonization model of the Tuning Project. The final brochure of this project offers a “model for the development, implementation and use of curricula, which allows to summarize the institutional parameters of determining the ability of HEI to start the SP” [
42] (p. 14). It is significant that the questionnaire suggested in these materials is sufficiently detailed and is aimed at maximizing the involvement of stakeholders, in particular, to determine compliance with the basic conditions of a strategic nature: “Is the public need for this program identified at the regional/national/European level? Is this done in consultation with stakeholders: employers, professionals and professional organizations?” At the same time, institutional parameters are not overlooked; in particular, the study of the use of internal and external resources. All components of the SP are listed as a document, namely profile, goals, learning outcomes, general and professional competencies, curriculum and topics, and modules and credits according to specific educational elements, and approaches to teaching and learning as well as assessment. Of course, the project executors emphasize the need to develop an evaluation system designed to ensure continuous quality improvement [
42] (pp. 14–15). However, this approach does not define the mechanism and stages of involving stakeholders or personal or collective responsibility for the study program at the stage of its formation.
In Ukrainian higher education, the role of the guarantor and the project team is important in the process of ensuring the quality of the study program and educational activities, in the formation of the study program in particular. This concept is repeatedly mentioned by Yu. Rashkevych, interpreting it as a person who is responsible for the SP [
62] (p. 6). In European practices, such functionality is not observed; this is a Program Facilitator or Academic tutor in higher education, who monitors the actual implementation of the SP [
63]. In Ukrainian conditions, such a person, as already mentioned in our article, is vital because the system of measures aimed at forming a quality study program and all necessary actions, procedures, and technology should be concentrated in the guarantor’s focus as a knowledgeable moderator.
Quite optimal stages are offered by the regulations on study and scientific programs for the training of doctors of philosophy at the Ukrainian Medical Dental Academy UMDA at the first stage (stage 1), proposing the formation of a project team and the appointment of a guarantor for the study program. The following stages: stage 2—urgency analysis of a SSP and an estimation of sufficiency of available resources; stage 3—determination of the SSP profile; stage 4—determining the educational content of the SSP and developing a curriculum; stage 5—development of a system for assessing the quality of the SSP in order to improve it—are impossible without the organizational and effective involvement of the guarantor and the project team headed by them [
64] (pp. 5–6).
Introduced in 2019, the system of accreditation for study programs had a positive impact, particularly on the procedure of forming the study program, laying the groundwork for qualitative new approaches to the design of study programs, and the participation of all stakeholders. This system provided mandatory elements and stages of formation that were in accordance with the guidelines of the ESG, while leaving the choice of forms and ways to implement the process under the control of the HEI.
In general, one of the reasons why the greatest difficulties encountered when developing the concept of study program formation in the context of ESG is that some certain process parameters for initiating and modeling study programs by Ukrainian HEIs are still poorly studied. Another reason is the ambiguity of the term “study program” and the non-standardization of the key concepts “study program” and “stakeholder”. As a result, Ukrainian HEIs have not yet developed a clear policy on the consistency and systematic involvement of stakeholders in the formation of study programs despite the available ESG guidelines.
Prospects for successful SP formation by Ukrainian institutions in the context of the ESG criteria are seen in the definition and legislative consolidation of the concepts “stakeholder” and “formation of a study program”, the unification and the clear regulation of study program stages through legislative acts regulating activities in the field of education as well as in developing a strategy and sequence for involving stakeholders, determining personal and/or collective responsibility for the study program at the stage of its formation and incorporating such a policy in local regulations of higher education institutions.
Summarizing the practical impact of the suggested model, we can outline the prospects for its implementation. At the first stage of practical application, participation will be offered to the group of higher education institutions that have agreed to be the site of the experiment. During the approbation, there will be monitoring, and then the effectiveness of the model will be analyzed. In fact, the SP formation stages will be able to be unified and standardized to some extent through legislation.
5. Conclusions
An analysis of scientific and methodological achievements of Ukrainian and foreign authors showed that the problem of forming a study program attracts a large number of researchers, but their work mainly concerns individual aspects or generalizations of experience in study programs in certain fields or specialties.
Researchers provide recommendations for the application of general approaches for the development of study programs; sometimes, they trace the formal or some structural parameters of the SP, which must be followed during its formation. Herewith, there is an emphasis on the autonomy of higher education institutions, which allows, on the one hand, the discovery of unique SPs, and on the other hand, it blurs the clarity of the requirements for the formation of SPs.
At the same time, a review of the Ukrainian legal framework on the standardization of quality assurance in higher education shows that a number of key concepts regarding the conclusion of study programs need to be standardized and that the existing ones need to be improved. Such a problem has a negative impact on the development of local regulations of Ukrainian universities, which regulate the formation of SPs today.
After analyzing the existing conceptual framework for the quality assurance of educational activities, we found that it has certain gaps, so it was suggested that the concept of “formation of study program”, the first stage of a continuous process of its conclusion, be defined by taking into account the regulatory requirements for its formation and content and the planning of educational activities under the program that will provide constant internal and external monitoring of its quality.
Our research, which is based on the developed samples of the SP and the local regulatory framework of universities, and the approaches suggested in theoretical work offer a comprehensive vision of the stages SP formation and depicts the architecture of this process.
A model for the formation of study programs with clearly outlined stages has been developed in the current research and is correlated with ESG standards. In our opinion, the use of the suggested model is not only a theoretical development but can also serve as a flexible practical tool for the formation of a quality SP that follows the guidelines of ESG 2015 and national educational legislation.
This model is based on the analysis of positive and negative practices from the experience of the accreditation procedures of the National Agency for Quality Assurance in Higher Education of Ukraine (public); therefore, it is functional and based on theoretical generalizations of new approaches and real cases of Ukrainian HEIs.
The first stage of this process requires the involvement of a maximum variety of stakeholders, including employers; potential educators; internal stakeholders, including research and teaching staff; freelancers who will be involved in providing educational activities under the program, etc. (step 1).
At the same time, the experience of other similar or the same SPs should be studied (step 2). The research emphasizes the need for a comprehensive study of SPs and not just the structure of its educational components.
In the case of a positive decision, cooperation with stakeholders will become more applied, particularly in the form of surveys, round tables, “brainstorming”, etc. (step 3).
Thus, it is important to broadly investigate the institutional capacity of an HEI to implement the SP: organizational, personnel, financial resources, and research potential (laboratories, equipment) (step 4). At this stage, there should also be active interaction with employers and students, and the SP should be self-governed by the HEI.
The collected information during the previous stages will allow the study program project to conclude (step 5), resulting in the formation of a study program, to the purpose of which is to define the program and additional competences and program results resulting from the training and semantic structure of the study program (list and sequence of studying of educational components).
During the discussion of the project (step 6), it is important to monitor all suggestions and to determine which of them will be considered or rejected and why as well as one to monitor the important components of the discussion that could be constructive for external and internal discussions to test decisions and make optimal proposals.
According to the ESG guidelines, the procedure for approving the study program (step 7) must be provided for and followed by the HEI, after which the SP can be implemented.
As such, the research conducted in our study provides practical steps to create a quality study program with maximum compliance with the guidelines of ESG 2015.
These steps are not rigid, and they can be changed or supplemented if necessary, but their usage is aimed at implementing the mandatory principles that will help during the work required for such projects. Thus, this development method can become both a practical tool and a basis for further research on methodological work and recommendations for the formation of study programs.
The application of this set of measures will help eliminate significant gaps in understanding the impact of the ESG guidelines on the formation of a quality study program in the realities of Ukrainian higher education, particularly in terms of structure, specific steps, and the role and place of stakeholders in the formation of a quality study program.