Next Article in Journal
A Longitudinal Study Examining the Association between Cognitive Behavior and Rational Abilities and the Effect of Sleep Quality on Construction Laborers
Next Article in Special Issue
Sustainable Development and Corporate Sustainability of Chilean State Universities: Evidence from Their Strategic Elements
Previous Article in Journal
Evaluation of the Development Potential of Urban Underground Space Using Set Pair Analysis and the Comprehensive Weight Method
Previous Article in Special Issue
Added Value on a Day in the Pandemic in Tourist Attractions in the Polish–Czech Borderland as a Green Economy Initiative
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Using a Multi-Criteria Ranking Method to Assess Factors Influencing the Implementation of Sustainable Development at Higher Educational Institutions

by
Jagoda Mrzygłocka-Chojnacka
* and
Radosław Ryńca
*
Faculty of Management, Wrocław University of Science and Technology, Wyb. Wyspianskiego 27, 50-370 Wrocław, Poland
*
Authors to whom correspondence should be addressed.
Sustainability 2023, 15(7), 6256; https://doi.org/10.3390/su15076256
Submission received: 29 December 2022 / Revised: 15 March 2023 / Accepted: 4 April 2023 / Published: 5 April 2023

Abstract

:
Over the last years, there has been a significant increase in interest in sustainable development in higher education institutions, and many have begun to implement sustainable development into their system. Several sustainable development assessment tools have also been developed to help universities systematically measure, monitor, benchmark, communicate, and manage their sustainable development efforts. These efforts have led to mixed results. It seems that one of the main reasons for this situation is the non-systematic and non-holistic approach to implementing sustainable development in universities. Thus, it can be assumed that the implementation of sustainable development in a university should cover all dimensions of its functioning and involve actors within it. Therefore, the aim of this article is to present a tool (inspired by the concept of university sustainability), based on the method of multicriteria rankings, for assessing the factors influencing the implementation of sustainable development in higher education institutions at the level of departments, as relatively autonomous wholes, based on the analysis of departments at one of the leading technical universities in Poland. The proposed tool provides an opportunity for a more holistic view of sustainable development implementation, both by prioritizing factors and by considering that higher education institutions are systems that are, in fact, composed of two distinct but necessarily cooperating subsystems: the academic subsystem and the administrative subsystem. The proposal is preliminary, but it seems that given the relevance and urgency of the sustainable development issue, this is the direction to take in research on sustainable development management in higher education institutions.

1. Introduction

The number of publications on sustainable development (SD) in higher education institutions (HEIs) has increased significantly in recent years. In the last year alone (2022), 125 articles on this topic were published in the ScienceDirect database (search based on keywords “higher educational institutions” and “sustainable development”). A detailed analysis of the number of publications in the last decade (based on the criteria indicated above) is shown in Figure 1. Several reasons for this increase can be identified: firstly, sustainability has become an urgent issue (if only because of the real threat of climate catastrophe), secondly, it has become a problematic issue (if only because of the expectations exerted by stakeholders to take action and make decisions with care to maintain an ethical responsibility towards the social environment, the environment, or employees), and thirdly, it has become a strategic issue (if only because social and environmental aspects are starting to be considered as a source of competitive advantage and added value for organizations). Undoubtedly, therefore, growing economic, social, and environmental issues (known as the conceptualization of SD based on three pillars [1]) are becoming increasingly important challenges for modern organizations, including HEIs, which, due to their role, if only in shaping social attitudes and creating innovative solutions, should play a special role in creating answers to these problems. The challenges associated with this concern are largely attempts to integrate SD into the current HEI management models. This is extremely difficult for two main reasons. Firstly, because the very concept of SD is still unclear [2]. Second and more importantly, HEIs as open and dynamic systems [3] are actually composed of two distinct, though necessarily collaborative, subsystems: the academic subsystem and the administrative subsystem. The academic subsystem encompasses teaching, learning, research, and the transfer of knowledge to the community (outreach) and broadly corresponds to Education for Sustainable Development (ESD) activities. The administrative subsystem, on the other hand, is related to the management of sustainability in universities and covers two main aspects: campus operations and management processes, while serving the academic subsystem to achieve its objectives [3]. Therefore, there is a legitimate trend in the administrative subsystem to adopt strategies and structures from the manufacturing sector [4,5]. The sector has adopted corporate sustainability (CS), applying it to the entire organizational system. In fact, CS contributes to sustainability while improving its long-term economic performance [6]. However, it should be emphasized that ESD in HEIs is implemented through mission functions such as teaching, research and outreach, institutional engagement, campus activities, and communication with stakeholders [7,8,9,10]. Therefore, ESD seems to be more related to the practices of sustainable development themselves. In contrast, HEIs to effectively implement SD should have a more integrated organizational structure and strategy for sustainability [11,12,13]. However, the literature so far does not provide a single model that encompasses all these characteristics [12], and sustainability is not yet an integral part of the university system [14]. The reasons for this range from the fact that different HEIs adopt different priorities for integrating sustainability [11], which is caused by the complex conditions of the social, economic, political, and cultural environment [15], to the fact that HEIs often still misunderstand sustainability [16]. Therefore, we assume that to talk about the implementation and consequently the management of SD in HEIs, the whole system, consisting of both academic and administrative subsystems, must be taken into account. Therefore, the university system partially integrates ESDU, but it is possible (and perhaps necessary) to integrate the concept of CS as a management approach into the administrative subsystem to improve it.
The implementation of SD in HEIs is related to the belief that HEIs should play a fundamental role in the implementation of SD because of their position and function in both generating and disseminating knowledge, innovation, and awareness [19,20,21,22]. As a result, many HEIs have begun to integrate SD into their systems (although, as ref. [23] notes, often only piecemeal) and assess and report on their progress in meeting their SD obligations [24,25,26,27,28,29,30]. Various tools for assessing SD have been developed (an overview of these can be found in, among others, ref. [22,31,32,33]), to support HEIs in systematically measuring, controlling, comparing, and informing their efforts to implement SD. These tools are also used as benchmarking practices to compare the processes and performance indicators of different HEIs [22]. However, many authors note that the systematization used in these tools is not homogeneous—there are no common labels or objectives, and they include diverse tools, often with different objectives or methodologies for implementing sustainable development [22]. Indeed, some tools focus only on selected dimensions of SD implementation in HEIs, such as campus operations (e.g., Campus Sustainability Assessment Framework—CSAF [34]) or curricula (e.g., Sustainability Tool for Assessing University Curricula Holistically, STAUNCH [35]). Others are limited to evaluating only a selected aspect of SD, most often the environmental aspect (e.g., Campus Ecology [36], Environmental Performance Survey [37]). Still others, including the most popular at present, serve only as guidelines to support the communication of progress in SD implementation, rather than as requirements for the evaluation of this implementation itself.
This is the case with the guidelines, which suggest reporting SD for HEIs based on the Global Reporting Initiative (GRI) indicators (which, while covering environmental, social, and economic aspects and being the only tool that considers economic aspects in depth, are not adapted to the reality of the operations and organizational systems of HEIs [38,39]) and the Sustainability Tracking, Assessment and Rating System (STARS) [40], currently rated as one of the most transparent, comprehensive, and detailed tools, but which does not address the question of the financial benefits of SD [41,42,43,44,45].
A consequence, as discussed above, of the lack of systematization in the tools used is that there is ambiguity in the resulting assessments of SD implementation, depending on the tool used, which may translate into the realization of activities aimed at both SD implementation and SD management. Furthermore, as the authors [46] rightly state, it is important not only to use tools to assess SD in HEIs, but above all to involve different stakeholders, including internal stakeholders, in the process. Such an approach, based on the participatory participation of parties involved in the implementation of SD, should not only be a requirement when assessing the level of SD implementation, but also a guarantee of the integration of sustainability into university culture [47]. This is because it leads to a higher level of SD implementation [48], but more importantly, it is crucial to the implementation of SD in the university strategic planning, management, and development process [49].
As mentioned above, the implementation of SD in HEIs is often done in a fragmented manner. The reasons for this are both the complexity of the SD requirements themselves and the complexity of the HEIs systems. Previous work on the implementation of SD in HEIs (see, e.g., [50,51,52,53]) indicates that the implementation of SD requires not only a real interest in HEIs, but also a real commitment of staff (academic and administrative), supported by knowledge of SD, concrete actions taken in this regard (more important than the simple declaration of a desire to implement SD, the definition of an SD policy or even the formulation of SD action plans), and the need to overcome resistance to necessary changes. Furthermore, as ref. [45,54] shows, the implementation of SD in HEIs must at the same time presuppose the modification of existing structures and habits, which poses many challenges in terms of real commitment, the need for changes at the level of behaviour and values, and the need to involve a variety of resources. In addition, [32] notes that it is important in SD management that a critical mass of the entities that make up the higher education institution adopt the principles of sustainability in their tasks and responsibilities. Based on the analyses indicated, it can therefore be assumed that the implementation of SD in a higher education institution should, on the one hand, obviously include all dimensions of its operation and, on the other hand, realistically involve the entities within it. According to the authors of this article, the fulfilment of these conditions is possible when focusing on those SD activities that are indicated as key by the university staff (academic and administrative) responsible for the university’s activities at the operational level. Therefore, the aim of the article is to propose a tool, based on the multi-criteria ranking method, to rank the factors-elements of SD, allowing for the management of the implementation of SD at the university at the level of faculties, as relatively autonomous wholes, based on the analysis of faculties at one of the leading technical universities in Poland. The research presented in this article is inspired by the concept of university sustainability (USus), along with the measurement scale presented in [39]. The tool presented in the article is managerial in nature and can enable university authorities to compare the implementation of SD at the faculties level as semi-autonomous units, so that it is possible to identify those areas that, on the one hand, are crucial (in the subjective opinion of faculty management and implementing activities at the operational level) for the implementation of SD at the university-wide level and allow, according to the authors, for the actual implementation of SD in the university as a whole, defined as a system consisting of administrative and academic subsystems.

2. Materials and Methods

2.1. The University Sustainability Concept (USus)

When implementing SD, universities can translate their objectives into actions in different areas: education and curricula, research, community outreach, campus operations, organizational change management, institutional framework, assessment and reporting) [16,55]. In principle, they can achieve this by focusing on one or more domains or by adopting a holistic approach [39,56,57] or a systems thinking approach [58], which are increasingly identified as essential for the ability to realistically implement sustainability goals and management in HEIs. The ever-growing interest in SD initiatives in HEIs makes it increasingly important to measure, evaluate, and report on the progress of HEIs toward SD, in addition to a holistic approach [38]. In fact, this assessment is considered one of the most important dimensions of SD implementation in HEIs. Therefore, it should be carried out with specific tools to assess whether all possible dimensions of SD implementation are being met and whether the implementation is holistic in nature [32]. Well-developed tools can be used as benchmarking practices, but, above all, they need to be able to assess sustainability in HEIs without being ranked or competed with. The development of tools for assessing SD in HEIs has been devoted to a lot of conceptual and research work (see, e.g., [7]), while noting that these tools should be useful for monitoring and supporting SD management decisions [33,59], although this usefulness has not yet been fully demonstrated [60].
One of the more recent tools that inspired this article is the university sustainability (USus) concept presented in [39] which, according to its authors, complements existing tools such as the Sustainability Tracking and Assessment Rating System (STARS) and the Global Reporting Initiative (GRI). In addition to the theoretical construct, the concept includes the validated USus measurement scale, used for the empirical verification of SD management in HEIs. USus integrates concepts related to education for sustainable development in universities (ESDU) and concepts related to corporate sustainability (CS) by considering the HEI as a system consisting of academic and administrative subsystems. Usus, therefore, includes teaching and learning, research, and outreach from ESDU, which are in the academic subsystem, and campus operations, networking, strategy-structure, and governance from CS, which comprise the administrative subsystem. In addition, both subsystems share an assessment reports component.

2.2. Ranking of Sites in the Context of Multi-Criteria Assessments

The literature on the subject provides numerous examples of the application of multi-criteria methods in the decision-making process [61,62,63]. A commonly used method is the ranking of sites presented by [64]. This tool has found wide application in many scientific fields, including management science. Among the advantages of the presented method, the authors point out both its simplicity and its usefulness in the decision-making process [63].
The ranking process consists of determining the objects O that are the subject of the ranking. The object of ranking in a higher education institution can be factors that affect sustainability management.
Set of objects O = O 1 , O 2 , , O r , where r is the number of objects tested.
Each object under analysis is a set of diagnostic variables X that describe phenomena in the object. In the case at hand, the diagnostic variables could be the assessments of experts or university faculty managers on the impact of a factor on sustainability management at the HEIs.
Set of diagnostic variables X = X 1 , X 2 , , X s , where s is the number of diagnostic variables.
The basis for developing a ranking of the factors influencing sustainability management in a university is the division of diagnostic variables X into three subsets. The first set, known as stimulants, is the set of such variables whose increase should be equated with an increase and decrease with a decrease in the evaluation of a complex phenomenon. The second set comprises destimulants, that is, such diagnostic variables whose increase should be associated with a decrease in the evaluation of the phenomenon under consideration (while a decrease should be associated with an increase in the evaluation) [65].
The last set of diagnostic variables are the nominants. These are variables that have a specific value that is the most favorable from the point of view of the evaluation of the composite phenomenon. In order to perform a multi-criteria evaluation of individual phenomena, it is necessary to transform the values of the original characteristics. This requires a normalization process consisting of transforming diagnostic variables that, when unaffected, have values of a similar order of magnitude [64].
We standardize stimulants according to Formula (1)
z i j = x i j m i n i x i j m a x i x i j m i n i x i j
where: i = 1, 2, 3, …, r and j = 1, 2, 3, …, s
X j S
S—a subset of diagnostic variables called stimulants.
The stimulants are normalized using Formula (2)
z i j = m a x i x i j x i j m a x i x i j m i n i x i j
where: i = 1, 2, 3, …, r and j = 1, 2, 3, …, s
X j D
D—a subset of diagnostic variables called destimulants.
The nominants are normalized according to the nature that the variables take. When a nominant takes one specific value C o j , we use Formula (3)
X i j m i n i   X i j C 0 j m i n i   X i j ,     w h e r e   X i j < C 0 j , 1 ,                                 w h e r e   X i j = C 0 j ,                 X j N X i j m a x i   X i j C 0 j m a x i   X i j ,     w h e r e   X i j > C 0 j ,
When the nominant is a set, Formula (4) should be applied.
X i j m i n i   X i j C 1 j m i n i   X i j ,     w h e r e   X i j < C 1 j , 1 ,     w h e r e   C 1 j X i j C 2 j ,   X i j m a x i   X i j C 2 j m a x i   X i j ,     w h e r e   X i j > C 2 j , X j   N    
The method of normalization outlined above is referred to as the null unitization method. This is because it allows for a fixed reference point to be taken, where the interval of the normalized variable is fixed at 1, while the normalizations are in the interval <0.1> [64].
The result of the normalization is the matrix shown in Table 1.
The development of the ranking requires the determination of aggregate (synthetic) variables based on Formula (5)
Q i = j = 1 s z i j ( i = 1 , 2 , 3 , r )
where Q i is the synthetic variable that is a multi-criteria evaluation of the composite phenomenon characterising the i-th object. The higher the value of the synthetic variable Q i , the better the ranking of the object in question.
As indicated by [64], it is also possible to group objects together in order to distinguish between the best, average, and worst objects. Formula (6) can be used for this purpose.
U = max Q i i min Q i i 3
  • obtaining a subgroup of the best sites for Q i ( max i Q i U ,   max i Q i >
  • a subgroup of average objects for Q i ( max i Q i 2 U ,   max i Q i U >
  • a subgroup of the worst sites for Q i ( min i Q i ,   max i Q i 2 U >

2.3. Using Facility Ranking to Assess Factors Affecting Sustainable Development Management in University Faculties

This section can be divided into subheadings. It should provide a concise and precise description of the experimental results, their interpretation, and the experimental conclusions that can be drawn.
Although the object-ranking method has found wide application in various scientific fields, including organizational management sciences, the authors of the article did not find in the literature any proposals for object-ranking in decision making in higher education institutions in the field of university sustainability management. As [66] points out, methods and tools are needed to facilitate decision making in HEI, including sustainability management. It should be emphasized that in HEIs the grouping of factors influencing sustainability management into individual subgroups can provide valuable management information. This is because grouping can indicate on which factors management should focus its efforts to manage HEI in the most effective way. What activities should be taken into further consideration next when implementing SD in HEIs and, finally, in developing the university’s sustainability strategy?
The use of site ranking incorporating multi-criteria assessments, according to the authors of this article, can have a significant impact on the effectiveness of sustainability management in HEIs. It can also provide one of the essential prerequisites for sound decision making [64].

2.4. Research Methodology

Figure 2 shows the implementation process of the proposed model.
The starting point of the proposed model is to identify the factors influencing the implementation of SD in HEI (Step 1). A further step is the selection of the research subject (Step 2). The subject can be the whole HEI or its departments (as in the case of the presented article). To assess the influence of individual factors on the implementation of SD at the university (Step 3), it is recommended that interview should be conducted with the university’s top management or the management of the individual faculties (as in the case of the presented article). These interviews allow for the assigning of weights to the individual factors based on a 5-point Likert scale, where 1 means a very important factor and 5 means completely unimportant. The result of the interviews is the development of a ranking of the surveyed objects (Step 4) based on the procedure presented in Section 2.2 of this article and a proposal for the classification of the factors (Step 5) influencing the implementation of SD in the HEI, divided into a group of the most important, of average importance, and of no importance, from the perspective of the university management or individual departments.
As mentioned, the inspiration for the research presented in this article came from the concept of university sustainability (USus), together with the measurement scale presented in [39]. Inspired by this concept, the authors of this article decided, after necessary modifications, to use its assumptions to assess the factors influencing sustainable management within a university (Step 1). For this reason, in contrast to the original USus concept, not universities as complex wholes, but faculties as relatively autonomous systems were adopted as units of analysis. One of the leading technical universities in Poland, comprising 10 faculties, was chosen as the subject of the analysis. To do this, some modifications to the USus concept were necessary. To this end, the factors identified as a result of the thematic analysis performed by [39] condensed into a USus measurement tool were presented to a group of five experts familiar with sustainability practices at Polish universities, with a request to validate the questionnaire to determine which elements—factors of USus measurement—are administered by the faculties rather than the universities as a whole. This procedure was aimed at creating a tool, inspired by USus, which would be managerial in nature and would enable university authorities to compare faculties, as semi-autonomous units, so that it would be possible to identify those areas which, on the one hand, are crucial for the implementation of SD at faculty level, which will ultimately translate into the implementation of SD at the level of the university as a whole. On the other hand, it may allow for an appropriate reallocation of resources (human, financial, physical, or informational) to strengthen those activities that, in the opinion of the faculty management, are key to the implementation of SD in the faculties, which will ultimately allow, according to the authors, for a more efficient and optimized implementation of SD in the university as a whole.
The subject of the analysis were 10 faculties at a university (Step 2). The above-mentioned group of experts, as a result of the validation of the original 32 factors (to assess the implementation of SD), selected, based on their expertise, 16 factors, as those administered by the departments. As a result of this validation, the following factors, assigned to the academic or administrative subsystems, were analyzed:
  • C1: In our faculty, SD is part of strategic planning (i.e., mission, vision, strategic plan, etc.)—administrative subsystem;
  • C2: In our faculty, there is an SD coordination (committee, office or person), identified in the organizational chart, that integrates all areas of the faculty—administrative subsystem;
  • C3: In the curricula of our faculty, students acquire SD skills such as systems thinking, critical thinking, teamwork, SD problem solving, future vision, self-awareness, or interdisciplinary work—academic subsystem;
  • C4: In the curricula of our faculty, students learn about topics related to SD—academic subsystem;
  • C5: Our faculty offers curricula in the field of SD—academic subsystem;
  • C6: Our faculty promotes interdisciplinary research projects that contribute to SD—academic subsystem;
  • C7: Our faculty provides services to communities to improve their quality of life—academic subsystem;
  • C8: Our faculty provides external consultancy on SD—academic subsystem;
  • C9: Our faculty participates in the development of public policies at the local, regional, national or international level—academic subsystem;
  • C10: Our faculty communicates adopted SD practices to the community (e.g., through website, campaigns, posters, etc.)—academic subsystem;
  • C11: Our faculty has advisory and intervention mechanisms in cases of ethical problems and corruption administrative subsystem;
  • C12: Our faculty participates in SD networks—administrative subsystem;
  • C13: Our faculty has interinstitutional agreements to develop cooperation in the field of SD—administrative subsystem;
  • C14: Information about our faculty is openly available—administrative subsystem;
  • C15: There is trust in decision-making bodies such as the Faculty Council—administrative subsystem;
  • C16: The institution’s values, principles, standards, and norms of conduct are clearly stated in our faculty’s bylaws—administrative subsystem.
The 10 structured interviews conducted by the authors of this article then asked the management of each faculty to assign (based on a 5-point Likert scale, where 1 meant very important and 5 completely unimportant) weights to all of the above-mentioned factors (Step 3). The results of this survey are presented in the Section 3.

3. Results and Discussion

Table 2 presents numerical information on the values of the diagnostic characteristics defined on a scale of 1 to 5, obtained from a structured interview with the management of each of the ten faculties of the university. The variables shown W1–W10 are the destimulants {W1, …, W10} ϵ D. The recognition of variables influences the way they are normalized. Completion of the process of normalising the diagnostic characteristics enables us to proceed to the aggregation stage. This results in aggregate variables characterising each of the 16 factors.
Next step (Step 4) was developing a ranking of the tested objects according to Section 2.2. The results of the normalization of the diagnostic characteristics and the values of the aggregate variables (synthetic) Q are presented in Table 3.
On the basis of the obtained results of the multicriteria evaluation, a ranking of factors influencing the implementation of sustainable management of the university was drawn up. As a result of this ranking key factors (step 5 of the proposed model), factors of average importance and irrelevant factors were identified. A list of these factors is presented below.
Key factors:
  • C10: Our faculty communicates adopted SD practices to the community (e.g., through website, campaigns, posters, etc.)—academic subsystem;
  • C13: Our faculty has inter-institutional agreements to foster collaboration on SD—administrative subsystem;
  • C15: There is trust in the decision-making bodies of our university, such as the Faculty Council—administrative subsystem;
  • C16: The values, principles, standards, and norms of conduct of the institution are clearly stated in our faculty’s bylaws—administrative subsystem.
Factors of average importance:
  • C1: In our faculty, SD is part of strategic planning (i.e., mission, vision, strategic plan, etc.)—administrative subsystem;
  • C2: There is SD coordination (committee, office, or person) in our faculty, identified in the organizational chart, which integrates all areas of the faculty—administrative subsystem;
  • C3: In the curricula of our faculty, students acquire SD skills such as systems thinking, critical thinking, teamwork, SD problem solving, future vision, self-awareness, or interdisciplinary work—academic subsystem;
  • C4: In the curricula of our faculty, students are introduced to topics related to SD—academic subsystem;
  • C5: Our faculty offers curricula in the field of SD—academic subsystem;
  • C6: Our faculty promotes interdisciplinary research projects that contribute to SD—academic subsystem;
  • C9: Our department participates in the development of public policies at local, regional, national or international levels—academic subsystem;
  • C14: Information about our faculty is openly available—administrative subsystem.
Factors not relevant:
  • C7: Our faculty provides services to communities to improve their quality of life—academic subsystem;
  • C8: Our faculty provides external consultancy on SD—academic subsystem;
  • C11: Our faculty has mechanisms to advise and intervene in cases of ethical problems and corruption—administrative subsystem;
  • C12: Our faculty participates in SD networks—administrative subsystem.
The above classification of factors should be taken into account in both the implementation and management of SD at a university.
The aim of this article was to present a tool, based on the multi-criteria ranking method, for assessing factors influencing the implementation of SD within a higher education institution at the level of faculties, as relatively autonomous wholes, based on an analysis of the faculties at one of Poland’s leading technical universities.
As a result of the study, three groups of factors influencing the assessment of sustainable management at a university were identified. The first group of factors—the most important (C10, C13, C15 and C16)—should be of particular interest to the university management in the process of continuous improvement and the intensification of work on SD implementation at the university. The factors identified relate, on the one hand, to the implementation of SD in strategic terms, including the existence of internal regulations in the form of institutionalized standards, norms, and operating principles and cooperation with stakeholders in the form of external institutions. On the other hand, the identified factors refer to such important elements for SD implementation as communication, norms and values, trust and standards of action. Therefore, this points to the need for a holistic implementation of SD in the faculties analyzed, as already pointed out by [39], as well as the need to implement SD across the academic and administrative subsystem divide. This may be due to the fact that Polish HEIs (and perhaps HEIs in general) are currently facing major changes caused by economic, political, and sociological factors. The current high competition on the market of educational services and the greater awareness and expectations of stakeholders in terms of the university’s actions and decisions taking care of the ethical principles of responsibility towards the social environment, natural environment, or employees imply the necessity of assessing the factors influencing implementation of SD at the university. Polish HEIs, wishing to be competitive on the European and global markets, are forced to improve the way they function so far. The ability to quickly adapt to new environmental conditions and awareness of continuous change requires the management to have a good knowledge of the phenomena and processes occurring in the organization. It seems important to use a managerial approach to management and, in particular, to apply such methods and tools supporting the implementation of SD of HEIs, which will consequently improve the current position of the HEI on the market.
Factors belonging to both subsystems, academic (C7, C8) and administrative (C11, C12), were also among the least important determinants of SD implementation. However, these factors should not be considered completely insignificant for SD implementation. According to the respondents, they are less important, which, based on the description of these factors, can be considered secondary to the most important factors.
Although the object ranking method has found wide application in various fields of science, including organizational management sciences [41,42], in the opinion of the authors of this article there is no proposal of object ranking in the decision-making process in higher education institutions. The necessity of taking immediate corrective measures and the search for effective tools facilitating the decision-making process seems fair and even necessary [44,45]. Therefore, this article presents a tool that attempts to address the challenges of implementing SD in HEIs from the perspective of its faculties, as relatively autonomous units. Their attempts to implement SD, both in relation to the academic subsystem (corresponding to education for sustainable development in HEIs-ESDU) and the administrative subsystem (corresponding to corporate sustainability—CS) translate (although only to a certain extent, related to the relative autonomy of the faculties) to the level of SD implementation in the HEI as a whole. However, the authors of this article are aware that certain aspects or practices of SD implementation may have been overlooked. Therefore, this tool is not a definitive tool, but an attempt to integrate the two subsystems. Indeed, existing frameworks and theoretical approaches in the literature often refer to one of the two, and by far more often issues related to SD implementation are addressed within the academic subsystem, which includes issues related to education, study programmes, or campus operations. On the other hand, issues related to the administrative subsystem, referring to issues of organizational management in the broadest sense, are less frequently addressed. Thus, according to the authors, this tool provides an opportunity to take a more holistic view of SD implementation, if only by prioritising factors. It also provides the opportunity to look holistically at the university as a complex system, which goes further than having a statement, commitment, or even a policy to run the university with environmental considerations.

4. Conclusions

This paper aimed to propose a tool, based on the multi-criteria ranking method, for ranking the factors-elements of SD, allowing the management of SD implementation in a university at the level of departments, as relatively autonomous wholes, based on an analysis of the departments at one of the leading technical universities in Poland. According to the authors, this tool can be a valuable source of information for university management. This is because it indicates which factors influencing the implementation of SD should focus their efforts on first, taking into account their own preferences and/or those of experts. It makes it possible to identify groups of factors with different degrees of importance from the point of view of the evaluators. It also provides information on what actions should be taken first to improve the implementation of SD at the university.
Grouping the factors that influence the implementation of SD into individual subgroups can provide valuable management information. This is because grouping can indicate which factors management should focus on in order to manage the university more effectively. The measures should be taken for further analysis in the development of the university’s sustainability strategy. The use of a facility ranking that considers multi-criteria assessments, as already mentioned, can have a significant impact not only on the implementation of SD, but also on the effectiveness of sustainability management at HEIs. It can also provide one of the essential prerequisites for sound decision making.
The authors of this article are also aware of the weaknesses of the proposed tool. This is because the development of the ranking requires the identification of factors influencing the implementation of SD in HEIs, which can be time consuming, and the familiarity of HEI managers with the procedure for developing a ranking of facilities. It also requires skills related to the development of a mathematical model.
Implementing sustainability strategy measures in a university can be a costly process. Therefore, it is necessary to analyze the costs of implemented changes based on the activity-based costing method (activity-based costing) Although the presented instrument was made using the international and proven standards on which the USus concept that inspired this article is based, it could be improved by involving more universities to verify the results. Nevertheless, this tool could help to understand the priorities in the implementation of an SD in HEIs. A further direction of research will be the expansion of the proposed model with other tools and ranking methods, and to analyze and optimize the available resources of the university, which will be a further step in the ongoing research on sustainability management at the university. A desirable direction would be an attempt to combine the proposed tool with optimization tools, in particular with liner programming and goal programming.

Author Contributions

Conceptualization, J.M.-C. and R.R.; investigation, J.M.-C.; formal analysis, R.R.; writing—original draft preparation, J.M.-C. and R.R.; writing—review and editing, J.M.-C. and R.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Simon, D. Our Common Future: Report of the World Commission on Environment and Development (Book Review). Third World Plan. Rev. 1987, 9, 285. [Google Scholar] [CrossRef]
  2. Mensah, J. Sustainable Development: Meaning, History, Principles, Pillars, and Implications for Human Action: Literature Review. Cogent Soc. Sci. 2019, 5, 1653531. [Google Scholar] [CrossRef]
  3. Gough, S.; Scott, W. Higher Education and Sustainable Development: Paradox and Possibility; Routledge: Abingdon, UK, 2008. [Google Scholar]
  4. Melewar, T.C.; Foroudi, P.; Dinnie, K.; Nguyen, B. The Role of Corporate Identity Management in the Higher Education Sector: An Exploratory Case Study. J. Mark. Commun. 2018, 24, 337–359. [Google Scholar] [CrossRef] [Green Version]
  5. Lewis, D.R.; Hendel, D.D.; Kallsen, L. Performance Indicators as a Foundation of Institutional Autonomy: Implications for Higher Education Institutions in Europe. Tert. Educ. Manag. 2007, 13, 203–226. [Google Scholar] [CrossRef]
  6. Annunziata, E.; Pucci, T.; Frey, M.; Zanni, L. The Role of Organizational Capabilities in Attaining Corporate Sustainability Practices and Economic Performance: Evidence from Italian Wine Industry. J. Clean. Prod. 2018, 171, 1300–1311. [Google Scholar] [CrossRef]
  7. Müller-Christ, G.; Sterling, S.; van Dam-Mieras, R.; Adomßent, M.; Fischer, D.; Rieckmann, M. The Role of Campus, Curriculum, and Community in Higher Education for Sustainable Development-A Conference Report. J. Clean. Prod. 2014, 62, 134–137. [Google Scholar] [CrossRef]
  8. Filho, W.L. About the Role of Universities and Their Contribution to Sustainable Development. High. Educ. Policy 2011, 24, 427–438. [Google Scholar] [CrossRef]
  9. Filho, W.L.; Manolas, E.; Pace, P. Education for Sustainable Development: Current Discourses and Practices and Their Relevance to Technology Education. Int. J. Technol. Des. Educ. 2009, 19, 149–165. [Google Scholar] [CrossRef] [Green Version]
  10. Fadeeva, Z.; Mochizuki, Y. Higher Education for Today and Tomorrow: University Appraisal for Diversity, Innovation and Change towards Sustainable Development. Sustain. Sci. 2010, 5, 249–256. [Google Scholar] [CrossRef]
  11. Beringer, A.; Adomßent, M. Sustainable University Research and Development: Inspecting Sustainability in Higher Education Research. Environ. Educ. Res. 2008, 14, 607–623. [Google Scholar] [CrossRef]
  12. Lukina, A.v.; Skorobogatykh, I.I.; Potravnyy, I.M.; Kuznetsov, V.v. The Strategy of Green University: Russian Experience of Implementation. In Proceedings of the 2017 10th International Conference Management of Large-Scale System Development, MLSD 2017, Moscow, Russia, 2–4 October 2017. [Google Scholar]
  13. Zhao, W.; Zou, Y. Green University Initiatives in China: A Case of Tsinghua University. Int. J. Sustain. High. Educ. 2015, 16, 491–506. [Google Scholar] [CrossRef]
  14. Lozano, R.; Lukman, R.; Lozano, F.J.; Huisingh, D.; Lambrechts, W. Declarations for Sustainability in Higher Education: Becoming Better Leaders, through Addressing the University System. J. Clean. Prod. 2013, 48, 10–19. [Google Scholar] [CrossRef]
  15. Kopnina, H.; Meijers, F. Education for Sustainable Development (ESD): Exploring Theoretical and Practical Challenges. Int. J. Sustain. High. Educ. 2014, 15, 188–207. [Google Scholar] [CrossRef]
  16. Wals, A.E.J. Shaping the Education of Tomorrow: 2012 Full-Length Report on the UN Decade of Education for Sustainable Development; UNESCO: London, UK, 2012. [Google Scholar]
  17. United Nations. Higher Education Sustainability Initiative. In Sustainable Development Knowledge Platform; United Nations: San Francisco, CA, USA, 2016. [Google Scholar]
  18. Adams, R.; Martin, S.; Boom, K. University Culture and Sustainability: Designing and Implementing an Enabling Framework. J. Clean. Prod. 2018, 171, 434–445. [Google Scholar] [CrossRef]
  19. Finnveden, G.; Newman, J.; Verhoef, L.A. Sustainable Development and Higher Education: Acting with a Purpose. Sustainability 2019, 11, 3831. [Google Scholar] [CrossRef] [Green Version]
  20. Amaral, L.P.; Martins, N.; Gouveia, J.B. Quest for a Sustainable University: A Review. Int. J. Sustain. High. Educ. 2015, 16, 155–172. [Google Scholar] [CrossRef]
  21. Leal Filho, W.; Azeiteiro, U.; Alves, F.; Pace, P.; Mifsud, M.; Brandli, L.; Caeiro, S.S.; Disterheft, A. Reinvigorating the Sustainable Development Research Agenda: The Role of the Sustainable Development Goals (SDG). Int. J. Sustain. Dev. World Ecol. 2018, 25, 131–142. [Google Scholar] [CrossRef] [Green Version]
  22. Caeiro, S.; Hamón, L.A.S.; Martins, R.; Aldaz, C.E.B. Sustainability Assessment and Benchmarking in Higher Education Institutions-a Critical Reflection. Sustainability 2020, 12, 543. [Google Scholar] [CrossRef] [Green Version]
  23. Denman, B.D. What Is a University in the 21st Century? High. Educ. Manag. Policy 2005, 17, 9–28. [Google Scholar] [CrossRef] [Green Version]
  24. Gamage, P.; Sciulli, N. Sustainability Reporting by Australian Universities. Aust. J. Public Adm. 2017, 76, 187–203. [Google Scholar] [CrossRef]
  25. Klußmann, C.; Sassen, R.; Gansel, E. Structural Key Factors of Participatory Sustainability Reporting for Universities. Int. J. Sustain. High. Educ. 2019, 20, 1080–1098. [Google Scholar] [CrossRef]
  26. Zorio-Grima, A.; Sierra-García, L.; Garcia-Benau, M.A. Sustainability Reporting Experience by Universities: A Causal Configuration Approach. Int. J. Sustain. High. Educ. 2018, 19, 337–352. [Google Scholar] [CrossRef]
  27. Brusca, I.; Labrador, M.; Larran, M. The Challenge of Sustainability and Integrated Reporting at Universities: A Case Study. J. Clean. Prod. 2018, 188, 347–354. [Google Scholar] [CrossRef]
  28. González-Torre, P.L.; Suárez-Serrano, E. A Framework for Implementing and Reporting United Nations Sustainable Development Goals in Spanish Higher Education Institutions. Int. J. Sustain. High. Educ. 2022, 23, 1349–1365. [Google Scholar] [CrossRef]
  29. De La Poza, E.; Merello, P.; Barberá, A.; Celani, A. Universities’ Reporting on SDGs: Using the Impact Rankings to Model and Measure Their Contribution to Sustainability. Sustainability 2021, 13, 2038. [Google Scholar] [CrossRef]
  30. Zahid, M.; Ur Rahman, H.; Ali, W.; Habib, M.N.; Shad, F. Integration, Implementation and Reporting Outlooks of Sustainability in Higher Education Institutions (HEIs): Index and Case Base Validation. Int. J. Sustain. High. Educ. 2021, 22, 120–137. [Google Scholar] [CrossRef]
  31. Laub, J.A. Assessing the Servant Organization. Development of the Organizational Leadership Assessment (OLA) Model; Dissertation Abstracts International; Florida Atlantic University: Boca Raton, FL, USA, 1999; Volume 1. [Google Scholar]
  32. Kapitulčinová, D.; AtKisson, A.; Perdue, J.; Will, M. Towards Integrated Sustainability in Higher Education–Mapping the Use of the Accelerator Toolset in All Dimensions of University Practice. J. Clean. Prod. 2018, 172, 4367–4382. [Google Scholar] [CrossRef]
  33. Findler, F.; Schönherr, N.; Lozano, R.; Stacherl, B. Assessing the Impacts of Higher Education Institutions on Sustainable Development-an Analysis of Tools and Indicators. Sustainability 2019, 11, 59. [Google Scholar] [CrossRef] [Green Version]
  34. Cole, L.; Wright, T. Assessing Sustainability on Canadian University Campuses: Development of a Campus Sustainability Assessment Framework. Unpublished. Master’s Thesis, Royal Roads University, Victoria, BC, USA, 2003. [Google Scholar]
  35. Lozano, R. Diffusion of Sustainable Development in Universities’ Curricula: An Empirical Example from Cardiff University. J. Clean. Prod. 2010, 18, 637–644. [Google Scholar] [CrossRef]
  36. Smith, A.A.; Student Environmental Action Coalition. Campus Ecology: A Guide to Assessing Environmental Quality and Creating Strategies for Change; Living Planet Press: Bonn, Germany, 1993. [Google Scholar]
  37. McIntosh, M.; Cacciola, K.; Clermont, S.; Keniry, J. State of the Campus Environment: A National Report Card on Environmental Performance and Sustainability in Higher Education; National Wildlife Federation: Reston, VA, USA, 2001. [Google Scholar]
  38. Alghamdi, N.; den Heijer, A.; de Jonge, H. Assessment Tools’ Indicators for Sustainability in Universities: An Analytical Overview. Int. J. Sustain. High. Educ. 2017, 18, 84–115. [Google Scholar] [CrossRef]
  39. Hernández-Diaz, P.M.; Polanco, J.A.; Escobar-Sierra, M.; Leal Filho, W. Holistic Integration of Sustainability at Universities: Evidences from Colombia. J. Clean. Prod. 2021, 305, 127145. [Google Scholar] [CrossRef]
  40. The Sustainability Tracking, Assessment and Rating System. Available online: https://stars.aashe.org/ (accessed on 24 February 2023).
  41. Hoover, E.; Harder, M.K. What Lies beneath the Surface? The Hidden Complexities of Organizational Change for Sustainability in Higher Education. J. Clean. Prod. 2015, 106, 175–188. [Google Scholar] [CrossRef] [Green Version]
  42. Blanco-Portela, N.; Benayas, J.; Pertierra, L.R.; Lozano, R. Towards the Integration of Sustainability in Higher Eeducation Institutions: A Review of Drivers of and Barriers to Organisational Change and Their Comparison against Those Found of Companies. J. Clean. Prod. 2017, 166, 563–578. [Google Scholar] [CrossRef]
  43. Barth, M. Many Roads Lead to Sustainability: A Process-Oriented Analysis of Change in Higher Education. Int. J. Sustain. High. Educ. 2013, 14, 160–175. [Google Scholar] [CrossRef]
  44. Casarejos, F.; Gustavson, L.M.; Frota, M.N. Higher Education Institutions in the United States: Commitment and Coherency to Sustainability Vis-à-Vis Dimensions of the Institutional Environment. J. Clean. Prod. 2017, 159, 74–84. [Google Scholar] [CrossRef]
  45. Verhulst, E.; Lambrechts, W. Fostering the Incorporation of Sustainable Development in Higher Education. Lessons Learned from a Change Management Perspective. J. Clean. Prod. 2015, 106, 189–204. [Google Scholar] [CrossRef]
  46. Berzosa, A.; Bernaldo, M.O.; Fernández-Sanchez, G. Sustainability Assessment Tools for Higher Education: An Empirical Comparative Analysis. J. Clean. Prod. 2017, 161, 812–820. [Google Scholar] [CrossRef] [Green Version]
  47. Disterheft, A.; Caeiro, S.S.; Leal Filho, W.; Azeiteiro, U.M. The INDICARE-Model—Measuring and Caring about Participation in Higher Education’s Sustainability Assessment. Ecol. Indic. 2016, 63, 172–186. [Google Scholar] [CrossRef]
  48. Yuan, X.; Zuo, J.; Huisingh, D. Green Universities in China-What Matters? J. Clean. Prod. 2013, 61, 36–45. [Google Scholar] [CrossRef]
  49. Zaini, R.M.; Pavlov, O.v.; Saeed, K.; Radzicki, M.J.; Hoffman, A.H.; Tichenor, K.R. Let’s Talk Change in a University: A Simple Model for Addressing a Complex Agenda. Syst. Res. Behav. Sci. 2017, 34, 250–266. [Google Scholar] [CrossRef]
  50. Filho, W.L.; Manolas, E.; Pace, P. The Future We Want Key Issues on Sustainable Development in Higher Education after Rio and the Un Decade of Education for Sustainable Development. Int. J. Sustain. High. Educ. 2015, 16, 112–129. [Google Scholar] [CrossRef] [Green Version]
  51. Wright, T.; Horst, N. Exploring the Ambiguity: What Faculty Leaders Really Think of Sustainability in Higher Education. Int. J. Sustain. High. Educ. 2013, 14, 209–227. [Google Scholar] [CrossRef]
  52. Wright, T.S.A.; Wilton, H. Facilities Management Directors’ Conceptualizations of Sustainability in Higher Education. J. Clean. Prod. 2012, 31, 118–125. [Google Scholar] [CrossRef]
  53. Leal Filho, W.; Wu, Y.C.J.; Brandli, L.L.; Avila, L.V.; Azeiteiro, U.M.; Caeiro, S.; da Rosa Gama Madruga, L.R. Identifying and Overcoming Obstacles to the Implementation of Sustainable Development at Universities. J. Integr. Environ. Sci. 2017, 14, 93–108. [Google Scholar] [CrossRef] [Green Version]
  54. Hugé, J.; Mac-Lean, C.; Vargas, L. Maturation of Sustainability in Engineering Faculties–From Emerging Issue to Strategy? J. Clean. Prod. 2018, 172, 4277–4285. [Google Scholar] [CrossRef]
  55. UNESCO. Shaping the Future We Want UN Decade of Education for Sustainable Development; 2005–2014 Final Report; UNESCO: London, UK, 2014. [Google Scholar]
  56. Lozano, R.; Peattie, K. Assessing Cardiff University’s Curricula Contribution to Sustainable Development Using the STAUNCH (RTM) System. J. Educ. Sustain. Dev. 2011, 5, 115–128. [Google Scholar] [CrossRef]
  57. Leal Filho, W.; Frankenberger, F.; Salvia, A.L.; Azeiteiro, U.; Alves, F.; Castro, P.; Will, M.; Platje, J.; Lovren, V.O.; Brandli, L.; et al. A Framework for the Implementation of the Sustainable Development Goals in University Programmes. J. Clean. Prod. 2021, 299, 126915. [Google Scholar] [CrossRef]
  58. Ramos, T.B.; Caeiro, S.; van Hoof, B.; Lozano, R.; Huisingh, D.; Ceulemans, K. Experiences from the Implementation of Sustainable Development in Higher Education Institutions: Environmental Management for Sustainable Universities. J. Clean. Prod. 2015, 106, 3–10. [Google Scholar] [CrossRef]
  59. Ramos, T.; Pires, S.M. Sustainability Assessment: The Role of Indicators. In Sustainability Assessment Tools in Higher Education Institutions: Mapping Trends and Good Practices Around the World; Springer: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  60. Ramos, T.B. Sustainability Assessment: Exploring the Frontiers and Paradigms of Indicator Approaches. Sustainability 2019, 11, 824. [Google Scholar] [CrossRef] [Green Version]
  61. Akhavi, F.; Hayes, C. A Comparison of Two Multi-Criteria Decision-Making Techniques. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Washington, DC, USA, 8 October 2003; Volume 1. [Google Scholar]
  62. Yildirim, B.F.; Önder, E. Evaluating Potential Freight Villages in Istanbul Using Multi Criteria Decision Making Techniques. J. Logist. Manag. 2014, 3, 1–10. [Google Scholar] [CrossRef]
  63. Kamishima, T.; Kazawa, H.; Akaho, S. A Survey and Empirical Comparison of Object Ranking Methods. In Preference Learning; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar]
  64. Jędrzejczak, Z.; Kukła, K.; Skrzypek, J. Badania Operacyjne w Przykładach i Zadaniach; PWN: Warszawa, Poland, 2022. [Google Scholar]
  65. Ryńca, R. Zastosowanie Wybranych Metod i Narzędzi w Ocenie Działalności Szkoły Wyższej; Oficyna Wydawnicza Politechniki Wrocławskiej: Wrocław, Poland, 2014. [Google Scholar]
  66. Lynch, K. Control by Numbers: New Managerialism and Ranking in Higher Education. Crit. Stud. Educ. 2015, 56, 190–207. [Google Scholar] [CrossRef]
Figure 1. Number of publications in ScienceDirect between 2012 and 2022, search based on keywords “higher educational institutions” and “sustainable development”. Source: https://tiny.pl/wnf45 (accessed on 15 January 2020) [14,17,18].
Figure 1. Number of publications in ScienceDirect between 2012 and 2022, search based on keywords “higher educational institutions” and “sustainable development”. Source: https://tiny.pl/wnf45 (accessed on 15 January 2020) [14,17,18].
Sustainability 15 06256 g001
Figure 2. Proposed implementation of the proposed model. Source: own study.
Figure 2. Proposed implementation of the proposed model. Source: own study.
Sustainability 15 06256 g002
Table 1. Matrix of normalized variables.
Table 1. Matrix of normalized variables.
Object i-thDiagnostic Variables
Xi1Xi2Xij
C1 z 11 z 12 z 1 j
C2 z 21 z 22 z 2 j
Ci z i 1 z i 2 z i j
Source: own study.
Table 2. Numerical values of diagnostic characteristics.
Table 2. Numerical values of diagnostic characteristics.
Diagnostic Variables
FactorW1W2W3W4W5W6W7W8W9W10
C12322211254
C24332322224
C33232232333
C42221223533
C51332342331
C63222234422
C74434325332
C85452112243
C94232122321
C103123211212
C113344323243
C124431232456
C132232121243
C145123213233
C151122422223
C162211221122
Source: own study.
Table 3. Normalized values of the diagnostic variables and values of the synthetic variable.
Table 3. Normalized values of the diagnostic variables and values of the synthetic variable.
FactorZi1Zi2Zi3Zi4Zi5Zi6Zi7Zi8Zi9Zi10Q
C10.670.330.750.670.671.001.000.670.000.406.16
C20.000.330.500.670.330.670.750.670.750.405.07
C30.330.670.500.670.670.330.750.330.500.605.35
C40.670.670.751.000.670.670.50−0.330.500.605.7
C51.000.330.500.670.330.000.750.330.501.005.41
C60.330.670.750.670.670.330.250.000.750.805.22
C70.000.000.500.000.330.670.000.330.500.803.13
C8−0.330.000.000.671.001.000.750.670.250.604.61
C90.000.670.500.671.000.670.750.330.751.006.34
C100.331.000.750.330.671.001.000.671.000.807.55
C110.330.330.250.000.330.670.500.670.250.603.93
C120.000.000.501.000.670.330.750.000.000.003.25
C130.670.670.500.671.000.671.000.670.250.606.7
C14−0.331.000.750.330.671.000.500.670.500.605.69
C151.001.000.750.670.000.670.750.670.750.606.86
C160.670.671.001.000.670.671.001.000.750.808.23
Source: own study.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mrzygłocka-Chojnacka, J.; Ryńca, R. Using a Multi-Criteria Ranking Method to Assess Factors Influencing the Implementation of Sustainable Development at Higher Educational Institutions. Sustainability 2023, 15, 6256. https://doi.org/10.3390/su15076256

AMA Style

Mrzygłocka-Chojnacka J, Ryńca R. Using a Multi-Criteria Ranking Method to Assess Factors Influencing the Implementation of Sustainable Development at Higher Educational Institutions. Sustainability. 2023; 15(7):6256. https://doi.org/10.3390/su15076256

Chicago/Turabian Style

Mrzygłocka-Chojnacka, Jagoda, and Radosław Ryńca. 2023. "Using a Multi-Criteria Ranking Method to Assess Factors Influencing the Implementation of Sustainable Development at Higher Educational Institutions" Sustainability 15, no. 7: 6256. https://doi.org/10.3390/su15076256

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop