4.1. Performance Evaluation Process of the Environmentally Sustainable Port
Step 1: The proposed framework is based on [
9], incorporating four primary factors derived from port authority functions: landlord, regulatory, operator, and community functions. Each of these port authority functions is subdivided into dimensions assigned as subfactors. Consequently, there are six subfactors under the landlord function, five under the regulatory function, three under the operator function, and six under the community function. The resulting MCDM model is illustrated in
Figure 2.
Step 2: K decision makers were invited to answer the questionnaire but only three respondents who fit the criteria as experts answered the questionnaire in form of AHP analysis (pairwise structure) using Goepel’s [
29] online software. These experts, who hold senior positions at important ports in Malaysia, play active roles in advancing environmentally sustainable practices in port management. They contribute innovative solutions aimed at enhancing sustainability at the port, thereby benefiting both their organization and the industry’s environmental initiatives. According to the literature, three (3) experts are sufficient to implement the IF-AHP technique [
34].
Table 2 presents the basic profiles of the experts.
Step 3: The online software is programmed to automatically compute the Consistency Ratio (CR). Pairwise comparisons may produce inconsistent results (CR > 0.10) in certain scenarios. In cases where the consistency ratio (CR) exceeded the threshold of 0.10, the experts were re-engaged to review and clarify their pairwise comparison inputs. The final overall CR values for each factor and sub-factor are listed in
Table 3. Note that all the CR values are lower than 0.1 and indicate consistent evaluations by the experts.
Step 4: Design and select the evaluation scale for the Intuitionistic Fuzzy Analytic Hierarchy Process (IF-AHP). The evaluation scale employed by [
30] was applied for pairwise comparisons, as presented in
Table 2. The foundation for developing an intuitionistic fuzzy judgment matrix involves evaluating the assessments of experts regarding environmentally sustainable ports in Malaysia. In the assessment of the relative significance of the two indexes, the experts are tasked with comparing the criteria-level indicators through pairwise comparisons. The intuitionistic fuzzy judgment matrix (IFJM)
is derived from the evaluation information provided by K decision-makers using a preference relation matrix integration method. The degree of membership
signifies the importance of the
index in relation to the
index. The degree of non-membership
signifies the relevance of the
index in relation to the
index, whereas the degree of hesitation is defined as
.
Step 5: Obtain and evaluate the criteria based on DMs assessments in the form of intuitionistic fuzzy numbers (IFNs). The results answered by experts in Step 2 for AHP-OS were transformed into Linguistic Variables, as shown in
Table 1.
Table 4 shows the pairwise comparisons against the criteria. Each of the factors and subfactors were compared against each other (pairwise), and the results were presented in the preference matrix. In
Table 5, for example, from Decision Maker 1 (DM1), when the Landlord Function is compared to the Operator Function, the linguistic variables are Slightly Important (SI), which means that the Landlord Function is slightly important compared to the Operator Function. When the Landlord Function is compared with the Community Function, the linguistic variables are very important (VI), which means that Landlord Function is very important compared to community function.
Step 6: The linguistic expressions within the decision matrices are transformed into IF values, according to the scale outlined in
Table 1.
Table 5 presents the converted values for the IF decision matrices listed in
Table 4. In IF-AHP, when two criteria are compared, there is a reciprocal relationship between them. For example, linguistic expressions in
Table 4 for Decision Maker 1, comparing the Landlord Function and Operator Function, are “Slightly Important” (SI). This expression is converted into IF values as (0.60, 0.25, 0.15) and the reciprocal for the Operator Function compared with the Landlord Function is (0.25, 0.60, 0.15).
Step 7: Perform a consistency test on expert evaluation opinions. The intuitionistic fuzzy data in IFJM
for this study were derived from Step 6. This study established five (5) IFJM
based on the established index system for environmentally sustainable ports within the context of port authority functions. Step 7 involves the verification and revision of the IFJM’s consistency. The modified IFJM
for the first-level indicator is computed using formulas (i)–(iii), and is presented in
Table 6. Taking the calculation of
as an example
and
as the main factors, as shown in
Table 6, the calculation can be expressed as follows:
Using Equation (1), the distance between and is calculated as = 0.1575 > 0.1, indicating that consistency is not acceptable.
For the IFJM with respect to the landlord function, the consistency was calculated as = 0.1782 > 0.1, indicating that the consistency was not acceptable. For the IFJM with respect to regulatory function, the consistency was calculated as = 0.1448 > 0.1, indicating that the consistency was not acceptable. At the same time, for the IFJM with respect to the operator function, the consistency was calculated as = 0.1434 > 0.1, indicating that the consistency was not acceptable. Similarly, for the IFJM with respect to community function, consistency was calculated as = 0.1572 > 0.1, indicating that the consistency was not acceptable.
Step 8: Adjust the IFJM to satisfy the consistency requirements. According to step 7, not all IFJM
do not pass the consistency test; thus, the adjusted IFJM
is calculated using Equations (5) and (6), as shown in
Table 7. Taking the calculation of
as an example
and
as the main factors, as shown in
Table 7, when
the calculation can be expressed as follows:
The distance between and was determined using Equation (7). The consistency was quantified as 0.0991, which is below the threshold of 0.1, indicating that the modified IFJM effectively met the consistency criteria.
For the adjusted intuitionistic fuzzy consistency test matrix pertaining to the Landlord function, at , the consistency was calculated as 0.0988, which was less than 0.1, indicating that the modified IFJM had successfully passed the consistency test. The adjusted intuitionistic fuzzy consistency test matrix corresponding to the regulatory function, at the was calculated as 0.0995, which was less than 0.1, also indicating that the modified IFJM successfully passed the consistency test.
At the adjusted intuitionistic fuzzy consistency test matrix corresponds to the operator function, which was calculated as 0.0992, which was less than 0.1, indicating that the modified IFJM successfully passed the consistency test. And lastly, the adjusted intuitionistic fuzzy consistency test matrix pertaining to the community function was calculated at resulted in 0.0989, which was less than 0.1, indicating that the modified IFJM passed the consistency test.
Step 9: The weight of each index is calculated using the intuitionistic fuzzy judgement matrix that has passed the consistency test.
Following the calculations in Step 8, all intuitionistic fuzzy judgment matrices demonstrate consistency in the test. To ascertain the index weight of each level, the weights of the four main port authority functions can be computed using Equation (8) along with the intuitionistic fuzzy consistency matrix
presented in
Table 8. The weights
of the four primary functions are represented as
for the Landlord Function,
for the regulatory function,
, and
for the Operator and Community functions, respectively.
Table 8 presents the index weights for each level.
Step 10: The comprehensive weights of the indicators are calculated in
Table 9. Taking the calculation of
as an example for Landlord function 1, the calculation can be expressed as
Step 11: Normalize the weights of indicators. The normalized index weight assigned to each factor and sub-factor represents the local weighting of that particular factor and sub-factors within the hierarchical structure of the decision-making process. This local weighting is crucial, as it reflects the relative importance of each indicator in relation to others at the same level of the hierarchy. The sum of the local weights within each level equals one, thereby providing a consistent and comparable measure of the significance of each indicator in contributing to the overall decision outcome.
Step 12: Calculate the global weights and rankings. To illustrate the calculation of the global weights, as shown in
Table 10, consider the Landlord function (LF) with a local weight of 0.298. The sub-factor Landlord function 1 (LF1) in this category had a local weight of 0.214. Therefore, the global weight for (LF1) is therefore calculated to be 0.064. This indicates that (LF1) contributed 0.064 to the overall decision-making process when considering its position within the entire framework.
This method was systematically applied to all the sub-factors for each main factor. By calculating the global weightage, decision makers can obtain a clear understanding of the relative importance of each sub-factor within the broader context of the decision. This global weighting system not only ensures consistency across different levels of the framework, but also provides a comprehensive basis for making well-informed decisions that consider all relevant factors and sub-factors.
The sub-factors have been ranked based on their calculated global weights, which reflect their overall importance in the hierarchical structure of IF-AHP. From
Table 11, OF1 has the highest global weight of 0.105, making it the most significant sub-factor in the overall hierarchy. This is followed by OF2 with the global weight of 0.091, and FR1 with a weight of 0.073, indicating their substantial influence in the decision-making process.
Sub-factors with lower global weights, such as those under Community function, like CF1 (0.032), CF2 (0.030), and others with weights of 0.025 and 0.022, are ranked lower, indicating that the sub-factors have less influence on the overall decision outcome of environmentally sustainable ports. The ranking effectively prioritizes the sub-factors, guiding decision-makers in focusing on the most impactful criteria within the hierarchical structure.
This ranking is crucial as it helps identify which sub-factors contribute most to achieving environmentally sustainable ports in Malaysia, thereby enabling a more targeted and efficient decision-making process. The ranked list allows stakeholders to allocate resources and attention according to the relative importance of each sub-factor, ensuring that the most critical aspects of the decision are addressed adequately.
The calculation of global weightage for sub-factors reveals that minimizing impacts from operations (OF1) and improving energy efficiency and energy conservation within the port (OF2) have the highest global weights, despite the Operator function being ranked the third among the main factors, below the Landlord and Regulatory functions. This outcome is primarily attributed to the significantly high local weights assigned to OF1, which is 0.395 and OF2, which is 0.344, within the Operator function. Although Operator function is comparatively lower overall weight (0.265) compared to Landlord function and the Regulatory function, these sub-factors OF1 and OF2 gain prominence due to their dominant local weight, which, when multiplied by the weight of the Operator function, result in higher global weights than any if the sub-factors.
Conversely, while the Landlord function and Regulatory function possess higher factor weights, which are 0.298 and 0.281, respectively, the local weights of their sub-factors are more evenly distributed and relatively lower. This distribution indicates that the importance within these functions is spread across multiple sub-factors, thereby diluting the global impact of each individual sub-factor. This outcome highlights how the distribution of local weights among sub-factors significantly influences global weightage, making it possible for sub-factors in a lower-ranked main factor to dominate in terms of global weight.
4.2. Group Consensus Analysis
The Analytical Hierarchy Process (AHP) employs a consensus indicator to measure the degree of agreement among participants regarding their priorities. This indicator spans from 0% to 100%, where 0% signifies no consensus and 100% denotes full consensus. The consensus metric is derived using Shannon entropy, partitioned into alpha and beta components as per Goepel’s methodology [
35]. Shannon entropy measures diversity, enabling the assessment of homogeneity (alpha diversity) and dissimilarity (beta diversity) within groups.
For categorizing group consensus, the following classifications can be applied based on the percentage values:
Very low consensus: Below 50% (indicating disagreement);
Low consensus: 50% to 67.5%;
Moderate consensus: 67.5% to 75%;
High consensus: 75% to 87.5%;
Very high consensus: Above 87.5% (indicating excellent agreement).
Values under 50% indicate a lack of consensus among the group, demonstrating significant diversity in judgments. Values at or above 87.5% reflect a substantial alignment in priorities, indicating strong consensus among group members. The consensus indicator
is calculated as follow:
where:
exp ( (Gamma diversity)
exp ( (Alpha diversity)
adjusts for the minimum entropy in AHP
and are Shannon entropy values for individual and group distributions, respectively.
Here,
and
are computed as follows:
where
is the priority weight for criterion
by decision-maker
and
is the average priority weight for
across all decision-makers.
The result from online software shows that the is 82.8%, categorized as high consensus for Port Authority Function. This reflects a strong level of agreement among the experts in the analysis. The group consensus of sub-criteria can also be conducted by similar method.
Table 11 shows the aggregated group results derived from pairwise comparison by the experts. The result is obtained by combining the individual priorities of experts, which are derived from pairwise comparisons of each factor against others. The aggregated group result places the highest priority on the Landlord Function (37.0%) followed by the Regulatory Function (29.7%) and the Operator Function (27.3%). The Community Function (6.1%) was deemed the least critical. The prioritization of the Landlord Function highlights the importance of sustainable infrastructure management in achieving environmentally sustainable ports. Activities such as ecological preservation, climate adaptation, and waste management directly align with reducing the environmental impact of ports. The emphasis on the Regulatory Function underscores the necessity of compliance and enforcement to ensure sustainable practices, while the Operator Function reflects the operational adjustments required for energy efficiency and pollution reduction. The lower prioritization of the Community Function suggests that stakeholder engagement is seen as a supportive role rather than a core driver of sustainability. However, fostering environmental awareness and encouraging green practices among stakeholders remain critical for long-term sustainability efforts.
Individual decision-makers displayed distinct emphases in their evaluations. Decision-maker 1 (DM1) assigned the highest priority to the Regulatory Function (53.0%), reflecting a strong emphasis on oversight and compliance. In contrast, the Landlord Function received moderate weight (28.1%), while the Operator Function (13.6%) and Community Function (5.3%) were considered less significant. Decision-maker 2 (DM2) prioritized the Landlord Function (46.6%), highlighting its importance for infrastructure management. The Operator Function (25.5%) and Regulatory Function (22.2%) received relatively balanced weights, with the Community Function (5.7%) being minimally weighted. Decision-maker 3 (DM3), however, prioritized the Operator Function (44.5%), indicating a focus on operational efficiency. This was followed by the Landlord Function (31.6%), with the Regulatory Function (17.9%) and Community Function (5.9%) receiving lower emphasis. These variations among individual decision-makers reflect the diverse perspectives shaped by their professional roles and priorities. Nevertheless, the aggregated results, characterized by a high consensus value, illustrate that the group outcome effectively synthesizes these differences into a cohesive decision.
To further understand the alignment among decision-makers, pairwise similarity scores were computed and presented in a similarity matrix as shown in
Figure 3. To compute the similarity metrics between decision-makers, the relative homogeneity formula is used, specifically for pairwise combinations. The similarity formula for two decision-makers
is derived as follows:
where:
exp ( (Gamma diversity)
exp ( (Alpha diversity)
Average Shannon entropy of individual distributions
Shannon entropy of the group result
Figure 3 illustrates the similarity matrix, which shows the alignment of individual judgments. The similarity scores ranged from 80% to 95%, demonstrating strong consensus among the groups, with minor variations due to differences in individual perspectives. For instance, in
Table 3, DM1 (indicated by 1) and DM2 (indicated by 2) exhibited an 88% similarity, while DM2 and DM3 (indicated by 3) showed the highest similarity of 95%. These differences suggest that while there is a general agreement on priorities, individual perspectives may vary slightly, possibly due to differences in personal or professional experiences.
Figure 3.
Similarity matrix for Port Authority Function.
Figure 3.
Similarity matrix for Port Authority Function.