Next Article in Journal
Higher Education Institutions as Leverage for Backing up SMEs’ Efforts to Meet SDG 9
Previous Article in Journal
The Development of Agricultural Drought Monitoring and Drought Limit Water Level Assessments for Plateau Lakes in Central Yunnan Based on MODIS Remote Sensing: A Case Study of Qilu Lake
Previous Article in Special Issue
The Effect of Corporate Social Responsibility and Sustainable Development Practices on Employer Branding—A Case Study of an International Corporation Operating in Poland
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Developing Key Performance Indicators for a Port in Indonesia

by
Yugowati Praharsi
1,
Mohammad Abu Jami’in
2,
Devina Puspita Sari
1,
Putri Rahmatul Isti’anah
3 and
Hui-Ming Wee
4,*
1
Business Management Department, Shipbuilding Institute of Polytechnic Surabaya, Surabaya 60111, Indonesia
2
Electrical Engineering Department, Shipbuilding Institute of Polytechnic Surabaya, Surabaya 60111, Indonesia
3
Management School, University of Sheffield, Sheffield S10 1FL, UK
4
Industrial and System Engineering Department, Chung Yuan Christian University, Taoyuan City 320314, Taiwan
*
Author to whom correspondence should be addressed.
Sustainability 2025, 17(10), 4664; https://doi.org/10.3390/su17104664
Submission received: 22 March 2025 / Revised: 7 May 2025 / Accepted: 9 May 2025 / Published: 19 May 2025

Abstract

:
Ports play a crucial role in Indonesia’s economy, yet many, particularly smaller ports, lack standardized port performance indicators (PPIs) to assess and improve operational efficiency. Existing studies primarily focus on financial and operational performance, often employing either the balanced scorecard (BSC) or PESTLE analysis in isolation, with limited integration of sustainability concepts, such as smart port and green port frameworks. This study bridges this gap, aiming to develop and validate a comprehensive PPI framework that combines BSC, PESTLE, and circular economy smart and green port principles to create holistic performance assessment tools for ports. The research used a three-round Delphi method, incorporating expert evaluations and consensus from academics, consultants, port authorities, and customers to validate key performance indicators. A total of 127 PPIs were initially identified through a literature review and expert consultations, using strict selection criteria—standard deviation ≤ 1.5, interquartile range (Q3–Q1) ≤ 2.5, and ≥51% expert agreement (ratings 8–10). The final validated framework includes 114 indicators covering financial, operational, environmental, and strategic dimensions. This study provides valuable insights for port authorities to optimize performance and align with global best practices by integrating internal and external factors into a comprehensive model.

1. Introduction

Ports are pivotal economic centers in global multimodal transportation and supply chain networks [1]. Indonesia, the world’s largest archipelagic nation, relies heavily on its ports for domestic and international trade, prompting the government to launch feeder-port development projects to enhance inter-island connectivity [2]. These ports play a vital role in Indonesia’s logistics operations, serving as an integral component of the national infrastructure that supports trade and commercial activities. They provide a broad array of services essential to business operations, functioning as hubs for docking ships, embarking and disembarking passengers, loading cargo, also facilitating both intra-modal and inter-modal transportation [3].
Given their importance to the Indonesian economy, port performance is critical for ensuring a steady flow of goods and supply chains. Reliable port services are, thus, paramount for stakeholder satisfaction [1]. To remain competitive, Indonesian ports must deliver high performance through fast service and cost efficiency, achievable via port performance indicators (PPIs). Organizational performance measurement is vital for effective management [4], and in the supply chain context, it functions as a strategic tool for planning and coordinating activities [5].
However, many Indonesian ports, particularly smaller and regional ones, do not employ such performance indicators. While essential for business development, port authorities often rely solely on internal metrics, like net profit and operational smoothness. Effective performance measurement, however, necessitates considering external factors and the competitive landscape. In a global economy reliant on maritime transport, ports face increasing pressure to optimize their performance across economic, environmental, energy, and functional dimensions, impacting their sustainability [6]. Therefore, a comprehensive approach to port indicator measurement, encompassing both internal and external factors, is crucial for enhancing performance [6].
Recent studies have employed the balanced scorecard (BSC) for internal factor analysis and politics, economics, social, technology, legal, environment (PESTLE) scores for external factors [7,8]. Additionally, green and smart port concepts contribute to the assessment of external influences [9,10]. However, these methodologies are seldom integrated, particularly within the port sector. This study addresses that gap by proposing an integrated framework that combines the BSC, PESTLE, and sustainability principles to enhance port performance. Such a holistic approach—incorporating both internal and external dimensions—is essential given the complexity of port systems [11].
Beyond the synthesis of the existing literature, this study incorporates indicators derived from government-owned ports and expert brainstorming. As Radovic and Stevic [12] emphasize, the evaluation and selection of key performance indicators (KPIs) should be tailored to the specific characteristics of each organization, underscoring the value of incorporating expert opinions for effective management. While various methodologies exist for evaluating and selecting KPIs, such as the analytical hierarchy process (AHP) and data envelopment analysis (DEA) [13,14,15], this study employs the Delphi technique. The Delphi method is particularly well-suited for establishing port performance criteria and minimizing bias in individual perceptions among expert judgments [14].
This research utilizes a three-round Delphi technique, a group assessment method for achieving consensus among expert judgments [16]. Questionnaires developed using the Delphi technique have demonstrated validity and reliability in evaluating port performance [17]. This paper identifies critical implementation aspects in comprehensively merging frameworks and integrates the BSC, PESTLE, and green/smart port concepts to develop robust port performance indicators, embedding the latter within PESTLE’s technology and environment elements. This integrative approach distinguishes this study and offers a valuable reference for academics and practitioners in developing PPIs, particularly for smaller ports which are often overlooked in research.

2. Literature Review

2.1. Overview of Existing Port Performance Indicators (Global and Indonesia)

Effective port performance measurement is essential for efficiency, competitiveness, and sustainable development. Globally, ports use various KPIs to assess operational, financial, and environmental effectiveness. Common international indicators include vessel turnaround time (VTT), berth occupancy, crane productivity, cargo dwell time, container throughput, and yard utilization [1,18]. These provide benchmarks for performance comparison across time and contexts.
Comparative analyses, such as that by Ha and Yang [18], highlighted the interdependency of operational indicators, like VTT and crane productivity. Yeo et al. [1] emphasized the increasing relevance of customer-oriented indicators, including service quality and logistics integration. Mazibuko et al. [19] underscored the importance of ship waiting time and berth availability, especially in congested African and Asian ports.
In Indonesia, Hamid [7] found that the BSC was effective in enhancing a state-owned port’s (Pelindo IV) competitive advantage. The study found a strong, positive relationship between BSC implementation and business competitiveness, especially when focusing on financial performance. The BSC aligned strategy with operations, improved learning, and clarified goals. However, the application was limited to internal operational, financial, and customer service metrics. The study did not address broader sustainability indicators, external stakeholder involvement, or standardized KPI practices across the national port network. It also did not evaluate other ports beyond Pelindo IV, nor did it explore national benchmarking mechanisms.
Indonesia’s unique challenges, including its archipelagic nature, underdeveloped hinterland access, and technological disparities, complicate the direct application of global KPIs. Localized indicators are needed, incorporating national priorities, regulations, and infrastructure readiness.
This study addresses this gap by developing a context-sensitive, holistic framework integrating international best practices and national relevance, using the BSC, PESTLE analysis, as well as smart and green port concepts, for applicability to smaller ports lacking measurement criteria.

2.2. Balance Scorecard

BSC is a strategic tool that translates organizational vision and objectives into actionable initiatives [20]. It facilitates employee understanding of the organization’s mission and strategy, aligning activities with goals [21].
The BSC comprises the following four performance dimensions: financial, customer, learning and growth, and internal business processes [7]. These provide a balanced approach to assessing organizational performance [22], ensuring long-term sustainability by aligning strategic goals across each dimension [21]. Table 1 summarizes port performance indicators based on BSC dimensions, drawing from the literature, government-owned port indicators, and expert interviews.

2.3. PESTLE

PESTLE analysis strategically examines macro-environmental factors—political, economic, social, technological, legal, and environmental—influencing organizational operations and planning [31], providing an external overview for understanding market dynamics and business positioning. In port operations, PESTLE factors are crucial for evaluating external influences on performance [8].
The technological dimension, including R&D, automation, technology incentives, and change, links to smart port development, aiming for enhanced performance via full automation and IoT integration [3,32]. The environmental dimension aligns with the green port concept, emphasizing ecological and environmental considerations, integrating sustainability, energy conservation, community development, and economic interests [33]. Table 2 presents port performance indicators categorized by PESTLE dimensions, derived from the literature, government port indicators, expert interviews, as well as smart/green port indicators.

2.4. Delphi Method

The Delphi method is widely used by academic research as a valuable technique for reaching consensus. This method collects data from a panel of experts using several rounds of questionnaires [48]. The Delphi method represents a structured group communication process for evaluating evidence collectively and providing expert judgment [49]. A major strength of the Delphi method in comparison to other group-based techniques is the reduced influence of social pressures among respondents [49]. Walters et al. [50] showed that it is an efficient, systematic, and structured approach that can be used to address complex issues in a range of disciplines, such as medicine, social policy, tourism, and sustainability science. Table 3 presents the use of the Delphi method in previous studies.

3. Methodology

3.1. Development of Port Performance Indicator (PPI)

This study integrates the BSC, PESTLE analysis, and smart/green port concepts to establish a comprehensive and balanced approach to port performance measurement. Each framework offers a distinct perspective, as follows: the BSC focuses on internal performance indicators, including financial, internal business processes, and customer-related dimensions. This internal focus is essential for evaluating a port’s operational effectiveness and inherent capabilities. Conversely, the PESTLE framework addresses the external environmental factors—political, economic, social, technological, legal, and environmental—that influence a port’s adaptability and long-term competitiveness.
By incorporating smart and green port concepts, the model also emphasizes innovation and sustainability. These concepts align with PESTLE’s technological and environmental dimensions and complement the strategic orientation of the BSC. For instance, smart technologies can enhance internal processes (BSC) while simultaneously addressing external technological shifts (PESTLE). Similarly, green initiatives support compliance with environmental regulations and broader sustainability goals, thereby increasing a port’s resilience to future challenges.
In this study, PPI development is based on a comprehensive analysis of both the internal and external factors that affect port operations. This integrated model, illustrated in Figure 1, builds upon the conceptual framework of Praharsi et al. [11].

3.2. Expert Selection and Data Collection

3.2.1. Expert Profile

This research incorporated expert opinions to obtain essential reference data. Experts were selected using purposive sampling, based on their professional background, familiarity with port operations, and involvement in decision-making roles. Each participant possessed a minimum of five years of relevant experience in port management, consulting, logistics, or maritime academia. Experts were consulted to provide input on the PPIs’ design, including recommendations for eliminating or adding PPIs, and to assess the importance level of each PPI. These expert judgments were gathered from individuals with in-depth knowledge of ports and diverse backgrounds, enhancing the applicability of the study’s results. The profiles of the experts who contributed to the Delphi survey are detailed in Table 4.

3.2.2. Data Collection

This study used both qualitative and quantitative data collection methods. Qualitative data were gathered from a review of the current literature, using the following keywords: “Port Performance Indicators (PPIs)”, “Key Performance Indicators (KPIs)”, “Balanced Scorecard”, “PESTLE”, “Sustainability”, “Green Port”, “Smart Port”, and “the Delphi Method”. This review yielded 25 relevant studies from the past ten years. The literature review results were screened using expert judgment, with experts providing input on PPIs not in the initial list. Additionally, indicators from government-owned ports were included. Quantitative data were gathered through questionnaires, distributed to experts to evaluate the importance of the compiled PPIs. Questionnaires were distributed online via Google Forms and Microsoft Word, and responses were analyzed using the Delphi method.

3.2.3. Profile Port

The primary output of this study is a port performance indicator (PPI) framework, which is tested for ports in Indonesia. Tanjung Perak Port serves as the reference port for this research. A description of the port is provided in Table 5.
To ensure relevance, this study referenced Tanjung Perak Port, a publicly owned port managed by the Indonesian Ministry of Transportation. This port operates with a dual mandate, achieving operational efficiency and financial sustainability alongside fulfilling public service obligations concerning accessibility, connectivity, and environmental responsibility. Consequently, Tanjung Perak’s performance goals encompass both profitability metrics (e.g., revenue growth, berth utilization) and non-financial priorities, like environmental protection, safety, and stakeholder engagement.
These dual strategic objectives were explicitly communicated to the expert Delphi panel, selected for their expertise in both public and private Indonesian port operations, to inform their evaluation of the proposed performance indicators.

3.3. Application of Delphi Technique

3.3.1. Round 1

This stage began by distributing a list of PPIs to experts. Then, the experts were asked to analyze and evaluate the list of PPIs to determine their suitability.

3.3.2. Round 2

In the second round, twelve experts evaluated PPIs via a 10-point Likert scale questionnaire [57]. Acceptance was determined by calculating the mean, Q1, median, Q3, coefficient of variation (CV), modus, and standard deviation (SD). PPIs were accepted if they simultaneously met the following three criteria [56]: (1) SD ≤ 1.5 (statistical agreement) [58]; (2) interquartile range or IQR (Q3–Q1) ≤ 2.5 (reduced outlier impact and central consistency) [59]; and (3) ≥51% rating 8–10 (high importance threshold). These thresholds were adapted from prior Delphi studies [57]; using all three ensured rigor [56]. PPIs not meeting all criteria (rejected) were revised by adding interquartile range (IQR) “shading” to facilitate reconsideration based on group opinion for Round 3.

3.3.3. Round 3

In the third Delphi round, questionnaires displaying the aggregated results from Round 2 were distributed to the expert panel (n = 11), yielding 10 valid responses. Experts were asked to either concur with the previously established group opinion or provide their individual rating along with a rationale for any divergence. The data from this round were then analyzed using the criteria defined in Round 2 to finalize the acceptance or rejection of each PPI. This iterative process ensured that the final selection of PPIs, while initially grounded in the literature, was ultimately shaped by expert consensus and justification.

4. Discussion

4.1. Delphi Round 1

The study commenced with the development of a preliminary PPI framework derived from a comprehensive literature review, which identified 10 key dimensions and 112 individual indicators. A panel of 12 experts, representing various port stakeholders (including users, consultants, authorities, and academics), then participated in the first Delphi round. Their task was to assess the literature-based indicators for comprehensiveness and relevance, and to propose any missing indicators. This expert consultation, along with consideration of internal PPIs from government-owned ports, yielded an additional 15 indicators. Consequently, a total of 127 indicators were compiled for subsequent analysis. Table 6 presents the final set of indicators, categorized by their origin (the literature, expert feedback, and government port resources).

4.2. Delphi Round 2

The second round of the Delphi process involved the distribution of questionnaires containing the 127 indicators identified in the previous stage to the same panel of 12 experts. These experts were requested to evaluate the importance level of each indicator. Following the collection of the completed questionnaires, the data were processed to determine the acceptance or rejection of individual indicators based on predefined criteria outlined in Section 3.3. This analysis resulted in the rejection of 72 indicators and the acceptance of 55 indicators. Subsequently, the accepted indicators were ranked within their respective dimensions. The mean value of the experts’ ratings for each indicator served as the basis for this ranking, with higher mean values indicating a higher level of importance and, thus, a higher rank. The detailed results of this round, including the ranking of the accepted indicators, are provided in the Appendix A.

4.3. Delphi Round 3

The third Delphi round involved re-administering questionnaires, displaying IQR (Q1–Q3) shading from Round 2, to the expert panel (n = 11, 10 valid responses). Experts either confirmed the group opinion or provided individual ratings with justifications for deviations. Data were analyzed using Round 2 criteria to finalize PPI acceptance and rejection. This iterative process ensured that the final PPI selection was informed by both the literature and expert consensus with justification.
According to Table 7, of the initial 127 PPIs, 114 were validated based on SD ≤ 1.5, IQR ≤ 2.5, and ≥ 51% high-importance ratings (8–10). Conversely, 13 PPIs were rejected, including transportation cost per cargo (internal business process), commitment and loyalty (learning and growth), CSR cost (social), and several technology-related indicators (smart ships, automated operations, gate management, and renewable energy sources). The rejection suggests a lack of consistent expert agreement or high response variability. A full list is in Appendix A. Subsequent sections analyze the validated dimensions, ranked by mean values.
Political dimension: The level of engagement between port authorities and policymakers stands out as the highest ranking among the accepted five PPIs. This PPI is crucial within the context of this study as it relates to stakeholder influence and the integration of clusters within the port as policy drivers. Rijkure [34] posits that the port cluster integration indicator serves to determine the establishment of a cohesive system within the port environment. Furthermore, Cullinane and Christodoulou [8] identify the port energy management system (PEMS) as one such existing system or policy within the port. They also assert that stakeholder involvement is instrumental in the development and implementation of such systems and policies [8]. Aligning with this, Rijkure [34] also suggests that clusters can serve as a unifying mechanism for stakeholders. Schipper, Vreugdenhil, and De Jong [44] highlight the role of port authorities in defining and monitoring strategic development through planning initiatives. PPIs offer a valuable means of assessing performance outcomes across diverse aspects, thereby revealing the inherent complexity of the port system [34]. This perspective is corroborated by Kirchherr et al. [60], who emphasize the necessity of political and policy support for a successful transition towards a circular economy.
Economic dimension: The highest-ranking of the six accepted PPIs was the contribution level of the port’s added value to GDP, quantifying the port’s national GDP contribution (%). Rijkure [34] emphasizes its importance due to transportation’s link to economic circulation. Enhancing the port’s added value is expected to improve social welfare and economic value creation in Indonesia, aligning with Song et al. [61] on its role in decarbonization and digitalization.
Social dimension: Eight PPIs were accepted within this dimension, with one rejection. The highest-ranking PPI was the level of availability of access infrastructure to the port. The significant weighting of port infrastructure in performance evaluations, as demonstrated by its high scores in six of mainland China’s ports, underscores its importance [60]. Pasetto et al. [62] further emphasize the necessity for ports to upgrade and reconfigure infrastructure availability to accommodate anticipated future freight traffic demands. Moreover, improvements in port infrastructure can foster enhanced community engagement and city–port interactions, potentially encouraging greater public participation [43]. Conversely, the rejected PPI was corporate social responsibility (CSR) cost [62]. This rejection suggests the expert panel perceived a weak direct correlation between CSR expenditure and port performance, potentially aligning with the managerial agency problem, where CSR activities may serve managerial interests rather than directly enhancing organizational utility.
Technology dimension: The fifteen accepted PPIs were the level of achievement of project milestones related to technology initiatives, localization technologies (GPS, RFID, etc.), parking space management, intelligent railway, smart maintenance, cloud computing, web-based communication platform, the connectivity of hardware, the availability of software, direct and indirect energy consumption, energy management system, and the monitoring and optimization of energy consumption. Among those, the highest ranking was vessel traffic management (VTM), a system coordinating ship movements with port services for safety, fluency, and resource planning [63]. Javier and Aguardo [64] note that IMO mandates VTM for navigation safety, security, and environmental protection. Port Rotterdam implemented VTM to obtain reliable information and minimize delays [65]. Zhang et al. [42] identified feasibility as key for smart/green port adoption (e.g., Raffina, Los Angeles, Long Beach), supported by Tang [66] on technological efficiency driving dynamic efficiency in Chinese smart ports. Nevertheless, ten indicators were rejected (e.g., smart ships, automated operations, and renewable energies) due to limited smart port implementation in Indonesia, making automation-related indicators currently irrelevant for performance assessment. The Indonesian Sea Transportation Directorate noted the need for improvements in human resources, information and communication technology, as well as infrastructure for smart port implementation.
Legal dimension: The highest-ranking of the three accepted PPIs was the level of institutional communication, critical for understanding a port’s operational context, particularly regulatory and legal aspects [67]. Effective institutional communication is posited to foster cooperative relationships with other ports. Furthermore, communication deficiencies are identified as a significant challenge within the transportation sector, underscoring the necessity of mitigating potential risks [68]. The experience in mainland China’s ports, as highlighted by Song et al. [61], indicates that the decentralization of port functions, responsibilities, and legal aspects from central to local government did not inherently yield positive outcomes suggesting a continued need for robust intergovernmental communication and support. Consequently, strengthening intergovernmental communication is deemed essential for optimal port governance and development.
Environmental dimension: Twenty-three PPIs were accepted, with none rejected. The highest-ranking PPI in this dimension was the land use rate. Reisi et al. [69] defined this as the area of land designated for transportation infrastructure, estimated using land use maps to enhance sustainable transportation at ports. The evolving energy transition is fundamentally changing ports through land use [43], necessitating the reconfiguration of port areas to accommodate new, cleaner energy infrastructure and services, which will ultimately impact the port’s environmental footprint and sustainability initiatives.
Financial dimension: Eleven PPIs were accepted in this dimension, with berth occupancy revenue per TEU achieving the highest rank. This indicator is a key component influencing the contribution per ton of cargo. Consequently, by focusing on berth occupancy revenue per TEU, port management can identify strategic actions to enhance financial viability and effectively measure the efficiency of port performance [70].
Customer dimension: Ten PPIs were accepted. Among these, the accuracy of documents/information achieved the highest ranking. The completeness of documentation prepared by the shipper during the initial processing stage is a critical determinant of subsequent document processing time, which can significantly impact vessel waiting times at the port or dock [71]. Furthermore, the establishment of a reliable information network is crucial for ensuring the promptness of port authority responses to service-related issues [61].
Productivity dimension: There were 21 PPIs accepted and 1 rejected. The PPI that was rejected was transportation cost per cargo. The highest-ranking PPI in the productivity dimension was vessel turnaround time. Vessel turnaround time (VTT) is one of the main performance measures of the Colombo Port as a transshipment hub port to improve competitiveness in the transshipment business in the Asian region [72]. Vessel operations (avg. turnaround time, avg. vessel calls, etc.) are factors that affect port efficiency. It is based on benchmarking results from four seaports (Tanger Med, Algeciras Bay, Rotterdam, and New York–New Jersey) [73]. In brief, it is essential to use vessel turnaround as a key port performance metric. Thus, the port can be more efficient and increase its competitiveness.
Learning and growth dimension: 12 PPIs were accepted, with only one rejected. The highest-ranking PPI in this dimension was teamwork, recognized as a critical indicator within this domain [24]. This was followed in rank by leadership, capabilities, knowledge and skills, also culture, respectively. Meanwhile, the commitment and loyalty indicator was rejected due to its primary focus on employee perspectives, rendering it somewhat tangential to the broader organizational-level PPIs being assessed.

5. Conclusions

This study addressed the challenges faced by smaller Indonesian ports (Section 1) through the development of a comprehensive suite of port performance indicators (PPIs). By integrating internal (balanced scorecard—BSC) and external (PESTLE) analytical frameworks (Section 2) and employing a rigorous three-round Delphi methodology to elicit and synthesize expert consensus (Section 3 and Section 4), this research yielded a validated set of PPIs tailored to the specific context of Indonesian state-owned service ports.
The primary objective of this endeavor was to establish a robust framework for enhancing performance monitoring, ensuring operational efficiency, and supporting strategic decision making within these vital maritime hubs. The study’s innovative approach combined internal organizational considerations with broader external environmental dynamics, drawing upon the strengths of the BSC, PESTLE analysis, and the principles of smart and green ports to construct a holistic performance evaluation instrument. The Delphi process, engaging a diverse panel of experts from academia, consultancy, port authorities, and customer segments, proved instrumental in identifying, refining, and achieving consensus on the most pertinent PPIs through a structured iterative process encompassing literature-informed initial indicators (n = 112), expert augmentation (totaling 127 PPIs), quantitative evaluation and feedback (Round 2—acceptance of 55 PPIs), and a final consensus-building stage (Round 3—acceptance of 114 PPIs from 11 valid responses).
The findings compellingly demonstrate the efficacy of integrating multi-dimensional assessment frameworks to generate robust and contextually relevant port performance metrics. The validated PPIs provide Indonesian port authorities with a clear, structured, and actionable approach to measuring performance across critical dimensions, including financial, operational, environmental, and strategic aspects. The incorporation of sustainability principles within this framework underscores its relevance in supporting efforts to enhance operational efficiency, maintain global competitiveness, and align with evolving environmental imperatives. To facilitate the practical application of these findings, a final integrated model (Figure 2) was developed. This model strategically synthesizes the BSC, PESTLE analysis, and smart and green Port concepts, effectively linking internal organizational factors with external environmental influences through the validated indicators, thereby offering a holistic and readily applicable structure for managing and optimizing port performance.
Managerial implications: This research offers a practically applicable and empirically validated framework, embodied in the integrated model presented in Figure 2, empowering Indonesian port authorities to strategically identify, implement, and monitor key performance indicators. This framework provides a robust tool for comprehensive performance measurement, encompassing crucial aspects, such as customer satisfaction, and facilitates informed strategic decision-making.
Limitations: The applicability of the developed PPIs is primarily circumscribed to the specific context of state-owned service ports within Indonesia, characterized by a unified ownership structure encompassing all assets. This unique operational and ownership model may limit the direct transferability of these findings to privately-owned or concessioned ports operating under different structural paradigms. Furthermore, the marginal attrition in expert participation during the final Delphi round (n = 11, compared to 12 in previous rounds) is acknowledged as a potential, albeit likely minor, source of bias.
Future research directions: Future studies could examine the practical implementation and longitudinal impact of this framework across diverse Indonesian ports and assess its adaptability to varying port sizes and regions under different economic, regulatory, and environmental conditions. Integrating real-time data analytics and artificial intelligence (AI) for enhanced performance monitoring also warrants investigation.

Author Contributions

Conceptualization, Y.P. and D.P.S.; methodology, Y.P.; software, M.A.J.; validation, Y.P., D.P.S. and P.R.I.; formal analysis, M.A.J.; investigation, M.A.J.; resources, Y.P.; data curation, Y.P.; writing—original draft preparation, Y.P.; writing—review and editing, H.-M.W. and P.R.I.; visualization, P.R.I.; supervision, H.-M.W.; project administration, Y.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Delphi results for Round 2 and Round 3.
DimensionIndicators8–10%IRSDMeanImportance Degree RankConsensus
Result
2nd Round3rd Round2nd Round3rd Round2nd Round3rd Round2nd Round3rd Round2nd Round3rd Round
Financial (11)Revenue growth15.146.000.250.000.820.298.008.0984ACCEPTED
EBIT (operating profit) margin20.2911.001.250.501.040.458.087.7358ACCEPTED
Net profit margin20.299.002.001.001.070.728.178.1843ACCEPTED
Operating cash flow22.298.001.001.000.950.508.588.4512ACCEPTED
Berth occupancy revenue per TEU33.5711.002.251.501.190.838.508.8221ACCEPTED
Current ratio26.4311.001.502.001.260.858.088.0055ACCEPTED
Debt to total asset13.148.001.001.002.090.507.337.551111ACCEPTED
Debt to equity14.149.002.001.002.180.757.587.73108ACCEPTED
Conformance cost19.2911.002.001.001.260.728.087.8257ACCEPTED
Non-conformance cost26.4335.272.251.501.180.778.338.0035ACCEPTED
Opportunity cost13.147.001.251.001.070.487.837.64910ACCEPTED
Customers (10)Overall service reliability34.576.002.001.501.090.838.759.1822ACCEPTED
Responsiveness to special requests20.296.001.250.501.150.458.007.7369ACCEPTED
Accuracy of documents/information40.717.002.001.001.140.778.839.3611ACCEPTED
Incidence of cargo damage20.297.002.001.002.290.887.588.3697ACCEPTED
Incidence of service delay27.437.001.501.002.110.507.838.4576ACCEPTED
Unified key account management19.290.001.501.002.290.507.337.551010ACCEPTED
Overall service costs44.8651.453.002.002.561.008.088.9144ACCEPTED
Cargo handling charges39.718.002.252.002.500.908.089.0943ACCEPTED
Value-added service26.4359.552.251.002.360.757.678.2788ACCEPTED
Overall cost of cargo loading/discharging and (re)stows and other ship operations32.5717.093.001.501.461.088.178.5535ACCEPTED
Internal business process (22)Ship load rate33.5711.002.252.001.570.908.178.91169ACCEPTED
Berth occupancy40.716.002.002.001.310.948.679.1843ACCEPTED
Crane productivity39.7142.362.252.002.460.948.339.18133ACCEPTED
Yard utilization39.7151.452.252.002.450.858.259.00148ACCEPTED
Labor productivity28.439.001.251.001.040.488.588.64813ACCEPTED
Crane efficiency33.5733.272.252.002.150.908.179.09166ACCEPTED
Traffic handled (port productivity)40.710.002.001.501.140.798.839.0926ACCEPTED
Number of vessels handled52.0043.362.251.501.590.838.759.1833ACCEPTED
Average output per hook per shift21.2959.551.251.001.280.508.178.451618ACCEPTED
Idling time at berth27.4359.551.501.001.360.508.258.551415ACCEPTED
Throughput growth28.4343.361.250.501.190.458.428.731112ACCEPTED
Vessel call size growth32.5711.003.002.002.001.168.008.451918ACCEPTED
Container throughput45.8651.452.251.502.500.868.429.27112ACCEPTED
Non-container throughput33.5743.362.252.001.180.908.678.9149ACCEPTED
Vessel turnaround time40.7151.451.251.001.080.649.009.3611ACCEPTED
Truck turnaround time28.4311.001.251.001.030.508.678.55415ACCEPTED
Cargo dwell time39.7111.002.251.501.370.798.678.9149ACCEPTED
Average pre-berthing waiting time (APBWT)28.4311.001.251.001.040.508.588.55815ACCEPTED
Maritime (liner) connectivity15.1432.271.001.000.890.508.558.451018ACCEPTED
Short sea connectivity27.4359.551.501.002.350.508.008.451918ACCEPTED
Gate productivity20.2943.362.001.502.010.837.758.182222ACCEPTED
Transportation cost per cargo38.7151.453.003.002.501.307.928.642113REJECTED
Learning and growth (13)Knowledge and skills33.5711.002.252.001.320.908.509.0932ACCEPTED
Capabilities39.7135.272.251.501.360.798.758.9113ACCEPTED
Commitment and loyalty32.5711.003.003.001.381.378.508.5535REJECTED
% female nominated talent18.2911.003.001.001.530.987.757.64913ACCEPTED
% of millennials (<40 years) in top talent10.1411.002.001.001.180.727.677.821211ACCEPTED
Technical skills standards program26.438.002.251.001.310.668.338.4567ACCEPTED
Culture20.2939.362.001.002.090.757.758.2798ACCEPTED
Leadership22.2951.451.000.001.230.398.258.8274ACCEPTED
Teamwork35.5735.272.001.001.160.788.759.4511ACCEPTED
Millennial successor setup13.1447.451.001.001.010.627.757.73912ACCEPTED
Effective personnel ratio25.437.002.251.501.320.798.088.0989ACCEPTED
Employee turnover rate13.147.002.000.002.250.517.507.911310ACCEPTED
Training hours per employee15.1410.001.251.001.110.508.428.5555ACCEPTED
Politics (5)The level of availability of information regarding the expansion project to the public18.1410.001.001.000.640.838.428.1835ACCEPTED
Level of engagement between port authorities and policymakers41.7135.271.000.500.830.459.259.2711ACCEPTED
Port KPI success rate27.4311.001.501.001.420.508.258.5544ACCEPTED
Level of implementation of sustainable port policy21.2919.091.251.001.160.648.258.6443ACCEPTED
Level of implementation of security policies at ports33.5735.272.251.001.320.748.509.0022ACCEPTED
Economics (6)Amount of foreign direct investment (FDI)8.000.001.000.500.940.577.677.8265ACCEPTED
Value distributed to shareholders8.008.001.251.000.900.487.837.6456ACCEPTED
Investment level9.007.000.250.000.640.297.928.0944ACCEPTED
Level of achievement of project milestones related to funding initiatives (%)28.4311.001.250.001.360.398.258.1813ACCEPTED
Port’s value-added contribution rate to GDP33.5711.002.501.001.690.888.258.6411ACCEPTED
Port-related jobs21.2926.181.251.001.160.628.258.2712ACCEPTED
Social (9)Corporate social responsibility (CSR) cost13.1410.001.251.001.070.507.837.4579REJECTED
Level of management support for worker safety conditions16.140.001.001.000.850.508.338.5533ACCEPTED
Commitment to environmental management28.435.001.251.001.030.488.678.6412ACCEPTED
Number of accidents at the port31.5711.003.252.001.581.168.008.4554ACCEPTED
Amount of time wasted due to accidents19.2911.001.500.002.060.397.427.8287ACCEPTED
Number of deaths at the port18.2932.271.501.002.690.876.927.8098ACCEPTED
Level of availability of access infrastructure to the port32.579.003.000.502.480.838.008.8251ACCEPTED
Average time in hinterland21.2914.091.251.001.040.508.428.4524ACCEPTED
Traffic volume21.2926.181.251.001.280.508.178.4544ACCEPTED
Technology (25)Level of achievement of project milestones related to technology initiatives (%)15.1411.001.251.001.040.498.088.4056ACCEPTED
Smart ships14.1411.001.501.002.050.487.337.361519REJECTED
Smart containers or connected containers14.140.001.001.002.270.667.097.551915REJECTED
Automated operations10.1410.002.501.001.680.997.097.451918REJECTED
Port road management system25.434.003.503.002.051.567.738.09109REJECTED
Intelligent railway6.005.002.001.002.070.776.837.362219ACCEPTED
Smart maintenance12.145.001.251.001.690.507.257.551615ACCEPTED
Vessel traffic management (VTM)33.5738.362.502.002.140.907.928.9161ACCEPTED
Smart WMS System31.576.004.252.002.961.427.087.732113ACCEPTED
Localization technologies (GPS, RFID, etc.)21.296.001.251.002.290.667.678.45115ACCEPTED
Cloud computing (SaaS, PaaS, IaaS)25.4343.362.252.001.920.857.758.00911ACCEPTED
Parking space management21.2922.180.500.001.380.297.928.0969ACCEPTED
Sensors (humidity, temperature, etc.)7.0019.091.001.001.790.487.257.361619REJECTED
Web-based communication platform21.297.001.501.001.820.507.838.5583ACCEPTED
Gate management38.7111.003.252.501.791.238.258.6432REJECTED
Connectivity hardware (cameras, wireless technology, sensors, RFID tags)32.574.003.001.501.371.078.338.3617ACCEPTED
The availability of software for data collection, visualization, analysis, and optimization24.4311.003.252.002.220.857.428.001411ACCEPTED
Direct energy consumption33.5740.362.501.001.670.668.178.5543ACCEPTED
Indirect energy consumption12.1424.182.001.001.480.777.257.361619ACCEPTED
Monitoring and optimization of energy consumption22.297.001.001.001.110.488.338.3617ACCEPTED
Energy management system19.2919.091.501.01.490.487.677.641114ACCEPTED
Use of wind energy5.006.002.002.002.010.946.676.822324REJECTED
Use of solar power13.1411.001.251.001.310.667.677.551115REJECTED
Use of biomass energy4.007.003.002.002.251.165.925.912525REJECTED
Use of wave and tidal energy6.004.002.001.501.970.796.676.912323REJECTED
Legal (3)Number of collaborations with external parties21.295.001.251.001.180.508.338.4512ACCEPTED
Institutional communication level20.291.002.001.001.190.668.088.5521ACCEPTED
Number of standards or regulations enforced related to external policies16.143.000.250.000.950.008.088.0023ACCEPTED
Environment (23)Electricity consumption rate14.140.002.001.001.080.778.008.3644ACCEPTED
Fuel consumption rate13.1411.001.000.000.900.297.837.91714ACCEPTED
Water consumption rate14.1410.001.000.000.800.397.837.82715ACCEPTED
Land use rate26.4311.002.001.001.290.758.278.7321ACCEPTED
Combustion gas emission rate15.140.001.251.000.900.488.178.3634ACCEPTED
Emission of particulate matter14.149.001.001.000.860.487.927.64519ACCEPTED
Odor emission12.1410.002.001.001.940.747.508.001913ACCEPTED
Monitoring system for noise level13.149.001.001.000.900.487.837.64719ACCEPTED
Reducing noise and vibrations from cargo handling equipment and vessels13.1427.181.001.000.900.507.837.55721ACCEPTED
Lden—noise pollution11.1411.001.001.000.960.507.507.551921ACCEPTED
Emission into soil and groundwater13.147.002.251.001.340.727.838.1879ACCEPTED
Environmental accidents14.148.001.250.502.180.457.427.732117ACCEPTED
Number of environmental complaints15.147.000.500.001.280.297.838.09712ACCEPTED
Dredging frequency26.436.002.501.002.290.727.678.18179ACCEPTED
Sediment quality assessment26.436.001.501.001.820.627.838.2777ACCEPTED
Total wastewater26.439.002.251.001.850.727.928.1859ACCEPTED
Level of B3 waste26.438.002.251.002.380.667.758.45162ACCEPTED
Level of non-B3 waste13.1411.001.000.502.130.457.257.732317ACCEPTED
Material recycling rate (tons)14.149.001.251.002.180.507.427.552121ACCEPTED
Fuel spill contingency plan21.2910.001.251.002.340.487.838.3674ACCEPTED
Sewage treatment25.439.002.251.002.370.757.838.2777ACCEPTED
Ballast water pollutant control20.2910.001.250.501.970.577.677.821715ACCEPTED
Waste dumping management22.298.001.001.000.950.508.588.4512ACCEPTED

References

  1. Yeo, G.T.; Song, D.W.; Roe, M. Evaluating the Competitiveness of Container Ports in Korea and China. Transp. Res. Part A Policy Pract. 2015, 69, 2–14. [Google Scholar] [CrossRef]
  2. Karimah, I.D.; Yudhistira, M.H. Does Small-Scale Port Investment Affect Local Economic Activity? Evidence from Small-Port Development in Indonesia. Econ. Transp. 2020, 23, 100180. [Google Scholar] [CrossRef]
  3. Azhar, Z.; Mardiana, H.; Hidayat, R.D.R.; Himawan, D.; Rahmawati, A. The Implementation of Smart Port in Tanjung Priok Port for Utilization and Green Port Optimization. Adv. Transp. Logist. Res. 2018, 1, 132–138. Available online: https://proceedings.itltrisakti.ac.id/index.php/ATLR/article/view/23 (accessed on 1 May 2025).
  4. Shetty, S.D.; Dwarakish, G.S. An Overview of Maritime Transportation with Emphasis on the Port of Mangalore. Ocean Coast. Manag. 2018, 163, 289–304. [Google Scholar] [CrossRef]
  5. Morgan, C. Structure, Speed, and Salience: Performance Measurement in the Supply Chain. Bus. Process Manag. J. 2014, 10, 522–536. [Google Scholar] [CrossRef]
  6. Molavi, A.; Lim, G.; Race, B. A Framework for Building a Smart Port and Smart Port Index. Int. J. Sustain. Transp. 2019, 14, 686–700. [Google Scholar] [CrossRef]
  7. Hamid, N. Use Balanced Scorecard for Measuring Competitive Advantage of Infrastructure Assets of Owned State Ports in Indonesia: Case in Pelindo IV, Indonesia. J. Manag. Dev. 2018, 37, 114–126. [Google Scholar] [CrossRef]
  8. Christodoulou, A.; Cullinane, K. Identifying the Main Opportunities and Challenges from the Implementation of a Port Energy Management System: A SWOT/PESTLE Analysis. Sustainability 2019, 11, 6046. [Google Scholar] [CrossRef]
  9. González, A.; Cancelas, N.; Serrano, B.; Orive, A. Preparation of a Smart Port Indicator and Calculation of a Ranking for the Spanish Port System. Logistics 2020, 4, 9. [Google Scholar] [CrossRef]
  10. Teerawattana, R.; Yang, Y.C. Environmental Performance Indicators for Green Port Policy Evaluation: Case Study of Laem Chabang Port. Asian J. Shipp. Logist. 2019, 35, 63–69. [Google Scholar] [CrossRef]
  11. Praharsi, Y.; Hardiyanti, F.; Puspitasari, D.; Akseptori, A.; Maharani, A. An Integrated Framework of Balance Scorecard—PESTLE—Smart and Green Port for Boosting the Port Performance. In Proceedings of the International Conference on Industrial Engineering and Operations Management, Monterrey, Mexico, 3–5 November 2021; Available online: https://index.ieomsociety.org/index.cfm/article/view/ID/3965 (accessed on 1 May 2025).
  12. Radovic, D.; Stevic, Z. Evaluation and Selection of KPI in Transport Using SWARA Method. Transp. Logist. Int. J. 2018, 18, 60–68. Available online: https://www.researchgate.net/publication/325681450_EVALUATION_AND_SELECTION_OF_KPI_IN_TRANSPORT_USING_SWARA_METHOD (accessed on 1 May 2025).
  13. Buiza-Camacho, G.; Cerbán-Jiménez, M.D.M.; Gonzalez-Gaya, C. Assessment of the Factors Influencing on a Smart Port with an Analytic Hierarchy Process. DYNA 2015, 91, 498–501. [Google Scholar] [CrossRef]
  14. Chen, Z.; Pak, M. A Delphi Analysis on Green Performance Evaluation Indices for Ports in China. Marit. Policy Manag. 2017, 44, 537–550. [Google Scholar] [CrossRef]
  15. Sun, X.; Xu, M.; Li, H.; Zhang, Y. The Port Industry Development and Environmental Performance in China. Transp. Res. Part D Transp. Environ. 2017, 57, 45–57. [Google Scholar]
  16. Drumm, S.; Bradley, C.; Moriarty, F. ‘More of an Art Than a Science’? The Development, Design, and Mechanics of the Delphi Technique. Res. Soc. Adm. Pharm. 2022, 18, 2230–2236. [Google Scholar] [CrossRef]
  17. Akbari, A.A.; Samiromi, F.B.; Arjmandi, R.; Shojaei, M. Development of a Tool for Environmental Performance Evaluation in Ports: A Case Study Based on the Delphi Technique in Port Environment. Int. J. Occup. Hyg. 2021, 13, 266–277. Available online: https://ijoh.tums.ac.ir/index.php/ijoh/article/view/535 (accessed on 1 May 2025). [CrossRef]
  18. Ha, M.-H.; Yang, Z. Comparative Analysis of Port Performance Indicators: Independency and Interdependency. Transp. Res. Part A 2017, 103, 264–278. [Google Scholar] [CrossRef]
  19. Mazibuko, K.; Kuroshi, M.; Mutombo, L. An Evaluation of the Relationship Between Ship Turnaround Time and Key Port Performance Indicators: A Case Study of a Southern African Port. WMU J. Marit. Aff. 2024, 23, 499–524. [Google Scholar] [CrossRef]
  20. Kaplan, R.; Norton, D. Using the Balanced Scorecard as a Strategic Management System. Harv. Bus. Rev. 1996, 7, 75–85. [Google Scholar]
  21. Benkova, E.; Petter, G.; Balogová, B.; Nemec, J. Factors Affecting the Use of Balanced Scorecard in Measuring Company Performance. Sustainability 2020, 12, 1178. [Google Scholar] [CrossRef]
  22. Niven, P. Balanced Scorecard: Step-by-Step for Government and Nonprofit Agencies, 2nd ed.; Wiley: Hoboken, NJ, USA, 2015. [Google Scholar] [CrossRef]
  23. Karakas, S.; Acar, A.Z.; Kirmizi, M. Development of a Multidimensional Performance Evaluation Model for Container Terminals at Marmara Sea. Res. Transp. Bus. Manag. 2020, 37, 100498. [Google Scholar] [CrossRef]
  24. Bulak, M. A Frontier Approach to Eco-Efficiency Assessment in the World’s Busiest Sea Ports. Sustainability 2024, 16, 1142. [Google Scholar] [CrossRef]
  25. Ridwan, A.; Noche, B. Model of the Port Performance Metrics in Ports by Integration Six Sigma and System Dynamics. Int. J. Qual. Reliab. Manag. 2018, 35, 82–108. [Google Scholar] [CrossRef]
  26. Ha, M.-H.; Yang, Z.; Lam, J.S.L. Port Performance in Container Transport Logistics: A Multi-Stakeholder Perspective. Transp. Policy 2018, 73, 25–40. [Google Scholar] [CrossRef]
  27. Serra, P.; Codipietro, M.; Melis, A.; Fancello, G. Review of Port KPIs Considering Safety, Environment, and Productivity as the Three Dimensions of Port Sustainability. In Proceedings of the Computational Science and Its Applications—ICCSA 2023 Workshops, Athens, Greece, 3–6 July 2023. [Google Scholar] [CrossRef]
  28. Zhou, X.; Suh, J. A Comprehensive Study on Static and Dynamic Operational Efficiency in Major Korean Container Terminals Amid the Smart Port Development Context. Sustainability 2024, 16, 5288. [Google Scholar] [CrossRef]
  29. Chen, W.; Yin, Y. Evaluation and Analysis of Sustainable Development Efficiency of Port Cities in China Using the Super-Efficiency SBM-DEA Model. Orig. Res. 2024, 33, 5037–5050. [Google Scholar] [CrossRef]
  30. Estevez, C.; Orive, A.; Cabrero, R. Development of a “Smart Dry Port” Indicator and Ranking Calculation for Spanish Dry Ports. Future Transp. 2023, 3, 1272–1291. [Google Scholar] [CrossRef]
  31. Bonnici, T.S.; Galea, D. PEST Analysis. In Wiley Encyclopedia of Management; Wiley: Hoboken, New Jersey, USA, 2015. [Google Scholar] [CrossRef]
  32. Yang, Y.; Zhong, M.; Yao, H.; Yu, F.; Fu, X.; Postolache, O. Internet of Things for Smart Ports: Technologies and Challenges. IEEE Instrum. Meas. Mag. 2018, 21, 34–43. [Google Scholar] [CrossRef]
  33. Chang, Y.-T. Environmental Efficiency of Ports: A Data Envelopment Analysis Approach. Marit. Policy Manag. 2013, 40, 467–478. [Google Scholar] [CrossRef]
  34. Rijkure, A. The Use of Port Performance Indexes in the Transport Economy and the Strengthening of Port Competitiveness. J. Bus. Econ. 2019, 10, 387–394. [Google Scholar] [CrossRef]
  35. Muangpan, T.; Suthiwartnarueput, K. Key Performance Indicators of Sustainable Port: Case Study of the Eastern Economic Corridor in Thailand. Cogent Bus. Manag. 2019, 6, 1603275. [Google Scholar] [CrossRef]
  36. Oh, H.; Lee, S.-W.; Seo, Y.-J. The Evaluation of Seaport Sustainability: The Case of South Korea. Ocean Coast. Manag. 2018, 161, 50–56. [Google Scholar] [CrossRef]
  37. Duru, O.; Galvao, C.B.; Mileski, J.; Robles, L.T.; Gharehgozli, A. Developing a Comprehensive Approach to Port Performance Assessment. Asian J. Shipp. Logist. 2020, 36, 169–180. [Google Scholar] [CrossRef]
  38. Hui, F.K.P.; Aye, L.; Duffield, C. Engaging Employees with Good Sustainability: Key Performance Indicators for Dry Ports. Sustainability 2019, 11, 2967. [Google Scholar] [CrossRef]
  39. Douaioui, K.; Fri, M.; Mabrouki, C.; Semma, E.A. Smart Port: Design and Perspectives. In Proceedings of the 4th International Conference on Logistics Operations Management (GOL), Le Havre, France, 10–12 April 2018. [Google Scholar] [CrossRef]
  40. Philipp, R. Digital Readiness Index Assessment Towards Smart Port Development. Sustain. Manag. Forum 2020, 28, 49–60. [Google Scholar] [CrossRef]
  41. Bakhsh, W.; Fiori, C.; de Luca, S. Literature Review on the Smart Port: Evolution, Technological Development, Performance Indicators of Smart Ports. In Proceedings of the Computational Science and Its Applications—ICCSA 2024 Workshops, Hanoi, Vietnam, 1–4 July 2024. [Google Scholar] [CrossRef]
  42. Zhang, C.; Jiawen, Z.; Mingxin, F.; Tonni, P.-S. Digitalization and Innovation in Green Ports: A Review of Current Issues, Contributions and the Way Forward in Promoting Sustainable Ports and Maritime Logistics. Sci. Total Environ. 2024, 912, 169075. [Google Scholar] [CrossRef]
  43. Bartosiewicz, H.; Kurcharski, R. Indicators of Port Sustainability: The Example of Baltic Sea Container Ports. Sustain. Dev. 2023, 32, 2371–2384. [Google Scholar] [CrossRef]
  44. Schipper, C.A.; Vreugdenhila, H.; de Jong, M.P.C. A Sustainability Assessment of Ports and Port-City Plans: Comparing Ambitions with Achievements. Transp. Res. Part D 2017, 57, 84–111. [Google Scholar] [CrossRef]
  45. Puig, M.; Wooldridge, C.; Casal, J.; Darbra, R. Tool for the Identification and Assessment of Environmental Aspects in Ports (TEAP). Ocean Coast. Manag. 2015, 113, 8–17. [Google Scholar] [CrossRef]
  46. Di Vaio, A.; Varriale, L.; Alvino, F. Key Performance Indicators for Developing Environmentally Sustainable and Energy-Efficient Ports: Evidence from Italy. Energy Policy 2018, 122, 229–240. [Google Scholar] [CrossRef]
  47. Siroka, M.; Pilicic, S.; Milosevic, T.; Lacalle, I.; Traven, L. A novel approach for assessing the ports’ environmental impacts in real time—The IoT based port environmental index. Ecol. Indic. 2021, 120, 106949. [Google Scholar] [CrossRef]
  48. Keeney, S.; Hasson, F.; McKenna, H. Consulting the Oracle: Ten Lessons from Using the Delphi Technique in Nursing Research. Methodol. Issues Nurs. Res. 2006, 53, 205–212. [Google Scholar] [CrossRef] [PubMed]
  49. Mukherjee, N.; Hugé, J.; Sutherland, W.; McNeill, J.; Opstal, M.; Dahdouh-Guebas, F.; Koedam, N. The Delphi Technique in Ecology and Biological Conservation: Applications and Guidelines. Methods Ecol. Evol. 2015, 6, 1097–1109. [Google Scholar] [CrossRef]
  50. Walters, D.; Kotze, D.C.; Rebelo, A.; Pretorius, L.; Job, N.; Lagesse, J.V.; Cowden, C. Validation of a Rapid Wetland Ecosystem Services Assessment Technique Using the Delphi Method. Ecol. Indic. 2021, 12, 107511. [Google Scholar] [CrossRef]
  51. Wang, Y.-F.; Hsu, Y.-F.; Fang, K. The Key Elements of Gamification in Corporate Training—The Delphi Method. Entertain. Comput. 2021, 40, 100463. [Google Scholar] [CrossRef]
  52. Zielske, M.; Held, T. Application of Agile Methods in Traditional Logistics Companies and Logistics Startups: Results from a German Delphi Study. J. Syst. Softw. 2021, 177, 110950. [Google Scholar] [CrossRef]
  53. Miller, K.; Collada, B.; Tolliver, D.; Audi, Z.; Cohen, A.; Michelson, C.; Newman, L. Using the Modified Delphi Method to Develop a Tool to Assess Pediatric Residents Supervising on Inpatient Rounds. Acad. Pediatr. 2019, 20, 89–96. [Google Scholar] [CrossRef]
  54. Doğan, M.B.; Yükseloğlu, E.H.; Doğan, M.; Uğraş, S.D. The Evaluation of Medical Malpractice Claims: Creating a Standard Approach Model Using the Delphi Method. J. Forensic Leg. Med. 2020, 71, 101932. [Google Scholar] [CrossRef]
  55. Azadi, T.; Sadoughi, F.; Khorasani-Zavareh, D. Using Modified Delphi Method to Propose and Validate the Components of a Child Injury Surveillance System for Iran. Chin. J. Traumatol. 2020, 23, 274–279. [Google Scholar] [CrossRef]
  56. Kluge, U.; Ringbeck, J.; Spinler, S. Door-to-Door Travel in 2035—A Delphi Study. Technol. Forecast. Soc. Change 2020, 157, 120096. [Google Scholar] [CrossRef]
  57. Giannarou, L.; Zervas, E. Using Delphi Technique to Build Consensus in Practice. Int. J. Bus. Sci. Appl. Manag. 2014, 9, 65–82. Available online: https://hdl.handle.net/10419/190657 (accessed on 1 May 2025). [CrossRef]
  58. Christie, C.A.; Barela, E. The Delphi Technique as a Method for Increasing Inclusion in the Evaluation Process. Can. J. Program Eval. 2005, 20, 105–122. [Google Scholar] [CrossRef]
  59. Kittell-Limerick, P. Perceived Barriers to Completion of the Academic Doctorate: A Delphi Study. Ph.D. Thesis, Texas A&M University, Commerce, TX, USA, 2005. [Google Scholar]
  60. Kirchherr, J.; Yang, N.-H.N.; Schulze-Spüntrup, F.; Heerink, M.J.; Hartley, K. Conceptualizing the Circular Economy (Revisited): An Analysis of 221 Definitions. Resour. Conserv. Recycl. 2023, 194, 107001. [Google Scholar] [CrossRef]
  61. Song, Z.-Y.; Lin, C.-W.; Feng, X.; Lee, P.T.-W. An Empirical Study of the Performance of the Sixth Generation Ports Model with Smart Ports with Reference to Major Container Ports in Mainland China. Transp. Res. E 2024, 184, 103460. [Google Scholar] [CrossRef]
  62. Pasetto, M.; Giordano, A.; Borin, P.; Giacomello, G. Integrated Railway Design Using Infrastructure-Building Information Modeling: The Case Study of the Port of Venice. Transp. Res. Procedia 2020, 45, 850–857. [Google Scholar] [CrossRef]
  63. Van Westrenen, F. Modelling Arrival Control in a Vessel Traffic Management System. Cogn. Technol. Work 2014, 16, 501–508. [Google Scholar] [CrossRef]
  64. Javier, F.; Aguado, C. The Vessel Traffic Management System at the Batangas Baseport: Basis of Enhancing Vessel Traffic Services at the Batangas Bay. IAMURE Int. J. Bus. Manag. 2012, 1, 57–78. Available online: https://research.lpubatangas.edu.ph/wp-content/uploads/2014/05/IAMURE-Vessel-Traffic-Management-System.pdf (accessed on 1 May 2025). [CrossRef]
  65. Seignette, R. Vessel Traffic Management in the Port of Rotterdam. Port Technology. 2012. Available online: https://www.porttechnology.org/wp-content/uploads/2019/05/PTI-32.pdf (accessed on 10 July 2024).
  66. Tang, N. Multi-Element Integrated Design of Marine Landscape in Sustainable Smart Ports. J. Sea Res. 2024, 199, 102496. [Google Scholar] [CrossRef]
  67. Cambronero, A.S.; Cancelas, N.; Serrano, B.M. Analysis of Port Sustainability Using the PPSC Methodology (PESTEL, Porter, SWOT, CAME). World Sci. News 2020, 146, 121–138. [Google Scholar]
  68. Samanes, T.; Gonzales-Cancelas, M.N.; Serrano, B.M.; Magdalena, M. Determination of Key Operational and Environmental Performance Indicators in Dirty Solid Bulk Terminals. Implementation In the Spanish Port System. World Sci. News 2019, 132, 16–34. [Google Scholar]
  69. Reisi, M.; Aye, L.; Rajabifard, A.; Ngo, T. Implications of Land Use and Socio-Economic Factors on Transport Sustainability. J. Urban Plan. Dev. 2014, 28, 1103–1114. Available online: https://www.researchgate.net/publication/281287751_Implications_of_land_use_and_socio-economic_factors_on_transport_sustainability (accessed on 1 May 2025).
  70. UNCTAD. The Integrated Programme for Commodities. In Report of the United Nations Conference on Trade and Development, Fourth Session, Nairobi, 5–31 May 1976; UNCTAD: Geneva, Switzerland, 1976; Volume I. [Google Scholar]
  71. Wibowo. Manajemen Kinerja; Rajawali Pers: Jakarta, Indonesia, 2010. [Google Scholar]
  72. Premathilaka, W.H.V. Determining the Factors Affecting the Turnaround Time of Container Vessels: A Case Study on Port of Colombo. Master’s Thesis, World Maritime University, Malmö, Sweden, 2018. Available online: https://commons.wmu.se/all_dissertations/600/ (accessed on 1 May 2025).
  73. Imrani, O.E.; Babounia, A. Benchmark and Competitive Analysis of Port Performances Model: Algeciras Bay, Rotterdam, New York-New Jersey and Tangier Med. Eur. J. Logist. Purch. Supply Chain Manag. 2018, 6, 28–48. [Google Scholar] [CrossRef]
Figure 1. Framework integration of the BSC, PESTLE, and smart and green port concepts.
Figure 1. Framework integration of the BSC, PESTLE, and smart and green port concepts.
Sustainability 17 04664 g001
Figure 2. Validated integrated port performance framework.
Figure 2. Validated integrated port performance framework.
Sustainability 17 04664 g002
Table 1. Performance indicators based on BSC.
Table 1. Performance indicators based on BSC.
DimensionSub-DimensionIndicators References
FinancialProfitabilityRevenue growth, EBIT (operating profit margin), net profit margin, operating cash flow [18,23,24]
Financial performance (FP)Berth occupancy revenue per TEU [23]
Liquidity and solvencyCurrent ratio, debt to equity [18]
The cost of poor
profitability
Conformance cost, non-conformance cost, opportunity cost [25]
CustomersService fulfilmentOverall service reliability, responsiveness to special requests, accuracy of documents/information, incidence of cargo damage, incidence of service delay, unified key account management [11,26], government-owned port indicator
Service costOverall service costs, cargo handling charges, value-added service, overall cost of cargo loading/discharging and (re)stows and other ship operations [4,18,26]
Internal business
process
ProductivityShip load rate, berth occupancy, crane productivity, yard utilization, labor productivity, crane efficiency, traffic handled (port productivity), number of vessels handled, average output per hook per shift, idling time at berth [4,18,19,26,27]
OutputThroughput growth, vessel call size growth, container throughput, non-container throughput, government-owned port indicator [4,18,28,29]
Lead timeVessel turnaround time (VTT), truck turnaround time, cargo dwell time, average pre-berthing waiting time (APBWT) [4,18,23,26]
Logistics and operational performance (LOP)Maritime (liner) connectivity, short sea connectivity, gate productivity, transportation cost per cargo [23]
Learning and growthHuman capitalKnowledge and skills, capabilities, commitment and loyalty, % female nominated talent, % of millennials (<40 years) in top talent, technical skills standards program [18,26], government-owned port indicator
Organization capitalCulture, leadership, teamwork, millennial successor setup [18,26], government-owned port indicator
Corporate social
performance (CSP)
Effective personnel ratio, employee turnover rate, training hours per employee [23,30]
Table 2. Performance indicators based on PESTLE, smart port, and green port indicators.
Table 2. Performance indicators based on PESTLE, smart port, and green port indicators.
DimensionSub DimensionIndicatorsReferences
PoliticStakeholder influenceThe level of availability of information regarding the expansion project to the public, level of engagement between port authorities and policymakers [8,34]
Port policyPort KPI success rate, level of implementation of sustainable port policy, level of implementation of security policies at ports [8,35] government-owned port indicator, expert judgment
EconomyFunding and investmentAmount of foreign direct investment (FDI), value distributed to shareholders, investment level, level of achievement of project milestones related to funding initiatives (%) [23,35,36], government-owned port indicator, expert judgment
Port value-added as % of GDPPort’s value-added contribution rate to GDP, port-related jobs [23]
SocialSocial contributionCorporate social responsibility (CSR) cost [8]
Top management commitmentLevel of management support for worker safety conditions, commitment to environmental management [8,35,36]
Safety and securityNumber of accidents at the port, amount of time wasted due to accidents, number of deaths at the port [24,30,37]
Traffic congestionLevel of availability of access infrastructure to the port, average time in hinterland, traffic volume [37,38], expert judgment
TechnologyLatest technological developmentLevel of achievement of project milestones related to technology initiatives (%)Government-owned port indicator
AutomationSmart ships, smart containers or connected containers, automated operations [39]
Intelligent infrastructurePort road management system, intelligent railway, vessel traffic management (VTM), smart WMS system, localization technologies (GPS, RFID, etc.), cloud computing (SaaS, PaaS, IaaS), sensors (humidity, temperature, etc.), web-based communication platform, gate management [6,40]
Integrated monitoring and optimization systemConnectivity hardware, such as cameras, wireless technology, sensors, and RFID tags, the availability of software for data gathering, visualization, analysis, and optimization [6]
Efficient energy consumptionDirect energy consumption, indirect energy consumption [6,29]
Energy managementMonitoring and optimization of energy consumption, energy management system [6,41]
Production and use of renewablesUse of wind energy, use of solar power, use of biomass energy, use of wave and tidal energy [6,42,43]
EnvironmentEnergy consumption rateElectricity consumption rate, fuel consumption rate, water consumption rate [6,35,42,43,44]
Land use for transportationLand use rate [38]
Emission to soilEmission into soil and groundwater [45]
Technical and operationalEnvironmental accidents, dredging frequency, number of environmental complaints [36,46] expert judgment
Discharges to water/sedimentsDischarges of wastewater, sediment quality assessment [45,47]
Waste generationGeneration of hazardous waste, generation of non-hazardous waste, generation of recyclable garbage [45,47]
Liquid pollution managementFuel spill contingency plan, sewage treatment, hazard waste management, ballast water pollutant control, waste dumping management [14,47]
Table 3. Previous studies of the Delphi method.
Table 3. Previous studies of the Delphi method.
Author (Year)Research ScopeParticipantsLikert ScaleMeasure of
Consensus
Delphi Rounds
[51]This study used the Delphi method to engender and prioritize a list of the key elements of effective gamification in the course of corporate training.Pre-round of the Delphi method: 15
1st round: 15
2nd round: 14
3rd round: 14
5-point (from not at all important to very importantSD ≤ 1.5
IQR ≤ 1
≥4 ratio more than 51%
3 Rounds and a Pre-round of the Delphi Method
[52]This study identified agile methods and practices in traditional logistics companies and startups, highlighting key approaches, benefits, and challenges.1st round: 29
2nd round: 25
3rd round: 22
7-point (from no
know-how to very extensive know-how)
≥5 ratio3 rounds
[53]Used modified Delphi method to develop a checklist of essential supervisory behaviors that pediatric residents demonstrate while leading inpatient, non-ICU, no specialty teaching rounds and to pilot the checklist1st round: 7
2nd round: 6
3-point (from strongly agree to do not agree)A criterion was eliminated if >25% of experts felt it was not observable2 rounds
[54]The Delphi method was used to provide a standard approach model for the experts in the evaluation of medical malpractice claims1st round: 11
2nd round: 11
7-point (from strongly disagree to strongly agree)Interquartile range value R is 1 or under 13 rounds
[55]This research used the Delphi method to determine the key components of a child ISS for Iran and to construct a framework for its implementation1st round: 16
2nd round: 16
4-point (from unimportant to very important)Items were accepted if they acquired a more than 75% collective consensus of 4 (very important) and 3 (important).2 rounds
[56]This paper used the Delphi method to determine future projections of European air passengers, their requirements, and which scenarios could possibly occur1st round: 43
2nd round: 38
7-point (from not probable to very probable)IQR ≤ 12 rounds
Table 4. Expert profile for the Delphi method.
Table 4. Expert profile for the Delphi method.
Expert IDAffiliationInstitutionsBackgroundYears of
Experience
Role/Expertise
E1AcademicShipbuilding Institute of Polytechnic SurabayaPort and shipping management30+Port Operations and Management, Port Logistics
E2AcademicShipbuilding Institute of Polytechnic SurabayaEngineering management20+Maritime Business
E3ConsultantScheepvaart en Transport College (STC)Logistics and supply chain management10+Port logistics
E4ConsultantScheepvaart en Transport College (STC)Transport, infrastructure, and logistics10+Port operations and management
E5ConsultantScheepvaart en Transport College (STC)Transportation, infrastructure, and logistics10+Transport and port specialist
E6ConsultantScheepvaart en Transport College (STC)Logistics, procurement, and supply chain management20+Port operations and management
E7ConsultantScheepvaart en Transport College (STC)Port management30+Terminal operations
E8Port authoritiesPELINDOFinance20+Port finance
E9Port authoritiesPELINDOTechnology management10+Port OHS and management system
E10Port authoritiesPELINDOPort management20+Port operations and management
E11CustomerPT Puteri Maju SuksesMarine technology30+Shipping management
E12CustomerPT Alfaj CargoShipping management25+Port and customs management
Table 5. Profile of the port.
Table 5. Profile of the port.
Tanjung Perak Port
Port businessesMultipurpose, passenger, general cargo, international dry bulk, container terminal
Type of portPublic
PPIs includedYes
Implementation of green port conceptsYes
Implementation of smart port conceptsYes
Table 6. Port performance indicators.
Table 6. Port performance indicators.
DimensionIndicators
Financial (11)Revenue growth, EBIT (operating profit margin), net profit margin, operating cash flow, berth occupancy revenue per TEU, current ratio, debt to total asset, debt to equity, conformance cost, non-conformance cost, opportunity cost
Customers (10)Overall service reliability, responsiveness to special requests, accuracy of documents/information, incidence of cargo damage, incidence of service delay, unified key account management, overall service costs, cargo handling charges, value-added service, overall cost of cargo loading/discharging and (re)stows and other ship operations
Internal business
process (22)
Ship load rate, berth occupancy, crane productivity, yard utilization, labor productivity, crane efficiency, traffic handled (port productivity), number of vessels handled, average output per hook per shift, idling time at berth, throughput growth, vessel call size growth, container throughput, non-container throughput, vessel turnaround time, truck turnaround time, cargo dwell time, average pre-berthing waiting time (APBWT), maritime (liner) connectivity, short sea connectivity, gate productivity, transportation cost per cargo
Learning and growth (13)Knowledge and skills, capabilities, commitment and loyalty, % female nominated talent, % of millennials (<40 years) in top talent, technical skills standards program, culture, leadership, teamwork, millennial successor setup, effective personnel ratio, employee turnover rate, training hours per employee
Politic (5)The level of availability of information regarding the expansion project to the public, level of engagement between port authorities and policymakers, port KPI success rate, level of implementation of sustainable port policy, level of implementation of security policies at ports
Economy (6)Amount of foreign direct investment (FDI), value distributed to shareholders, investment level, level of achievement of project milestones related to funding initiatives (%), port’s value-added contribution rate to GDP, port-related jobs
Social (9)Corporate social responsibility (CSR) cost, level of management support for worker safety conditions, commitment to environmental management, number of accidents at the port, amount of time wasted due to accidents, number of deaths at the port, level of availability of access infrastructure to the port, average time in hinterland, traffic volume
Technology (25)Level of achievement of project milestones related to technology initiatives (%), smart ships, smart containers or connected containers, automated operations, port road management system, intelligent railway, vessel traffic management (VTM), smart WMS system, localization technologies (GPS, RFID, etc.), cloud computing (SaaS, PaaS, IaaS), parking space management, sensors (humidity, temperature, etc.), web-based communication platform, gate management, connectivity hardware, such as cameras, wireless technology, sensors, and RFID tags, the availability of software for data gathering, visualization, analysis, and optimization, direct energy consumption, indirect energy consumption, monitoring and optimization of energy consumption, energy management system, use of wind energy, use of solar power, use of biomass energy, use of wave and tidal energy
Legal (3)Number of collaborations with external parties, institutional communication level, number of standards or regulations enforced related to external policies
Environment (23)Electricity consumption rate, fuel consumption rate, water consumption rate, land use rate, emission of combustion gases, emission of particulate matter, odor emission, monitoring system for noise level, reducing noise and vibrations from cargo handling equipment and vessels, Lden—noise pollution, emission to soil and groundwater, environmental accidents, dredging frequency, number of environmental complaints, discharges of wastewater, sediment quality assessment, generation of hazardous waste, generation of non-hazardous waste, generation of recyclable garbage, fuel spill contingency plan, sewage treatment, hazard waste management, ballast water pollutant control, waste dumping management
Table 7. Final list of validated port performance indicators.
Table 7. Final list of validated port performance indicators.
DimensionIndicators
Financial (11)Revenue growth
EBIT (operating profit) margin
Net profit margin
Operating cash flow
Berth occupancy revenue per TEU
Current ratio
Debt to total asset
Debt to equity
Conformance cost
Non-conformance cost
Opportunity cost
Customers (10)Overall service reliability
Responsiveness to special requests
Accuracy of documents/information
Incidence of cargo damage
Incidence of service delay
Unified key account management
Overall service costs
Cargo handling charges
Value-added service
Overall cost of cargo loading/discharging and (re)stows and other ship operations
Internal business
process (21)
Ship load rate
Berth occupancy
Crane productivity
Yard utilization
Labor productivity
Crane efficiency
Traffic handled (port productivity)
Number of vessels handled
Average output per hook per shift
Idling time at berth
Throughput growth
Vessel call size growth
Container throughput
Non-container throughput
Vessel turnaround time
Truck turnaround time
Cargo dwell time
Average pre-berthing waiting time (APBWT)
Maritime (liner) connectivity
Short sea connectivity
Gate productivity
Learning and growth (12)Knowledge and skills
Capabilities
% female nominated talent
% of millennials (<40 years) in top talent
Technical skills standards program
Culture
Leadership
Teamwork
Millennial successor setup
Effective personnel ratio
Employee turnover rate
Training hours per employee
Politics (5)The level of availability of information regarding the expansion project to the public
Level of engagement between port authorities and policymakers
Port KPI success rate
Level of implementation of sustainable port policy
Level of implementation of security policies at ports
Economics (6)Amount of foreign direct investment (FDI)
Value distributed to shareholders
Investment level
Level of achievement of project milestones related to funding initiatives (%)
Port’s value-added contribution rate to GDP
Port-related jobs
Social (8)Level of management support for worker safety conditions
Commitment to environmental management
Number of accidents at the port
Amount of time wasted due to accidents
Number of deaths at the port
Level of availability of access infrastructure to the port
Average time in hinterland
Traffic volume
Technology (15)Level of achievement of project milestones related to technology initiatives (%)
Intelligent railway
Smart maintenance
Vessel traffic management (VTM)
Smart WMS system
Localization technologies (GPS, RFID, etc.)
Cloud computing (SaaS, PaaS, IaaS)
Parking space management
Web-based communication platform
Connectivity hardware (cameras, wireless technology, sensors, RFID tags)
The availability of software for data collection, visualization, analysis, and optimization
Direct energy consumption
Indirect energy consumption
Monitoring and optimization of energy consumption
Energy management system
Legal (3)Number of collaborations with external parties
Institutional communication level
Number of standards or regulations enforced related to external policies
Environment (23)Electricity consumption rate
Fuel consumption rate
Water consumption rate
Land use rate
Combustion gas emission rate
Emission of particulate matter
Odor emission
Monitoring system for noise level
Reducing noise and vibrations from cargo handling equipment and vessels
Lden—noise pollution
Emission to soil and groundwater
Environmental accidents
Number of environmental complaints
Dredging frequency
Sediment quality assessment
Total wastewater
Level of B3 waste
Level of non-B3 waste
Material recycling rate (tons)
Fuel spill contingency plan
Sewage treatment
Ballast water pollutant control
Waste dumping management
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Praharsi, Y.; Jami’in, M.A.; Sari, D.P.; Isti’anah, P.R.; Wee, H.-M. Developing Key Performance Indicators for a Port in Indonesia. Sustainability 2025, 17, 4664. https://doi.org/10.3390/su17104664

AMA Style

Praharsi Y, Jami’in MA, Sari DP, Isti’anah PR, Wee H-M. Developing Key Performance Indicators for a Port in Indonesia. Sustainability. 2025; 17(10):4664. https://doi.org/10.3390/su17104664

Chicago/Turabian Style

Praharsi, Yugowati, Mohammad Abu Jami’in, Devina Puspita Sari, Putri Rahmatul Isti’anah, and Hui-Ming Wee. 2025. "Developing Key Performance Indicators for a Port in Indonesia" Sustainability 17, no. 10: 4664. https://doi.org/10.3390/su17104664

APA Style

Praharsi, Y., Jami’in, M. A., Sari, D. P., Isti’anah, P. R., & Wee, H.-M. (2025). Developing Key Performance Indicators for a Port in Indonesia. Sustainability, 17(10), 4664. https://doi.org/10.3390/su17104664

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop