Next Article in Journal
Group User Profile Modeling Based on Neural Word Embeddings in Social Networks
Next Article in Special Issue
Geometrical Information Flow Regulated by Time Lengths: An Initial Approach
Previous Article in Journal
Is There Any Symmetry Left in Gravity Theories with Explicit Lorentz Violation?
Previous Article in Special Issue
A New Evaluation for Solving the Fully Fuzzy Data Envelopment Analysis with Z-Numbers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Measuring Performance in Transportation Companies in Developing Countries: A Novel Rough ARAS Model

by
Dunja Radović
1,
Željko Stević
1,*,
Dragan Pamučar
2,
Edmundas Kazimieras Zavadskas
3,
Ibrahim Badi
4,
Jurgita Antuchevičiene
5 and
Zenonas Turskis
6
1
Faculty of Transport and Traffic Engineering Doboj, University of East Sarajevo, Vojvode Mišića 52, 74000 Doboj, Bosnia and Herzegovina
2
Department of Logistics, University of Defence in Belgrade, Pavla Jurisica Sturma 33, 11000 Belgrade, Serbia
3
Institute of Sustainable Construction, Vilnius Gediminas Technical University, Sauletekio al. 11, LT-10223 Vilnius, Lithuania
4
Faculty of Engineering, Misurata University, 2429 Misurata, Libya
5
Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, LT-10223 Vilnius, Lithuania
6
Department of Construction Technology and Management, Vilnius Gediminas Technical University, Sauletekio al. 11, LT-10223 Vilnius, Lithuania
*
Author to whom correspondence should be addressed.
Symmetry 2018, 10(10), 434; https://doi.org/10.3390/sym10100434
Submission received: 6 September 2018 / Revised: 17 September 2018 / Accepted: 20 September 2018 / Published: 25 September 2018
(This article belongs to the Special Issue Solution Models based on Symmetric and Asymmetric Information)

Abstract

:
The success of any business depends fundamentally on the possibility of balancing (symmetry) needs and their satisfaction, that is, the ability to properly define a set of success indicators. It is necessary to continuously monitor and measure the indicators that have the greatest impact on the achievement of previously set goals. Regarding transportation companies, the rationalization of transportation activities and processes plays an important role in ensuring business efficiency. Therefore, in this paper, a model for evaluating performance indicators has been developed and implemented in three different countries: Bosnia and Herzegovina, Libya and Serbia. The model consists of five phases, of which the greatest contribution is the development of a novel rough additive ratio assessment (ARAS) approach for evaluating measured performance indicators in transportation companies. The evaluation was carried out in the territories of the aforementioned countries in a total of nine companies that were evaluated on the basis of 20 performance indicators. The results obtained were verified throughout a three-phase procedure of a sensitivity analysis. The significance of the performance indicators was simulated throughout the formation of 10 scenarios in the sensitivity analysis. In addition, the following approaches were applied: rough WASPAS (weighted aggregated sum product assessment), rough SAW (simple additive weighting), rough MABAC (multi-attributive border approximation area comparison) and rough EDAS (evaluation based on distance from average solution), which showed high correlation of ranks by applying Spearman's correlation coefficient (SCC).

1. Introduction

Transportation, according to Grabara et al. [1], represents the most important logistics activity and in order to enable the smooth running of a transportation process, a series of activities has to be integrated into one coherent whole. Transportation is, according to Borzacchiello et al. [2], a natural and dynamic part of any modern space-economy, offers great economic benefits and improves economic development, as confirmed by research [3] emphasizing that freight transportation plays a key role in today’s economies. Mobility in this century is an everyday aspect of life, and it is necessary to take into account all trends in commodity flows, measure their performance and optimize them from economic, functional, technological and organizational aspects. The trend of urbanization is constantly increasing in the world, which increases the delivery frequency of goods and demands for transportation, which makes it an even more important factor of a complete supply chain. Adding to this the fact that it is necessary to connect production and consumption that are thousands of kilometers away from each other in many cases, understanding and measuring one’s own performance is a prerequisite for the efficient operation of transportation companies. It has been recognized that the large number of criteria that contributed to the problem-solution process must be considered embody duality, paradox, unity in diversity, change, and harmony, offering a holistic approach to problem-solving. An effective integration of cross-functional processes has a considerable influence on the success [4] any company. According to Stević et al. [5], transportation represents the most expensive logistics subsystem, the subsystem that causes the largest percentage of logistics costs, as confirmed by Guasch [6], who states that transportation costs represent the most significant item in total logistics costs. Considering the structure of total logistics costs, the transportation costs, according to Karri and Ojala [7], account for about 40%, and in total costs account for up to 20%. According to Stević et al. [5], it is necessary to work day-to-day to reduce these costs, especially regarding large companies that have a large volume of transportation movements on a daily basis.
Taking into account the aforementioned, the procedure for measuring and monitoring performance indicators is of great importance for the operation of every transportation company. Determining the performance that has the greatest impact on the efficiency of the operation of transportation companies enables optimization of logistics processes and shorter time to complete them. In developed countries around the world, monitoring key performance indicators has been recognized as a necessity, both due to the improvement of the operation of companies as well as the increasing competition on the market, and it is an inevitable part of the logistics processes of every company. However, developing countries have not fully recognized the importance of identifying key performance yet or are at very beginning of recognizing it.
Throughout the research and development of the model in this paper, several goals have been presented. The first goal relates to the improvement and enrichment of the methodology for dealing with uncertainty in the field of group multi-criteria decision-making throughout the development and presentation of a novel rough additive ratio assessment (ARAS) approach. The second goal of this paper is to bridge the gap that currently exists in the methodology for measuring and monitoring performance indicators in the logistics subsystem of transportation. The second goal is achieved throughout a newly developed approach to dealing with imprecision based on rough numbers. The third goal of the paper is a possibility of improving the efficiency of the operation of transportation companies in developing countries and encouraging the development of competitiveness as an important factor in the success of every company. The fourth goal of the paper refers to a possibility of post-analysis in transportation companies that are evaluated in this paper, where the best-ranked ones can serve others as a benchmark. The last, fifth goal of the paper is to popularize and affirm the idea of rough numbers throughout a detailed calculation of operations with rough numbers, which are characteristic of the field of multi-criteria decision-making.
This paper contains six sections in total, the first of which relates to the importance of measuring and monitoring the performance of transportation companies. In the second section, which is related to a literature review, there is a review of studies on similar issues in which multi-criteria decision-making methods are applied. The third section presents the applied methods. Basic operations with rough numbers and a detailed algorithm of a newly developed rough ARAS approach are presented. The fourth section presents a detailed study on performance measurement in Bosnia and Herzegovina, Libya and Serbia based on the developed approach. The fifth section is a sensitivity analysis that involves checking the stability of the results using a three-phase procedure and the discussion of the results. The sixth section presents the key contributions of the developed model and the research, as well as proposals for future research.

2. Literature Review

In order to evaluate and improve the performance of transportation companies, it is necessary to know and analyse key performance indicators (KPIs) [8,9]. KPIs are the measures that organizations can use to assess their own performance. In other words, KPIs help organizations determine the degree of their success in achieving their goals [10,11]. KPIs help managers of transportation companies determine which components of the company require more care and continuous monitoring in order to achieve values that will satisfy service users. In general, the development of key performance indicators for every organization has always been one of the most stressful tasks [12,13]. In that sense, although today many organizations around the world use key performance indicators to find out how successful they are, a very small number of organizations use the most appropriate KPIs to assess their own performance. The reason for that is a lack of understanding of the key performance indicators by business leaders [14]. Performance measurement, in various logistics domains, using performance indicators was carried out in several studies to assess the logistics situation in countries such as Malaysia [15], Finland [16] and Turkey [17,18]. These studies show the acceptance of a logistics performance index as a measure for assessing the logistics performance in the country and linking the logistics performance to trade and transportation policies. Other studies have used indicators of logistics performance for research purposes. Hoekman and Nicita [19] consider various World Bank indices that affect the limitation and facilitation of trade and consider their application in developing countries.
In some studies, the estimation of KPIs is also used as a reflection of logistics performance that may be affected by certain policy measures [20,21,22]. Cemberci et al. [22] considered the effect of global competitiveness on the KPIs of transportation operators and concluded that better competitiveness could be achieved by timely improvement of the KPI components as well as through active monitoring of international shipments. Kim and Min [20] combined the KPIs and the environmental performance index to create an index of green logistics performance, which significantly influenced the final results of the research. Marti et al. [21] examined the importance of each component of KPIs in relation to trade in developing economies using a gravity model. They concluded that all components of KPIs have a positive connection with the scope of international trade. Civelek et al. [23] applied a hierarchical regression analysis to determine the correlation between the logistics performance index, the competitive index and the gross domestic product. Another study that applied the hierarchical regression analysis was by Uca et al. [24] who, similar to Civelek et al. [23], considered the correlation between transportation performance, a corruption perception index and the extent of external trade. The conclusion of the study is that there is a significant correlation and influence between the logistical capacity of a country, corruption, and the extent of external trade.
Leading practitioners who are researching the performance of transportation companies look for answers to several questions, including the question of which indicators they should use and when they need to use them to measure the performance of transportation companies [25]. Therefore, in the transportation industry there is a need to establish a framework for the implementation of a strategic system for measuring the performance of companies [26]. Such a system implies a choice of balanced indicators with a holistic approach [27]. However, the importance of identifying indicators for performance measurement in transportation companies has been recognized only by a small number of researchers and practitioners [26]. Several studies focus on evaluating the logistics performance from several perspectives [28] and logistics throughout performance measurement [29]. Consequently, in order to identify key indicators in logistics performance measurement, the balanced scorecard (BSC) concept is a widely accepted approach and it has been used in several studies [30,31,32].
Norin [33] investigated logistics in air transportation. The study proposed a set of key performance indicators to assess the performance of logistics components using a conceptual model. In recent studies, Kosanke and Schultz [9] have proposed a KPI set to assess the performance of air transportation operations at an airport. Humphreys and Francis [34] have come to the conclusion that increasing demand in air transportation and changes in airport ownership led to the introduction of new financial and environmental measures. The authors have provided a good discussion on a wide range of past, present and future key performance indicators of airports. Regarding the issue of the environment, Morrell and Lu [35] and Ignaccolo [36] studied noise related to transportation activities and its impact on communities near transportation terminals.
In a limited number of studies, models for multi-criteria decision-making are used. The research shown in [37] has indicated that KPIs are necessary to improve internal organization, relationship with customers, competitiveness, and strategy planning in the case of tanker companies in Greece. Nathnail et al. [38] used the analytic hierarchy process (AHP) to assess the significance of each criterion in KPIs and the overall performance of two terminals. Bentaleb et al. [39] identified and analyzed key performance indicators for a port using Measuring Attractiveness by a Categorical-Based Evaluation Technique (MACBETH) tools. The methodology based on the previous analysis helps managers in such companies to make decisions and increase global performance. In [40], the decision-making trial and evaluation laboratory (DEMATEL) method for analyzing the importance and relation among the criteria for evaluating intermodal transportation was used. Moreover, there are many other models used to evaluate and compare key performance indicators [41,42,43,44,45]. In addition to the presented multi-criteria decision-making models (MCDM) for the analysis of KPIs of transportation companies, methods of strategic management in combination with MCDM were also used, e.g., a benchmarking technique that is very useful for assessing the impact of various factors such as services, safety, environment, costs and profit indicators [46,47,48,49,50].
This study extends the existing knowledge of the applicability of KPI measurement in the transportation industry by introducing a comprehensive, balanced set of performance indicators. In complex real-life scenarios, there may be a need for modeling a hierarchical structure, as well as a need to determine the prioritization of different indicators. This presents a challenging and still insufficiently considered issue in the domain of transportation [51]. It is therefore necessary for transportation companies to explore the relations among their different abilities [52]. Therefore, managers of transportation companies should try to answer several questions, such as how to determine the priorities of indicators and how to build a hierarchical relation in order to identify the impacts among indicators [53]. In such cases, MCDM methods offer practical solutions. However, designing the MCDM framework for performance measurement is a complex process that is further elaborated in order to improve the area discussed in this paper [54].
Consequently, in order to face the above challenges, it is necessary to develop a model for identifying the key performance indicators of transportation companies and determining their relations. It is precisely this purpose that is the goal of this study, in order to provide a comprehensive decision-making model that identifies key performance indicators for the transportation industry and evaluate the relations among these indicators from the perspective of logistics providers using MCDM models. In order to achieve this goal, the main research question of this study is: how do you form a decision-making model in which key transportation performance indicators are implemented and which enables the setting of priorities for these indicators, taking into account mutual relations? To solve this problem, the study proposes the measurement of KPIs of transportation companies using step-wise weight assessment ratio analysis (SWARA) and ARAS methods, throughout the analysis of dependence among performance indicators and a proposal of their priorities. Although there are several studies focusing on the application of the MCDM concept in the transportation industry [55], the implementation of a rough approach in MCDM models, which are applied in the field of logistics, has received very limited attention. In particular, there are no studies that consider the integration of a rough approach in the SWARA-ARAS hybrid model, not only in the field of performance measurement of logistics companies, but in general in the MCDM literature. The SWARA-rough ARAS model is a new comprehensive decision-making model that allows management of transportation companies to measure performance even in situations where there are inaccuracies and uncertainties in data.

3. A Novel Rough Additive Ratio Assessment (ARAS) Method

The ARAS method belongs to a group of multi-criteria decision-making methods that have been developed over the past decade and it has found a wide application in different areas. A classic form of this method was developed in 2010 [56], while its fuzzy [57] and grey forms [58] were developed in the same year. Bearing in mind all the advantages of using rough theory [59,60] in the MCDM to represent ambiguity, vagueness and uncertainty, the authors have decided in this paper to modify the ARAS algorithm using rough numbers, which is an original contribution. The fuzzy form of ARAS method offers certain benefits in terms of uncertainty, and due to a possibility of reducing subjectivity to a minimum, reducing uncertainty, and obtaining clearer results, a new rough ARAS consisting of seven steps has been developed in this paper.
Step 1. Forming a multi-criteria model. In this step, it is necessary to define the problem that needs to be solved, to form a set of m criteria on the basis of which n alternatives will be evaluated. In addition, it is necessary to define a set of k decision-makers who will participate in a process of group decision-making.
Step 2. Forming a group rough matrix. In this step using Equations (A1)–(A6) it is necessary to aggregate individual matrices into a group rough matrix represented by Equation (1). An integral part of this initial matrix, unlike in other approaches, is an additional row that represents optimal values of the alternatives according to the criteria.
I R M = [ [ x 11 L , x 11 U ] [ x 12 L , x 12 U ] [ x 1 n L , x 1 n U ] [ x 21 L , x 21 U ] [ x 22 L , x 22 U ] [ x 2 n L , x 2 n U ] [ x m 1 L , x m 1 U ] [ x m 2 L , x m 2 U ] [ x m n L , x m n U ] [ x O 1 L , x O 1 U ] [ x O 2 L , x O 2 U ] [ x O n L , x O n U ] ]
Optimal values of alternatives according to criteria are formed by taking the highest or lowest values depending on whether the criterion belongs to a cost or benefit type. If it is a benefit-type criterion, then the maximum value is taken, and if it is a cost-type criterion, the minimum value is taken.
Step 3. Normalization of an initial rough matrix that involves three phases depending on the type of criteria. The first phase relates to the normalization of benefit-type criteria by applying Equation (2).
( a )   n i j = [ x L i j ; x U i j ] i = 1 m [ x L i j ; x U i j ] f o r c 1 , c 2 , c 3 c n B .
If we take into account the basic operations with rough numbers and the sum calculated by columns for each criterion in particular, the normalization process obtains the following form Equation (3)
n i j = [ x i j L x * U i j ; x i j U x * L i j ] .
where x * U i j indicates the upper sum limit by the criterion, and x * L i j the lower sum limit.
The second and third phase of normalization involve the application of Equations (4) and (5): for cost criteria; Equation (4) should be first applied in order to obtain inverse values for [ x i j L ; x i j U ] .
( b )   x i j ¯ = [ 1 x i j L ; x i j U ] = [ 1 x i j U ; 1 x i j L ] .
and then the Equation (5) in order to complete the normalization process:
( c )   n i j = [ x ¯ i j L ; x ¯ i j U ] i = 1 m [ x ¯ i j L ; x ¯ i j U ] = [ x ¯ i j L x ¯ i j * U ; x ¯ i j U x ¯ i j * L ] .
where x ¯ i j * U and x ¯ i j * L represents the upper and lower limits of the sum by the inverse value criterion for [ x i j L ; x i j U ] , respectively.
Step 4. Weighting the normalized rough matrix using Equation (6):
W n = [ w i j L ; w i j U ] m × n w i j = w j L × n i j , L i = O , 1 , 2 , , m w i j = w j U × n i j , U i = O , 1 , 2 , , m .
Step 5. Determining the matrix S i by summing all the values per rows from the previous weighted matrix, Equation (7).
S i = [ s i j L ; s i j U ] s i j L = w i j L ; s i j U = w i j U ; j = O , 1 , 2 , , n .
Step 6. Calculation of the degree of usefulness applying Equation (8):
K i = [ s i j L s o U ; s i j U s o L ] .
where S o indicates the value of the best alternative.
Step 7: Ranking the alternatives in decreasing order. The highest value is the best solution, while the smallest value represents the worst solution.
To adequately solve decision-making problems with vague or imprecise information according to Mardani et al. [61], the fuzzy set theory [62,63,64] and aggregation operator theory [65,66] have become powerful tools. As opposed to fuzzy sets theory, which requires a subjective approach in determining partial functions and fuzzy set boundaries, rough set theory determines set boundaries based on real values and depends on the degree of certainty of the decision maker. Since rough set theory deals solely with internal knowledge, i.e., operational data, there is no need to rely on assumption models. In other words, when applying rough sets, only the structure of the given data is used instead of various additional/external parameters. The logic of rough set theory is based solely on data that speak for themselves. When dealing with rough sets, the measurement of uncertainty is based on the vagueness already contained in the data. In this way, the objective indicators contained in the data can be determined. In addition, rough set theory is suitable for application on sets characterized by irrelevant data where the use of statistical methods does not seem appropriate [67].
The benefits of the novel rough ARAS approach in relation to other approaches developed so far can be seen throughout several options. The first one refers to a relatively small number of steps that are needed for a complete calculation according to this approach; then taking into account the optimal alternative as a possibility for more precise decision-making; and reducing uncertainty and subjectivity in a decision-making process using rough instead of crisp numbers.
The implementation of this approach was demonstrated on the case study of transportation companies in Libya, Serbia and Bosnia and Herzegovina.

4. Case Study

The developed model for performance evaluation in transportation companies in developing countries consists of a total of 23 steps divided into five phases: initial data collection, the application of the SWARA (step-wise weight assessment ratio analysis) method [68] for the selection of performance indicators, data collection related to performance measurement in developing countries, the development and implementation of the novel rough ARAS approach and sensitivity analysis. The proposed model is shown in Figure 1 where steps and sub-steps of all phases are presented.
Recognizing the need for forming such a model and completing performance measurement started at the end of 2017, when a part of the team for research and development of the model was formed. The first ideas, a review of the relevant literature, and discussion on indicators for performance measurement with managers of transportation companies, were carried out exactly in that period. In the period of January–March 2018, the first phase of data collection was completed, while the second phase was completed at the beginning of April. The third phase related to data re-collection was carried out in the period of April–June. Along with the idea of the development of this model, it also started the development of the novel rough ARAS algorithm, which is one of key contributions of this paper, and lasted until May 2018. Taking into account the aforementioned and later the application of the developed rough ARAS approach in June it can be concluded that the fourth phase lasted longer than five months. The last phase was carried out in July. When the timing of all the phases of the proposed model is taken into account, it can be concluded that the complete research took about nine months.
The first phase is data collection and consists of three steps. The first step is forming a set of 62 performance indicators in the field of transportation based on a detailed literature review, as well as opinions and discussions with managers from various transportation companies. The second step is forming a hierarchical structure made up of the main criteria and sub-criteria, which is given in detail in Figure 2 and explained in Table 1. The third step of the first phase is the assessment of 62 performance indicators by managers from 19 different transportation companies.
Determining the significance of criteria according to different authors [69,70] is one of the most important stages in the decision-making process, so the second phase represents the use of the SWARA method in order to perform the selection of key performance indicators. It consists of six steps, with the first five steps representing the integral steps of the SWARA method. At the very beginning, it is necessary to sort the criteria according to their importance, i.e., it is necessary that experts rank the criteria according to their significance. Then, it is necessary to determine the comparative importance of the average value. The third, fourth and fifth steps are related to the calculation and determination of coefficient and weight values. The sixth step of the second phase is a selection of 20 key performance indicators.
The third phase is also a collection of data for the next part of the work related to the measurement of 20 identified performance indicators in developing countries, in this case Bosnia and Herzegovina, Libya and Serbia. The managers of nine transportation companies located in the aforementioned countries filled in the tables by inputting their own values for each performance indicator. After that, the performance indicators were evaluated by six experts with at least seven years of experience in the field of transportation, and located in the territory of Bosnia and Herzegovina and Serbia.
The fourth phase relates to the development and application of the novel rough ARAS approach for evaluating measured performance indicators in transportation companies in developing countries. It consists of seven steps that are explained in detail in the section related to work methods.
The fifth and also the last phase of the proposed model refers to a sensitivity analysis. The sensitivity analysis was carried out in three steps. The first step is the change in the weight of criteria, and the second step is the application of different methods of multi-criteria decision-making, which is given in detail in the fifth section of the paper. Several methods are applied to the same multi-criteria model in order to better represent the difference in the ranks of transportation companies with a change in approach. The last step is the determination of Spearman’s coefficient of correlation, on the basis of which the stability of the obtained results, i.e., the ranking of alternatives, can be determined. The SCC is calculated for both phases of the sensitivity analysis, i.e., for the rank of alternatives according to formed scenarios in which the weights of criteria are changed and in comparison to other approaches.
Figure 2 shows a hierarchical structure with 20 key performance indicators identified by evaluations by experts from 19 different transportation companies. At the first level of the hierarchy, there is a goal that is related to performance measurement in transportation companies in developing countries. The second level of the hierarchy consists of a total of 20 performance indicators that are identified based on the first part of this study, which is shown in [71]. At the third level, there are values of measured performance indicators in transportation companies in developing countries, i.e., in Bosnia and Herzegovina, Libya and Serbia.
As already noted in the section explaining the proposed model, a detailed explanation of the used indicators is given in Table 1 to enable transport managers to input their own values of indicators in an easier and more understandable way.
The values of performance indicators, on the basis of which the alternatives were evaluated, were obtained using the SWARA method in the research [71]. In the initial study, as already mentioned, a total of 62 indicators were evaluated based on 19 decision-makers. The weight coefficients of the criteria in this paper have been multiplied by two in relation to the above research, for the purpose of easier calculation.
In the first step of the proposed approach, a multi-criteria model should be formed, which in this case consists of 20 criteria, nine alternatives and six decision-makers. The alternatives represent three transportation companies from Bosnia and Herzegovina, Libya and Serbia, respectively. In order to be able to form a group rough matrix, it is first necessary to convert individual matrices of all decision-makers (Table 2) into group rough ones.
The evaluation of the alternatives by six experts shown in Table 2 was carried out on the basis of the linguistic scale defined in [5], taking into account the type of criteria.
The transformation of individual matrices is completed using the Equations (A1)–(A6) in the following way: For the first criterion c ˜ 1 = { 9 , 9 , 9 , 7 , 7 , 7 } it will be:
L i m _ ( 9 ) = 1 6 ( 9 + 9 + 9 + 7 + 7 + 7 ) = 8.00 , L i m ¯ ( 9 ) = 9.00 L i m _ ( 7 ) = 7.00 , L i m ¯ ( 7 ) = 1 6 ( 9 + 9 + 9 + 7 + 7 + 7 ) = 8.00 R N ( c 1 1 ) = R N ( c 1 2 ) = R N ( c 1 3 ) = [ 8.00 , 9.00 ] ; R N ( c 1 4 ) = R N ( c 1 5 ) = R N ( c 1 6 ) [ 7.00 , 8.00 ] c 1 L = c 1 1 + c 1 2 + c 1 3 + c 1 4 + c 1 5 + c 1 6 n = 8.00 + 8.00 + 8.00 + 7.00 + 7.00 + 7.00 6 = 7.50 c 1 U = c 1 1 + c 1 2 + c 1 3 + c 1 4 + c 1 5 + c 1 6 n = 9.00 + 9.00 + 9.00 + 8.00 + 8.00 + 8.00 6 = 8.50
For the second criterion according to the first alternative c ˜ 2 = { 5 , 7 , 7 , 5 , 5 , 7 }
L i m _ ( 5 ) = 5.00 , L i m ¯ ( 5 ) = 1 6 ( 5 + 7 + 7 + 5 + 5 + 7 ) = 6.00 L i m _ ( 7 ) = 1 6 ( 5 + 7 + 7 + 5 + 5 + 7 ) = 6.00 , L i m ¯ ( 7 ) = 7.00 R N ( c 2 1 ) = R N ( c 2 4 ) = R N ( c 2 5 ) = [ 5.00 , 6.00 ] ; R N ( c 2 2 ) = R N ( c 2 3 ) = R N ( c 2 6 ) [ 6.00 , 7.00 ] c 2 L = 5.00 + 6.00 + 6.00 + 5.00 + 5.00 + 6.00 6 = 5.50 c 2 U = 6.00 + 7.00 + 7.00 + 6.00 + 6.00 + 7.00 6 = 6.50
For the eighth criterion c ˜ 8 = { 7 , 7 , 9 , 7 , 7 , 5 } :
L i m _ ( 7 ) = 1 5 ( 7 + 7 + 7 + 7 + 5 ) = 6.60 , L i m ¯ ( 7 ) = 1 5 ( 7 + 7 + 9 + 7 + 7 ) = 7.40 L i m _ ( 9 ) = 1 6 ( 7 + 7 + 9 + 7 + 7 + 5 ) = 7.00 , L i m ¯ ( 9 ) = 9.00 L i m _ ( 5 ) = 5.00 , L i m ¯ ( 5 ) = 1 6 ( 7 + 7 + 9 + 7 + 7 + 5 ) = 7.00 R N ( c 8 1 ) = R N ( c 8 2 ) = R N ( c 8 4 ) = R N ( c 8 5 ) = [ 6.60 , 7.40 ] ; R N ( c 8 3 ) = [ 7.00 , 9.00 ] ; R N ( c 8 6 ) = [ 5.00 , 7.00 ] c 8 L = 6.60 + 6.60 + 7.00 + 6.60 + 6.60 + 5.00 6 = 6.40 c 8 U = 7.40 + 7.40 + 9.00 + 7.40 + 7.40 + 7.00 6 = 7.60
For the twentieth criterion according to the first alternative c ˜ 20 = { 7 , 3 , 5 , 7 , 7 , 3 }
L i m _ ( 3 ) = 3.00 , L i m ¯ ( 3 ) = 1 6 ( 7 + 3 + 5 + 7 + 7 + 3 ) = 5.33 L i m _ ( 5 ) = 1 3 ( 3 + 5 + 3 ) = 3.67 , L i m ¯ ( 5 ) = 1 4 ( 7 + 5 + 7 + 7 ) = 6.50 L i m _ ( 7 ) = 1 6 ( 7 + 3 + 5 + 7 + 7 + 3 ) = 5.33 , L i m ¯ ( 7 ) = 7.00 R N ( c 20 1 ) = R N ( c 20 4 ) = R N ( c 20 5 ) = [ 5.33 , 7.00 ] ; R N ( c 20 2 ) = R N ( c 20 6 ) = [ 3.00 , 5.33 ] ; R N ( c 20 3 ) = [ 3.67 , 6.50 ] c 20 L = 5.33 + 3.00 + 3.67 + 5.33 + 5.33 + 3.00 6 = 4.28 c 20 U = 7.00 + 5.33 + 6.50 + 7.00 + 7.00 + 5.33 6 = 6.36
In an identical way, the other values shown in Table 3 are also calculated.
Table 3 shows a part of the calculation that refers to obtaining an aggregated initial group rough matrix for the first alternative. In the same way, other values for other alternatives are calculated, so the initial aggregated rough matrix is presented in Table 4.
Table 4 shows the initial rough matrix from the second step of the developed rough ARAS approach. The last column marked with gray indicates the optimal values of the alternatives obtained by taking maximum or minimum values depending on the type of criteria. The total number of criteria belonging to a beneficial group is 14, while the remaining six criteria are of cost type, and they are C14, C15, C17, C18, C19 and C20.
In the third step of the rough ARAS approach, it is necessary to apply a three-phase procedure for normalizing the initial rough matrix. In this step, it is also important which criteria are benefit ones, and which are the cost ones, and, accordingly, the normalization is carried out in the following way.
Applying Equation (2):
( a )   n 11 = [ 7.50 ; 8.50 ] [ 49.39 ; 60.61 ]
i.e., (3):
n 11 = [ 7.50 ; 8.50 ] [ 60.61 ; 49.39 ] = [ 0.12 ; 0.17 ]  
The normalized value of the first alternative for the first criterion was obtained. The normalization procedure for all the other criteria that belong to the benefit ones is the same. The second and third phases of normalization include the application of Equations (4) and (5): for cost criteria, Equation (4) should be first applied in order to obtain inverse values for [ x i j L ; x i j U ] .
For the first alternative according to the fourteenth criterion, the inverse value (Table 5) is:
( b )   x 114 ¯ = [ 1 3.47 ; 1 1.88 ] = [ 0.29 , 0.53 ]  
Applying Equation (5), a normalized value is obtained (Table 6):
( c )   n 114 = [ 0.29 4.45 ; 0.53 2.97 ] = [ 0.06 , 0.18 ]  
Table 5 shows inverse values from the initial rough matrix, i.e., values obtained by applying the second phase of normalization, which is the third step of the developed approach. Table 6 gives an overview of a complete normalized matrix after the application of the above three phases.
The fourth step is the aggregation of the normalized rough matrix by multiplying all the values of the normalized matrix with the weighted values of criteria by applying Equation (6). The weighted normalized matrix is shown in Table 7.
In the fifth step, it is necessary to determine the matrix S i by summing all the values per rows of the previous weighted matrix (7). After that, applying Equation (8), the degree of usefulness K i is calculated and in the last seventh step, the ranking of the alternatives according to decreasing order is performed. Operations with rough numbers are performed using Equations (15)–(20). The results of the last three steps of the rough ARAS approach are shown in Table 8.
Alternative 9 represents the best solution, which means that the transportation company from Serbia is in first place with the best performance indicators compared to other alternatives. In second and third places are transportation companies from Bosnia and Herzegovina. The worst-ranked companies are from Libya, which is in some way an understandable and expected outcome taking into account recent events in that country.

5. Sensitivity Analysis and Discussion

The sensitivity analysis performed in this paper includes three phases, which determine the sensitivity and validity of the results obtained. The first phase consists of the formation of 10 different scenarios in which the values of weight coefficients are simulated and the rank obtained using Spearman’s correlation coefficient is checked. In the second phase, different methods of multi-criteria decision-making are applied in a rough form, and in the third phase, a statistical correlation checking is performed for all applied methods.
Figure 3 shows the ranks of alternatives throughout 10 scenarios formed. The first four scenarios are formed in such a way that five criteria per scenario increase by 0.100 or even 145% and more. In the first scenario, the first five criteria change the value, while the others remain unchanged in sequence to the fourth scenario. The fifth scenario implies a reduction in the value of the first 10 criteria by 100% of their own value. The sixth scenario is formed in the same way as the fifth, with the increased values of the other 10 criteria. In the seventh scenario, the values of C1–C10 criteria are reduced by 100% of their own value, and the C11–C20 criteria are increased by the same percentage. In the eighth scenario, the first five criteria are eliminated, so that the alternatives are ranked on the basis of 15 indicators, while in the ninth scenario, the five worst criteria are eliminated. The last, tenth scenario implies that all criteria are equally important with a share of 0.100.
Figure 3 shows the ranks of alternatives through the formed scenarios that have previously been explained in detail. The second, fifth, sixth and tenth scenarios encompass identical ranks as in the initial scenario. In the third scenario, the only difference in rank is the third and eighth alternatives that change places, while in the fourth, the difference is in the first two alternatives that also change positions. Scenarios 7 and 8 have an identical correlation with the initial scenario in which the first two alternatives change places and alternatives 6 and 8, so the correlation is a bit smaller compared to the scenarios previously explained. The first scenario presents greater differences in ranks than the initial scenario, which means that the increase in significance of the first five criteria significantly influences the rank. The biggest difference in the scenarios formed is in the ninth scenario when five of the worst criteria are eliminated, which means that these criteria still play an important role in measuring performance in transportation companies.
In Figure 4, Spearman’s coefficient of rank correlation is shown in all scenarios compared to the initial one.
Figure 4 shows the SCC through all the scenarios for which it can be seen that the model is sensitive to changes of the weights of criteria and that each indicator plays an important role in measuring performance in transportation companies. Spearman’s coefficient of correlation ranges in the scope of 0.917–1.00, which represents a high degree of correlation, and the results obtained using the developed rough ARAS model are considered stable. The average SCC value of all 10 scenarios formed in relation to the initial rank is 0.977.
Figure 5 shows the second phase of the sensitivity analysis, which includes the application of different approaches: rough WASPAS (weighted aggregated sum product assessment) [67] rough SAW (simple additive weighting) [5], rough MABAC (multi-attributive border approximation area comparison) [72] and rough EDAS (evaluation based on distance from average solution) [73] to the same multi-criteria model. Extension of the MCDM methods with rough numbers has become common in the last few years. The reason for using a rough SAW, rough MABAC and rough EDAS method is that they in a very short time found application in different areas. These methods are well accepted by the wider academic community, which is confirmed by the number of their citations. Rough WASPAS is a method developed a few months ago and is often used in previous forms (crisp, fuzzy, grey) in the sensitivity analysis [74].
In Figure 5, it can be seen that the best transportation company does not change the rank in any approach, i.e., in all scenarios it is the best-ranked company. In addition, the following alternatives remain in their original positions by applying all approaches: the first, third and seventh alternatives are in the second, fifth and sixth place, respectively. The second alternative using rough ARAS, rough WASPAS and rough SAW takes the third position, while using rough MABAC and rough EDAS is in fourth place. By applying these two methods, the fourth alternative is best-ranked and takes the seventh position, while applying other approaches it is in the eighth position. The rank of the fifth alternative ranges from the seventh (rough ARAS, rough WASPAS and rough SAW) to ninth place (rough EDAS), while using rough MABAC it is in eighth place. The sixth alternative is worst-ranked in all approaches except rough EDAS when it takes the last position. The eighth alternative occupies the fourth position (rough ARAS, rough WASPAS and rough SAW), while applying rough MABAC and rough EDAS it is in a high third position.
Table 9 shows the third phase in the sensitivity analysis, which includes checking the correlation of ranks using different approaches.
Table 9 shows the SCC for all five applied approaches according to which it can be concluded that the ranks in all approaches are in very high correlation. The above is confirmed by the average value of SCC for all approaches which is 0.983. Spearman’s correlation coefficient ranges in the scope from 0.933–1.00. The developed rough ARAS has a full correlation of ranks with rough WASPAS and rough SAW. It has a slightly smaller correlation (0.967) with rough MABAC, while the smallest correlation with rough EDAS (0.933). Since rough WASPAS and rough SAW have a full correlation with rough ARAS, it is obvious that they have the same correlation with other approaches as rough ARAS has. Rough MABAC and rough EDAS have a correlation coefficient of 0.983, which is a consequence of the change of rank in two alternatives.
An explanation of the obtained results can be seen throughout the current state of the transport system in the observed countries. Libya is plagued by a poor transport system, which leads to enormous problems of traffic congestion and pollution. The lack of an integrated transport system has made logistics operations in the country primitive. City-to-city freight, sometimes over long distances of more than 1500 kilometers, is only carried out by people-owned vehicles or small shipping companies. This is also the case for logistics within cities, where they are carried out by inadequate fleets and trucks using the inner city roads. For instance, local product distributions are carried out by the same producing companies, which tend to own freight vehicles for distribution within cities, as well as larger trucks for longer haulage. The same applies to some food manufacturers, as well as to some companies specializing in supplying various goods and distributing them to retailers.
Road transportation is the most developed mode of transportation in Bosnia and Herzegovina, although by the middle of 2003, when it obtained the first 11 km of a modern highway, B&H was the only country in the region of south-east Europe that did not have a single kilometer of modern highway. With the construction of new road networks, road freight transportation has gained significance. Companies with their own fleets, which deal with both domestic and international freight transportation, have been established. Most frequently, cargo transportation is performed by furgon trucks, tanks and trailer trucks, but a large number of means of transportation exceeds the permitted age limit. Although road networks have already been constructed and reconstructed, there is still a need for improvement and the construction of a new road infrastructure; because of the aforementioned factors, there is often a delay in road traffic, and as a consequence, the delivery of goods to the recipient regarding transportation at a national level. Regarding international freight transportation, these problems are much less common.
Road transportation in Serbia is at a bit higher in its level of development than in BiH and represents a dynamic and dominant mode of transportation. Although transportation in Serbia is more developed compared to that in B&H, it still largely lags behind the region due to the poor condition of the existing road network, as well as a slow construction of new transport corridors. In the last few years, there has been a tendency for the growth of freight transportation and an increase in the number of road vehicles. However, this growth represents a heavy burden for already bad road infrastructure. The current road transportation is characterized by an ageing vehicle fleet, which affects safety in traffic, and poor road infrastructure causes damage to road vehicles.
It is important to note that in the last few years, the number of transportation companies offering logistics outsourcing in Bosnia and Herzegovina and Serbia has increased, and consequently, the quality of a complete transport system and, to a certain extent, logistics has also increased.

6. Conclusions

In this research, a model was created for performance measurement in transportation companies based on 20 performance indicators, which were identified in the previous study based on the assessment of a large number of decision-makers. The key contribution of this paper is the improvement and enrichment of the methodology for treating uncertainties in the field of group multi-criteria decision-making through the development of a novel rough ARAS approach. The developed approach allows bridging the gap that currently exists in the methodology for measuring and monitoring performance indicators in the logistics subsystem of transportation. The proposed model in this paper provides an opportunity to improve the efficiency of the operations of transportation companies in developing countries, and encourages the development of competitiveness as an important factor in a success of every company. The novel rough ARAS approach is applied to evaluate the performance of nine transportation companies located in the territory of Bosnia and Herzegovina, Libya and Serbia, i.e., in developing countries. The results obtained are checked throughout a sensitivity analysis forming different scenarios, simulating the weight values of criteria and applying different approaches developed over the last three years. The stability of the model is verified throughout a statistical correlation coefficient, which shows a high correlation of ranks in all scenarios. The results show that transportation companies from Serbia and Bosnia and Herzegovina are significantly ahead of the transportation companies from Libya. The measurements presented in this paper can serve as a guide to transportation companies in developing countries, since they provide an insight into the calculated values of the 20 most important performance indicators and, thus, unambiguously show them which indicators to pay attention to in order to rationalize their business. In addition, the measured values of the most significant performance should further stimulate the development of competitiveness both among developing countries and among countries that have developed logistics and good-quality transportation. We ranked nine companies from three different countries, but that does not mean that we optimized this. The model ranked the performance in transportation and the best alternative having the best performance in comparison to another; but this does not mean that the best alternative has optimal performance. Taking all this into account and the methodology developed in this paper, there is a possibility for a post-analysis in all transportation companies evaluated here, where the best-ranked ones can serve others as a benchmark, which can be one of the directions for future research. Also, one of the guidelines for future research in a practical aspect should be constant monitoring and measurement of the worst performance and their improvement. Moreover, improvement from academic and practical aspects can develop the MCDM method which can be used only for the measurement of perfomance in transportation. A similar approach to solve decision problems in a supply chain is developed in [75].

Author Contributions

Each author has participated and contributed sufficiently to take public responsibility for appropriate portions of the content.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Rough Set Theory and Operations with Rough Numbers
In rough set theory, any vague idea can be represented as a couple of exact concepts based on the lower and upper approximations.
Suppose U is the universe which contains all the objects, Y is an arbitrary object of U, R is a set of t classes { G 1 , G 2 , , G t } that cover all the objects in U, R = { G 1 , G 2 , , G t } . If these classes are ordered as { G 1 < G 2 < < G t } , then Y U , G q R , 1 q t , the lower approximation ( A p r _ ( G q ) ) , upper approximation ( A p r ¯ ( G q ) ) and boundary region ( B n d ¯ ( G q ) ) of class G q are, defined as:
A p r _ ( G q ) = { Y U / R ( Y ) G q }  
A p r ¯ ( G q ) = { Y U / R ( Y ) G q }  
B n d ( G q ) = { Y U / R ( Y ) G q } = { Y U / R ( Y ) G q } { Y U / R ( Y ) < G q }  
Then G q can be shown as a rough number ( R N ( G q ) ) , which is determined by its corresponding lower limit ( L i m _ ( G q ) ) and upper limit ( L i m ¯ ( G q ) ) where:
L i m _ ( G q ) = 1 M L R ( Y ) | Y A p r _ ( G q )  
L i m ¯ ( G q ) = 1 M U R ( Y ) | Y A p r ¯ ( G q )  
R N ( G q ) = [ L i m _ ( G q ) , L i m ¯ ( G q ) ]  
where M L , M U are the numbers of objects that contained in A p r _ ( G q ) and A p r ¯ ( G q ) , respectively.
The difference between them is expressed as a rough boundary interval ( I R B n d ( G q ) ) :
I R B n d ( G q ) = L i m ¯ ( G q ) L i m _ ( G q )  
The operations for two rough numbers R N ( α ) = [ L i m _ ( α ) , L i m ¯ ( α ) ] and R N ( β ) = [ L i m _ ( β ) , L i m ¯ ( β ) ] are:
Addition (+) of two rough numbers R N ( α ) and R N ( β ) :
R N ( α ) + R N ( β ) = [ L i m _ ( α ) + L i m _ ( β ) , L i m ¯ ( α ) + L i m ¯ ( β ) ]  
Subtraction (−) of two rough numbers R N ( α ) and R N ( β ) :
R N ( α ) R N ( β ) = [ L i m _ ( α ) L i m ¯ ( β ) , L i m ¯ ( α ) L i m _ ( β ) ]  
Multiplication (×) of two rough numbers R N ( α ) and R N ( β ) :
R N ( α ) × R N ( β ) = [ L i m _ ( α ) × L i m _ ( β ) , L i m ¯ ( α ) × L i m ¯ ( β ) ]  
Division (/) of two rough numbers R N ( α ) and R N ( β ) :
R N ( α ) / R N ( β ) = [ L i m _ ( α ) / L i m ¯ ( β ) , L i m ¯ ( α ) / L i m _ ( β ) ]  
Scalar multiplication of rough number R N ( α ) , where μ is a non-zero constant:
μ × R N ( α ) = [ μ × L i m _ ( α ) , μ × L i m ¯ ( α ) ]

References

  1. Grabara, J.; Kolcun, M.; Kot, S. The role of information systems in transport logistics. Int. J. Educ. Res. 2014, 2, 1–8. [Google Scholar]
  2. Borzacchiello, M.T.; Torrieri, V.; Nijkamp, P. An operational information systems architecture for assessing sustainable transportation planning: Principles and design. Eval. Progr. Plan. 2009, 32, 381–389. [Google Scholar] [CrossRef] [PubMed]
  3. Ghiani, G.; Laporte, G.; Musmanno, R. Introduction to Logistics Systems Planning and Control; John Wiley & Sons: West Sussex, UK, 2004. [Google Scholar]
  4. Hashemkhani Zolfani, S.; Zavadskas, E.K.; Turskis, Z. Design of products with both international and local perspectives based on yin-yang balance theory and SWARA method. Ecomic Res.-Ekomsk Istrživnj 2013, 26, 153–166. [Google Scholar] [CrossRef]
  5. Stević, Ž.; Pamučar, D.; Zavadskas, E.K.; Ćirović, G.; Prentkovskis, O. The Selection of Wagons for the Internal Transport of a Logistics Company: A Novel Approach Based on Rough BWM and Rough SAW Methods. Symmetry 2017, 9, 264. [Google Scholar] [CrossRef]
  6. Guasch, J.L.; Kogan, J. Inventories and logistic costs in developing countries: Levels and determinants—A red flag for competitiveness and growth. Revista de la Competencia y de la Propiedad Int. 2006, 5. [Google Scholar]
  7. Rantasila, K.; Ojala, L. Measurement of national-level logistics costs and performance. In Transport Forum Discussion Paper; International Transport Forum: Paris, France, 2012. [Google Scholar] [CrossRef]
  8. Enoma, A.; Allen, S. Developing key performance indicators for airport safety and security. Facilities 2007, 25, 296–315. [Google Scholar] [CrossRef]
  9. Kosanke, L.; Schultz, M. Key Performance Indicators for Performance-Based Airport Management from the perspective of airport operations. In Proceedings of the Fifth Air Transport and Operations Symposium (ATOS), Delft, Netherlands, 7–11 September 2015. [Google Scholar]
  10. Gillen, D.; Lall, A. Developing measures of airport productivity and performance: An application of data envelopment analysis. Transp. Res. E Logist. Transp. Rev. 1997, 33, 261–273. [Google Scholar] [CrossRef]
  11. Lindberg, C.-F.; Tan, S.; Yan, J.Y.; Starfelt, F. Key performance indicators improve industrial performance. Energy Procedia 2015, 75, 1785–1790. [Google Scholar] [CrossRef]
  12. Lapide, L. What about measuring supply chain performance. Achiev. Supply Chain Excell. Technol. 2000, 2, 287–297. [Google Scholar]
  13. Chae, B. Developing key performance indicators for supply chain: An industry perspective. Supply Chain Manag. Int. J. 2009, 14, 422–428. [Google Scholar] [CrossRef]
  14. Parmenter, D. Key Performance Indicators: Developing, Implementing, and Using Winning KPIs; John Wiley & Sons: Hoboken, NJ, USA, 2015. [Google Scholar]
  15. Jumadi, H.; Zailani, S. Integrating green innovations in logistics services towards logistics services sustainability: A conceptual paper. Environ. Res. J. 2010, 4, 261–271. [Google Scholar] [CrossRef]
  16. Solakivi, T.; Ojala, L.; Laari, S.; Lorentz, H.; Toyli, J.; Malmsten, J.; Viherlehto, N. Finland State of Logistics 2014; University of Turku: Turku, Finland, 2015. [Google Scholar]
  17. Drivers of Logistics Performance: A Case Study of Turkey; International Transport Forum (ITF); OECD: Paris, France, 2015.
  18. Ekici, Ş.Ö.; Kabak, Ö.; Ülengin, F. Linking to compete: Logistics and global competitiveness interaction. Transp. Policy 2016, 48, 117–128. [Google Scholar] [CrossRef]
  19. Hoekman, B.; Nicita, A. Trade policy, trade costs, and developing country trade. World Dev. 2011, 39, 2069–2079. [Google Scholar] [CrossRef]
  20. Kim, I.; Min, H. Measuring supply chain efficiency from a green perspective. Manag. Res. Rev. 2011, 34, 1169–1189. [Google Scholar] [CrossRef]
  21. Martí, L.; Puertas, R.; García, L. The importance of the logistics performance index in international trade. Appl. Econ. 2014, 46, 2982–2992. [Google Scholar] [CrossRef]
  22. Çemberci, M.; Civelek, M.E.; Canbolat, N. The moderator effect of global competitiveness index on dimensions of logistics performance index. Procedia Soc. Behav. Sci. 2015, 195, 1514–1524. [Google Scholar] [CrossRef] [Green Version]
  23. Civelek, M.E.; Uca, N.; Cemberci, M. The mediator effect of logistics performance index on the relation between global competitiveness index and gross domestic product. Eur. Sci. J. 2015, 11, 368–375. [Google Scholar] [CrossRef]
  24. Uca, N.; Ince, H.; Sumen, H. The mediator effect of logistics performance index on the relation between corruption perception index and foreign trade volume. Eur. Sci. J. 2016, 12, 37–45. [Google Scholar] [CrossRef]
  25. Gopal, P.; Thakkar, J. A review on supply chain performance measures and metrics: 2000–2011. Int. J. Prod. Perform. Manag. 2012, 61, 518–547. [Google Scholar] [CrossRef]
  26. Rajesh, R.; Pugazhendhi, S.; Ganesh, K.; Ducq, Y.; Koh, S.L. Generic balanced scorecard framework for third party logistics service provider. Int. J. Prod. Econ. 2012, 140, 269–282. [Google Scholar] [CrossRef]
  27. Gutierrez, D.M.; Scavarda, L.F.; Fiorencio, L.; Martins, R.A. Evolution of the performance measurement system in the logistics department of a broadcasting company: An action research. Int. J. Prod. Econ. 2015, 160, 1–12. [Google Scholar] [CrossRef]
  28. Wang, L.; Zhang, H.; Zeng, Y.R. Fuzzy analytic hierarchy process (FAHP) and balanced scorecard approach for evaluating performance of third-party logistics (TPL) enterprises in Chinese context. Afr. J. Bus. Manag. 2012, 6, 521–529. [Google Scholar] [CrossRef]
  29. Keebler, J.S.; Plank, R.E. Logistics performance measurement in the supply chain: A benchmark. Benchmarking Int. J. 2009, 16, 785–798. [Google Scholar] [CrossRef]
  30. Chia, A.; Goh, M.; Hum, S. Performance measurement in supply chain entities: Balanced scorecard perspective. Benchmarking Int. J. 2009, 16, 605–620. [Google Scholar] [CrossRef]
  31. Jothimani, D.; Sarmah, S.P. Supply chain performance measurement for third party logistics. Benchmarking Int. J. 2014, 21, 944–963. [Google Scholar] [CrossRef]
  32. Poveda-Bautista, R.; Baptista, D.C.; García-Melón, M. Setting competitiveness indicators using BSC and ANP. Int. J. Prod. Res. 2012, 50, 4738–4752. [Google Scholar] [CrossRef] [Green Version]
  33. Norin, A. Airport Logistics: Modeling and Optimizing the Turn-around Process. Ph.D. Thesis, Linköping University, Norrköping, Sweden, 2008. [Google Scholar]
  34. Humphreys, I.; Francis, G. Performance measurement: A review of airports. Int. J. Transp. Manag. 2002, 1, 79–85. [Google Scholar] [CrossRef]
  35. Morrell, P.; Lu, C.H.-Y. Aircraft noise social cost and charge mechanisms—A case study of amsterdam airport schiphol. Transp. Res. Part D Transp. Environ. 2000, 5, 305–320. [Google Scholar] [CrossRef]
  36. Ignaccolo, M. Environmental capacity: Noise pollution at catania-fontanarossa international airport. J. Air Transp. Manag. 2000, 6, 191–199. [Google Scholar] [CrossRef]
  37. Konsta, K.; Plomaritou, E. Key performance indicators (kpis) and shipping companies performance evaluation: The case of greek tanker shipping companies. Int. J. Bus. Manag. 2012, 7. [Google Scholar] [CrossRef]
  38. Nathnail, E.; Gogas, M.; Adamos, G. Urban freight terminals: A sustainability cross-case analysis. Transp. Res. Procedia 2016, 16, 394–402. [Google Scholar] [CrossRef]
  39. Bentaleb, F.; Mabrouki, C.; Semma, A. Key performance indicators evaluation and performance measurement in dry port-seaport system: A multi criteria approach. J. ETA Marit. Sci. 2015, 3, 97–116. [Google Scholar] [CrossRef]
  40. Stoilova, S.; Kunchev, L. Study of criteria for evaluation of transportation with intermodal transport. In Proceedings of the 16th International Scientific Conference Engineering for Rural Development, Jelgava, Latvia, 24–26 May 2017. [Google Scholar]
  41. Carlucci, D. Evaluating and selecting key performance indicators: An ANP-based model. Meas. Bus. Excell. 2010, 14, 66–76. [Google Scholar] [CrossRef]
  42. Alvandi, M.; Fazli, S.; Yazdani, L.; Aghaee, M. An integrated mcdm method in ranking bsc perspectives and key performance indicators (kpis). Manag. Sci. Lett. 2012, 2, 995–1004. [Google Scholar] [CrossRef]
  43. Mladenovic, G.; Vajdic, N.; Wündsch, B.; Temeljotov-Salaj, A. Use of key performance indicators for ppp transport projects to meet stakeholders’ performance objectives. Built Environ. Proj. Asset Manag. 2013, 3, 228–249. [Google Scholar] [CrossRef]
  44. Podgórski, D. Measuring operational performance of osh management system-a demonstration of ahp-based selection of leading key performance indicators. Saf. Sci. 2015, 73, 146–166. [Google Scholar] [CrossRef]
  45. Stević, Ž. Izbor i merenje ključnih indikatora performansi u skladišnom sistemu. In Proceedings of the Internacionalni Naučni Skup SM 2015 Strategijski Menadžment i Sistemi Podrške Odlučivanju u Strategijskom Menadžmentu, Subotica-Palić, Serbia, 21 May 2015; pp. 931–938. [Google Scholar]
  46. Adler, N.; Liebert, V.; Yazhemsky, E. Benchmarking airports from a managerial perspective. Omega 2013, 41, 442–458. [Google Scholar] [CrossRef]
  47. Chung, T.W.; Ahn, W.C.; Jeon, S.M.; Van Thai, V. A benchmarking of operational efficiency in Asia Pacific international cargo airports. Asian J. Shipp. Logist. 2015, 31, 85–108. [Google Scholar] [CrossRef]
  48. Kılkış, Ş.; Kılkış, Ş. Benchmarking airports based on a sustainability ranking index. J. Clean. Prod. 2016, 130, 248–259. [Google Scholar] [CrossRef]
  49. Maclean, M.; Harvey, C.; Clegg, S.R. Conceptualizing historical organization studies. Acad. Manag. Rev. 2016, 41, 609–632. [Google Scholar] [CrossRef]
  50. Schmidberger, S.; Bals, L.; Hartmann, E.; Jahns, C. Ground handling services at european hub airports: Development of a performance measurement system for benchmarking. Int. J. Prod. Econ. 2009, 117, 104–116. [Google Scholar] [CrossRef]
  51. Akyuz, G.A.; Erkan, T.E. Supply chain performance measurement: A literature review. Int. J. Prod. Res. 2010, 48, 5137–5155. [Google Scholar] [CrossRef]
  52. Yew Wong, C.; Karia, N. Explaining the competitive advantage of logistics service providers: A resource-based view approach. Int. J. Prod. Econ. 2010, 128, 51–67. [Google Scholar] [CrossRef]
  53. Qureshi, M.N.; Kumar, D.; Kumar, P. An integrated model to identify and classify the key criteria and their role in the assessment of 3PL services providers. Asia Pac. J. Mark. Logist. 2008, 20, 227–249. [Google Scholar] [CrossRef]
  54. Shaik, M.N.; Abdul-Kader, W. Performance measurement of reverse logistics enterprise: A comprehensive and integrated approach. Meas. Bus. Excell. 2012, 16, 23–34. [Google Scholar] [CrossRef]
  55. Zavadskas, E.K.; Stević, Ž.; Tanackov, I.; Prentkovskis, O. A novel multicriteria approach–Rough Step-Wise Weight Assessment Ratio Analysis method (R-SWARA) and its application in logistics. Stud. Inf. Control 2018, 27, 97–106. [Google Scholar] [CrossRef]
  56. Zavadskas, E.K.; Turskis, Z. A new additive ratio assessment (aras) method in multicriteria decision-making. Technol. Econ. Dev. Econ. 2010, 16, 159–172. [Google Scholar] [CrossRef]
  57. Turskis, Z.; Zavadskas, E.K. A new fuzzy additive ratio assessment method (aras-f). Case study: The analysis of fuzzy multiple criteria in order to select the logistic centers location. Transport 2010, 25, 423–432. [Google Scholar] [CrossRef]
  58. Turskis, Z.; Zavadskas, E.K. A novel method for multiple criteria analysis: Grey Additive Ratio Assessment (ARAS-G) method. Informatica 2010, 21, 597–610. [Google Scholar]
  59. Pawlak, Z. Rough Sets: Theoretical Aspects of Reasoning about Data; Springer: Berlin, Germany, 1991. [Google Scholar]
  60. Pawlak, Z. Anatomy of conflicts. Bull. Eur. Assoc. Theor. Comput. Sci. 1993, 50, 234–247. [Google Scholar]
  61. Mardani, A.; Nilashi, M.; Zavadskas, E.K.; Awang, S.R.; Zare, H.; Jamal, N.M. Decision making methods based on fuzzy aggregation operators: Three decades review from 1986 to 2017. Int. J. Inf. Technol. Decis. Mak. 2018, 17, 391–466. [Google Scholar] [CrossRef]
  62. Nowaková, J.; Prílepok, M.; Snášel, V. Medical image retrieval using vector quantization and fuzzy s-tree. J. Med. Syst. 2016, 41. [Google Scholar] [CrossRef]
  63. Kumar, A.; Kumar, D.; Jarial, S.K. A hybrid clustering method based on improved artificial bee colony and fuzzy C-Means algorithm. Int. J. Artif. Intell. 2017, 15, 24–44. [Google Scholar]
  64. Lukovac, V.; Popović, M. Fuzzy Delphi approach to defining a cycle for assessing the performance of military drivers. Decis. Mak. Appl. Manag. Eng. 2018, 1, 67–81. [Google Scholar] [CrossRef]
  65. Medina, J.; Ojeda-Aciego, M. Multi-adjoint t-concept lattices. Inf. Sci. 2010, 180, 712–725. [Google Scholar] [CrossRef]
  66. Pozna, C.; Minculete, N.; Precup, R.-E.; Kóczy, L.T.; Ballagi, Á. Signatures: Definitions, operators and applications to fuzzy modelling. Fuzzy Sets Syst. 2012, 201, 86–104. [Google Scholar] [CrossRef]
  67. Stojić, G.; Stević, Ž.; Antuchevičienė, J.; Pamučar, D.; Vasiljević, M. A Novel Rough WASPAS Approach for Supplier Selection in a Company Manufacturing PVC Carpentry Products. Information 2018, 9, 121. [Google Scholar] [CrossRef]
  68. Keršuliene, V.; Zavadskas, E.K.; Turskis, Z. Selection of rational dispute resolution method by applying new step-wise weight assessment ratio analysis (swara). J. Bus. Econ. Manag. 2010, 11, 243–258. [Google Scholar] [CrossRef]
  69. Petrović, G.S.; Madić, M.; Antucheviciene, J. An approach for robust decision making rule generation: Solving transport and logistics decision making problems. Expert Syst. Appl. 2018, 106, 263–276. [Google Scholar] [CrossRef]
  70. Karavidić, Z.; Projović, D. A multi-criteria decision-making (MCDM) model in the security forces operations based on rough sets. Decis. Mak. Appl. Manag. Eng. 2018, 1, 97–120. [Google Scholar] [CrossRef]
  71. Radović, D.; Stević, Ž. Evaluation and selection of KPI in transport using SWARA method. Transp. Logist. 2018, 44, 60–68. [Google Scholar]
  72. Roy, J.; Chatterjee, K.; Bandhopadhyay, A.; Kar, S. Evaluation and selection of Medical Tourism sites: A rough AHP based MABAC approach. arXiv 2016, arXiv:1606.08962. [Google Scholar] [CrossRef]
  73. Stević, Ž.; Pamučar, D.; Vasiljević, M.; Stojić, G.; Korica, S. Novel integrated multi-criteria model for supplier selection: Case study construction company. Symmetry 2017, 9, 279. [Google Scholar] [CrossRef]
  74. Vesković, S.; Stević, Ž.; Stojić, G.; Vasiljević, M.; Milinković, S. Evaluation of the railway management model by using a new integrated model DELPHI-SWARA-MABAC. Decis. Mak. Appl. Manag. Eng. 2018. [Google Scholar] [CrossRef]
  75. Dey, B.; Bairagi, B.; Sarkar, B.; Sanyal, S.K. Multi objective performance analysis: A novel multi-criteria decision making approach for a supply chain. Comput. Ind. Eng. 2016, 94, 105–124. [Google Scholar] [CrossRef]
Figure 1. The proposed model.
Figure 1. The proposed model.
Symmetry 10 00434 g001
Figure 2. A hierarchical structure of performance measurement in transportation companies in three different countries.
Figure 2. A hierarchical structure of performance measurement in transportation companies in three different countries.
Symmetry 10 00434 g002
Figure 3. Rank of alternatives through various scenarios.
Figure 3. Rank of alternatives through various scenarios.
Symmetry 10 00434 g003
Figure 4. The Spearman’s correlation coefficient (SCC) through 10 scenarios.
Figure 4. The Spearman’s correlation coefficient (SCC) through 10 scenarios.
Symmetry 10 00434 g004
Figure 5. Ranking alternatives according to various rough multi-criteria decision-making models (MCDM) methods.
Figure 5. Ranking alternatives according to various rough multi-criteria decision-making models (MCDM) methods.
Symmetry 10 00434 g005
Table 1. Explanation of indicators used in this research.
Table 1. Explanation of indicators used in this research.
IndicatorExplanation
Coefficient of time utilizationCoefficient of time utilization (total working time of vehicles (h)/total number of available hours per month, whereby 1 day = 24 h) × 100 (%)
Number of km per vehicleNumber of km per vehicle (total number of kilometers/total number of vehicles)
Number of routes per vehicleNumber of routes per vehicle (total number of routes/total number of vehicles)
Number of routes per driverNumber of routes per driver (total number of routes/total number of drivers)
Number of tours per vehicleNumber of tours per vehicle (total number of tours/total number of vehicles)
Coefficient of working vehicle utilizationCoefficient of working vehicle utilization (total number of working vehicles per month/number of vehicles per day x number of working days) × 100 (%)
Average number of routes per dayAverage number of routes per day (total number of routes/number of working days)
Number of tours per driverNumber of tours per driver (total number of tours/total number of drivers)
Number of tours per routeNumber of tours per route (total number of tours/total number of routes)
Coefficient of weight utilizationCoefficient of weight utilization (total weight of transported goods/total available weight load capacity of vehicle per month) × 100 (%)
Load capacity per monthLoad capacity per month (total available weight load capacity of vehicle per day × average number of tours per type of vehicle per day × number of working days in a month)
Number of routes per employerNumber of routes per employer (total number of routes/total number of employees)
Coefficient of utilization in palletsCoefficient of utilization in pallets (total number of transported pallets/number of available pallet spaces) × 100 (%)
Costs per driverCosts per driver (total transport costs/total number of drivers)
Coefficient of parked vehicleCoefficient of parked vehicle (total number of vehicles in parking space per month/number of vehicles per day × number of working days) × 100 (%)
Average number of tours per dayAverage number of tours per day (total number of tours/number of working days)
Fuel cost per total kmFuel cost per total km (total fuel cost/total number of crossed kilometers)
Cost per realized routeCost per realized route (total transport costs/total number of routes)
Cost per kmCost per km (total transport costs/total number of crossed kilometers)
Coefficient of damaged vehicleCoefficient of damaged vehicle (total number of damaged vehicles per month/number of vehicles per day × number of working days) × 100 (%)
Table 2. Evaluation of alternatives by six decision-makers.
Table 2. Evaluation of alternatives by six decision-makers.
A1A2A3
E1E2E3E4E5E6E1E2E3E4E5E6E1E2E3E4E5E6
C1999777799777799777
C2577557131111577557
C3797957797977795957
C4777755779955777755
C5799777577553799777
C6779977757777757777
C7553333555355531333
C8779775557755557755
C9957797735553957775
C10577555353335353335
C11999799753335999777
C12555535755535553335
C13777979999999553577
C14311335311335311335
C15153533977979977979
C16733333999979733333
C17999999311313979999
C18977977755735755757
C19111111113111133111
C20735737311111957959
A4A5A6
C1355333357355355333
C2353335333335353335
C3331311331311331311
C4131311131311131311
C5353311353311353311
C6999997777777999997
C7111111333333311111
C8111111333333111111
C9957775755553755753
C10577555577555597555
C11753335753335753335
C12111111111111111111
C13533557553577533557
C14535555535555535555
C15111111111111111111
C16513111733333513111
C17111111111111111111
C18977977999977977977
C19333331575775333331
C20111111111111111111
A7A8A9
C1351313577355355333
C2999979777759131111
C3555755797977999999
C4355551777957999999
C5577553799777999999
C6111331535553111331
C7797577111111999999
C8335335799777999999
C9999997735553311111
C10577555999777999777
C11111111331111111111
C12553335997979997999
C13777779797999999999
C14757777979979111131
C15111111131133111111
C16775555513111999779
C17597555333333111111
C18735535755557111113
C19353531113111333331
C20333333111331111111
Table 3. Calculation of aggregated values for the initial group rough matrix for the first alternative.
Table 3. Calculation of aggregated values for the initial group rough matrix for the first alternative.
Low LimitUpper Limit
E1E2E3E4E5E6E1E2E3E4E5E6A1
C18.008.008.007.007.007.009.009.009.008.008.008.007.508.50
C25.006.006.005.005.006.006.007.007.006.006.007.005.506.50
C36.507.336.507.335.006.507.809.007.809.007.337.806.538.12
C46.336.336.336.335.005.007.007.007.007.006.336.335.896.78
C57.007.677.677.007.007.007.679.009.007.677.677.677.228.11
C67.007.007.677.677.007.007.677.679.009.007.677.677.228.11
C73.673.673.003.003.003.005.005.003.673.673.673.673.224.11
C86.606.607.006.606.605.007.407.409.007.407.407.006.407.60
C97.335.006.506.507.336.509.007.337.807.809.007.806.538.12
C105.005.675.675.005.005.005.677.007.005.675.675.675.226.11
C118.678.678.677.008.678.679.009.009.008.679.009.008.398.95
C124.674.674.674.673.004.675.005.005.005.004.675.004.394.95
C137.007.007.007.677.007.677.677.677.679.007.679.007.228.11
C142.201.001.002.202.202.673.502.672.673.503.505.001.883.47
C151.003.332.503.332.502.503.335.003.805.003.803.802.534.12
C163.673.003.003.003.003.007.003.673.673.673.673.673.114.23
C179.009.009.009.009.009.009.009.009.009.009.009.009.009.00
C187.677.007.007.677.007.009.007.677.679.007.677.677.228.11
C191.001.001.001.001.001.001.001.001.001.001.001.001.001.00
C205.333.003.675.333.005.337.005.336.507.005.337.004.286.36
Table 4. The initial rough matrix.
Table 4. The initial rough matrix.
A1A2A3A4A5A6A7A8A9Ao
C1[7.5, 8.5][7.22, 8.11][7.22, 8.11][3.22, 4.11][3.88, 5.47][3.22, 4.11][1.88, 3.47][4.53, 6.12][3.22, 4.11][7.5, 8.5]
C2[5.5, 6.5][1.06, 1.61][5.5, 6.5][3.22, 4.11][3.06, 3.61][3.22, 4.11][8.39, 8.95][6.4, 7.6][1.06, 1.61][8.39, 8.95]
C3[6.53, 8.12][7.22, 8.11][6.8][1.5, 2.5][1.5, 2.5][1.5, 2.5][5.06, 5.61][7.22, 8.11][9.9][9.9]
C4[5.89, 6.78][6.8][5.89, 6.78][1.22, 2.11][1.22, 2.11][1.22, 2.11][3.17, 4.77][6.4, 7.6][9.9][9.9]
C5[7.22, 8.11][4.53, 6.12][7.22, 8.11][1.88, 3.47][1.88, 3.47][1.88, 3.47][4.53, 6.12][7.22, 8.11][9.9][9.9]
C6[7.22, 8.11][6.39, 6.95][6.39, 6.95][8.39, 8.95][7.7][8.39, 8.95][1.22, 2.11][3.89, 4.78][1.22, 2.11][8.39, 8.95]
C7[3.22, 4.11][4.39, 4.95][2.4, 3.6][1.1][3.3][1.06, 1.61][6.4, 7.6][1.1][9.9][9.9]
C8[6.4, 7.6][5.22, 6.11][5.22, 6.11][1.1][3.3][1.1][3.22, 4.11][7.22, 8.11][9.9][9.9]
C9[6.53, 8.12][3.88, 5.47][5.88, 7.47][5.88, 7.47][4.4, 5.6][4.53, 6.12][8.39, 8.95][3.88, 5.47][1.06, 1.61][8.39, 8.95]
C10[5.22, 6.11][3.22, 4.11][3.22, 4.11][5.22, 6.11][5.22, 6.11][5.23, 6.83][5.22, 6.11][7.5, 8.5][7.5, 8.5][7.5, 8.5]
C11[8.39, 8.95][3.49, 5.22][7.5, 8.5][3.49, 5.22][3.49, 5.22][3.49, 5.22][1.1][1.22, 2.11][1.1][8.39, 8.95]
C12[4.39, 4.95][4.4, 5.6][3.5, 4.5][1.1][1.1][1.1][3.5, 4.5][7.89, 8.78][8.39, 8.95][8.39, 8.95]
C13[7.22, 8.11][9.9][4.53, 6.12][3.88, 5.47][4.53, 6.12][3.88, 5.47][7.06, 7.61][7.89, 8.78][9.9][9.9]
C14[1.88, 3.47][1.88, 3.47][1.88, 3.47][4.39, 4.95][4.39, 4.95][4.39, 4.95][6.39, 6.95][7.89, 8.78][1.06, 1.61][1.06, 1.61]
C15[2.53, 4.12][7.5, 8.5][7.5, 8.5][1.1][1.1][1.1][1.1][1.5, 2.5][1.1][1.1]
C16[3.11, 4.23][8.39, 8.95][3.11, 4.23][1.23, 2.83][3.11, 4.23][1.23, 2.83][5.22, 6.11][1.23, 2.83][7.89, 8.78][8.39, 8.95]
C17[9.9][1.5, 2.5][8.39, 8.95][1.1][1.1][1.1][5.23, 6.83][3.3][1.1][1.1]
C18[7.22, 8.11][4.53, 6.12][5.5, 6.5][7.22, 8.11][7.89, 8.78][7.22, 8.11][3.88, 5.47][5.22, 6.11][1.06, 1.61][1.06, 1.61]
C19[1.1][1.06, 1.61][1.22, 2.11][2.39, 2.95][5.5, 6.5][2.39, 2.95][2.53, 4.12][1.06, 1.61][2.39, 2.95][1.06, 1.61]
C20[4.28, 6.36][1.06, 1.61][6.28, 8.36][1.1][1.1][1.1][3.3][1.22, 2.11][1.1][1.1]
Table 5. The inverse values of cost criteria obtained by applying Equation (4).
Table 5. The inverse values of cost criteria obtained by applying Equation (4).
C14C15C17C18C19
A10.290.530.240.400.110.110.120.141.001.00
A20.290.530.120.130.400.670.160.220.620.94
A30.290.530.120.130.110.120.150.180.470.82
A40.200.231.001.001.001.000.120.140.340.42
A50.200.231.001.001.001.000.110.130.150.18
A60.200.231.001.001.001.000.120.140.340.42
A70.140.161.001.000.150.190.180.260.240.40
A80.110.130.400.670.330.330.160.190.620.94
A90.620.941.001.001.001.000.620.940.340.42
Ao0.620.941.001.001.001.000.620.940.620.94
SUM2.974.456.887.336.106.422.393.284.756.48
Table 6. The normalized matrix.
Table 6. The normalized matrix.
C1C2C3C8C9C10C19C20
A10.120.170.100.140.100.150.120.150.100.150.080.110.150.210.020.03
A20.120.160.020.040.110.150.090.120.060.100.050.070.100.200.080.14
A30.120.160.100.140.090.150.090.120.090.140.050.070.070.170.020.02
A40.050.080.060.090.020.050.020.020.090.140.080.110.050.090.130.15
A50.060.110.060.080.020.050.050.060.070.110.080.110.020.040.130.15
A60.050.080.060.090.020.050.020.020.070.120.080.120.050.090.130.15
A70.030.070.160.200.080.100.060.080.130.170.080.110.040.080.040.05
A80.070.120.120.170.110.150.130.160.060.100.120.150.100.200.060.12
A90.050.080.020.040.140.170.160.180.020.030.120.150.050.090.130.15
Ao0.120.170.160.200.140.170.160.180.130.170.120.150.100.200.130.15
Table 7. The weighted normalized rough matrix.
Table 7. The weighted normalized rough matrix.
C1C2C8C9C10C19C20
A10.0090.0120.0070.0100.0060.0080.0050.0080.0040.0060.0060.0080.0010.001
A20.0080.0110.0010.0020.0050.0070.0030.0060.0030.0040.0040.0080.0030.005
A30.0080.0110.0070.0100.0050.0070.0050.0080.0030.0040.0030.0070.0010.001
A40.0040.0060.0040.0060.0010.0010.0050.0080.0040.0060.0020.0030.0050.006
A50.0040.0080.0040.0050.0030.0030.0040.0060.0040.0060.0010.0010.0050.006
A60.0040.0060.0040.0060.0010.0010.0040.0060.0040.0070.0020.0030.0050.006
A70.0020.0050.0110.0140.0030.0040.0070.0090.0040.0060.0010.0030.0020.002
A80.0050.0090.0080.0120.0070.0090.0030.0060.0060.0080.0040.0080.0020.005
A90.0040.0060.0010.0020.0090.0100.0010.0020.0060.0080.0020.0030.0050.006
Ao0.0090.0120.0110.0140.0090.0100.0070.0090.0060.0080.0040.0080.0050.006
Table 8. Results and ranking of alternatives using the rough additive ratio assessment (ARAS) approach.
Table 8. Results and ranking of alternatives using the rough additive ratio assessment (ARAS) approach.
SiKiRank
A1[0.09, 0.13][0.48, 0.89]2
A2[0.08, 0.13][0.43, 0.85]3
A3[0.08, 0.12][0.41, 0.81]5
A4[0.06, 0.09][0.31, 0.59]8
A5[0.06, 0.09][0.33, 0.6]7
A6[0.06, 0.09][0.31, 0.59]9
A7[0.07, 0.1][0.38, 0.71]6
A8[0.08, 0.12][0.43, 0.81]4
A9[0.11, 0.15][0.58, 1.01]1
Table 9. Statistical comparison of ranks for different methods.
Table 9. Statistical comparison of ranks for different methods.
MethodsR-ARASR-WASPASR-SAWR-MABACR-EDASAverage
R-ARAS1.0001.0001.0000.9670.9330.980
R-WASPAS-1.0001.0000.9670.9330.975
R-SAW--1.0000.9670.9330.967
R-MABAC---1.0000.9830.992
R-EDAS----1.0001.000
Overall average0.983

Share and Cite

MDPI and ACS Style

Radović, D.; Stević, Ž.; Pamučar, D.; Zavadskas, E.K.; Badi, I.; Antuchevičiene, J.; Turskis, Z. Measuring Performance in Transportation Companies in Developing Countries: A Novel Rough ARAS Model. Symmetry 2018, 10, 434. https://doi.org/10.3390/sym10100434

AMA Style

Radović D, Stević Ž, Pamučar D, Zavadskas EK, Badi I, Antuchevičiene J, Turskis Z. Measuring Performance in Transportation Companies in Developing Countries: A Novel Rough ARAS Model. Symmetry. 2018; 10(10):434. https://doi.org/10.3390/sym10100434

Chicago/Turabian Style

Radović, Dunja, Željko Stević, Dragan Pamučar, Edmundas Kazimieras Zavadskas, Ibrahim Badi, Jurgita Antuchevičiene, and Zenonas Turskis. 2018. "Measuring Performance in Transportation Companies in Developing Countries: A Novel Rough ARAS Model" Symmetry 10, no. 10: 434. https://doi.org/10.3390/sym10100434

APA Style

Radović, D., Stević, Ž., Pamučar, D., Zavadskas, E. K., Badi, I., Antuchevičiene, J., & Turskis, Z. (2018). Measuring Performance in Transportation Companies in Developing Countries: A Novel Rough ARAS Model. Symmetry, 10(10), 434. https://doi.org/10.3390/sym10100434

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop