Next Article in Journal
The Projected Impact of a Neighborhood-Scaled Green-Infrastructure Retrofit
Previous Article in Journal
International Occupational Health and Safety Management-Systems Standards as a Frame for the Sustainability: Mapping the Territory
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:

Measuring the Macroeconomic Performance among Developed Countries and Asian Developing Countries: Past, Present, and Future

Department of Industrial Engineering and Management, National Kaohsiung University of Science and Technology, Kaohsiung 80778, Taiwan
Department of Tourism Management, Dalat University, Da Lat 66000, Vietnam
Authors to whom correspondence should be addressed.
Sustainability 2018, 10(10), 3664;
Submission received: 1 September 2018 / Revised: 10 October 2018 / Accepted: 11 October 2018 / Published: 13 October 2018


The purpose of this paper is to measure and forecast the macroeconomic performance in developed countries and Asian developing countries over the periods from 2013 to 2016 and 2017 to 2020. We used four macroeconomic indicators: government gross debt, real GDP growth, inflation rate, and unemployment rate to construct a scalar-valued summary measure of macroeconomic performance. These indicators are inspired by data envelopment analysis (DEA)-based models, which allow for unequal weighting of the different economic objectives. Based on the resampling models of DEA, we developed a research procedure for solving the macroeconomic performance problem by integrating gauge and forecast. Two variants of resampling models of DEA, i.e., past-present and past-present-future, were used to gauge and forecast the relative performance for each country in each year. Throughout the analysis, emphasis is placed on a comparison of the performances of 12 Asian developing countries with those of the five developed countries. Our empirical results reveal that Switzerland, Singapore, and the United States have achieved the most successful macroeconomic management in a time-series.

1. Introduction

The stability of a macroeconomic environment plays an important role for business and, therefore, has significance for the overall competitiveness of a country. Although it is certainly true that macroeconomic stability alone cannot increase the productivity of a nation, it is also recognized that macroeconomic disarray harms the economy [1]. As we have seen over the past years in the European community, a government cannot provide services efficiently if it has to make high interest payments on its past debts. Furthermore, firms cannot operate efficiently when inflation rates are out of hand. In summary, the economy cannot grow in a sustainable manner unless the macro environment is stable. Each economy has an apparatus responsible for the conduct of its macroeconomic policy, i.e., the helmsman [2]. Initially, the helmsmen are assumed to provide varying amounts of macroeconomic services. Some macroeconomic services include a high level of real GDP per capita, a low rate of inflation, a high employment rate, a favorable trade balance, and so on. Thus, macroeconomic performance is evaluated in terms of the ability of the helmsmen in each country to maximize provision of these fundamental macroeconomic services.
Various contributions in the past have measured macroeconomic performance using different approach. First is Okun’s misery index [3]. The Okun index of a nation is defined as the sum of both its unemployment rate and inflation rate. The Calmfors–Driffill index was developed by Calmfors and Driffill [4]. The measure is obtained as the sum of unemployment rate and trade balance normalized by its gross national product. Both these measures give useful information but still flawed. The Okun and Calmfors–Driffill index are obtained by using two single indicators (unemployment rate, inflation rate and the sum of unemployment rate, trade balance) and both attach equal unitary weights to their respective components. The OECD’s “magic diamond” is rebased on four macroparameters such as GDP growth, trade balance, inflation, and unemployment, but also attaches equal unitary weights to its components. The implicit assumption that policymakers assess all policy goals equally important, or, in other words, that no priorities are attributed. This seems an unrealistic hypothesis. Equality across components is unnecessarily because they depend each countries’ different objective through time. That means that sometimes a lower value is again associated with better macroeconomic performance, and whenever there is need for a change in policy priorities, the policymakers face tradeoffs among these objectives. So, the main shortcoming of these gauges is the arbitrary weighting scheme they share. Therefore, it is imperative to seek a scientific methodology that helps one to determine unequal weights for macro indicators, which the weight of each indicator reflecting the policy priority assumed by the policy-makers. The emergence of DEA well suited to obtain such synthetic indicators. It allows for a ranking of economies on the basic of their relative performance.
The DEA was introduced by Charnes et al. [5]. They proposed a “data oriented” approach for measuring the performance of multiple decision-making units (DMUs) by converting multiple inputs into outputs. DMU could include schools, universities, bank, hospitals, power plants, etc. In the past few years, some researchers have implemented the DEA approach to measure environmental, energy, and economic performance in economies and regions. Wang et al. used data envelopment analysis and the heuristic technique approach to help department stores find the most suitable partners for strategic alliances [6]. Yuan and Tian applied the DEA model to analyze the science and technology resources efficiency of industrial enterprises. The results reflected the independence of the input element and the concentration of the output element [7]. Wu et al. assessed the industrial energy efficiency with CO2 emissions in China by means of DEA [8]. Egilmez et al. employed DEA to analyze the sustainability performance and improve the energy efficiency of the U.S. manufacturing sector [9]. Chang used the DEA model and directional distance function model to measure the overall efficiency of G7 and BRICS countries. The study found out that G7 countries have higher efficiency than BRICS countries before 2005 [10].
Some other researchers have implemented the DEA approach to measure macroeconomic performance (MEP) of economies. For instance, Lovell [11] used mathematical programming techniques of efficiency measurement to construct a “best practice” macroeconomic performance frontier, and then to measure performance in terms of an indicator-based efficiency score. The paper is applied to 10 Asian economies, with special attention paid to Taiwan in the period 1970 to 1988. Lovell et al. [12] studied the macroeconomic performance of 17 OECD countries over the period from 1970 to 1990 using data envelopment analysis (DEA). Cherchye [13] used a DEA-based model, which allowed for unequal weighting of the different economic objectives. The study provided a comparison of several synthetic indicators that merged four separate indicators into a single statistic. Despite the similarity of the research model, the results of the previous studies had differences. To be specific, Lovell [11] established a scalar-valued measure of the macroeconomic performance of an economy. However, in this application there are no inputs and only contains four outputs (GDP growth, employment, trade balance, and price stability). Moreover, the study was conducted in a small scale of 10 economies in Asian for varying lengths of time, it was difficult to come up with a convincing overall performance ranking. Or Cherchye [13] who provided a comparison of several synthetic indicators that merged four separate indicators into one single statistic to evaluate 20 OECD countries for four years. Our study has produced outstanding results when selecting four indicators (government’s gross debt, real GDP growth, inflation rate, and unemployment rate) as inputs/outputs. Of which, the government gross debt indicator is replaced by the trade balance indicator of Lovell [11]. Data was collected from 17 economies show the big picture of macroeconomic.
Notably, unlike in the earlier convergence study, the highlight of the current study is predicting macroeconomic performance based on historical data using new resampling models in the DEA approach. A traditional DEA model is known as a measure of the effectiveness of DMUs based on past data. In this model, Tone and Ouenniche [14] proposed two resampling models, in which the first model utilizes historical data, e.g., past-present, for estimating data variations, imposing chronological order weights that are supplied by the Lucas series. The second model deals with future prospects that aims at forecasting the future efficiency score and its confidence interval for each DMU. By combining with the super-SBM model, none of the past studies were able to provide a comprehensive picture from the past, present, and future concerning macroeconomic performance. Therefore, this present study is considered the first of its kind in assessing and forecasting the relative performance of Asian developing economies by simultaneously considering all the macro indicators; at the same time, it helps one to see the overall picture of global macroeconomic performance.
One of the contributions of this study uses of the resampling model, i.e., a new DEA model included in our research. Resampling models are new models developed by Tone and Ouenniche in 2016 [14]. In this model, Tone and Ouenniche proposed new resampling models, based on these variations, for gauging the confidence intervals of DEA scores. The first model utilizes past-present data for estimating data variations imposing chronological order weights that are supplied by the Lucas series. The second model deals with future prospects. This model aims at forecasting the future efficiency score and its confidence interval for each DMU.
The goal of this study is to combine the popular super-SBM model in DEA with two new models in resampling to build “a model combining assessment and forecasting of macroeconomic performance” from past, present, and future. To the best of our knowledge, no previous research has done this; not only is this new to the field of macroeconomic performance, but it can be applied to other research subjects.
In this paper, we integrate DEA models to gauge and forecast the relative performance of economies, in which the authors applied the super-SBM model and the past-present model to combine ranking and evaluating performance year by year for the period of 2014 to 2016. Then, the authors used two resampling models, i.e., past-present and past-present-future, to evaluate and forecast the next years for the period of 2017 to 2019. In this study, Lucas weights were used for past and present data, selecting 500 replicas, and evaluating confidence intervals before performance analysis. The study was divided into five parts, as shown in Figure 1.

2. Materials and Methods

2.1. Macroeconomic Data

Each country has an apparatus responsible for conducting its macroeconomic policy. Although the size and organizational structure of this bureaucracy vary across countries, through time, the authors view such variation as irrelevant to the objective of research. What matters is its macroeconomic performance. All data used in the analysis are taken from various International Monetary Fund (IME) publications and the World Bank. Data for the labor capital indicator are taken from the World Bank [15], while the five remaining indicators are taken from annual issues of the IMF’s World Economic Outlook, Balance of Payments Statistics, and International Financial Statistics [16]. Due to data availability of Asian developing countries, this study takes the data of 12 economies in the area as a sample. Moreover, the authors added five countries with the highest global competitiveness index (GCI) in the world for analysis. This makes it more abundant to compare the effectiveness of macroeconomic policies. All data cover 17 countries over the period from 2013 to 2016.
The authors follow the principles stated in Cook, Tone, and Zhu [17] in this study and believe that DEA performance measures are relative, not absolute, and frontier-dependent. The use of inputs and outputs are proportionate to the number of DMUs. The variables selected to reflect the macroeconomic performance of the economies are as follows:
1. Government gross debt: Government’s gross debt to GDP ratio is the amount of a country’s total gross government debt as a percentage of its GDP. It is an indicator of an economy’s health and a key factor for the sustainability of government finance [16].
2. Real GDP growth: Gross domestic product is the most commonly used single measure of a country’s overall economic activity.
3. Inflation rate: Inflation is a sustained increase in the general price levels of goods and services in an economy over a period of time. Inflation reflects a reduction in the purchasing power per unit of money of an economy [18]. Inflation is defined as the rate of percent change in the consumer price index (PCI) [16].
4. Unemployment rate: Number of employed persons as a percentage of the total labor force. Employment rate is defined (E/L)t, i.e., the ratio of civilian employment (E) to the civilian labor force (L). Employment rate in the longer term is significantly affected by a government’s policies [19].
Because a government’s gross debt, inflation rate, and unemployment rate are undesirable factors, we convert them to a measure of “uninflation”, “employment”, and “government gross debt”. The indicators of real GDP growth, employment rate, and price stability each take on strictly positive values for all observations. General government gross debt takes on negative values for some observations, and DEA is not capable of dealing with negative values. Consequently, general government gross debt has been transformed to a (0–100) scale prior to analysis. Variable transformations are given by [11] transformed output = α + β (raw output), where α = 100(min/(max − min), β = 100/(max − min).
Table 1 shows a summary of statistics for input and output factors for selected countries between 2013–2016. The paper points out government gross debt, real GDP growth, the inflation rate, and unemployment rate of 17 economies.

2.2. Methodology

2.2.1. Resampling model in DEA

In principle one might choose from a relatively wide range of DEA models. However, Tone and Ouenniche [14] recommended the use of the non-oriented super slacks-based measure model (previously called the super-SBM model) [20] under the constant returns-to-scale (CRS) assumption for evaluating the relative efficiency. This model was an extension of the SBM [21].

2.2.2. Historical Data Model (Past-Present Based Framework)

Historical data (previously called past-present information): Let the historical set of the input and output matrix be (Xt, Yt) (t = 1, …, T). where t = 1 is the first period and t = T is the last period with X t = ( x 1 t , x n t ) and Y t = ( y 1 t , y n t ) . The number of the DMU is n, and x j t R m and y j t R s are the input and output vectors of DMUj, respectively.
Choice of a weighting scheme for historical data: Tone and Ouenniche [14] used Lucas weight to weight information on the past and the present. By setting the weight wt to period t and assuming the weight is increasing in t. For this purpose, the following Lucas number series (l1, …, lT) (a variant of Fibonacci series) was a candidate where we had
lt+2 = lt + lt+1 (t = 1, …, T, T − 2; l1 = 1, l2 = 2)
Let the sum be L = t = 1 T l t and weight wt is defined by:
wt = lt/L (t = 1, …, T).
In this paper, we set T = 4, we had w1 = 0.0909, w2 = 0.1818, w3 = 0.2727, and w4 = 0.4545. Thus, the influence of the past period faded away gradually.
Super-efficiency scores: Tone and Ouenniche [14] used historical data (Xt, Yt) (t = 1, …, T) to gauge the confidence interval (CI) of the last period’s scores. The super-efficiency scores of the last period’s DMUs were evaluated firstly. Then, DMU’s CI was gauged using replicas from (Xt, Yt) (t = 1, …, T) as follows.
Choice of the replication process and the number of replicas: The historical data (Xt, Yt) (t = 1, …, T) was regarded as discrete events with probability wt and cumulative probability:
W t = i = 1 t w i ( t = 1 , , T ) .
The replication process based on bootstrapping was first proposed by Efron [22]. Bootstrapping refers to a collection of method that randomly resample with replacement for the original sample. Bootstrapping could be either parametric or nonparametric. For a noncorrelated and homoskedastic dataset, one could for example use smooth bootstrapping or Bayesian bootstrapping, where smooth bootstrapping generates replicas by adding small amounts of zero-centered random noise to resampled observations, whereas Bayesian bootstrapping generates replicas by reweighting the initial data set according to a randomly generated weighting scheme.
In this paper, we use a variant of Bayesian bootstrapping whereby the weighting scheme consists of the Lucas number series-based weights wt presented above, because it is more appropriate when one is resampling over a past-present time frame and more recent information is considered more valuable. For a noncorrelated and homoskedastic dataset, our data generation process (DGP) in this study may be summarized as follows. First, a random number Ϛ is draw from the uniform distribution over the interval [0, 1], the whichever cross section data (Xt, Yt) so that Wt−1< Ϛ < Wt is resampled, where W0 = 0. This process is repeated as many times as necessary to produce the required number of valid replicas or samples.
There is no general rule to the choice the number of replicas B except that the larger the value of B the more stable the results [14]. However, we would keep increasing the value of B until the simulation converges. That mean the results from a run do not change when adding more iterations.
Fisher’s z transformation: Computing the correlation coefficient of two inputs (outputs and input vs. output) items of the last period data over the all DMUs. Then, calculating its ζ % confidence interval, e.g., 95%, using Fisher’s z transformation [23,24]. If the corresponding correlation of a resample data was out of range of this interval, we discard this resample data. The same process between all pair of inputs, outputs, and input vs. output were executed. Thus, inappropriate samples with unbalanced inputs and outputs relative to the inputs and outputs of the last period are excluded from resampling. The above noted 95% confidence interval was not compulsory. The narrower the interval, the closer the resample would be to the last period data.

2.2.3. Resampling with Future Forecasting or Past-Present-Future Model

Tone and Ouenniche [14] forecasted “future” (Xt+1, Yt+1) by using “past-present” data (Xt, Yt) (t = 1, …, T) and forecast the efficiency scores of the future DMUs with their confidence intervals.
Forecasting future data: Let ht (t = 1, …, T) be the observed historical data for a certain input/output of a DMU. Wishing to forecast hT+1 from ht (t = 1, …, T). There are three scenarios of forecasting engines available for this purpose. First, trend analysis: a simple linear least square regression. Second, weight average: weight by Lucas number. And finally, the average of trend and weight averae. In this study, we chose a Lucas weight analysis scenario to forecast for the problem at hand. By applying the Lucas weight forecasting model, we obtained data set (Xt+1, Yt+1). Then, we assumed the super-efficiency for the “future” DMU (Xt+1, Yt+1).

3. Empirical Analysis of Macroeconomic Performance

3.1. Preliminary Results

Table 2 and Figure 2 show the variation of efficiency scores of economies from 2013 to 2016 and average of four years source-calculated by the researcher. In general, the efficiency scores fluctuated by year. From the results of comparing the averages of four years, we found that the average 0.659 of year 2013 was the lowest score whereas year 2014 had the highest score.
Some economies in Asian developing areas (Cambodia, China, Indonesia, Philippines, and so on) had the lowest efficiency scores and the most invariable efficiency scores in economies which accounted for approximately 5.0. Singapore was the only country in the areas achieving relavitely high performance scores from 1.141 in 2013, 0.0872 in 2014, 1.107 in 2015, and 1.049 in 2016.
Next, some countries such as the United Kingdom, Switzerland, and Germany still had higher scores than the rest. Germany peaked at 1.664 in 2013, fell suddenly in 2014 with a score of 0.979 and remained at 0.996 and 0.788 for 2015 and 2016, respectively. Specially, the United States peaked at 1 for all four years.
Besides, Figure 2 shows the variation between years for each economy. Specicially, Thailand (E11) and Germany (E13) fluctuated dramatically in a positive way at years 2013 and 2014. However, their scores then fell back to approximately average scores in the subsequent years.

3.2. Illustration of the Past-Present Framework

We applied the proposed procedure to the historical data of 17 economies for four years (2013–2016) in Table 1. In this study, we use Lucas weights for past and present data.
Testing replicas and correlation
Table 3 and Table 4 illustrate the process of constructing replicas and evaluating correlation coefficients for the study results. Meanwhile, Table 3 exhibits the resampling results of 500 and 5000 replicas obtained with a 95% confidence interval. However, the number of replicas depends on the number of inputs, outputs, and DMUs [14]. Hence, we need to check the variations of scores by increasing the number of replicas. In this study, the results from the data analysis show that the difference was negligible. We found 26 out-of-range samples, 500 replicas obtained 0.052%, and 236 out-of-range samples, 5000 replicas obtained 0.047% discards. 500 replicas may be acceptable in this case.
Fisher 95% confidence intervals are shown in Table 4. For instance, the correlation coefficient between government gross debt and unemployment rate is −0.0676 and its 95% lower/upper bounds are −0.5309 and 0.4269, respectively. The correlation coefficient applied the DEA model shows a linear relationship between input and output factors. The correlation coefficient is always between (−1) and (+1), the closer the correlation is to (±1), the closer it is to a perfect linear linear relationship.
The past performance evaluation results
We evaluated the efficiency score of each DMU by using the super-SBM model. To be specific, Table 5 and Figure 3 give information about the DEA score, average score, ranking, and their confidence interval with 500 replicas for the last period, year 2016.
Table 5 exhibits the results obtained by 500 replicas where the column DEA is the last period’s (2016) efficiency score and average indicated the average score over 500 replicas. The column rank is the ranking of average scores. We applied the Fisher 95% threshold and found 26 out-of-range samples.
As can be clearly seen from the given diagram, results fluctuated for each indicator. With DEA score, the number of efficient DMUs is 3, and the number of inefficient DMUs is 14. In fact, three countries, i.e., Singapore, Switzerland, and United States were considered to be highly efficient, Singapore (E10) accounted for 1.033, Switzerland (E15) for 1.045, and United States (E17) for 1.135. The efficiency scores were lower than 0.5 in Cambodia (E2), China (E3), and Indonesia (E5). The other countries’ DEA efficiency scores are between 0.5 and 0.9.
However, ranking with a confidence interval of 97.5% resulted in seven efficient DMUs and 10 inefficient DMUs. Inside, Singapore (E10) still remained the highest raking (the 97.5% confidence interval score was 1.172 and the average score was 1.044), and United States (E17) had the second ranking (the 97.5% confidence interval score was 1.194 and the average score was 1.042). The other 14 countries had efficiency scores which fluctuated between 0.541 for the confidence interval score, 0.454 for the average score, and a ranking between 3 to 16. The Philippines’ performance was deemed to be the worst when ranked at the bottom of the board.

3.3. Illustration of the Past-Present-Future Framework

Hereafter, we present results for the past-present-future framework. In this case, we regard the period from 2013 to 2016 as the past-present and 2017 as the future. We used three simple prediction models to forecast the future, the Trend model, Lucas weights model, and a hybrid model that consists of averaging their predictions with 500 replicas to forecast and examine the future efficiency in 17 economies.
Table 6 points out the detailed evaluation results of 2017 for the input/output, forecast DEA score, and confidence interval along with the ranking for each DMU. Singapore continued to lead the ranking in predicting performance with a confidence interval (97.5–2.50%) acounting for 1.152 and 0.813, respectively, with average efficiency remaining at 1.051. The United States ranked second with a confidence interval (97.5–2.50%) acounting for 1.199 and 0.827, respectively, with average efficiency remaining at 1.042. Switzerland followed third, and Germany was fourth, with average efficiency remaining at 1.002 and 0.993, respectively. Eight countries, i.e., United Kingdom, Thailand, Australia, Hong Kong SAR, Sweden, Korea Rep., New Zealand, and Malaysia were considered to be at medium efficiency levels with average scores from 0.589 to 0.727. The other four countries (Vietnam, Indonesia, Cambodia, and China) had low efficience scores between 0.475 and 0.513. The Philippines’ performance was deemed to be the worst, ranking at the bottom.
Table 7 provides the results of a basic indicator in 2017 for input/output of each DMU. At the same time, the authors added the actual super-SBM score for 2017 to compare real data and forecast data. The results shown in Figure 4 and Table 7 reveal little difference between the forecast efficiency levels and actual efficiency levels. Of the 17 countries, the actual 2017 scores of 17 are included in the 95% confidence interval. The average of forecast-actual over the 17 countries was −0.035 (−3.5%).
It was observed that the forecast of rank and score of 17 countries remained at a similar level to the actual. There was a slight change in ranking for Korea Rep., Germany, and Sweden. To be specific, Korea Rep. and Sweden were down one level; Germany increased one level compared to the actual. However, Singapore dropped abruptly four steps compared with the prediction from the top-ranked to the third, while Switzerland led the ranking from the third ranked.

3.4. Future Forecast Performance Evaluation Results

Figure 5 illustrates the overall picture of macroeconomics of 17 countries over time from the past to the future for each year in past (2013–2016), present (2013–2016), and future (2017–2020). During this time-series, the 17 countries (economies) as a whole experienced a slight change. The performance index estimates indicated that Singapore, Germany, Switzerland, and United States achieved sustainable performance. The average score of these economies remained at a high level, and is larger than 1. The 11 Asian developing area countries stood at just under 1. That is, they have not reached the effective threshold in macroeconomic management.
By using forecast data for 2017 and the following years, this research obtained the forecasting result of all DMUs for the subsequent years of 2018 to 2020 (detailed data are shown in Appendix A, Appendix B and Appendix C). Appendix A forecasts the indicators from 2017 to 2020; Appendix B forecasts a confidence interval from 2017 to 2020 of the Lucas weight of the past-present-furute model; and Appendix C assesses the macroeconomic performance over the time chain.

4. Discussions

The paper was inspired by “The Global Competitiveness Report” of the World Economic Forum [1] evaluating the global competitiveness of the countries/economies. In the whole study, the authors used the terms “economy” and “country” in a flexible way because of the political implications of some countries, in which the macroeconomic environment plays an important role in maintaining the sustainability of each economy. From the overall picture of global competitiveness, we focus on selecting countries that are emerging economies such as Singapore, China, Hong Kong SAR, Korea Rep, Thailand, Australia, Indonesia, New Zealand… (mainly in the Asia Pacific region) to be the main research objects. Besides, we selected the remaining five economies (including Germany, Sweden, Switzerland, United Kingdom, and United States) as advanced economies in the world. From there, the paper was compared and analyzed to see the overall picture of global macroeconomic performance.
By clearly defining the subject and referring to the methods of measuring macroeconomic effectiveness, the authors realize that DEA is an effective method to measure the performance of multiple decision-making units when putting research subjects (the economies) in the correlation. The advantage of the DEA method is that it combines many input/output indicators to assess the effectiveness of economies. This is confirmed in several past papers [11,12,13]. Besides, various contributions in the past using econometric approaches such as the Okun index, the Calmfors–Driffill index, or the OECD’s “magic diamond” considered all of the four main macro indicators, i.e., GDP growth, trade balance, inflation, and unemployment. Once again, the authors have a solid basis for selecting the input/outputs as presented in the study.
Our study is correlated with previous studies via the use of the DEA method to measure macroeconomic performance. Despite similarities with those of the research model, the results are significantly different due to the selection of inputs, outputs, and country of study. For example, Lovell [11] established a scalar-valued measure of an economy’s macroeconomic performance. The procedure was applied to a set of 10 Asian economies over a 19-year period from 1970 to 1988, with special attention paid to Taiwan. The four variables selected were GDP growth, employment, trade balance, and price stability. The results, i.e., the performance of the 10 economies, had been evaluated during part or the entire period from 1970 to 1988. However, the first point concerns the structure of the model, which contains no inputs and four outputs. It did not adequately reflect the real targets of macroeconomic policy. Moreover, although the data collected in the past are relative, the study was conducted on a small scale: 10 economies in Asia. Our study has produced outstanding results when selecting four indicators (government gross debt, real GDP growth, inflation rate, and unemployment rate) as input/output, in which a government gross debt indicator replaces Lovell’s trade balance indicator [11], and four indicators are set for the inputs and outputs of study. Data were collected from 17 economies, which show the main macroeconomic picture. Further, Cherchye [13] used a DEA model to evaluate a sample of 20 OECD countries covering the period from 1992 to 1996. The study provided a comparison of several synthetic indicators that merge the four separate indicators into a single statistic. The difference in this study and the current study is that countries are selected as DMUs and time to conduct research. Therefore, it is difficult to make comparisons from the results of the analysis. The highlight of the current study is predicting macroeconomic performance in the near future based on historical data.
The results from the research data show that research results are as close to the World Economic Forum’s ranking in the annual report. Specifically, advanced economies such as Switzerland, Singapore, and the United States always rank highly in macroeconomic performance. This also reflects the macroeconomic management success of the country. On the contrary, some economies in emerging markets such as those in Cambodia and the Philippines show less effective macroeconomic management capacity. In addition, the near future forecast data for the next four years gives the same results. On the other hand, the results from data analysis also show significant differences between the macroeconomic performance of emerging markets compared with those in the five advanced countries. This has been clearly demonstrated in the analysis of research results.

5. Conclusions

This paper provides an evaluation of the performance of institutions responsible for the conduct of macroeconomic and environmental policies in some economies. Similar analyses have been conducted previously, although they have been summarized into an evaluation of macroeconomic policies. This study appears to be the first of its kind to focus on performance evaluation by combining prediction models to provide overall circumstances and efficient tendencies for the 17 countries. The resampling model is based on these variations for gauging the confidence intervals of DEA scores, in which the first model was utilized by past-present data for estimating data variations imposing chronological order weights, which are supplied by Lucas series. The second model deals with future prospects. The analytical tools we have employed in this study are intended to improve upon previous treatments. DEA originated by Charnes and Cooper [5] is a nonparametric mathematical programming methodology that deals directly with input/output data. Using the data, DEA can evaluate the relative efficiency of DMUs and propose a plan to improve the inputs/outputs of inefficient DMUs. This function is difficult to achieve with similar models in statistics, i.e., stochastic frontier analysis. DEA scores are not absolute but relative, i.e., they depend on the choice of inputs, outputs, and DMUs as well as on the choice of model for assessing DMUs. DEA scores are subject to change; thus, data variations in DEA shoud be taken into account.
Application of the resampling model to a set of 17 economies over the period from 2013 to 2016 and forecasting for the period 2017 to 2020 generated the following conclusions: (i) the overall picture of macroeconomic performance of 17 countries was built based on DEA-integrated models for the period from 2013 to 2016; (ii) there appear to be significant differences between the quality of macroeconomic management in the 12 Asian developing countries and in the remaining five developed countries. This has helped consolidate the World Economic Forum’s annual rankings in the global competitiveness report [1]; (iii) when the four primary macroeconomic objectives are included in the performance evaluation analysis, we find that Switzerland, Singapore, and the United States have enjoyed the most successful macroeconomic management, while Cambodia, China, and the Philippines have suffered the least sucessful macroeconomic management; these conclusions are supported by the data. This is particularly relevant for developed countries, which historically have pursued macroeconomic policies designed to achieve an equitable income distribution.
Although this paper shows that a resampling model is a flexible and easy model of use to predict, this paper only focuses on a quantitative model, and the results reveal the relative performance. The authors will do more research of external environmental factors in the future. The comparisions with other quantitative and qualitative approaches will be a good research direction as well.
The main contribution of this paper is to provide an evaluation and forecast of macroeconomic policies of 17 countries. The research results may help to improve macroeconomic efficiency, to achieve economic growth, to reduce the ratio of inflation and unemployment, and toward a sustainable economic development. The findings in this study will provide policy-makers with incentives to improve macroeconomic indicators. The estimation results may give useful information and practical suggestions for governments to realize their collective goal of enhancing global competitiveness.

Author Contributions

C.-N.W. guided the research direction, guided the analysis method, and edited the content; A.L.L. designed the research framework, analyzed the empirical result, and wrote the paper. Both authors contributed to issuing the final results.


This research was partly supported by MOST107-2622-E-992-012-CC3 from the Ministry of Sciences and Technology in Taiwan.


The authors appreciate the support from the National Kaohsiung University of Science and Technology, Ministry of Sciences and Technology in Taiwan.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations and Acronyms

The following abbreviations and acronyms are used in this manuscript:
DEAData Envelopment Analysis
GCIGlobal Competitiveness Index
CIConfidence interval

Appendix A

Table A1. 2017–2020 forecasts Lucas weight of past-present-future model.
Table A1. 2017–2020 forecasts Lucas weight of past-present-future model.
(I) GGD(I) R-GDP(O) I-Rate(O) U-Rate(I) GGD(I) R-GDP(O) I-Rate(O) U-Rate(I) GGD(I) R-GDP(O) I-Rate(O) U-Rate(I) GGD(I) R-GDP(O) I-Rate(O) U-Rate
E184.052.4998.3294.1283.862.5098.3894.1183.734 2.491 98.433 94.127 83.742.5098.4294.14
E284.957.1197.3399.7684.937.1097.3999.7784.876 7.091 97.432 99.756 84.887.0997.3699.75
E382.416.9698.1195.9582.296.9198.1695.9582.196 6.886 98.156 95.952 82.196.8998.1395.95
E499.872.3596.8196.9699.892.3196.9096.9899.887 2.272 96.973 97.010 99.892.2796.9697.02
E588.815.0394.9294.1288.754.9994.9994.1488.680 4.996 95.119 94.148 88.695.0095.1794.16
E684.342.9099.0096.4284.242.8999.0396.3984.193 2.869 99.040 96.382 84.212.8799.0396.38
E772.184.7997.7296.7171.944.7897.7396.7071.530 4.696 97.772 96.677 71.394.6997.7696.67
E887.703.2199.3394.7087.723.2899.3794.7387.717 3.310 99.392 94.740 87.723.3199.3794.74
E985.016.5597.7793.9085.106.5297.8693.9685.118 6.563 97.965 94.020 85.136.5897.9294.03
E1055.682.5499.9697.9955.552.37100.1297.9955.271 2.306 100.181 97.982 55.242.34100.1597.98
E1182.152.6599.6199.1882.152.6999.7699.1782.166 2.791 99.829 99.174 82.172.7899.7799.18
E1275.756.2397.2697.6975.606.2997.5497.7175.486 6.292 97.589 97.704 75.486.2797.4997.70
E1370.351.6799.5095.4570.521.7299.5795.5070.622 1.722 99.588 95.532 70.621.7399.5795.53
E1482.103.1599.2492.6482.053.2999.2192.6882.116 3.310 99.168 92.719 82.143.2799.1792.72
E1581.781.59100.5095.1181.791.55100.5495.0181.791 1.502 100.553 94.836 81.801.52100.5294.77
E1662.902.1599.1794.5062.832.1599.3094.6262.785 2.093 99.327 94.672 62.802.0999.2994.66
E1755.662.1098.9594.5155.642.1399.0194.6455.580 2.076 99.018 94.694 55.582.0498.9794.68
St Dev11.851.941.381.9811.871.931.371.9611.921.941.351.9511.931.941.341.95

Appendix B

Table A2. 2017–2020 confidence interval of forecasts Lucas weight of past-present-furture model.
Table A2. 2017–2020 confidence interval of forecasts Lucas weight of past-present-furture model.

Appendix C

Table A3. The macroeconomic performance over time.
Table A3. The macroeconomic performance over time.
Super-SBM Scores 2013–2016Past-Present Period 2013–2016Past-Present-Future DEA Scores 2017–2020
Hong Kong SAR0.444140.557130.65890.66660.66690.7280.7480.7480.757
Korea, Rep.0.508110.622100.66880.60480.604100.71100.7190.7090.709
New Zealand0.53280.63290.615100.526120.526110.65110.64110.63110.6311
United Kingdom0.72940.84550.88050.86340.86350.9350.9450.9450.935
United States1.08231.07121.04231.13521.13521.0621.0431.0431.052


  1. The Global Competitiveness Report 2017–2018. Available online: (accessed on 26 April 2018).
  2. Koomans, T.C. An analysis of production as an efficient combination of activities. In Activity Analysis of Production and Allocation, Cowles Commission for Research in Economics; Koopmans, T.C., Ed.; Monograph No. 13; Wiley: New York, NY, USA, 1951. [Google Scholar]
  3. McCracken, P.; Carli, G.; Giersch, H. Towards Full Employment and Price Stability: A Report to the OECD by a Group of Idependent Experts; Organization for Economic Cooperation and Development: Paris, France, 1977. [Google Scholar]
  4. Calmfors, L.; Driffill, J. Bargaining structure, corporatism and macroeconomic performance. Econ. Policy 1988, 6, 13–61. [Google Scholar] [CrossRef]
  5. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the efficiency of decision making units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  6. Wang, C.N.; Li, K.Z.; Ho, C.T.; Yang, K.L.; Wang, C.H. A model for candidate selection of strategic alliances: Case on industry of department store. In Proceedings of the Second International Conference on Innovative Computing, Information and Control, Kumamoto, Japan, 5–7 September 2007; IEEE: Piscataway, NJ, USA, 2007. [Google Scholar]
  7. Yuan, L.N.; Tian, L.N. A new DEA model on science and technology resources of industrial enterprises. Int. Conf. Mach. Learn. Cybern. 2012, 3, 986–990. [Google Scholar]
  8. Wu, F.; Fan, L.W.; Zhou, P.; Zhou, D.Q. Industrial energy efficiency with CO2 emissions in China: A nonparametric analysis. Energy Policy 2012, 49, 164–172. [Google Scholar] [CrossRef]
  9. Egilmez, G.; Kucukvar, M.; Tatari, O. Sustainability assessment of US manufacturing sectors: An economic input output-based frontier approach. J. Clean. Prod. 2013, 53, 91–102. [Google Scholar] [CrossRef]
  10. Chang, M.C. Room for improvement in low carbon economies of G7 and BRICS countries based on the analysis of energy efficiency and environmental Kuznets curves. J. Clean. Prod. 2015, 99, 140–151. [Google Scholar] [CrossRef]
  11. Lovell, C.A.K. Measuring the macroeconomic performance of the Taiwanese economy. Int. J. Prod. Econ. 1995, 39, 165–178. [Google Scholar] [CrossRef]
  12. Lovell, C.A.K.; Pastor, J.T.; Turner, J.A. Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries. Eur. J. Oper. Res. 1995, 87, 507–518. [Google Scholar] [CrossRef]
  13. Cherchye, L. Using data envelopment analysis to assess macroeconomic policy performance. Appl. Econ. 2001, 33, 407–416. [Google Scholar] [CrossRef]
  14. Tone, K.; Ouenniche, J. DEA score’ confidence intervals with past-preesent and past-present-future based resampling. Am. J. Oper. Res. 2016, 6, 121–135. [Google Scholar] [CrossRef]
  15. World Bank. Available online: (accessed on 15 November 2017).
  16. International Monetary Fund. Available online: (accessed on 13 November 2017).[Green Version]
  17. Cook, W.D.; Tone, K.; Zhu, J. Data envelopment analysis: Prior to choosing a model. Omega 2014, 44, 1–4. [Google Scholar] [CrossRef]
  18. Wikipedia. Available online: (accessed on 13 November 2017).
  19. The Organization for Economic Co-Operation and Development (OECD). Available online: (accessed on 24 November 2017).
  20. Tone, K. A slack-based measure of super-efficiency in data envelopment analysis. Eur. J. Oper. Res. 2002, 143, 32–41. [Google Scholar] [CrossRef]
  21. Tone, K. A slack-based measure of efficiency in data envelopment analysis. Eur. J. Oper. Res. 2001, 130, 498–509. [Google Scholar] [CrossRef]
  22. Efron, B. Bootstrap Methods: Another Look at the Jackknife. Ann. Stat. 1979, 7, 1–26. [Google Scholar] [CrossRef]
  23. Fisher, R.A. Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika 1915, 10, 507–521. [Google Scholar] [CrossRef]
  24. Fisher, R.A. On the interpretation of ÷2 from contingency tables, and the calculation of P. J. R. Stat. Soc. 1922, 85, 87–94. [Google Scholar] [CrossRef]
Figure 1. Research process.
Figure 1. Research process.
Sustainability 10 03664 g001
Figure 2. Panel data results.
Figure 2. Panel data results.
Sustainability 10 03664 g002
Figure 3. DEA score and confidence interval with 500 replicas.
Figure 3. DEA score and confidence interval with 500 replicas.
Sustainability 10 03664 g003
Figure 4. Confidence interval, forecast score, and actual 2017 score: forecast by Lucas model.
Figure 4. Confidence interval, forecast score, and actual 2017 score: forecast by Lucas model.
Sustainability 10 03664 g004
Figure 5. The macroeconomic performance over time (2013–2020).
Figure 5. The macroeconomic performance over time (2013–2020).
Sustainability 10 03664 g005
Table 1. Main statistics of inputs/outputs for 17 countries (average, 2013–2016).
Table 1. Main statistics of inputs/outputs for 17 countries (average, 2013–2016).
Variable(I) GGB(I) R-GDP(O) I-Rate(O) U-Rate(I) GGB(I) R-GDP(O) I-Rate(O) U-Rate
Table 2. Super-SBM score.
Table 2. Super-SBM score.
HK SARE40.4440.5570.6580.666GermanyE131.6640.9790.9960.788
Korea, Rep.E60.5080.6220.6680.604SwitzerlandE150.5840.7061.2271.150
New ZealandE80.5320.6320.6150.526United StatesE171.0821.0711.0421.135
PhilippinesE90.4410.5360.4800.429Avg 0.6590.7470.7140.675
Source: Calculated by researcher.
Table 3. Comparisons of 5000 and 500 replicas (Fisher 95%) period 2013 to 2016.
Table 3. Comparisons of 5000 and 500 replicas (Fisher 95%) period 2013 to 2016.
DMU5000 Replica500 ReplicaDifference
Hong Kong SAR0.7640.6660.4760.7620.6660.4780.0017−0.0014
Korea, Rep.0.7210.6040.5210.7130.6040.5160.00830.0051
New Zealand0.7450.5260.4880.7450.5260.4800.00020.0074
United Kingdom1.0640.8630.6841.0660.8630.683−0.00200.0007
United States1.1951.1350.8021.1941.1350.8020.00130.0000
Table 4. Lower/upper bounds of Fisher 95% confidence for correlation matrix.
Table 4. Lower/upper bounds of Fisher 95% confidence for correlation matrix.
Lower Bounds
Upper boundsGGD −0.1902−0.7428−0.5309
Real-GDP0.694 −0.8665−0.2386
I-rate0.0905−0.2649 −0.6114
Table 5. DEA score and confidence interval with 500 replicas.
Table 5. DEA score and confidence interval with 500 replicas.
Source: Calculated by researcher.
Table 6. 2017 forecasts: Lucas weight, DEA score, and ranking.
Table 6. 2017 forecasts: Lucas weight, DEA score, and ranking.
Forecast DEA and Confidence IntervalForecast Data by Lucas Case
DMU97.50%DEAAVG2.50%Rank(I) GGD(I) R-GDP(O) I-Rate(O) U-Rate
HK SAR0.7890.7190.6570.486899.872.3596.8196.96
Korea, Rep.0.7260.7060.6470.5281084.342.9099.0096.42
New Zealand0.7350.6470.6040.4921187.703.2199.3394.70
United Kingdom1.0410.9320.8910.727562.902.1599.1794.50
United States1.1991.061.0420.827255.662.1098.9594.51
(Hong Kong = HK SAR, Government gross debt = GGD; Real GDP growth = R-GDP; Inflation rate = I-rate; Unemployment rate = U-rate). Source: Calculated by researcher.
Table 7. Forecast DEA scores, actual (2017), and confidence interval: forecasts by Lucas weighted average model.
Table 7. Forecast DEA scores, actual (2017), and confidence interval: forecasts by Lucas weighted average model.
DMU97.50%Forecast (2017)Actual (2017)2.50%
Hong Kong SAR0.7890.65780.71980.486
Korea, Rep.0.7260.647100.70690.528
New Zealand0.7350.604110.647110.492
United Kingdom1.0410.89150.93250.727
United States1.1991.04221.06020.827

Share and Cite

MDPI and ACS Style

Wang, C.-N.; Le, A.L. Measuring the Macroeconomic Performance among Developed Countries and Asian Developing Countries: Past, Present, and Future. Sustainability 2018, 10, 3664.

AMA Style

Wang C-N, Le AL. Measuring the Macroeconomic Performance among Developed Countries and Asian Developing Countries: Past, Present, and Future. Sustainability. 2018; 10(10):3664.

Chicago/Turabian Style

Wang, Chia-Nan, and Anh Luyen Le. 2018. "Measuring the Macroeconomic Performance among Developed Countries and Asian Developing Countries: Past, Present, and Future" Sustainability 10, no. 10: 3664.

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop