Next Article in Journal
An Alternative Estimation Method for Time-Varying Parameter Models
Previous Article in Journal
A Conversation with Katarina Juselius
Previous Article in Special Issue
Model Validation and DSGE Modeling
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:

Algorithmic Modelling of Financial Conditions for Macro Predictive Purposes: Pilot Application to USA Data

Department of Economics, SOAS University of London, 10 Thornhaugh Street, Russell Square, London WC1H 0XG, UK
Global Development Institute (GDI), University of Manchester, Oxford Road, Manchester M13 9PL, UK
Facebook, UK Limited, London NW1 3FG, UK
Department of Economics, University of Massachusetts Amherst, 412 North Pleasant Street, Amherst, MA 01002, USA
Author to whom correspondence should be addressed.
Econometrics 2022, 10(2), 22;
Received: 28 September 2018 / Revised: 30 April 2021 / Accepted: 12 April 2022 / Published: 19 April 2022
(This article belongs to the Special Issue Celebrated Econometricians: David Hendry)


Aggregate financial conditions indices (FCIs) are constructed to fulfil two aims: (i) The FCIs should resemble non-model-based composite indices in that their composition is adequately invariant for concatenation during regular updates; (ii) the concatenated FCIs should outperform financial variables conventionally used as leading indicators in macro models. Both aims are shown to be attainable once an algorithmic modelling route is adopted to combine leading indicator modelling with the principles of partial least-squares (PLS) modelling, supervised dimensionality reduction, and backward dynamic selection. Pilot results using US data confirm the traditional wisdom that financial imbalances are more likely to induce macro impacts than routine market volatilities. They also shed light on why the popular route of principal-component based factor analysis is ill-suited for the two aims.

1. Introduction

The 2008 global financial crisis (GFC) has drawn macroeconomists’ attention to a major weakness of extant macro models: the lack of variables which adequately represent broad financial market conditions and are proven as aggregate predictors of financial shocks to key macro variables, e.g., Gadanecz and Jayaram (2009), Barnett (2012), Ng (2011), Borio (2011, 2013), and Morley (2016).1 In acknowledgment of this weakness, there is a visible growth of research into the construction of financial conditions indices (FCI) that could serve as predictors in macro models. Many of these aggregate FCIs are model-based, as there is no suitable way of weighing up financial market variables and indices across different financial markets. The most popular modelling approach is to construct FCIs by means of principal-component-based factor analysis following the seminal works by Stock and Watson (1989, 2002), e.g., see Hatzius et al. (2010), Brave and Butters (2011), Moccero et al. (2014), Chauvet et al. (2015), Levanon et al. (2015), and Giglio et al. (2016).
Evaluation of the existing FCIs has yielded mixed results, e.g., see Aramonte et al. (2017). A key problem is lack of concatenation, i.e., the preceding values of the FCIs fail to remain invariant when the models from which they have been derived are updated with incoming new data, see Stock and Watson (2009) and Kotchoni et al. (2019). The lack of concatenation precludes the practical usefulness of such FCIs, since concatenation constitutes a fundamental measurement property, see Markus and Borsboom (2013, chp. 2) for more discussion on this attribute in the classical theory of measurement. Although Stock and Watson (2011) show that factor invariance is technically achievable when the indicator set is sufficiently large and individual indicators fall homogeneously into certain idealised distributions, these requirements are practically unachievable. The dynamic features of available financial indicators are so heterogeneous and time-varying that the numbers of indicators found with significant factor loadings (i.e., estimated weights) fall far below a ‘sufficiently large’ number in practice.
This study explores a new route of FCI construction by assimilating knowledge and methods from three research fields outside econometrics: partial least-squares (PLS) regression in management and marketing research,2 measurement theory in psychology (psychometrics), and supervised versus unsupervised data dimensionality reduction in machine learning.3 Research insights from these fields reveal that constructing FCIs by principal-component-analysis (PCA) is a misconceived route, because FCI construction amounts to composite index making. Models used for composite index making are classified as causally formative models, as opposed to causally reflective models in measurement theory.4 It should be noted that causality here refers to the disaggregates-to-aggregate relationship, a different context from which causality is commonly conceived in the econometrics literature—causal direction of variables at the same aggregative level. The PCA is based on the criterion of maximising a uniquely shared variance and therefore suits, at best, the task of measuring a certain latent but commonly shared cause reflected in observed indicators (hence ‘reflective’ models). This criterion is unsuitable for the situation of weight determination in composite index making by formative models because there is no common latent cause. In the formative case, observed indicators are selected to represent distinctly different facets of the composite index of interest. Formative modelling is hence more challenging than reflective modelling, as it requires more than a single criterion, see Markus and Borsboom (2013, Part II), Howell et al. (2013), and Howell (2014). One popular criterion is a predictive target, as led by research in PLS regression modelling. This method is referred to as supervised dimensionality reduction in machine learning, as opposed to unsupervised dimensionality reduction with which PCA is associated, see Cunningham and Ghahramani (2015).5
The above discussion helps explain why progress has remained slow in the econometric research of leading indicator construction over the last century, see Marcellino (2006). Single-minded pursuit of the PCA route is unlikely to achieve the goal of producing, from large financial data sets, aggregate measures that are practically useful for macroeconomic prediction.6 Scrutinising the relationships between disaggregate financial indicators and macro aggregates is a prerequisite for any effective attempt on leading indicator construction. Such scrutiny reveals that the causality involved in aggregating financial shocks is even more complex than what the dichotomy of reflective versus formative models depicts. Dynamic interactions among indicators imply reactive or reciprocal causality, see Hayduk et al. (2007). Expounding these causal links among indicators requires a well-designed algorithm for indicator selection and classification. This task leads us to embrace concepts and statistical techniques from machine learning, e.g., Hastie et al. (2009), and Shalev-Shwartz and Ben-David (2014).7
The algorithm proposed in this study follows the spirit of supervised dimensionality reduction. Our aim is to construct, from a relatively large set of financial indicators, unidimensional, partial, and leading indices for macro variables of predictive interest. The algorithm allows for asynchronous dynamics among financial market indicators during the dimensionality reduction process and imposes time-wise concatenation during the data-updating process. The resulting FCIs replace financial variables conventionally used in macro models to evaluate the performance of the FCI-based models against their conventional counterparts. The LSE general-to-specific dynamic model reduction approach—see Hendry (1995)—is adopted for both the FCI construction step and the macro modelling step, to reduce the risk of overfitting. Since this approach methodologically accords with backward selection via certain regularisation rules in feature selection of machine learning, it is referred to simply as backward dynamic selection hereafter. To test the algorithm, three USA macro variables are chosen as forecasting targets: inflation and the growth rates of industrial production (IP) and GDP. Long-term and short-term interest rates are used to represent the monetary/financial sector in the baseline model. Over thirty financial variables of monthly frequency are used to construct FCIs.
The experiments yield the following results: (a) The problem of unstable loadings in financial indicator aggregation can be largely resolved by a targeted (supervised) dimensionality reduction approach in combination with asynchronous dynamics among indicators. (b) Indicators capturing short-run volatility are deselected in most cases while indicators capturing financial imbalances survive in diverse lag forms through the reduction process. (c) The forecasting performance of FCI-based macro models is sensitive to selected targets with the case of IP growth being a clear success, whereas inflation is found to be relatively too distant from FCI shocks. These findings demonstrate how intimately related the issues of aggregation, dynamics, specification of macro targets, and input feature design and selection are.
The paper is organised as follows. A detailed description of the algorithmic model design is given in Section 2. Section 3 describes the data used in the pilot experiments. Section 4 reports the findings and Section 5 considers potential further research.

2. Algorithmic Model Design

The algorithmic model design is introduced in two steps. Section 2.1 introduces the FCI-based macro model and the baseline model against which it is compared. Section 2.2 describes the algorithm for FCI construction and updating. The algorithm is designed to satisfy a multifaceted aim: constructing aggregates that have adequate financial market coverage such that they improve the forecasting capacity of macro models where such a coverage is lacking. This aim can be dissected into three key requirements. First, the selection of financial indicators should be exhaustive to ensure adequate representation of different facets of the markets. Second, the resulting FCIs should possess the fundamental measurement attribute of time-wise concatenation. Third, FCIs should be a leading cause of macro variables of predictive interest.
The first two requirements classify FCIs as composite aggregates. As mentioned in the previous section, composite measurement making entails more criteria than what is needed in dimensionality reduction of the reflective or common effect case, which is widely tackled by the PCA route. An explicit predictive target comes in naturally as one criterion. This puts FCI construction into the genre of supervised data reduction. Supervised data reduction focuses attention on dynamic features of data. For instance, aggregately redundant information is likely to exist among financial indicators across different markets. Further, not all indicators impact on the forecasting targets in a dynamically synchronised way and the dynamic features or ways via which indicators impact on the targeted macro variables can be more complex than what a simple linear model of those indicators can capture.8 The proposed algorithm is designed to tackle these issues using methods inspired by PLS regression modelling and backward dynamic selection.

2.1. Macro Model Setting and Model Training

The baseline macro model takes the form of an error-correction model (ECM), arguably the most popular type of macro-econometric model. Specifically, the following ECM is used for a particular macro variable of predictive interest, y t :
Δ y t = α 0 + i = 1 n α i Δ y t i + i = 0 n β i Δ X t i + i = 1 n θ i Δ R t i γ e t 1 + v t ,   e t 1 = y t 1 κ 1 X t 1 κ 2 R t 1
where Δ denotes a one-period difference, n is the lag length, e t 1 is the error-correction term, v t the model residual term, and X t represents real-sector variables which co-trend with y t , and R t are interest rates representing the financial or banking sector conditions.
The postulate that R t is inadequate in representing the financial markets motivates the FCI construction and the proposition of the following FCI-based model as an alternative to (1):
Δ y t = α 0 + i = 1 n α i Δ y t i + i = 0 n β i Δ X t i + i = 1 n θ i Δ f t i * γ e t 1 * + ε t
e t 1 * = y t 1 κ 1 X t 1 κ 3 f t 1 *
where f t * is a latent variable representing the aggregate financial market conditions. Two types of targets for FCI construction are identified from (2). One is Δ y t , an obvious target, referred to as the short-run target. Another is embedded in e t 1 * , which is effectively a leading indicator for Δ y t , and referred to as the long-run target.
After FCI construction, both models (1) and (2) are reduced into data-permissible parsimonious models via backward selection over a model training period. Models (1) and (2) are re-estimated at regular updating intervals and the possibility of model re-specification is examined. The examination leads to an additional model selection criterion: invariant lag structure.
The relative forecasting performance of (2) against (1) is then assessed by comparison of the mean squared forecasting errors (MSFE) and two types of forecast encompassing tests. One tests for MSFE dominance following Harvey et al. (1997, 1998) and the other tests for forecast-differential encompassing following Ericsson (1992, 1993) and Clements and Hendry (1993). It should be noted that MSFE dominance is a necessary but not sufficient condition for forecast encompassing, see Ericsson (1992). The latter test is also robust in the presence of integrated variables and hence provides a better assessment of the forecasting models compared here. The forecast encompassing tests are based on 1-step to 6-step ahead forecasts generated over the forecasting horizon, using observed data of the independent variables and forecasts of the dependent variable.

2.2. Algorithm for FCI Construction

Utilising the long-run and short-run targets identified in the previous sub-section, this sub-section introduces a new way to construct FCIs as feasible measures of f t * in (2), based on the principle of PLS regression. The long-run disequilibrium correction term, ( y t κ 1 X t ) , in (1) is used as a long-run target.9 Denoting observed financial indicators as i j , t and the total number of indicators as m, the following partial regression model is run for each target variable in the finite distributed lag form to allow for asynchronous dynamics among indicators:
( y t κ 1 X t ) = i = 0 n φ j , i i j , t i + ϵ j t   , j = 1 , , m
Only the term with the single largest—in absolute terms—weight φ ^ j , i k * , estimated by the PLS algorithm, is selected for each indicator from (3). From the selected terms and weights the long-run FCI is constructed:
f t L = j = 1 m φ ^ j , k * i j , t k *
Although Δ f t j L can be used as a measure of Δ f t j * in (2), this measure is rather restrictive in that it rules out the possibility that some i j , t may only exert a short-run impact on Δ y t and/or the dynamics of their short-run impact may be more complicated than what φ ^ j , k * can capture. Hence, the following short-run FCI using Δ y t as the target is constructed in a similar manner as (3) and (4).
Δ y t = i = 1 n ω i , j i j , t i + ϑ j t j = 1 , , m
f t S = 1 m * ω ^ j ( L ) i j , t ,
where L denotes the lag operator. ω ^ j ( L ) are obtained via backward selection from (5) by OLS and m * m number of input indicators with at least one significant ω ^ i , j enter the short-run FCI.
Two differences should be noted in the dynamic specifications between the long-run and the short-run FCI construction. First, (5) takes a n-lag leading indicator model form; (4) is simply a distributed-lag model, since the error-correction term in (2), e t 1 * , already acts as a leading indicator. Second, while the indicator loadings in both f t L and f t S are asynchronous, the lag structure of indicators is more complex in f t S than in f t L . Only one term is kept for each financial indicator in (3), whereas ω ^ j ( L ) in (6) retains all the significant lag loadings to allow for the possibility that the short-run input of some indicators is dynamically nonlinear. Findings of such nonlinearity can be further exploited to improve input feature design of the relevant financial indicators as discussed further in Section 4.2.10 See Appendix A for a summary of the algorithms for long-run and short-run FCI construction and Supplementary Materials for code.
With regular data updates, timewise concatenation of FCIs is a key requirement. An illustration of how concatenated FCI series are constructed during updating is given in Figure 1. The overall stability of loadings is checked through comparison of the concatenated FCI series with the un-concatenated ones, i.e., FCIs derived simply from various rounds of estimation after data updating.
To create 1-step to 6-step ahead forecasts of model (2), predicted FCIs over the forecasting horizon are generated, using observed data and estimated weights. As weights are not updated, concatenation is not required for the predicted part of the FCIs.

3. Data

Model (1) is applied to three macro targets: annual inflation based on the consumer price index (CPI), annual growth rates of IP and annual growth rates of GDP. Two output variables are considered due to the availability of monthly IP and the absence of monthly GDP. Monthly GDP series are interpolated from quarterly time series using the monthly weights of IP. Experiments with total retail sale as a proxy of private consumption yield similar results. For simplicity, a single real-sector explanatory variable is chosen for each of the three modelled variables in their level form: GDP for IP, the producer price index (PPI) for CPI, and the global output index from the GVAR literature11 for GDP.
The data sample is in monthly frequency over the period of 1980M1–2017M12, except for the global output index which is only available up to 2012M12. The period of 1980M1–2000M12 is used for model training to ensure a decent level of composite reliability, see Terry and Kelley (2012). The period of 2001M1–2006M12 is used for model validation. The rest of the sample is used to examine how the model evolves through the turbulent period of the GFC. Data updating is set at a 12-month interval for the validation period. The maximum lag length is set at six months, n = 6 in (3) and (5). For convenience, the data is updated historical data, not vintage data. Hence, the evaluation of the predictive performance does not emulate real-life forecasting performance.
The short-run macro targets and the two interest rate variables used in model (1) are plotted in Figure 2.
The set of initial indicators used as input indicators for FCI construction is classified into two types: unprocessed financial variables and processed financial variables. Type one forms the dominant part of the set. Variables are collected from money, forex, equity, and fixed income markets, as well as from banking sector balance sheets. Highly correlated variables from the same market are excluded to ensure indicators are as representative of as possible. Type two variables are systemic risk measures derived from micro financial series. These are provided by Giglio et al. (2016).12
While the latter type is directly used as input indicators for FCI construction, the former type is transformed to capture, in a concentrated manner, dynamic features of liquidity, leverage, and linkage frictions which are indicative of various market imbalances. This is achieved by choosing indicators of what Qin and He (2012) refer to as ‘long-run type’. According to their classification, long-run indicators cover ratios or differences across financial variables, such as interest rate spreads. In contrast, growth rates or changes of individual variables are referred to as ‘short-run type’.
From a time-series perspective, long-run indicators exhibit distinctly lower frequency dynamics than the short-run ones, and therefore are expected to match better with the dynamic features exhibited by macro variables, which are well-known to exhibit strong inertia. Such match in dynamic features is essential for successful modelling, as emphasised by Drehmann et al. (2012) and Borio (2014a, 2014b). Further, since long-run indicators are formed to capture features of imbalance or disequilibrium across different financial variables, these are expected to reflect the main transmission channels between the financial and real sectors, see BCBS (2011), Borio and Lowe (2002), and Gramlich et al. (2010). Previous experiments, reported in Wang (2017), have indeed shown that long-run indicators occupy a dominant part in the construction of FCIs while short-run indicators are largely screened out during indicator selection.
Table 1 provides a list of input indicators of the long run type with details about the variables underlying their construction and processed financial variables with their data source. A list of the unprocessed financial variables underlying the long run input indicators and their data sources can be found in the Appendix B, Table A1. All input indicators are standardised for comparability of loadings.

4. Empirical Results

The constructed FCIs are assessed on two criteria: (a) aggregation and (b) prediction. The first criterion is mainly examined via concatenation, as discussed in Section 2.2. The second criterion is assessed via the forecasting performance of model (2) as compared to model (1). This section reports and discusses the results with respect to these criteria in three parts.

4.1. Input Indicator Selection

Experiments with various sets of input indicators in the construction of long-run and short-run FCIs yield the following findings. First, loadings of the short-run input indicators, derived from the monthly differences of the unprocessed financial variables, are either very small or insignificant in the construction of both f t L and f t S . This result reinforces Wang’s (2017) findings and confirms the conventional wisdom that routine volatilities from financial markets are mostly noise to the real sectors unless they accumulate into disequilibrium signals too large to be ignored at a macro level.13 Forecasting comparisons between FCI-based models where the few surviving short-run indicators are kept and those without these indicators yield little difference. Short-run indicators are henceforth excluded from the FCI construction, following the call for simplicity in aggregation by Cox et al. (1992). Second, loadings of most of the processed financial variables are either insignificant or very small in f t S . In the construction of f t L , some loadings are significant, but unstable. Given the insignificance and instability of those loadings, the processed variables are excluded in subsequent experiments. The final set of input indicators used in the construction of the FCIs hence solely comprises input indicators of the long-run type constructed from unprocessed financial variables.
Figure 3 and Figure 4 show, respectively, the long-run targets with the resulting e t * series incorporating the long-run FCIs and the short-run FCIs, f t S and Δ 12 f t L , following Equations (4) and (6). κ 1 = 1 in the long-run targets is imposed based on empirical evidence.14 As can be seen from Figure 4, the FCI series vary distinctly from each other. While the FCIs targeted at the two output growth variables are similar—as expected given that IP forms a sizable part of GDP—the FCIs targeted at inflation are strikingly different. It is hence unsurprising that PCA-based FCIs cannot achieve the same adequacy in concatenation or possess the same predictive capacity as these targeted FCIs.
Short-run FCIs are relatively flat during the ‘great moderation’ of the mid-1980s. The period of low volatility and negligible financial market impact ends with the recession of the early 1990s, a period associated with financial innovation and expansion. These dynamic features are absent from the interest rate series in Figure 2. Further, FCIs closely track two financial crises, the dot-com crisis in 2000–02 and, most visibly, the GFC of 2008. During both crises, short-run FCIs tumble visibly.

4.2. Aggregation

This sub-section evaluates aggregation of the input variables by assessing the loadings and lag structure of the different FCIs with respect to prominence of financial sectors, leading information, constancy over data updates and dynamic form. The loadings of the chosen indicator set for the long-run FCIs are reported in Table 2. The first column reports k * , the lag of the most significant indicator loading φ ^ j , k * in (4). The second column reports the average of the loadings over repeated 12 month updates over the training period between 2001M1 and 2006M12.
The lack of cross-market synchronisation is noticeable, with indicators entering at different lag lengths from 0–6. Meanwhile, a sizeable part of the indicators has relatively constant loadings over time—highlighted in bold—especially when targeting inflation and IP. For inflation and GDP growth, forex market indicators are mostly insignificant and loadings for the banking sector indicators are dominant with a relatively stable lag structure. For IP, indicators representing the forex and fixed income markets are dominant and imbalances in the banking sector, except for the housing market, play a minor role with mostly insignificant loadings. Judging from the lag structure, fixed income indicators contribute the most leading information.
The links between IP and forex markets are unsurprising because exchange rates are a pivotal factor in determining international competitiveness. The leading role of indicators from the fixed income market explains why interest rates have taken hold as the aggregate variables representing the financial sector in conventional macro models.
Table 3 reports the loadings for short-run FCIs f t S constructed from the same indicator set used to construct the long-run FCIs. The dynamic form of several indicators is nonlinear. This nonlinearity can be captured by transforming the input indicators into a differenced term plus a level term. Because GDP and IP annual growth rates have similar dynamics, indicators enter in similar dynamic forms for these two targets, with many indicators entering as a difference. Because inflation exhibits faster dynamics than the output growth variables, few indicators enter as a difference in the short-run FCI targeting at inflation.
For FCIs built for the two output targets, the size of indicator loadings changes and lag instability emerges when extending the algorithm beyond the testing sample, foreshadowing the financial crisis. For most input indicators, stability returns with the 2010M1 update. In contrast, lag stability for the FCIs targeted at inflation is largely maintained over the crisis period, an indication of inflation being relatively less susceptible to financial market conditions. Table 4 summarises these changes in loadings and lag structure for the training period 2001M1 to 2006M12 as compared to the crisis and post-crisis period 2007M1 to 2016M12. Results for annual output growth by GDP are excluded as fails to de-trend US GDP after 2000, see Figure 3.
If we compare concatenated against non-concatenated short-run FCIs in Figure 5, a location shift is clearly discernible for the output growth targets at the 2009M1 update. However, the shift is negligible and transient for inflation, further supporting the hypothesis that inflation is less susceptible to financial market conditions. The stability for the output growth targets before the crisis period is promising with regards to aggregation.

4.3. Prediction

This sub-section summarises the model form and predictive performance of the FCI-based model (2) as compared to the baseline model (1). Backward dynamic selection using the training sample yields the parsimonious models summarised in Table 5. The dynamics of the macro target variables are dominantly explained by their own lags and other real sector variables in both model (1) and (2), while the explanatory power of the financial variables is relatively minor, be it interest rates or FCIs. This is a common feature of aggregate macro-econometric models and explains why the financial side has been regarded as marginally important in those models. Consequently, the model framework delimits the degree of possible improvement of model (2) over model (1).
Considering the magnitudes of the own-lag parameter estimates in contrast to those of the financial variables, the inflation target is the least susceptible to the financial sector impact. Indeed, both R t and f t L drop out of the error correction term. Moreover, IP and GDP share the same model specification as far as the real-sector variables are concerned, with Δ 12 x t and Δ 12 y t entering with one lag each in both cases.
Results in Table 2, Table 3 and Table 5 reveal that FCIs contain more leading information than interest rates. For instance, in the case of IP, no input variable, except for the EC-term, contains leading information beyond 2 lags ahead in the baseline model, while the short-run FCI in model (2) contains leading information up to 12 lags ahead.
After each 12-month update over the testing period 2001M1–2006M12, 1-step to 6-step ahead forecasts are produced. Figure 6 plots the ratios of the 1-step ahead MSFE of the FCI-based model (2) over the baseline model (1) for annual inflation (CPI), annual output growth by GDP and annual output growth by IP. In the IP and GDP case, the FCI-based model outperforms the baseline model up to the 2006M1 update. In the inflation case, the baseline model marginally outperforms the FCI-based model in most years. Results provided in Table 5 and Figure 6 suggest that the main forecasting power in (2) relative to (1) stems from e t * , which is absent from the FCI-based model for inflation, explaining the underperformance.
Table 6 reports the average 1-step ahead MSFE of the baseline and the FCI-based model over the testing period 2001M1–2006M12, and two extended testing periods including the GFC, 2001M1–2010M12 and 2001M1–2017M12. The remaining downward trend in e t for GDP undermines the results for GDP and GDP is excluded for the experiments over the extended testing periods. The difference in MSFE is marginal for all three macro targets and the forecast encompassing tests by Harvey et al. (1997) reveal no significant distinction between model (1) and (2). However, forecast encompassing tests by Ericsson (1992) suggest that the FCI-based model encompasses the baseline model for all three macro targets. Results are significant at the 1 percent level for the two output growth targets and at the 5 percent level for the inflation target over the initial testing period.
Figure 7 compares the MSFE of the 1-step to 6-step ahead forecasts over the extended testing period 2001M1–2017M12 for IP and inflation. As expected, the difference in forecasting error between baseline and FCI-based model widens with increasing steps. On average, the outperformance of the baseline model by the FCI-model is maintained over the crisis and post crisis period for IP.
To conclude, the financial market effect on inflation is too indirect to be meaningful as a measure to enhance forecasting performance. However, for IP, where effects are more direct, preliminary results are promising.

5. Concluding Discussion

This section concludes with a discussion on the methodological implications of our pilot experiments and a reflection on future research directions. A summary of the empirical findings is already given in Section 1 and is hence omitted here. Treating the construction of model-based composite aggregates as supervised dimensionality reduction has opened up new territory. The prerequisite of choosing a clearly defined set of criteria, as compatible as possible to the task at hand, has guided the algorithmic modelling design. Two vital criteria are identified: concatenation and macro prediction in weight measurement construction, a key step in composite or synthetic index making, see OECD (2008).
Experiments with regularly concatenated FCIs demonstrate the extent to and ways in which dimensionality reduction of financial market frictions is empirically feasible as far as specific macro forecast tasks are concerned. From the input side, indicators of financial market frictions constitute the main ingredients of FCIs, and the dynamic forms by which they enter the FCIs are heterogenous and asynchronous. This finding demonstrates, once more, why the PCA approach is inappropriate. From the target side, our results show that concatenation is target sensitive. The closer a specified macro target is to financial market frictions, the more data permissible the concatenation operation and the stronger the predictive content of the resulting FCIs.
Two implications follow. First, the modelling approach can be used to identify macro variables that are susceptible to aggregate financial shocks through the estimated impact of FCIs and the loadings of their components. Second, concatenation becomes data impermissible when the targets are broad and virtually relate to the whole macroeconomy. This verifies that the quest for a universal (i.e., unsupervised) and useful measure of financial market risks for the forecasting of specific macro variables is a fantasy.
More research is needed to improve the current algorithmic model design before its potential can be fully tapped beyond academia. Reflection on the presented experimental findings yields the following observations about important aspects for the future research agenda.
  • On model conceptualisation: Essentially, the model-based FCIs are pooled and partial predictors. However, it can be challenging to reach a consensus on the interpretation of these predictors, in view of the intense debates and discussions on the nature of latent variables or composite variates in PLS regression modelling and formative measurement modelling.15 From the stance of statistical modelling, the question of interpretability touches on the crux of under what conditions a theoretical identity has a one-to-one mapping from a statistical identity, see Markus (2016). Aside from epistemological concerns, the discussion highlights the primary importance of the algorithm design to ensure consistency between math/statistical aggregation rules and desired properties of the theoretical constructs, e.g., see Munda (2012).
  • On model design: Improvements can be made from two sides. From the input side, more elaborate aggregation rules should be introduced with help from dimensionality reduction techniques in machine learning. For instance, multi-path or classification models should be experimented with to replace the man-made filtering step of redundant indicators. The possibility of interactive dynamics among indicators should also be considered to search for more effective and parsimonious ways to formulate dynamic input features. From the target side, more attention should be focused on how to exploit the target selection capacity of this modelling approach to better serve policy purposes.16
  • On model testing: Improvements of methods of model evaluation are desired at various stages. Here, active research is worth tracking in two areas. One is concerned with the quality of composite indicators and tackled by sensitivity analysis, see Saisana et al. (2005), and Dobbie and Dail (2013). The other is on evaluation of various aspects of formative PLS path models, such as content, construct, convergent and discriminant validity, see Andreev et al. (2009), and Bentler and Huang (2014).

Supplementary Materials

The following supporting information can be downloaded at:, Experiments reported here were coded and run in EViews. A translation of the code in R and documentation is available at

Author Contributions

Conceptualization, D.Q. and Q.C.W.; methodology, D.Q., Q.C.W. and S.v.H.; software, Q.C.W.; validation, formal analysis and investigation, S.v.H. and T.M.; resources and data curation, T.M.; writing, D.Q., S.v.H. and Q.C.W. All authors have read and agreed to the published version of the manuscript.


Qing Chao Wang was generously supported by Beijing Cairncross Economic Research Foundation when he worked on this project.

Data Availability Statement

Restrictions apply to the availability of these data. Data was obtained from Datastream and is available for users subscribed to the service.


This is a substantial extension of the earlier study by Qin and Wang (2016). We thank Yanqun Zhang for her help with GVAR, Ho Tak Yui for translating our algorithm into R code, and Huiwen Wang and Shan Lu for their technical advice on the use of PLS as well as various suggestions.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A

Algorithm A1 Long-Run FCI Construction
1:for each increasing update interval u h ,   h 0 to N do
2:  standardise each column of matrix I T + u h by its mean i ¯ j , T + u h and sd s i j , T + u h
3:  compute the weight vector φ ^ i = I T + u h T y T + u h
4:  set φ ^ h = φ ^ h / | φ ^ h |
5:  for j = 1 to m do
6:    for k = 0 to n do
7:      if | φ ^ j , k , h | = m a x n | φ ^ j , n , h | then
8:       φ ^ j , k , h = φ ^ j , k , h
9:      else
10:       φ ^ j , k , h = 0
11:      end if
12:    end for
13:  end for
14:  compute the first factor f T + u h = I T + u h φ ^ h
15:  compute LRFCI f T + u h L = f T + u h × s y T + u h + y ¯ T + u h
16:end for
Notes: Matrixes are bold and in capital letters and vectors are bold and in lower case. y T is the vector of the long-run target ( y t κ 1 X t ) as specified in (3). I T is a T by m × n matrix of financial indicators and their respective lagged versions. The selected φ ^ j , k , h in step 8 is φ ^ j , k * in (4). s x T indicates the standard deviation of vector x T and x ¯ T its mean.
Algorithm A2 Short-Run FCI Construction
1:for each increasing update interval u h ,   h 0 to N do
2:  standardise each column of matrix I T + u h by its mean i ¯ j , T + u h and sd s i j , T + u h
3:  set m * = 0 and c = 0
4:  for j = 1 to m do
5:    regress y T + u h on [ i j ,   T + u h 1 , i j ,   T + u h 2 ,   ,   i j ,   T + u h n ]
6:    extract 3 coefficients with smallest p-value (including intercept)
7:    regress on 3 selected variables
8:    drop insignificant coefficients with p-value larger than threshold p 0
9:    if there is at least one remaining variable then
10:       m * = m * + 1
11:      save the remaining coefficient estimates as ω ^ j , h
12:      set the other insignificant coefficient estimates to zero
13:      if intercept β o is significant then
14:         c = c + β o
15:      end if
16:    else
17:      set ω ^ j , h = 0
18:    end if
19:  end for
20:  compute SRFCI f T + u h S = 1 / m * ( I T + u h ω ^ h + c )
21:end for
Notes: Matrixes are bold and in capital letters and vectors are bold and in lower case. y T is the vector of the short-run target Δ y t as specified in (5). I T is a T by m × n matrix of financial indicators and their respective lagged versions. s x T indicates the standard deviation of vector x T and x ¯ T its mean.

Appendix B

Table A1. Variable definitions and data sources.
Table A1. Variable definitions and data sources.
VariableDescriptionSource Series Title
O13-month market interest rate of USReutersUS INTERBANK RATE–3 MONTH
O23-month market interest rate of UKBank of EnglandUK BOE LIBID/LIBOR–3 MONTH
O33-month market interest rate of CanadaIMF, International Financial StatisticsCN interest rates: money market rate NADJ
O43-month market interest rate of SwedenSveriges RiksbankSD interbank money rate: 3 months (EP) NADJ
O5Exchange rate of UKBank of EnglandGBP to USD (BOE)–Exchange rate
O6Exchange rate of CanadaReutersCanadian $ to US $ (WMR)–Exchange Rate
O7Exchange rate of SwedenBank of EnglandSEK to USD (BOE)–Exchange Rate
O8Forward exchange rate of UKReutersUK £ to US $ 3M FWD (WMR)–Exchange Rate
O9Forward exchange rate of Canada Barclays Bank PLCCanadian $ to US $ 3M FWD (BBI)–Exchange Rate
O10Forward exchange rate of SwedenBarclays Bank PLCSwedish Krona TO US $ 3M FWD (BBI)–Exchange Rate
O11Stock market index of USStandard and Poors (S&P)S&P 500 Composite–Price index
O12Stock market index of CanadaIMF, International Financial StatisticsCN Share prices, total NADJ
O13Stock market index of GermanyReutersBD DAX Share Price Index, EP NADJ
O14Stock market index of JapanTokyo Stock ExchangeTOPIX–Price Index
O15Stock market index of UKIMF, International Financial StatisticsUK Share Prices, TOTAL NADJ
O161-year government bondThomson Reuters DatastreamUnited States GVT BMK Bid Yield 1 Year
O1710-year government bond OECD, Main economic indicators US Yield 10-Year FED GVT SECS NADJ
O1830-year government bondThomson Reuters DatastreamTR US GVT BMK BID YLD 30Y (U$)–RED. YIELD
O193-month T billFederal ReserveUS T-BILL 3 Month (W)
O206-month T billFederal ReserveUS T-BILL 6 Month (W)
O26Lending rate Federal ReserveUS Prime rate charged by banks (Month avg) NADJ
O27Mortgage rateFreddie MacMortgage Lending Rates, Conforming 30-Year Fixed Rate Mortgage, Total, Average Interest Rate
O28Mortgage volume of the banking sectorFederal ReserveUS Commercial Bank Assets–Real estate loans
O29Loan volume of the banking sectorFederal ReserveUS Commercial Bank Assets–Loans & Leases in Bank credit
O30Total liabilities of the banking sectorFederal ReserveUS Commercial Bank Liabilities–Total
O31Equity of the banking sectorFederal ReserveUS Commercial Bank Residual (Assets less Liabilities)
O32Deposit volume of the banking sectorFederal ReserveUS Commercial Bank Liabilities–Deposits
O33M1 Federal ReserveUS Money Supply M1
O34Real effective exchange rateIMF, International Financial StatisticsUS Real Effective FX Rate (REER) Based on Consumer price index
O35Consumer Price IndexOECD, Main economic indicators US CPI All items NADJ
O36Producer Price IndexBureau of Labor Statistics, U.S. Department of LaborUS PPI–All Commodities
O37Industrial Production IndexFederal ReserveUS Industrial Production–Total Index VOLA
O38GDP (quarterly)OECD, Main economic indicators US Gross Domestic Product (at COnstant PPP)
O39Global output (quarterly)From Di Mauro and Pesaran (2013)


The inadequacy of capturing the financial sector impact in macro modelling has been highlighted recently from a broader angle in a special issue of Oxford Review of Economic Policy vol. 34, i.e., see Stiglitz (2018), and Vines and Wills (2018).
The PLS method was proposed by H. Wold (1966, 1975, 1980); for more background information, see Wegelin (2000), Sanchez (2013) and McIntosh et al. (2014). It has been extended into the causal interpretation of PLS path modelling in relation to measurement theory, see Vinzi et al. (2010), Howell et al. (2013) and Howell (2014). A few trial applications of PLS can be found in the econometric literature: e.g., Lin and Tsay (2005), Eickmeier and Ng (2011), Lannsjö (2014), Kelly and Pruitt (2015), Fuentes et al. (2015), Groen and Kapetanios (2016), and Kapetanios et al. (2018), but none has adopted the causal model basis of the method.
Historically, the reflective model is referred to as ‘mode A’ and the formative model ‘mode B’, see Wold (1980) and also Vinzi et al. (2010). In a reflective model, weights are identified by the assumption of conditional independence, i.e., all the manifest indicators are effects of one common cause. In contrast, this assumption does not apply to the formative model. Hence, the weights of the indicators in a formative model cannot be identified by a single criterion, such as the common variance criterion of PCA. An additional criterion is needed for the identification (Markus and Borsboom 2013, p. 113).
Although the concept of supervised versus unsupervised data reduction is unfamiliar to economists, the idea of targeting the index construction process at dependent variables has been around since early warning systems research, e.g., Gramlich et al. (2010). The method of selecting indicators based on their ability to signal turning points in Levanon et al. (2015) effectively follows the supervised learning approach.
This incorrect formalization of problems falls into what is referred to as ‘Type III error’ by Hand (1994, p. 317).
See Breiman (2001) for a brilliant description of the algorithmic modelling approach as compared to the traditional statistical modelling approach.
Evidence of lack of volatility synchronization among financial indicators has been discussed in the literature, e.g., Cesa-Bianchi et al. (2014).
When this long-run combination of the ECM fits the description of cointegration, our formulation can be interpreted as exploiting the Granger-Engle two-step procedure.
The design is illustrated by diagram van Huellen et al. (2022), see Step 3 in Figure 1.
See Di Mauro and Pesaran (2013) for the data source and definition.
Selection of the unprocessed series is carried out with reference to Alessi and Detken (2011), Hatzius et al. (2010), Bisias et al. (2012), and Moccero et al. (2014). Particular attention is paid to the coverage of credit and property price information, see Borio (2014b). The processed data series are downloaded from: (accessed on 11 April 2022); see Giglio et al. (2016) Table 1 Systemic Risk Measures.
This view corresponds closely to Borio’s (2014a) ‘excess financial elasticity’ hypothesis.
Estimating the unrestricted ECM showed that the imposition agrees with data information. A natural extension of this imposition is calibration, a commonly used method in macro DSGE modelling practice, i.e., experimenting with small variation of the imposed values to choose the best possible one by certain modelling criteria, see van Huellen et al. (2022).
For the recent literature, see Rigdon (2012), Rönkkö and Evermann (2013), Henseler et al. (2014), Bentler and Huang (2014), Hair et al. (2017) and also the November issue, vol. 44 (2013) of the DATABASE for Advances in Information Systems, Aguirre-Urreta et al. (2016) and all its commentaries in vol. 14 (3–4) of Measurement: Interdisciplinary Research and Perspectives.
Experiments in a subsequent research project have already yielded some encouraging results on this point, see van Huellen et al. (2022).


  1. Aguirre-Urreta, Miguel I., Mikko Rönkkö, and George M. Marakas. 2016. Omission of Causal Indicators: Consequences and Implications for Measurement—A Rejoinder. Measurement: Interdisciplinary Research and Perspectives 14: 170–75. [Google Scholar] [CrossRef]
  2. Alessi, Lucia, and Carsten Detken. 2011. Quasi Real Time Early Warning Indicators for Costly Asset Price Boom/Bust Cycles: A Role for Global Liquidity. European Journal of Political Economy 27: 520–33. [Google Scholar] [CrossRef]
  3. Andreev, Pavel, Tsipi Heart, Hanan Maoz, and Nava Pliskin. 2009. Validating Formative Partial Least Squares (PLS) Models: Methodological Review and Empirical Illustration. ICIS 2009 Proceedings 193. Available online: (accessed on 11 April 2022).
  4. Aramonte, Sirio, Samuel Rosen, and John W. Schindler. 2017. Assessing and Combining Financial Conditions Indexes. International Journal of Central Banking 13: 1–52. [Google Scholar]
  5. Barnett, William A. 2012. Getting It Wrong: How Faulty Monetary Statistics Undermine the Fed, the Financial System, and the Economy. Cambridge: The MIT Press. [Google Scholar]
  6. BCBS. 2011. The Transmission Channels between the Financial and Real Sectors: A Critical Survey of the Literature, February. Available online: (accessed on 11 April 2022).
  7. Bentler, Peter M., and Wenjing Huang. 2014. On Components, Latent Variables, PLS and Simple Methods: Reactions to Rigdon’s Rethinking of PLS. Long Range Planning, Rethinking Partial Least Squares Path Modeling: Looking Back and Moving Forward 47: 138–45. [Google Scholar] [CrossRef] [PubMed][Green Version]
  8. Bisias, Dimitrios, Mark Flood, Andrew W. Lo, and Stavros Valavanis. 2012. A Survey of Systemic Risk Analytics. Annual Review of Financial Economics 4: 255–96. [Google Scholar] [CrossRef][Green Version]
  9. Borio, Claudio. 2011. Rediscovering the Macroeconomic Roots of Financial Stability Policy: Journey, Challenges, and a Way Forward. Annual Review of Financial Economics 3: 87–117. [Google Scholar] [CrossRef][Green Version]
  10. Borio, Claudio. 2013. The Great Financial Crisis: Setting Priorities for New Statistics. Journal of Banking Regulations 14: 306–17. [Google Scholar] [CrossRef]
  11. Borio, Claudio. 2014a. The Financial Cycle and Macroeconomics: What Have We Learnt? Journal of Banking & Finance 45: 182–98. [Google Scholar] [CrossRef][Green Version]
  12. Borio, Claudio. 2014b. The International Monetary and Financial System: Its Achilles Heel and What to Do about It. International Political Economy: Investment & Finance eJournal, 1–27. [Google Scholar] [CrossRef]
  13. Borio, Claudio, and Philip Lowe. 2002. Asset Prices, Financial and Monetary Stability: Exploring the Nexus. BIS Working Paper No. 114. Basel: Bank for International Settlements. [Google Scholar] [CrossRef][Green Version]
  14. Brave, Scott, and R. Andrew Butters. 2011. Monitoring Financial Stability: A Financial Conditions Index Approach. Economic Perspectives 35: 22–43. [Google Scholar]
  15. Breiman, Leo. 2001. Statistical Modeling: The Two Cultures (with Comments and a Rejoinder by the Author). Statistical Science 16: 199–231. [Google Scholar] [CrossRef]
  16. Cesa-Bianchi, Ambrogio, M. Hashem Pesaran, and Alessandro Rebucci. 2014. Uncertainty and Economic Activity: A Global Perspective. 4736. CESifo Working Paper Series. CESifo Group Munich. Available online: (accessed on 11 April 2022).
  17. Chauvet, Marcelle, Zeynep Senyuz, and Emre Yoldas. 2015. What Does Financial Volatility Tell Us about Macroeconomic Fluctuations? Journal of Economic Dynamics and Control 52: 340–60. [Google Scholar] [CrossRef][Green Version]
  18. Clements, Michael P., and David F. Hendry. 1993. On the Limitations of Comparing Mean Square Forecast Errors. Journal of Forecasting 12: 617–37. [Google Scholar] [CrossRef]
  19. Cox, David, R. Fitzpatrick, Astrid Fletcher, Sheila Gore, D. J. Spiegelhalter, and D. R. Jones. 1992. Quality-of-Life Assessment: Can We Keep It Simple? Journal of the Royal Statistical Society: Series A (Statistics in Society) 155: 353. [Google Scholar] [CrossRef][Green Version]
  20. Cunningham, John P., and Zoubin Ghahramani. 2015. Linear Dimensionality Reduction: Survey, Insights, and Generalizations. Journal of Machine Learning Research 16: 2859–900. [Google Scholar]
  21. Di Mauro, Filippo, and M. Hashem Pesaran. 2013. The GVAR Handbook: Structure and Applications of a Macro Model of the Global Economy for Policy Analysis. Oxford: Oxford University Press. [Google Scholar]
  22. Dobbie, Melissa J., and David Dail. 2013. Robustness and Sensitivity of Weighting and Aggregation in Constructing Composite Indices. Ecological Indicators 29: 270–77. [Google Scholar] [CrossRef]
  23. Drehmann, Mathias, Claudio Borio, and Kostas Tsatsaronis. 2012. Characterising the Financial Cycle: Don’t Lose Sight of the Medium Term! BIS Working Paper No. 380. Available online: (accessed on 11 April 2022).
  24. Eickmeier, Sandra, and Tim Ng. 2011. Forecasting National Activity Using Lots of International Predictors: An Application to New Zealand. International Journal of Forecasting 27: 496–511. [Google Scholar] [CrossRef][Green Version]
  25. Ericsson, Neil R. 1992. Parameter Constancy, Mean Square Forecast Errors, and Measuring Forecast Performance: An Exposition, Extensions, and Illustration. Journal of Policy Modeling 14: 465–95. [Google Scholar] [CrossRef][Green Version]
  26. Ericsson, Neil R. 1993. On the Limitations of Comparing Mean Square Forecast Errors: Clarifications and Extensions. Journal of Forecasting 12: 644–51. [Google Scholar] [CrossRef]
  27. Fuentes, Julieta, Pilar Poncela, and Julio Rodríguez. 2015. Sparse Partial Least Squares in Time Series for Macroeconomic Forecasting. Journal of Applied Econometrics 30: 576–95. [Google Scholar] [CrossRef][Green Version]
  28. Gadanecz, Blaise, and Kaushik Jayaram. 2009. Measures of Financial Stability—A Review. IFC Bulletins Chapters. Bank for International Settlements. Available online: (accessed on 11 April 2022).
  29. Giglio, Stefano, Bryan Kelly, and Seth Pruitt. 2016. Systemic Risk and the Macroeconomy: An Empirical Evaluation. Journal of Financial Economics 119: 457–71. [Google Scholar] [CrossRef]
  30. Gramlich, Dieter, Gavin Miller, Mikhail V. Oet, and Stephen J. Ong. 2010. Early Warning Systems for Systemic Banking Risk: Critical Review and Modeling Implications. Bank and Bank Systems 5: 199–211. [Google Scholar]
  31. Groen, Jan J. J., and George Kapetanios. 2016. Revisiting Useful Approaches to Data-Rich Macroeconomic Forecasting. Computational Statistics & Data Analysis 100: 221–39. [Google Scholar] [CrossRef][Green Version]
  32. Hair, Joe, Carole L. Hollingsworth, Adriane B. Randolph, and Alain Yee Loong Chong. 2017. An Updated and Expanded Assessment of PLS-SEM in Information Systems Research. Industrial Management & Data Systems 117: 442–58. [Google Scholar] [CrossRef]
  33. Hand, David J. 1994. Deconstructing Statistical Questions. Journal of the Royal Statistical Society. Series A (Statistics in Society) 157: 317–56. [Google Scholar] [CrossRef]
  34. Harvey, David, Stephen J. Leybourne, and Paul Newbold. 1997. Testing the Equality of Prediction Mean Squared Errors. International Journal of Forecasting 13: 281–91. [Google Scholar] [CrossRef]
  35. Harvey, David, Stephen J. Leybourne, and Paul Newbold. 1998. Tests for Forecast Encompassing. Journal of Business & Economic Statistics 16: 254–59. [Google Scholar] [CrossRef]
  36. Hastie, Trevor, Robert Tibshirani, and Jerome Friedman. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. Springer Series in Statistics; New York: Springer, Available online: (accessed on 11 April 2022).
  37. Hatzius, Jan, Peter Hooper, Frederic S Mishkin, Kermit L Schoenholtz, and Mark W. Watson. 2010. Financial Conditions Indexes: A Fresh Look after the Financial Crisis. NBER Working Paper 16150. Cambridge: National Bureau of Economic Research. [Google Scholar] [CrossRef]
  38. Hayduk, Leslie A., Hannah Pazderka Robinson, Greta G. Cummings, Kwame Boadu, Eric L. Verbeek, and Thomas A. Perks. 2007. The Weird World, and Equally Weird Measurement Models: Reactive Indicators and the Validity Revolution. Structural Equation Modeling: A Multidisciplinary Journal 14: 280–310. [Google Scholar] [CrossRef]
  39. Hendry, David F. 1995. Dynamic Econometrics. Oxford: Oxford University Press. [Google Scholar]
  40. Henseler, Jörg, Theo K. Dijkstra, Marko Sarstedt, Christian M. Ringle, Adamantios Diamantopoulos, Detmar W. Straub, David J. Ketchen, Joseph F. Hair, G. Tomas M. Hult, and Roger J. Calantone. 2014. Common Beliefs and Reality About PLS: Comments on Rönkkö and Evermann (2013). Organizational Research Methods 17: 182–209. [Google Scholar] [CrossRef][Green Version]
  41. Howell, Roy D. 2014. What Is the Latent Variable in Causal Indicator Models? Measurement: Interdisciplinary Research and Perspectives 12: 141–45. [Google Scholar] [CrossRef]
  42. Howell, Roy D., Einar Breivik, and James Wilcox. 2013. Formative Measurement: A Critical Perspective. ACM SIGMIS Database 44: 44–55. [Google Scholar] [CrossRef]
  43. Kapetanios, George, Simon Price, and Garry Younge. 2018. A UK Financial Conditions Index Using Targeted Data Reduction: Forecasting and Structural Identification. Econometrics and Statistics 7: 1–17. [Google Scholar] [CrossRef][Green Version]
  44. Kelly, Bryan T., and Seth Pruitt. 2015. The Three-Pass Regression Filter: A New Approach to Forecasting Using Many Predictors. Journal of Econometrics 186: 294–316. [Google Scholar] [CrossRef]
  45. Kotchoni, Rachidi, Maxime Leroux, and Dalibor Stevanovic. 2019. Macroeconomic Forecast Accuracy in a Data-Rich Environment. Journal of Applied Econometrics 34: 1050–72. [Google Scholar] [CrossRef]
  46. Lannsjö, Fredrik. 2014. Forecasting the Business Cycle Using Partial Least Squares. Available online: (accessed on 11 April 2022).
  47. Levanon, Gad, Jean-Claude Manini, Ataman Ozyildirim, Brian Schaitkin, and Jennelyn Tanchua. 2015. Using Financial Indicators to Predict Turning Points in the Business Cycle: The Case of the Leading Economic Index for the United States. International Journal of Forecasting 31: 426–45. [Google Scholar] [CrossRef]
  48. Lin, Jin-lung, and Ruey S. Tsay. 2005. Comparisons of Forecasting Methods with Many Predictors. Working Paper. Available online: (accessed on 11 April 2022).
  49. Marcellino, Massimiliano. 2006. Leading Indicators. In Handbook of Economic Forecasting, Vol. 1. Amsterdam: North Holland. [Google Scholar] [CrossRef]
  50. Markus, Keith A. 2016. Causal Measurement Models: Can Criticism Stimulate Clarification? Measurement: Interdisciplinary Research and Perspectives 14: 110–13. [Google Scholar] [CrossRef]
  51. Markus, Keith A., and Denny Borsboom. 2013. Frontiers of Test Validity Theory: Measurement, Causation, and Meaning, 1st ed. New York: Routledge. [Google Scholar]
  52. McIntosh, Cameron N., Jeffrey R. Edwards, and John Antonakis. 2014. Reflections on Partial Least Squares Path Modeling. Organizational Research Methods 17: 210–51. [Google Scholar] [CrossRef][Green Version]
  53. Moccero, Diego Nicolas, Matthieu Darracq Pariès, and Laurent Maurin. 2014. Financial Conditions Index and Credit Supply Shocks for the Euro Area. International Finance 17: 297–321. [Google Scholar] [CrossRef]
  54. Morley, James. 2016. Macro-Finance Linkages. Journal of Economic Surveys 30: 698–711. [Google Scholar] [CrossRef]
  55. Munda, Giuseppe. 2012. Choosing Aggregation Rules for Composite Indicators. Social Indicators Research 109: 337–54. [Google Scholar] [CrossRef]
  56. Ng, Tim. 2011. The Predictive Content of Financial Cycle Measures for Output Fluctuations. Risk Management Journal, 1–13. Available online: (accessed on 11 April 2022).
  57. OECD. 2008. Handbook on Constructing Composite Indicators: Methodology and User Guide. Paris: OECD Publishing. [Google Scholar] [CrossRef]
  58. Qin, Duo, and Qing Chao Wang. 2016. Predictive Macro-Impacts of PLS-based Financial Conditions Indices: An Application to the USA. SOAS Department of Economics Working Paper Series No. 201. Available online: (accessed on 11 April 2022).
  59. Qin, Duo, and Xinhua He. 2012. Modelling the Impact of Aggregate Financial Shocks External to the Chinese Economy. BOFIT Discussion Paper No. 25/2012. Available online: (accessed on 11 April 2022).
  60. Rigdon, Edward E. 2012. Rethinking Partial Least Squares Path Modeling: In Praise of Simple Methods. Long Range Planning, Analytical Approaches to Strategic Management: Partial Least Squares Modeling in Strategy Research 45: 341–58. [Google Scholar] [CrossRef]
  61. Rönkkö, Mikko, and Joerg Evermann. 2013. A Critical Examination of Common Beliefs About Partial Least Squares Path Modeling. Organizational Research Methods 16: 425–48. [Google Scholar] [CrossRef]
  62. Saisana, Michaela, Andrea Saltelli, and Stefano Tarantola. 2005. Uncertainty and Sensitivity Analysis Techniques as Tools for the Quality Assessment of Composite Indicators. Journal of the Royal Statistical Society: Series A (Statistics in Society) 168: 307–23. [Google Scholar] [CrossRef]
  63. Sanchez, G. 2013. PLS Path Modeling with R. Berkeley: Trowchez Editions 383: 551. [Google Scholar]
  64. Shalev-Shwartz, Shai, and Shai Ben-David. 2014. Understanding Machine Learning: From Theory to Algorithms. New York: Cambridge University Press. [Google Scholar]
  65. Stiglitz, Joseph E. 2018. Where Modern Macroeconomics Went Wrong. Oxford Review of Economic Policy 34: 70–106. [Google Scholar] [CrossRef]
  66. Stock, James H., and Mark W. Watson. 1989. New Indexes of Coincident and Leading Economic Indicators. Working Paper 1380. NBER Macroeconomics Annual 4: 351–409. [Google Scholar] [CrossRef]
  67. Stock, James H., and Mark W. Watson. 2002. Macroeconomic Forecasting Using Diffusion Indexes. Journal of Business & Economic Statistics 20: 147–62. [Google Scholar] [CrossRef][Green Version]
  68. Stock, James H., and Mark W. Watson. 2009. The Methodology and Practice of Econometrics: Festschrift in Honour of David F. Hendry. Oxford: Oxford University Press. [Google Scholar]
  69. Stock, James H., and Mark W. Watson. 2011. Dynamic Factor Models. Oxford: The Oxford Handbook of Economic Forecasting. [Google Scholar] [CrossRef]
  70. Terry, Leann, and Ken Kelley. 2012. Sample Size Planning for Composite Reliability Coefficients: Accuracy in Parameter Estimation via Narrow Confidence Intervals. The British Journal of Mathematical and Statistical Psychology 65: 371–401. [Google Scholar] [CrossRef]
  71. van Huellen, Sophie, Duo Qin, Shan Lu, Huiwen Wang, Qing Chao Wang, and Thanos Moraitis. 2022. Modelling Opportunity Cost Effects in Money Demand Due to Openness. International Journal of Finance & Economics 27: 697–744. [Google Scholar] [CrossRef]
  72. Vines, David, and Samuel Wills. 2018. The Financial System and the Natural Real Interest Rate: Towards a ‘New Benchmark Theory Model’. Oxford Review of Economic Policy 34: 252–68. [Google Scholar] [CrossRef]
  73. Vinzi, Vincenzo Esposito, Laura Trinchera, and Silvano Amato. 2010. PLS Path Modeling: From Foundations to Recent Developments and Open Issues for Model Assessment and Improvement. In Handbook of Partial Least Squares: Concepts, Methods and Applications. Edited by Vincenzo Esposito Vinzi, Wynne W. Chin, Jörg Henseler and Huiwen Wang. Springer Handbooks of Computational Statistics. Berlin/Heidelberg: Springer, pp. 47–82. [Google Scholar] [CrossRef]
  74. Wang, Qing Chao. 2017. Testing a New Approach to Construct International Financial Market Indices: An Application to Asian-Pacific Economies. Ph.D. Thesis, SOAS University of London, London, UK. [Google Scholar]
  75. Wegelin, Jacob A. 2000. A Survey of Partial Least Squares (PLS) Methods, with Emphasis on the Two-Block Case. Technical Report. Seattle: Department of Statistics, University of Washington. [Google Scholar]
  76. Wold, Herman. 1966. Estimation of principal component and related models by iterative least squares. In Multivariate Analysis. New York: Academic Press, pp. 391–420. [Google Scholar]
  77. Wold, Herman. 1975. PLS path models with latent variables: The NIPALS approach. In Quantitative Sociology: International Perspectives on Mathematical and Statistical Modeling. Edited by Hubert M. Blalock, Abel Aganbegian, Fridrich M. Borodkin, Raymond Boudon and Vittorio Cappecchi. New York: Academic Press. [Google Scholar]
  78. Wold, Herman. 1980. Model Construction and Evaluation When Theoretical Knowledge Is Scarce. In Evaluation of Econometric Models. New York: Academic Press, pp. 47–74. [Google Scholar] [CrossRef][Green Version]
Figure 1. Illustration of Concatenation.
Figure 1. Illustration of Concatenation.
Econometrics 10 00022 g001
Figure 2. Short-Run Macro Targets and US Interest Rates. Note: Short-run macro targets in annual growth rates Δ 12 y t and US interest rates R t . 1980M1–2017M12.
Figure 2. Short-Run Macro Targets and US Interest Rates. Note: Short-run macro targets in annual growth rates Δ 12 y t and US interest rates R t . 1980M1–2017M12.
Econometrics 10 00022 g002
Figure 3. Long-Run Macro Targets and Error Correction Terms. Note: Macro targets y t x t (left) and error correction term e t * = y t x t f t L (right). 1980M1–2017M12.
Figure 3. Long-Run Macro Targets and Error Correction Terms. Note: Macro targets y t x t (left) and error correction term e t * = y t x t f t L (right). 1980M1–2017M12.
Econometrics 10 00022 g003
Figure 4. Short-Run FCIs. Note: SRFCI is f t S constructed by targeting Δ 12 y t (left). D12LRFCI is Δ 12   f t L constructed by targeting long run macro targets and annual differencing of the resulting long run FCIs (right). 1980M1–2017M12.
Figure 4. Short-Run FCIs. Note: SRFCI is f t S constructed by targeting Δ 12 y t (left). D12LRFCI is Δ 12   f t L constructed by targeting long run macro targets and annual differencing of the resulting long run FCIs (right). 1980M1–2017M12.
Econometrics 10 00022 g004
Figure 5. Squared Difference Concatenated versus Non-Concatenated FCI. Note: Squared difference between concatenated and non-concatenated short-run FCIs f t S targeted at Δ y t following (3) and (4) over repeated 12-month periods, updating 2001M1–2016M12.
Figure 5. Squared Difference Concatenated versus Non-Concatenated FCI. Note: Squared difference between concatenated and non-concatenated short-run FCIs f t S targeted at Δ y t following (3) and (4) over repeated 12-month periods, updating 2001M1–2016M12.
Econometrics 10 00022 g005
Figure 6. MSFE Ratio Over Repeated Updates 2001M1–2006M12. Note: MSFE of baseline model (1) over the FCI-augmented model (2) over the testing period 2001M1–2006M12 for 1-step ahead forecasts over repeated 12-month updates. A value < 1 implies that (2) produces a smaller MSFE than (1).
Figure 6. MSFE Ratio Over Repeated Updates 2001M1–2006M12. Note: MSFE of baseline model (1) over the FCI-augmented model (2) over the testing period 2001M1–2006M12 for 1-step ahead forecasts over repeated 12-month updates. A value < 1 implies that (2) produces a smaller MSFE than (1).
Econometrics 10 00022 g006
Figure 7. MSFE Ratio Over Extended Testing Period 2001M1–2017M12. Note: MSFE of baseline model (1) over the FCI-augmented model (2) over the extended testing period 2001M1–2017M12 for 1-step to 6-step ahead forecasts. A value < 1 implies that (2) produces a smaller MSFE than (1).
Figure 7. MSFE Ratio Over Extended Testing Period 2001M1–2017M12. Note: MSFE of baseline model (1) over the FCI-augmented model (2) over the extended testing period 2001M1–2017M12 for 1-step to 6-step ahead forecasts. A value < 1 implies that (2) produces a smaller MSFE than (1).
Econometrics 10 00022 g007
Table 1. List of Input Indicators.
Table 1. List of Input Indicators.
Group Ind.Indicator DescriptionConstruction
Forex MarketI1CIP vis-à-vis UK sterling ln(O2)−ln(O1)−(ln(O8)−ln(O5))
I2CIP vis-à-vis Canadian dollarln(O3)−ln(O1)−(ln(O9)−ln(O6))
I3CIP vis-à-vis Sweden kronaln(O4)−ln(O1)−(ln(O10)−ln(O7))
I4Real effective rate of US dollarO29
Equity MarketI5Ratio of SMI: Canada/USAO12/O11
I6Ratio of SMI: Germany/USAO13/O11
I7Ratio of SMI: Japan/USAO13/O11
I8Ratio of SMI: UK/USAO14/O11
Fixed Income MarketI9TB spread: 10-to-1 yearsO17−O16
I10TB spread: 30-to-10 yearsO18−O17
I11TB spread: 30-to-1 yearsO18−O16
I12TB spread: 6-to-3 monthsO20−O19
I13TED spread: interbank loan to TB ratesO19−O1
Banking SectorI14Total liability to equity ratio of the banking sector O25/O26
I15Total lending to deposit ratio of the banking sectorO24/O27
I16IR spread: lending-to-deposit ratesO21/O1
I17Debt to liquidity ratio: M1 to liquidityO28/O25
I18IR spread: mortgage-to-bond ratesO22−O18
I19Bank lending: mortgage to loan ratioO23/O24
Systemic Risk MeasuresI22CatFin: Institution specific value-at-risk measureGiglio et al. (2016)
I23CoVar: Value-at-risk measure Giglio et al. (2016)
I24Mes: Institution specific exposure to shocks measureGiglio et al. (2016)
I25Mes_be: Variation of MesGiglio et al. (2016)
I26Dci: Interconnectedness of financial institutions Giglio et al. (2016)
I27Size_conc: Size concentration of financial institutionsGiglio et al. (2016)
Notes: Covered interest rate parity (CIP), stock market indices (SMI), treasury bond (TB), interest rate (IR). The corresponding variables used for the indicator construction can be found in the Appendix B.
Table 2. Representative Indicator Loadings φ ^ j , k * for Long-Run Macro Targets y t x t Over the Testing Period 2001M1–2006M12.
Table 2. Representative Indicator Loadings φ ^ j , k * for Long-Run Macro Targets y t x t Over the Testing Period 2001M1–2006M12.
ForexI100.05370, 6−0.04480, 6−0.1395
I23, 5−0.01170, 2, 60.01446, 5−0.1122
I32, 6, 0−0.00172, 6, 00.00650, 3, 6−0.1252
I40−0.05446, 00.065500.0664
EquityI52, 4, 6−0.15340, 4, 60.14035, 60.0817
I60, 40.06126, 0−0.04930−0.0855
I80, 1−0.07830, 60.08156, 0−0.0158
Fixed IncomeI960.04500, 6−0.03870, 6−0.1185
I100, 50.08500, 6−0.08540−0.1047
I1160.05960, 6−0.05540, 6−0.1266
I122−0.01891, 20.01142, 60.0071
I134, 20.11500, 1−0.10220−0.1240
Banking SectorI140−0.123600.127400.0379
I151, 60.13313, 6, 0−0.12526−0.0325
I170−0.068400.07330, 6−0.0153
I184−0.09094, 0, 60.083900.1004
Note: Bold figures indicate stable lag structure over repeated updates. Italic figures indicate insignificant loadings < 0.05. Loadings > 0.1 are highlighted in light grey. The long run targets y t x t are constructed as following: inflation with y t = C P I and x t = P P I ; GDP with y t = G D P US and x t = W o r l d   G D P ; IP with y t = I P and x t = G D P .
Table 3. Representative Indicator Loadings ω ^ j for Short-Run Macro Targets Δ y t Over the Testing Period 2001M1–2006M12.
Table 3. Representative Indicator Loadings ω ^ j for Short-Run Macro Targets Δ y t Over the Testing Period 2001M1–2006M12.
Fixed IncomeI9L16−0.0131D16|L6−0.0103|0.0013D16|L6−0.0156|0.0031
Banking SectorI14D16|L10.0107|0.0062D16|L1−0.0271|−0.0003D16|L1−0.0403|−0.0039
Note: Short-run macro targets in annual growth rates. Unstable lag structure indicated by NA in the lag column. D16|L1 means a difference between the 1st and the 6th lag with a remaining level on the 1st lag.
Table 4. Representative Indicator Loadings for (A) Long-Run and (B) Short-Run Macro Targets for 2001M1–2006M12 (pre) and 2007M1–2016M12 (post) Testing Period.
Table 4. Representative Indicator Loadings for (A) Long-Run and (B) Short-Run Macro Targets for 2001M1–2006M12 (pre) and 2007M1–2016M12 (post) Testing Period.
(A) Long-Run Macro Targets y t x t
Lag Cha.LoadingsLag Cha.Loadings
Fixed IncomeI9000.04500.04840.0012−0.1185−0.10300.02
Banking SectorI1400−0.1236−0.11260.01000.03790.10930.07
(B) Short-Run Macro Targets Δ y i t
Lag Cha.LoadingsLag Cha.Loadings
Fixed IncomeI901−0.0131−0.011800−0.0156|0.0031−0.0194|−0.0019
Banking SectorI14030.0107|0.00620.0189|0.008000−0.0403|−0.0039−0.0475|0.0027
Note: Lag changes (Lag Cha.) counts the number of times the lag structure changes over the training period. For (A) difference between loadings (Diff.) is in absolute values.
Table 5. Models (1) and (2) Over the Training Sample 1982M1–2000M12.
Table 5. Models (1) and (2) Over the Training Sample 1982M1–2000M12.
(A) CPI-Based Annual Inflation
y t Is CPI. x t Is PPI.
Model (1)–BaselineModel (2)–FCI-Based
α 0 0.0019 [0.0005] ** α 0 0.0021 [0.0005] **
Δ 12 y t 1 1.1278 [0.0567] ** Δ 12 y t 1 1.1362 [0.0566] **
Δ 12 y t 2 −0.2065 [0.0516] ** Δ 12 y t 2 −0.2233 [0.0513] **
Δ 12 x t 0.2074 [0.0214] ** Δ 12 x t 0.2114 [0.0214] **
Δ 12 x t 1 −0.1797 [0.0226] ** Δ 12 x t 1 −0.1790 [0.0226] **
e t 12 −0.0049 [0.0019] * e t 12 −0.0047 [0.0019] *
Δ r t 4 S 0.1011 [0.0277] ** Δ 3 Δ 12 f t 3 L −0.0130 [0.0034] **
(B) Annual GDP Growth
y t Is US GDP. x t Is GDP World.
Model (1)–BaselineModel (2)–FCI-Based
α 0 −0.0200 [0.0051] ** α 0 −0.0022 [0.0014]
Δ 12 y t 1 0.8632 [0.0281] ** Δ 12 y t 1 0.8227 [0.0296] **
Δ 12 x t 1.0090 [0.0528] ** Δ 12 x t 0.9854 [0.9854] **
Δ 12 x t 1 −0.8279 [0.0590] ** Δ 12 x t 1 −0.7831 [0.0584] **
e t 12 −0.0643 [0.0151] ** e t 12 * −0.1464 [0.0261] **
Δ 2 ( r L r S ) t 3 −0.2394 [0.0754] ** Δ f t 3 S 0.8527 [0.3809] *
(C) Annual IP Growth
y t Is US Industrial Production. x t is US GDP.
Model (1)–BaselineModel (2)–FCI-Based
α 0 0.1361 [0.0221] ** α 0 0.0607 [0.0102] **
Δ 12 y t 1 0.8471 [0.0239] ** Δ 12 y t 1 0.8741 [0.0217] **
Δ 12 x t 0.6300 [0.0420] ** Δ 12 x t 0.6068 [0.0408] **
Δ 12 x t 1 −0.3308 [0.0470] ** Δ 12 x t 1 −0.4186 [0.0456] **
e t 12 −0.1124 [0.0179] ** e t 12 * −0.1688 [0.0275] **
Δ 4 ( r L r S ) t 2 0.1659 [0.0519] ** Δ f t 6 S 0.7402 [0.2152] **
Note: r t s and r t L are the short-term and long-term interest rate respectively. e t = y t κ 1 x t κ 2 R t   with   R t = r t L δ r t s . Coefficient estimates for κ 2 and δ are determined by allowing R t to enter e t unrestrictedly. e t * = y t κ 1 x t f t L with κ 1 = 1 and f t L being the long-run FCI targeted at y t x t . For CPI κ 2 = 0 , for GDP κ 2 = 2 and δ = 0 , and for IP κ 2 = 1.4 and δ = 1 . f t S is the short-run FCI targeted at Δ 12 y t . Standard errors in [.]. ** indicates 1% and * indicates 5% significance level.
Table 6. 1-Step Ahead MSFE of Baseline and FCI-based Model and Forecast Encompassing Tests.
Table 6. 1-Step Ahead MSFE of Baseline and FCI-based Model and Forecast Encompassing Tests.
Forecast Encompassing Tests
MSFE Baseline (1)MSFE FCI-Based (2)Harvey et al. (1997)Ericsson (1992)
CPI0.00270.00270.40820.55000.27540.0443 *
GDP0.00660.00680.41470.47620.93570.0028 **
IP0.00650.00640.43360.42000.73810.0029 **
IP0.00960.00950.47600.43610.42720.0221 *
CPI0.00240.00240.44310.50720.78150.0341 *
IP0.00870.00850.48090.41990.0424*0.0092 **
Note: Recursive MSFE for 1-step ahead forecasts over repeated 12-month updates. H1: the FCI-based model (2) encompasses the baseline model (1); H2: the baseline model (1) encompasses the FCI-based model (2). * indicates 5% significance level and ** indicates 1%.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Qin, D.; van Huellen, S.; Wang, Q.C.; Moraitis, T. Algorithmic Modelling of Financial Conditions for Macro Predictive Purposes: Pilot Application to USA Data. Econometrics 2022, 10, 22.

AMA Style

Qin D, van Huellen S, Wang QC, Moraitis T. Algorithmic Modelling of Financial Conditions for Macro Predictive Purposes: Pilot Application to USA Data. Econometrics. 2022; 10(2):22.

Chicago/Turabian Style

Qin, Duo, Sophie van Huellen, Qing Chao Wang, and Thanos Moraitis. 2022. "Algorithmic Modelling of Financial Conditions for Macro Predictive Purposes: Pilot Application to USA Data" Econometrics 10, no. 2: 22.

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop