Regime-Switching Factor Investing with Hidden Markov Models

Abstract

This study uses the hidden Markov model (HMM) to identify different market regimes in the US stock market and proposes an investment strategy that switches factor investment models depending on the current detected regime. We first backtested an array of different factor models over a roughly 10.5 year period from January 2007 to September 2017, then we trained the HMM on S&P 500 ETF historical data to identify market regimes of that period. By analyzing the relationship between factor model returns and different market regimes, we are able to establish the basis of our regime-switching investing model. We then back-tested our model on out-of-sample historical data from September 2017 to April 2020 and found that it both delivers higher absolute returns and performs better than each of the individual factor models according to traditional portfolio benchmarking metrics.

1. Introduction

Markets have long been known to exhibit certain statistical properties that persist over a period of days, weeks, months, or even years due to reasons such as, but not limited to, macroeconomic conditions, governmental regulations, and political events. A constant challenge for market participants is detecting property changes in the market and responding accordingly. Ammann explored this very idea and showed how these prolonged market regimes could impact various investing styles differently (Ammann and Verhofen 2006). The coining of the terms bull and bear, for instance, are just one such attempt by people to provide a general classification of these market properties. Kim (Kim et al. 2019) explored the use of the hidden Markov model for regime detection to identify specific asset classes to invest in based on the current dominant market regime; however, as an attempt to both diversify our approach to investing and eliminate potential event-driven impact on pricing, we use an array of different factor models that vary in leverage, long-short strategies, and rebalancing methodologies.

The goal of this study is to design a regime-detection investing model that rotates between various factor models and analyze its performance in juxtaposition with the aforementioned factor models. This will allow us to empirically verify if an investing model can actually perform better through switching between multiple factor models to optimize for the regime predictions made by our hidden Markov model.

The composition of this study is as follows. Section 2 discusses factor investing, hidden Markov models, market regimes, and regime classification. Section 3 describes our HMM model and breaks it down to data collection, model training, model implementation, and the underlying factor models we use to implement asset allocation in this paper. Section 4 evaluates the result of our experiment and analyzes the quality of our model. Finally, the conclusions and potential future developments are presented in Section 5.

2. Literature Review

2.1. Factor Investing

Factor investing is an investment approach which is aimed at targeting specific characteristics or “factors” that can explain stock returns. The utilization of factor investing for asset allocation has long served as one of the fundamental cornerstones of investing. Its origin can be traced back to a paper published in 1976 which proposed the “Arbitrage Pricing Theory” (Ross 1976). The theory highlights a new way of thinking to interpret stock returns, that is, the returns in security can be decomposed to its main drivers which are the so-called “factors”. With the advent of the Fama-French 3-factor model (Fama and French 1993), the development of studying factors started to accelerate. This includes quality factors which try to capture returns between high and low-quality stocks (Asness et al. 2014) and volatility factors proposed to explain the abnormal excess return of low volatility stocks due to investors’ constraints (Frazzini and Pedersen 2014). Factor investing not only shapes the modern investment management industry but also provides investors insight for making investing decisions. There are two main categories of factors today: macroeconomic factors, which capture broad risks across asset classes, and style factors, which help to explain returns and risk within asset classes. In this paper, we focus on style factors in order to conduct an investing strategy. We rotate factors models in different regimes due to the cyclicality of factor risk premium (Bender et al. 2013). However, varying risk premiums (Raffinot 2007) indicates that we need an overarching rule to choose our factor models. Moreover, evidence shows that there is no direct relationship between economic variables and the variation of factor premia (Ilmanen et al. 2019). Thus, we observe the properties of popular factor models in different regimes and utilize a hidden Markov model to recognize regime shifts so we can change factor models correspondingly.

2.2. Hidden Markov Models

The hidden Markov model (HMM) is a memory-less probabilistic model that models a time-series as a Markov chain, or a sequence of discrete, finite states (Ramage 2007). In the past couple of decades, HMMs have been used in a wide variety of fields. One of the applications of HMMs is determining states in speech recognition (Rabiner 1989). Another popular use of the HMM is, like we will proceed to elaborate on in the paper, regime identification in the financial markets. The key difference between HMMs and regular Markov chains is that as the name suggests, the states in HMMs are hidden. As shown in Figure 1, instead of being able to observe the series of hidden states directly as one would with Markov chains, we can only observe the outputs of the hidden states. In general, there are two fundamental assumptions that the HMM makes: firstly, that all observations are solely dependent on the current state and are conditionally independent of other variables and secondly, that the transition probabilities are homogenous and depend only on the current hidden state (Ramage 2007).

While HMMs have a wide variety of applications, they are frequently used for regime and state prediction to identify trends and price movements in the market. For instance, (Hassan and Nath 2005) demonstrated that HMMs can be utilized effectively for stock price prediction. Furthermore, it’s also been shown that HMMs can be used in asset allocation to improve portfolio performance, yielding both higher returns and lower maximum drawdown (Kim et al. 2019). Furthermore, due to the phenomenon of volatility clustering in financial markets, which posits that price change behavior tends to cluster together, attempts to shield against volatile trading periods can help prevent large drawdowns (Cont 2005). Such periods can cause a sharp decreasing in performance for multiple factors, notably momentum (Daniel and Moskowitz 2014). Thus, regime-switching models that can adapt a portfolio’s exposure to different factors can prove to be useful in this context.

2.3. Market Regimes

Since both Hamilton (1989) and Kim and Nelson (2017) introduced the econometrics of state-space models with regime-switching, the assumption of stationary process of market-related data sequence has been challenged. If the market is subject to a so-called regime shift, then a dynamic model that governs a different return process can help us have a closer approximation to a real market situation. Research has shown that market regime detection can improve returns on a portfolio across different markets, often through avoidance of persistent high-volatility periods (Kritzman et al. 2012). Dynamic asset allocation based on the identification of market regimes has also been proven to be advantageous in investing (Vo and Maurer 2013). The importance of recognizing market regimes and their impact on portfolio performance has led to the development and application of regime-switching models.

Using an HMM to identify the hidden states that represent the market regimes, Kim showed that an active portfolio that adapts its investments to optimize for Sharpe ratio can yield superior portfolio performance across a variety of different asset classes (Kim et al. 2019). Likewise, not using a dynamic regime detection model and ignoring regimes that exhibit high volatility, as a result, has also been proven to be costly to portfolio performance (Ang et al. 2008), especially when cashing out the portfolio is an option. Ang and Bekaert 2004 empirically showed that a regime-switching strategy will perform better than static strategies in a global all-equity portfolio via an out-of-sample test.

2.4. Regime Classification

There are numerous ways to determine the state of the market and wide variety of models can be used to predict the market based on current stationary assumptions. There has been a lot of research that directly uses asset price action, like directional price changes as indicators for regime classification purposes (Chen and Tsang 2018). Similarly, derivative indicators of price action like volatility can also be particularly effective for regime classification in the context of HMMs due to the volatility clustering phenomenon in financial markets (Yuan and Gautam 2019). However, more qualitative variables have also been used successfully for regime classification. For instance, Kritzman et al. (2012) used important drivers of asset returns as opposed to price action to classify regimes that have similar traits like inflation, economic growth etc. Nguyen and Nguyen (2015) also came up with a similar approach, using macro variables such as industry production index and inflation rate for regime classification in the context of HMMs. Among all kinds of variables but with respect to the efficient market hypothesis, we think price action data can be the most immediately representative of market conditions. As a result, in this paper we focus on using two variables, price and volatility, to conduct our market regime classification for our model.

3. Model Specification

3.1. Data Source and Processing

The first step in setting up our investment strategy is to create the pipeline that differentiates between the different market regimes and trains our model with the data. We decided to train our model on the S&P500 ETF OHLC historical data. The reason we opted to use the S&P500 for regime classification is because it is often considered an indicator of not just the general economic health of the United States, but also the level of investor confidence in the stock market. As elaborated by Gibbons, using the S&P factors in on a broad level how confident investors are about current and future market conditions. While investor sentiment can impact different sectors or companies in dissimilar ways, using a capital-weighted index helps abstract those discrepancies away and allows us to study and evaluate the market as an aggregate (Gibbons 2010). Thus, we feel it is sensible to use the S&P to create derived data as variables that we feed into our HMM. Specifically for our observation variables, we choose to use daily return and volatility, which can be computed from the OHLC data. To calculate the daily return, we subtract the previous day’s closing price from the most recent closing price and divide that difference by the previous day’s closing. For volatility, we compute the mean squared error (MSE) from the moving average of daily closing prices within a 10-day sliding window period. We attempt to use these observation variables to capture macro trends in price action as a means to provide a general classification of broad market regimes. As shown in Figure 2, we attempt to classify various hidden states as discrete market regimes that generate volatility and return as a continuous set of observable variables.

3.2. Hidden Markov Model

3.2.1. Model Description

HMMs are stochastic probabilistic models that aims to model a system as a Markov chain with hidden states and distinct transition and emission probabilities for each respective state. In this study, we use a Gaussian HMM which is a continuous HMM that models the probability distributions of its observations as Gaussian distributions.

$$\lambda =\{A,\mu ,\sigma ,\pi \}.$$

(1)

The Gaussian HMM consists of four main parameters: the transition matrix A that delineates the probability of transition from one state to another, the observation probability distributions represented as $\mu$ and $\sigma$ which contain the mean and variance for observations with respect to each respective hidden state, and $\pi$ as the vector of probabilities of initial starting states.

3.2.2. Model Application

When applying an HMM in the real world, there are three main subproblems that are associated with fitting the model.

• Estimate the probability of occurrence for the set of observations
• Determining the most optimal sequence of hidden states for the HMM given the set of observations
• Finding the optimal parameters A, $\mu$, $\sigma$, and $\pi$ of the HMM.

The first problem can be solved by applying the forward algorithm. The forward algorithm is a dynamic programming algorithm that recursively computes the forward probabilities which calculates the probability of ending in a state given the prior observation sequence (Baum and Eagon 1967). The algorithm does this by summing the probabilities of all of the various hidden state paths that can potentially generate the observation sequence.

The second problem can be solved by the Viterbi algorithm, a dynamic programming algorithm that “decodes” the observation sequence to find the most probable sequence of hidden states. The Viterbi algorithm recursively computes the most probable path through a sequence of states by storing the probability and state sequence of the most probable path at each point in time (Viterbi 1967).

Finally, in order to calibrate the parameters of the HMM, we can apply the Baum-Welch algorithm. The Baum-Welch algorithm makes use of the forward-backward algorithm, which is a dynamic programming method that computes the conditional distribution of observations for the hidden states in two passes (Baum and Eagon 1967). In the first pass, the algorithm computes the forward probabilities as described in the forward algorithm, and in the second pass, the algorithm computes the backward probabilities which gives the probability of observing the rest of the observation sequence given a starting state. The results of both passes allow us to compute the probability of being in a state at any given point in time given the observation sequence, which is then iteratively used in an expectation-maximization fashion to move from our initial estimates of the parameters A, $\mu$, $\sigma$, and $\pi$ to more probable estimates (Baum et al. 1970).

Above in

Table 1. Initial state probabilities.

Regime	Probability
0	1.22182739 × ${10}^{-91}$
1	1.00000000
2	5.05164158 × ${10}^{-216}$

and

Table 2. State transition probabilities.

Source Regime	Destination Regime
	0	1	2
0	9.019 × ${10}^{-1}$	6.472 × ${10}^{-2}$	3.32960344 × ${10}^{-2}$
1	6.144 × ${10}^{-2}$	9.385 × ${10}^{-1}$	1.91529674 × ${10}^{-29}$
2	1.085 × ${10}^{-1}$	5.466 × ${10}^{-70}$	8.914 × ${10}^{-1}$

you will find the results of our initial HMM parameters. These metrics were obtained by fitting the observations during the training period to the Gaussian HMM. These correspond to the aforementioned A and $\pi$ parameters of the HMM during the training period.

3.2.3. Model Configuration

In this study, we used the Gaussian hidden Markov model from the hmmlearn library1 in Python as the basis for our model. There are three primary parameters for our model that we define: the number of hidden states, the covariance type, and the threshold for the maximum number of iterations to perform for the expectation maximization algorithm.

An important consideration for determining the parameters for the HMM is the bias-variance tradeoff. Both the number of hidden states and the threshold for expectation maximization can influence the fit of the model. For the purposes of this study we settled on using three hidden states: representing periods including bull, bear, and neutral market regimes. We provide our analysis result in Figure 3 for selecting the number of regimes. The figure shows the model score, or the log-likelihood of the observations under an HMM that uses a different number of regimes. We have most improvement of our log-likelihood from a two-state model to a three-state model. In order to prevent overfitting as a way to balance the bias-variance trade-off, we decided to settle with a three-state model which also corresponds to our initial setting. We set the threshold for the number of EM iterations to 75 so our model yielded an average continuous regime period of approximately 12.5 days. As for the covariance type, we opted to use a full covariance matrix over a diagonal covariance matrix because we are forgoing the assumption that the elements in the feature vector are independent of each other. The advantage of the full covariance matrix over the diagonal matrix is the inclusion of cross-correlation between our features in our model at the cost of an increased number of parameters (Gales 1999). As shown in Figure 4, we classify approximately 10 years worth of S&P500 data into three discrete market regimes.

3.3. Regime Classification

From the volatility and daily return averages for the three respective hidden states classified by the HMM, we can see that one regime has the highest daily return with low volatility, one has nonetheless positive daily return but higher volatility, and the last one is characterized by a negative daily return with extremely high volatility. An important concern to address is the parity, or rather the lack thereof, between risk and return in the regimes. This can be attributed to the fact that we used both volatility and returns as observations to train the HMM, the HMM also tries to classify trading days based on the volatility behavior. Thus, the end result is that the unsupervised learning classifies three regimes each with a distinct pair of volatility/return patterns. The way we interpreted the end result was regime 1 being a steady bull-market regime, regime 2 being a highly-volatile bear market regime, and regime 0 being a sideways “kangaroo“ market regime. The observation metrics of each regime can be found in

Table 3. Regime analysis and breakdown.

Regime	Distribution	Average	Average
	of Occurrence	Daily Return	Volatility
0	0.4237	0.0398	3.4739
1	0.4463	0.04635	0.9438
2	0.13	−0.066	13.63465

.

3.4. Factor Models

For the purposes of this study, we utilized QuantConnect2 as our backtesting platform. We have built and tested six distinct factor models and observed their performance under each distinct regime within our training period.

3.4.1. Fama-French Three-Factor Model

The Fama-French three-factor model is a pricing model that aims to expand on and explain anomalies in the capital asset pricing model (CAPM) through suggesting that smaller size, excess return on the market, and high book-to-market equity are indicators of higher average returns (Fama and French 2004). Thus, we implemented a leveraged long/short model that selects stocks with the smallest market cap, lowest price-to-book ratio, and lowest price-to-earnings ratio. In this model we attempt to use price-to-book ratio in lieu of book-to-market ratio as the latter does not exist on QuantConnect. In addition, we also use price-to-earnings ratio as a proxy for excess return on the market.

3.4.2. Modified Fama–French Model

As for the modified Fama–French model, we closely follow the implementation of the Fama–French three-factor model described above, except we utilize price change within the past one month instead of price-to-earnings ratio to attempt to measure excess return on the market. In this case, we prioritize stocks that have shown the largest relative gain as a percentage of its stock price.

3.4.3. Carhart Four-Factor Model

The Carhart four-factor was a model that expands on the Fama-French three-factor model proposed by Mark Carhart, who observed that returns of mutual funds in the top decile in terms of performance tend to all be positively correlated with momentum while that of those in the bottom decile are highly, negatively correlated (Carhart 1997). Thus, our implementation closely follows the implementation of the Fama–French three-factor model described above with an additional momentum factor. For the momentum factor, we choose to use the largest positive price change in the past month in an attempt to measure and observe the effect of short-term momentum in stock-picking.

3.4.4. Value

In this factor model, we aim to select high-value stocks that have the potential for stock price growth. We use dividend-per-share, book-value-per-share, and high free cash flow as a metric for value while using negative stock price changes to find a stock that will mean-revert and grow. Thus, we implemented a long-only model that selects stock based on highest dividend-per-share, highest book-value-per-share, highest free cash flow yield, and least or most negative stock price change in the past 1 month.

3.4.5. AQR Factor Model

In this factor model, we aim to capture the alpha described in stocks based on factors that pertain to quality, value, and momentum. Frazzini et al. 2013 shows that stocks with the aforementioned factors tend to generally outperform the market by delivering higher returns with lower risk. We emulate the concepts embodied by the models described by Frazzini by using a leveraged long/short model that selects stocks with the highest ratio of book-value-per-share to price, largest operating-income-to-revenue ratio, and largest or most positive stock price change in the past 1 month. By doing so, we aim to incorporate the factors of value, quality, and momentum respectively into our stock selection process.

3.4.6. S&P500 ETF

The Standard&Poors 500 index is a stock market index that aims to track the performance of 500 large-cap companies in the United States. It is often used as a benchmark for general market performance and conditions in the United States. For the S&P500, we simply pulled data for its ETF from Yahoo Finance to get its historical performance. For simplification purposes, we considered the S&P500 etf it’s own long-only “model”. This serves as a general benchmark for the performance of other factor models and is also used to signal -market conditions.

After performing regime classification with our HMM for the historical data, we are able to evaluate the quality of our factor models in these distinct regimes. We utilize the average daily return within the regime as well as the standard deviation of the daily returns to compute the Sharpe ratio, which we in turn use as a metric for quality for each respective factor model. For the computation of the Sharpe ratio, we subtract the risk-free rate from the model returns and divide it by the standard deviation of the excess returns.

3.5. Trading Model Implementation

3.5.1. Model Training

When the model is trading live, it’s important for our algorithm to retrain the HMM so judgments on regime switches and regime detection are not based on past, outdated data. Thus, we implemented a sliding window methodology that retrains the model every day prior to market open on the most recent 2707 days worth of daily return and volatility data. Despite the continuous retraining of the model, we maintain the same definitions for the classification of regimes: the regime with the lowest or most negative returns, which typically also has the highest volatility, is the “bear” regime and the regime with the highest return is the “bull” regime. If we judge that a regime switch has occurred with a probability that exceeds a certain confidence interval, the model will switch to the other corresponding factor model.

3.5.2. Regime Detection

Once we have the trained HMM, we need to design a mechanism that serves as the aforementioned confidence interval for judging whether a regime switch has occurred. In using the GaussianHMM API from hmmlearn we operate under the assumption that the observation probability distributions for volatility and daily returns are normally distributed. However, in the mechanism we designed for regime detection, we analyzeg regime observations independently. Thus, as can be observed in Figure 5, we utilize the Kolmogorov-Smirnov test to fit the observations to one of many common distributions including normal, lognormal, pareto, gamma, beta and exponential. With new daily returns and volatility values, we are then able to use the probability density function (PDF) of the fitted distribution to compare the likelihood we are currently in each respective regime in relative terms. Finally, if our estimation of our confidence interval exceeds a certain threshold, in other words, if both the PDF of the volatility is greater than 0.3 and the PDF of the daily returns is greater than 0.5, the model concludes that we are in that respective regime and correspondingly switches to a factor model that historically performs well in those conditions.

4. Empirical Analysis

In this section, we compare our HMM model with S&P500 and four factor models mentioned above. In order to conduct a fair comparison, we select four performance measurements: Sharpe ratio, information ratio, Treynor ratio, and the Treynor–Mazuy measurement.

4.1. Sharpe Ratio

The Sharpe ratio is a measure of risk-adjusted return for a security or portfolio. It was initially proposed to measure the average excess return per unit of risk with risk defined as the volatility of the excess return (Sharpe 1966). The Sharpe ratio helps explain whether the portfolio’s excess return is due to consistent intelligent decision-making or from taking on excessive risk, which can allow us to verify the effectiveness of our strategy.

$$S_p=(R_p-R_f)/{\sigma }_p,$$

(2)

where $c_p$ is return of portfolio, $R_f$ is risk-free rate, and ${\sigma }_p$ is standard deviation of portfolio’s excess return. In this study, we considered the 10-year US treasury bond as our risk-free rate for the computation of the annualized Sharpe ratio.

4.2. Information Ratio

The information ratio (IR) is a measurement for the effectiveness of portfolio management relative to a benchmark index. It is defined as the ratio of the excess return over benchmark to the tracking error of the portfolio (Clarke et al. 2001). The tracking error can be understood as the skill of the portfolio manager since it is the consistency of the excess return. As a result, we use information ratio for the purpose of comparing the overall effectiveness of each portfolio. The magnitude of the value of the information ratio determines the consistency and efficiency of the performance.

$$IR=(R_p-R_b)/T{E}_{p,b}$$

(3)

where $R_p$ is return of portfolio, $R_b$ is the return of benchmark, and $T{E}_{p,b}$ is the tracking error, or the standard deviation of the difference between the portfolios return and the benchmarks return. In this study, we use the return of S&P 500 as our benchmark return. If IR is positive, it means the portfolio management methodology efficiently processes the information and converts it into excess return.

4.3. Treynor Ratio

The Treynor ratio, similar to the Sharpe ratio, aims to measure the returns of a portfolio relative to the risk profile. However, the Treynor ratio differs in the way it defines risk. Rather than using the standard deviation of returns as a metric for volatility and risk by proxy, it utilizes the beta coefficient of the portfolio to quantify the systematic risk of the portfolio (Treynor 1965). Beta, a measure of the non-diversifiable risk of a portfolio to the market, is defined as the covariance between portfolio returns and market returns divided by the variance of the market returns (Fama and French 2004). Thus, the higher the ratio the more compensation we have from bearing systematic risk to beta.

$$T=(R_p-R_f)/{\beta }_p$$

(4)

where $R_p$ is return of portfolio, $R_f$ is risk-free rate, and ${\beta }_p$ the beta of the portfolio. In this study, we report the annualized Treynor ratio.

4.4. Treynor-Mazuy Measurement

In order to show that our regime-switching HMM model indeed introduces market timing skill to our investment methodologies, we also verify it by utilizing Treynor-Mazuy measurement. The Treynor-Mazuy measurement is a quadratic performance measurement model based on CAPM that aims to measure the timing ability of portfolio managers and their ability to “outguess” the market (Treynor and Mazuy 1966). The magnitude of the Treynor–Mazuy Measure depends primarily on two variables: portfolio returns and the variability of its risk sensitivities. For clarity, we present this measurement by showing the decomposition of excess return using the Treynor-Mazuy method.

$$ExcessReturn=R_p-R_f=\alpha +\beta (R_m-R_f)+\gamma {(R_m-R_f)}^2+ϵ,$$

(5)

where $R_p-R_f$ is excess return of portfolio, $R_m-R_f$ is market risk premium, $\alpha$ is stock selection ability, $\beta$ is the beta coefficient of the portfolio, $\gamma$ is market timing performance, and $ϵ$ is the noise. In the mathematical sense, $\gamma$ represents the curvature of the regression line obtained, which is desired by portfolio management since a positive value indicates that the portfolio returns are a convex function of market returns; the portfolio will gain more when the market goes up and lose less when the contrary occurs (Hwang and Salmon 2001). As a result, a significant and positive $\gamma$ value demonstrates strong market timing ability in portfolio management (Paramita 2015).

4.5. Evaluations

Table 4. Portfolio performance benchmarks for each model.

	S&P500	Fama-French	Modified	Carhart	Value	AQR	HMM
		Three-Factor	Three-factor	Four-Factor	Factor	Factor
		Model	Model	Model	Model	Model
Sharpe	−0.174	−1.418	0.208	−0.668	0.463	−1.423	2.017
IR	None	−0.481	0.249	−0.668	0.989	−0.53	1.64
Treynor	−0.03	−0.0059	0.0003	−0.015	0.02	0.123	0.264
Treynor- Mazuy $\left(\gamma \right)$	None	−0.3688	0.1763	0.1548	−3.687	0.1993	0.3698
Returns	−0.0068	−0.2115	0.2097	0.0442	0.5318	−0.2535	2.4491
Max Drawdown	0.341	0.2803	0.131	0.1557	0.5356	0.30	0.1283

summarizes the quantitative results of our experiment. As one can observe from Figure 6, the HMM model has higher returns and both a higher Sharpe ratio and a higher Treynor ratio when compared to the rest of the other models. This signifies that not only does the model deliver better-annualized returns as displayed in

Table 5. Average regime return for each model less the risk-free rate.

	S&P500	Fama-French	Modified	Carhart	Value	AQR
		Three-Factor	Fama-French	Four-Factor	Factor	Factor
		Model	Model	Model	Model	Model
Regime 0	0.03956	−0.01687	0.00061	−0.01331	0.07997	−0.01403
Regime 1	0.04517	0.03162	0.01647	0.01015	0.08538	−0.03338
Regime 2	−0.06607	0.03127	0.03338	−0.04775	−0.02835	−0.01136

, the HMM model also generates better risk-adjusted returns when we account for both systematic market risk and volatility of returns as can be seen in

Table 6. Standard deviation of regime return for each model.

	S&P500	Fama-French	Modified	Carhart	Value	AQR
		Three-Factor	Fama-French	Four-Factor	Factor	Factor
		Model	Model	Model	Model	Model
Regime 0	1.13402	0.65923	0.66564	0.81728	2.03671	0.74407
Regime 1	0.65726	0.53003	0.49889	0.62230	1.25162	0.58465
Regime 2	2.63856	0.93578	0.89436	1.13175	3.33736	0.79118

and

Table 7. Regime Sharpe ratio for each model.

	S&P500	Fama-French	Modified	Carhart	Value	AQR
		Three-Factor	Fama-French	Four-Factor	Factor	Factor
		Model	Model	Model	Model	Model
Regime 0	0.03488	−0.02559	0.00092	−0.01629	0.03926	−0.01885
Regime 1	0.06872	0.05966	0.03301	0.01631	0.06821	−0.05710
Regime 2	−0.02504	0.03342	0.03732	−0.04219	−0.00849	−0.01435

. As for the information ratio, the HMM model performs well relatively and absolutely, signifying that the systematic portfolio management methodology we designed is effective. It has a higher IR value than that of all the other models and surpasses 1, which is commonly used as a benchmark. As for market timing ability with respect to the Treynor–Mazuy measurement, despite the relatively better results of our model, the Treynor-Mazuy $\gamma$ coefficients in all of the models are not statistically significant enough. It corresponds to the fact that the risk exposures of our models are distinct from market risk, thus the market risk premium used in the Treynor–Mazuy cannot sufficiently explain the timing ability of our model. In order to validate whether our HMM model did provide superior performance, we ran a regression which takes HMM return as dependent variable and common factors as independent variables. The result is shown in

Table 8. Regression result of 95% confidence level.

	alpha	MKT	SMB	HML	MOM	QMJ
coef	0.1723	0.1511	0.0279	−0.5879	−0.1774	−0.1144
t(coef)	3.308	3.910	0.294	−6.301	−2.075	−0.828

. As we can see, even excluding the exposure of common factors3 we use in investment strategies, our HMM model still generate a significant abnormal return for approximately 2% annually.

4.6. Qualitative Considerations

It’s important to recognize that the HMM regime-switching model essentially provides a methodology of conditionally switching the portfolio’s factor exposure and by proxy, style risk as well. This experiment empirically proves that such a model can improve your risk-adjusted returns through factor timing, a practice that entails exposing the portfolio to certain factors at times when those factors will deliver above-average returns (Asness 2016). In addition to factor timing, regime-switching models offer market timing skills to enhance investment performance. For instance, Dapena (Dapena et al. 2019) relied on an HMM regime-switching model to determine risk-on and risk-off states for making active investment decisions. Kim et al. (2019) used an HMM to time the individual asset and construct an asset allocation portfolio. In our paper, we provide a new methodology that delivers higher returns and results in better performance metrics by combining multiple investing models and rotating between these models through regime detection. As one can observe from the results in Figure 6, the HMM trading model performs more poorly than the value factor model during bull market runs. However, during market downturns like in December 2018 and March 2020, the HMM trading model switches from the twice-leveraged long-only value model to a market-neutral Fama French model which shields the portfolio from the drawdown it otherwise would have experienced.

5. Conclusions

Akin to results obtained by Kim et al. (2019), we can observe that using a hidden Markov model for asset allocation can prove to yield superior portfolio results. As one can observe from the previous section, our HMM that rotates between two-factor models yielded performance results superior to that of either factor model on which it is based. However, one important consideration for such a mode of investing is that even with an HMM rotating across different factor models, portfolio returns and performance will still be heavily contingent on and limited by the inherent quality of the factor models the HMM is based on. The HMM can only be thought of as a tool to diversify investment to a pool of factor models in order to hedge against market trends or macroeconomic regimes that various models might be particularly susceptible to.

Additionally, there are definitely further developments that can be made to the model we introduced in this paper. For instance, in order to maintain a balance between model bias and variance, we didn’t dive as deeply into model parameter optimization in order to prevent overfitting. We can definitely conduct more research on optimizations that can be made with respect to the parameters of the HMM. Furthermore, one can also improve the quality and increase the number of factor models while increasing the number of regimes their HMM classifies to potentially create superior and more versatile investing models.