Abstract
Most of the financial institutions compute the Value-at-Risk (VaR) of their trading portfolios using historical simulation-based methods. In this paper, we examine the Filtered Historical Simulation (FHS) model introduced by Barone-Adesi et al. (1999) theoretically and empirically. The main goal of this study is to find an answer for the following question: “Does the assumption on innovation process play an important role for the Filtered Historical Simulation model?”. For this goal, we investigate the performance of FHS model with skewed and fat-tailed innovations distributions such as normal, skew normal, Student’s-t, skew-T, generalized error, and skewed generalized error distributions. The performances of FHS models are evaluated by means of unconditional and conditional likelihood ratio tests and loss functions. Based on the empirical results, we conclude that the FHS models with generalized error and skew-T distributions produce more accurate VaR forecasts.
1. Introduction
The most well known risk measure, Value-at-Risk (VaR), is used to measure and quantify the level of financial risk within a firm or investment portfolio over a specific holding period. The VaR measures the potential loss of risky asset or portfolio over a defined period and for a given confidence level. The VaR is defined as
where F is the cumulative distribution function (cdf) of financial losses, denotes the inverse of F and p is the quantile at which VaR is calculated. The approaches to VaR could be investigated in three categories: (i) fully parametric models approach based on a volatility models; (ii) non-parametric approaches based on the Historical Simulation (HS) methods and (iii) Extreme Value Theory approach based on modeling the tails of the return distribution.
In this paper, we focus on the non-parametric HS models. The HS model is based on the assumption that historical distribution of returns will remain the same over the next periods. The HS model assumes that price change behaviour repeats itself over the time. Thus, future distribution of asset returns could be described by the empirical one. The one-day-ahead VaR R forecast for HS model is given by
where p is the quantile at which VaR is calculated. Mögel and Auer (2017) compared the performance of HS model with several competitive VaR models and stated that HS model produces the similar VaR forecasts with unconditional generalized Pareto distribution.
The HS model has several advantages. For instance, it is easy to understand and implement. It is a nonparametric model and does not require any distributional assumption. However, the HS model has also several shortcomings. The HS model ignores the time-varying volatility dynamics. In order to remove lack of HS model, Hull and White (1998) and Barone-Adesi et al. (1999) introduced the FHS model. This approach can be viewed as mixture of the HS and the Generalized Autoregressive Conditional Heteroskedasticity (GARCH) models. Specifically, it does not make any distributional assumption about the standardized returns, while it forecasts the variance through a volatility model. Hence, it is mixture of parametric and non-parametric statistical procedures. Barone-Adesi and Giannopoulos (2001) demonstrated the usefulness of the FHS model over the historical one. Kuester et al. (2006) compared the forecasting performance of several advanced VaR models. Kuester et al. (2006) concluded that GARCH-Skew-T, Extreme Value Theory (EVT) approach with normal and Skew-T innovations and FHS model with normal and Skew-T innovations perform the best. Angelidis et al. (2007) compared the FHS model with GARCH models specified under different innovation distributions such as normal, Student’s-t and Skewed-T. Roy (2011) estimated the VaR of the daily return of Indian capital market using FHS model. Omari (2017) compared FHS, Exponentially Weighted Moving Average (EWMA), GARCH-normal, GARCH-Student’s-t, GJR-GARCH-normal and GJR-GARCH-Student’s-t models in terms of accuracy of VAR forecasts. Omari (2017) demonstrated that GJR-GARCH-Stundet’s-t approach and Filtered Historical Simulation method with GARCH volatility specification perform competitively accurate in estimating VaR forecasts for both standard and more extreme quantiles thereby generally out-performing all the other models under consideration.
The goal of this paper is to investigate the VaR forecasting performance of the FHS model specified under skewed and fat-tailed innovations distributions. For this goal, the comprehensive introduction to the FHS and GARCH models is given. The FHS model under six innovation distributions are introduced. Rolling window estimation produce is used to obtain both unknown parameters of GARCH models and VaR forecasts. The performance of the FHS models, in terms of accuracy of VaR forecasts, are evaluated by means of backtesting methods and loss functions.
The rest of the paper is organized as follows: Section 2 is devoted to theoretical properties of the FHS and GARCH models under normal, Student’s-t, skew-normal, skew-T, generalized error and skewed generalized error innovation distributions. Backtesting methodology is given in Section 3. Empirical findings and model comparisons are presented in Section 4. Concluding remarks are given in Section 5.
2. Filtered Historical Simulation Models
In this section, the FHS model is defined. Then, the log-likelihood functions of GARCH model specified under normal, skew-normal, Student’s-t, skew-T, generalized error and skewed genealized error innovation distributions are presented.
FHS model can be summarized as follows:
- √
- Let denotes the daily log-returns. The benchmark GARCH(1,1) model, introduced by Bollerslev (1986), is defined bywhere , ,, and are the conditional mean and variance, respectively, and is the innovation distribution with zero mean and unit variance. Maximum Likelihood Estimation (MLE) method is widely used to estimate parameters of GARCH models. Under the assumption of independently and identically distributed (iid) innovations with density function, the log-likelihood function of for a sample of T observations is given bywhere is the parameter vector of GARCH model, is the shape parameter(s) of and .The standardized residuals of estimated GARCH(1,1) model are extracted as follows:where is the estimated residual and is the corresponding daily estimated volatility.Now, we can generate the first simulated residual by randomly (with replacement) draw standardized residuals from the dataset with multiplying the one-day ahead volatility forecast:The first simulated return for period can be obtained as follows:where is the first simulated residual for period .
This procedure is repeated B times of length T. Here, B represents the number of bootstrapped samples and T represents the each of bootstrapped sample size. Then, VaR for period can be forecasted as follows:
The rest of this section is devoted to present the log-likelihood functions of GARCH model under normal, skew-normal, Student’s-t, skew-T, generalized error and skewed generalized error distributions.
2.1. Normal Distribution
The log-likelihood function of the GARCH model specified under normal innovations is given by
where denotes the parameter vector of the GARCH-normal (GARCH-N) model and .
2.2. Skew-Normal Distribution
The first skew extension of normal distribution was proposed by Azzalini (1985). The probability density function (pdf) of skew-normal (SN) distribution is given by
where is an additional parameter that controls the skewness. When , the SN distribution is left skewed, otherwise, it is right skewed. If , the SN distribution reduces to standard normal distribution. The kth moment of SN distribution is given by
here, and . Note that the even moments of the SN distribution are equal to standard normal distribution. The mean and variance of SN distribution is, respectively, given by,
where . The standardized SN distribution is obtained using the transformed random variable where and . The random variable z can be expressed as and . Thus, the pdf of the standardized SN distribution is given by
Hereafter, using the standardized SN distribution, the log-likelihood function of GARCH model with SN innovation distribution is given by
where is the parameter vector.
2.3. Student’s-t Distribution
Since financial return series has fatter tails than normal distribution, Bollerslev (1986, 1987) proposed the GARCH model with the Student’s-t innovations. GARCH model with the Student’s-t innovations enables to model both fat-tail and excess kurtosis observed in financial return series. The log-likelihood function of the GARCH-Student’s-t (GARCH-T) model is given by
where is the parameter vector, is the gamma function and parameter controls the tails of the distribution.
2.4. Skew-T Distribution
The pdf of skew-T distribution obtained by Azzalini and Capitanio (2003) is given by
where and are pdf and cdf of Student’s-t distribution, respectively, and controls the skewness. When , ST distribution reduces to Student’s-t distribution in Equation (16). The moments of ST distribution are given by
The mean and variance of ST distribution are, respectively, given by
The standardized ST distribution is obtained using the transformed random variable , where and . The random variable z can be expressed as and . Thus, the pdf of standardized ST distribution is given by
where and are mean and standard deviation of ST distribution, respectively. The log-likelihood function of GARCH model with the ST innovation distribution is given by
where is the parameter vector.
2.5. Generalized Error Distribution
Nelson (1991) introduced the GARCH volatility model of generalized error distribution (GED). The log-likelihood function of GARCH-GED model is given by
where is the parameter vector, is tail-thickness parameter and
Note that the normal distribution is a special case of the GED when . If , the GED has heavier tails than the Gaussian distribution.
2.6. Skewed Generalized Error Distribution
Skewed Generalized Error Distribution (SGED) provides an opportunity to model skewness and excess kurtosis observed in financial return series. Lee et al. (2008) introduced the GARCH-SGED model and concluded that GARCH model with SGED innovation process outperformed the GARCH-N model for all confidence levels.
The pdf of standardized SGED is given by,
where
where is the shape parameter, is skewness parameter. The SGED turns out to be the standard normal distribution when and . The log-likelihood function of GARCH-SGED model is given by
where is the parameter vector.
3. Evaluation of VaR Forecasts
Now, we introduce backtesting methodology that is used to compare VaR forecast accuracy of the models. Statistical accuracy of the models is evaluated by backtests of Kupiec (1995), Christoffersen (1998), Engle and Manganelli (2004) and Sarma et al. (2003). Recently, some alternative backtesting methods for VaR forecasts were proposed by Ziggel et al. (2014) and Dumitrescu et al. (2012).
Kupiec (1995) proposed a likelihood ratio (LR) test of unconditional coverage () to evaluate the model accuracy. The test examines whether the failure rate is equal to the expected value. The LR test statistic is given by
where is the MLE of p, represents the total violation and represents the total non-violations forecasts. Violation means that if , violation occurs, opposite case indicates the non-violation. Under the null hypothesis , the LR statistic follows a chi-square distribution with one degree of freedom.
The test fails to detect if violations are not randomly distributed. Christoffersen (1998) proposed a LR test of conditional coverage to remove the lack of Kupiec (1995) test. The test investigates both equality of failure rate and expected one and also independently distributed violations. The test statistic under the null hypothesis shows that the failures are independent and equal to the expected one. It is given by
where is the number of observations with value i followed by j for and is the probability, for . It denotes that the violation occurred, otherwise indicates the opposite case. The statistic follows a chi-square distribution with two degrees of freedom.
The Dynamic Quantile (DQ) test, proposed by Engle and Manganelli (2004), examines if the violations is uncorrelated with any variable that belongs to information set when the VaR is calculated. The main idea of DQ test is to regress the current violations on past violations in order to test for different restrictions on the parameters of the model. The estimated linear regression model is given by
where
This regression model tests whether the probability of violation depends on the level of the VaR. Here, p and q are used as 5 and 1, respectively, for illustrative purpose.
In most instances, evaluating the performance of VaR models by means of , and tests may not be sufficient to decide the most adequate model among others. For instance, some models may have the same violation number with different forecast errors. Sarma et al. (2003) defined a test on the basis of regulator’s loss function (RLF) to take into account differences between realized returns and VaR forecasts. The RLF is given by
where represents the one-day-ahead VaR forecast for a long position.
The unexpected loss (UL) is equal to average value of differences between realized return and VaR forecasts. The one-day-ahead magnitude of the violation for long position is given by
The QLF and UL loss functions do not consider the case in which the realized returns exceed the VaR forecast. The appropriate loss function should take into consideration the cost of excess capital. Because, overestimated VaR forecasts yield firms to hold much more capital value than required one. The main objective of any firm is to maximize the their profits. For this reason, Sarma et al. (2003) is proposed the new loss function, called Firm’s Loss Function (FLF). The FLF is given by
where is the cost of excess capital.
4. Empirical Results
4.1. Data Description
To evaluate the performance of FHS models in terms of accuracy of VaR forecasts, ISE-100 index of Turkey is used. The used time series data contains 1092 daily log-returns from 3 January 2013 to 4 May 2017. The descriptive statistics of the log-returns of ISE-100 index are given in Table 1.
Table 1.
Summary statistics for the ISE-100 index.
Table 1 shows that the mean return is closed to 0. The results of the Jarque-Bera test prove that the null hypothesis of normality is rejected at any level of significance. It shows strong evidence for high excess kurtosis and negative skewness. Thus, it is clear that log return of ISE-100 index has non-normal characteristics, excess kurtosis, and fat tails. Figure 1 displays the daily log-returns of ISE-100 index.
Figure 1.
Daily log-returns of the ISE-100 index.
Figure 2 displays the time-varying skewness and kurtosis of ISE-100. For Figure 2, window length is determined as 392 and the rolling window procedure is used. Based on Figure 2, it is clear that skewness and kurtosis of ISE-100 index exhibit great variability across the time.
Figure 2.
Time varying skewness and kurtosis plots of ISE-100 index.
The benchmark model, GARCH(1,1), is estimated with six different innovation distributions: Normal, SN, Student’s-t, ST, GED and SGED. Table 2 shows the estimated parameters of GARCH models. The rugarch package in R software is used to obtain parameter estimation of normal, Student’s-t, GED and SGED models. The constrOptim function in R software is used to minimize negative log-likelihood functions of GARCH-ST and GARCH-SN models.
Table 2.
In-sample performance of GARCH models under skewed and fat-tailed innovation distributions.
Based on Table 2, we conclude that GARCH-T and GARCH-SGED models have the lower log-likelihood value among others. Since GARCH-T model has the lowest log-likelihood value, it could be chosen as best model for in-sample period. Table 2 also shows that the conditional variance parameters are highly significant for all GARCH models.
4.2. Backtesting Results
In this subsection, rolling window estimation procedure is used to estimate parameters of GARCH models. Then, VaR forecasts of FHS models are obtained by using estimated parameters of GARCH models, one-day-ahead forecasts of conditional mean and conditional variance and standardized residuals extracted from estimated GARCH models. Rolling window estimation produce allows us to capture time-varying characteristics of the time series in different time periods. Window length is determined as 392 and next 700 daily returns are used to evaluate the out of sample performance of VaR models.
Table 3 shows the backtesting results for FHS-N, FHS-T, FHS-ST, FHS-SN, FHS-GED and FHS-SGED models. The two step decision making procedure is applied to decide the best VaR model. In first step, the performance of VaR models are evaluated according to results of , and tests. In second step, the models, achieved to pass these three backtest, considered as accurate model and obtained the results of loss functions of these VaR models. Finally, the lowest values of loss functions indicate the best VaR models.
Table 3.
Backtesting results of FHS models for long position (, , and ).
Table 4 shows that all FHS models perform well based on the results of , and tests results at ad levels. However, FHS model with Student’s-t and ST innovation distributions provide better VaR forecasts than other competitive models at level based on the result of test. Therefore, it can be concluded that FHS model specified under skewed and fat-tailed innovation distributions provides more accurate VaR forecasts especially for high quantiles.
Table 4.
Loss functions results of FHS models for long position (, , and ).
Even if FHS models have similar results in view of , and results, they have different failure rates and forecast errors. Loss functions are useful to compare VaR models with their forecast errors. Based on the ARLF, UL and FLF results, we conclude following results: (i) FHS-SN is the best performed model at and levels according to ARLF and UL criteria. Based on the FLF results, FHS-GED model has the lowest excess capital value than other models at and levels. Therefore, FHS-GED model could be chosen as best model for and levels; (ii) Based on the three backtesting results, FHS-T and FHS-ST models provide the most accurate VaR forecasts among others at level. According to loss functions results, it is easy to see that FHS-ST model has lower values of ARLF, UL and FLF results than FHS-T model. Therefore, FHS-ST model could be chosen as the best model for model.
Figure 3 displays the VaR forecasts of FHS models specified under six innovation distributions. As seen in Figure 3, the assumption on innovation process does not affect the VaR forecasts of FHS model soulfully. However, the GED and ST distributions could be preferable to reduce the forecast error of the FHS model.
Figure 3.
Daily VaR forecast of GARCH models with different innovation distributions for 97.5% and 99% confidence levels.
5. Conclusions
In this study, we investigate FHS models with skewed and fat-tailed innovation distributions both theoretically and empirically. For this aim, we use Normal, Student’s-t, ST, SN, GED and SGED as the innovation distributions. The empirical findings show that all of FHS models perform well based on the , and results at and levels. However, only two FHS model, FHS-T and FHS-ST models achieve to pass , and tests at level. Based on the results of loss functions, FHS-GED is the best performed model at and levels and FHS-ST model is the best performed model at level. We conclude that skewed and fat-tailed distributions are preferable to reduce the VaR forecast error of FHS models. We hope that the results given in this study will be useful for both researchers and practitioners.
Author Contributions
Emrah Altun, Huseyin Tatlidil, Gamze Ozel and Saralees Nadarajah have contributed jointly to all of the sections of the paper.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Angelidis, Timotheos, Alexandros Benos, and Stavros Degiannakis. 2007. A robust VaR model under different time periods and weighting schemes. Review of Quantitative Finance and Accounting 28: 187–201. [Google Scholar] [CrossRef] [Scilit]
- Azzalini, Adelchi. 1985. A class of distributions which includes the normal ones. Scandinavian Journal of Statistics 12: 171–78. [Google Scholar]
- Azzalini, Adelchi, and Antonella Capitanio. 2003. Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t-distribution. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 65: 367–89. [Google Scholar] [CrossRef] [Scilit]
- Barone-Adesi, Giovanni, Kostas Giannopoulos, and Les Vosper. 1999. VaR without correlations for nonlinear portfolios. Journal of Futures Markets 19: 583–602. [Google Scholar] [CrossRef]
- Barone-Adesi, Giovanni, and Kostas Giannopoulos. 2001. Non parametric var techniques. myths and realities. Economic Notes 30: 167–81. [Google Scholar] [CrossRef] [Scilit]
- Bollerslev, Tim. 1986. Generalized autoregressive conditional heteroskedasticity. Journal of Econometrics 31: 307–27. [Google Scholar] [CrossRef] [Scilit]
- Bollerslev, Tim. 1987. A conditionally heteroskedastic time series model for speculative prices and rates of return. The Review of Economics and Statistics 69: 542–47. [Google Scholar] [CrossRef] [Scilit]
- Christoffersen, Peter F. 1998. Evaluating interval forecasts. International Economic Review 39: 841–62. [Google Scholar] [CrossRef] [Scilit]
- Dumitrescu, Elena-Ivona, Christophe Hurlin, and Vinson Pham. 2012. Backtesting value-at-risk: from dynamic quantile to dynamic binary tests. Finance 33: 79–112. [Google Scholar]
- Engle, Robert F., and Simone Manganelli. 2004. CAViaR: Conditional autoregressive value at risk by regression quantiles. Journal of Business & Economic Statistics 22: 367–81. [Google Scholar]
- Hull, John, and Alan White. 1998. Incorporating volatility updating into the historical simulation method for value-at-risk. Journal of Risk 1: 5–19. [Google Scholar] [CrossRef] [Scilit]
- Kupiec, Paul H. 1995. Techniques for verifying the accuracy of risk measurement models. The Journal of Derivatives 3: 73–84. [Google Scholar] [CrossRef] [Scilit]
- Kuester, Keith, Stefan Mittnik, and Marc S. Paolella. 2006. Value-at-risk prediction: A comparison of alternative strategies. Journal of Financial Econometrics 4: 53–89. [Google Scholar] [CrossRef] [Scilit]
- Lee, Ming-Chih, Jung-Bin Su, and Hung-Chun Liu. 2008. Value-at-risk in US stock indices with skewed generalized error distribution. Applied Financial Economics Letters 4: 425–31. [Google Scholar] [CrossRef] [Scilit]
- Mögel, Benjamin, and Benjamin R. Auer. 2017. How accurate are modern Value-at-Risk estimators derived from extreme value theory? Review of Quantitative Finance and Accounting, 1–52. [Google Scholar]
- Nelson, Daniel B. 1991. Conditional heteroscedasticity in asset returns: A new approach. Econometrica 59: 347–70. [Google Scholar] [CrossRef] [Scilit]
- Omari, Cyprian Ondieki. 2017. A Comparative Performance of Conventional Methods for Estimating Market Risk Using Value at Risk. International Journal of Econometrics and Financial Management 5: 22–32. [Google Scholar]
- Roy, Indrajit. 2011. Estimating Value at Risk (VaR) using Filtered Historical Simulation in the Indian capital market. Reserve Bank of India Occasional Papers 32: 81–98. [Google Scholar]
- Sarma, Mandira, Susan Thomas, and Ajay Shah. 2003. Selection of Value-at-Risk models. Journal of Forecasting 22: 337–58. [Google Scholar] [CrossRef] [Scilit]
- Ziggel, Daniel, Tobias Berens, Gregor N. F. Weiß, and Dominik Wied. 2014. A new set of improved Value-at-Risk backtests. Journal of Banking & Finance 48: 29–41. [Google Scholar]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).


