Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error*

Sander Barendse, Erik Kole () and Dick van Dijk

Journal of Financial Econometrics, 2023, vol. 21, issue 2, 528-568

Abstract: We investigate the effect of estimation error on backtests of expected shortfall (ES) forecasts. These backtests are based on first-order conditions of a recently introduced family of jointly consistent loss functions for value-at-risk (VaR) and ES. For both single and multiperiod horizons, we provide explicit expressions for the additional terms in the asymptotic covariance matrix that result from estimation error, and propose robust tests that account for it. Monte Carlo experiments show that the tests that ignore these terms suffer from size distortions, which are more pronounced for higher ratios of out-of-sample to in-sample observations. Robust versions of the backtests perform well with power against common alternatives. We also introduce a novel standardization of the conditional joint test statistic that removes the need to estimate higher-order moments and significantly improves its performance. In an application to VaR and ES forecasts for daily FTSE 100 index returns as generated by (GJR-)GARCH and HEAVY models, we find that estimation error substantially impacts the outcome of the backtests, and is not bound to particular subperiods such as the credit crisis.

Keywords: backtesting; expected shortfall; risk management; tail risk; value-at-risk (search for similar items in EconPapers)
JEL-codes: C12 C53 C58 G17 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://hdl.handle.net/10.1093/jjfinec/nbab008 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error (2019)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:jfinec:v:21:y:2023:i:2:p:528-568.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

Journal of Financial Econometrics is currently edited by Allan Timmermann and Fabio Trojani

More articles in Journal of Financial Econometrics from Oxford University Press Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK. Contact information at EDIRC.
Bibliographic data for series maintained by Oxford University Press ().