Testing Whether Volatility Model Gains Persist: A Prespecified Holdout in Tail Risk Forecasting
Honfei Guo,
Juan Miguel Marín Díazaraque and
Helena Veiga
DES - Working Papers. Statistics and Econometrics. WS from Universidad Carlos III de Madrid. Departamento de EstadÃstica
Abstract:
Rankings of volatility models often change with the market, the evaluation period, and the forecast criterion, so a gain found in one setting may not carry over to another. We test this directly. Eight volatility models, four observation-driven and four stochastic volatility, are estimated for five equity indices by data cloning and compared on one-step-ahead forecasts. We assess joint value-at-risk and expected shortfall accuracy, calibration, predictive density accuracy, and forecast availability. In 2018–2023, nominally significant gains cluster in DAX and NIKKEI, with weaker evidence in FTSE. Neither holdout comparison is corroborated: the DAX estimate changes sign, and the NIKKEI estimate keeps its direction but is imprecise. Different criteria also favour different models. The results argue for validating a model in its intended market and for the criterion it is meant to serve, and they show how a prespecified holdout in a later period can test whether an advantage persists.
Keywords: Forecast; evaluation; Holdout; validation; Model; comparison; Stochastic; volatility; Tail; risk; forecasting; Volatility; asymmetry (search for similar items in EconPapers)
JEL-codes: C22 C52 C53 G17 (search for similar items in EconPapers)
Date: 2026-09-18
References: Add references at CitEc
Citations:
Downloads: (external link)
https://e-archivo.uc3m.es/rest/api/core/bitstreams ... f9af60ba63e1/content (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:cte:wsrepe:50798
Access Statistics for this paper
More papers in DES - Working Papers. Statistics and Econometrics. WS from Universidad Carlos III de Madrid. Departamento de EstadÃstica
Bibliographic data for series maintained by Ana Poveda ().