Tail calibration of probabilistic forecasts

Sam Allen (), Jonathan Koh, Johan Segers () and Johanna Ziegel
Additional contact information
Sam Allen: ETH Zurich
Jonathan Koh: University of Bern
Johan Segers: Université catholique de Louvain, LIDAM/ISBA, Belgium
Johanna Ziegel: ETH Zurich

No 2025010, LIDAM Reprints ISBA from Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA)

Abstract: Probabilistic forecasts comprehensively describe the uncertainty in the unknown future outcome, making them essential for decision making and risk management. While several methods have been introduced to evaluate probabilistic forecasts, existing evaluation techniques are ill-suited to the evaluation of tail properties of such forecasts. However, these tail properties are often of particular interest to forecast users due to the severe impacts caused by extreme outcomes. In this work, we introduce a general notion of tail calibration for probabilistic forecasts, which allows forecasters to assess the reliability of their predictions for extreme outcomes. We study the relationships between tail calibration and standard notions of forecast calibration, and discuss connections to peaks-over-threshold models in extreme value theory. Diagnostic tools are introduced and applied in a case study on European precipitation forecasts.

Keywords: Extreme event; proper scoring rule; forecast evaluation; tail calibration diagnostic plot; precipitation forecast (search for similar items in EconPapers)
Pages: 26
Date: 2025-05-21
Note: In: Journal of the American Statistical Association, 2025
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aiz:louvar:2025010

DOI: 10.1080/01621459.2025.2506194

Access Statistics for this paper

More papers in LIDAM Reprints ISBA from Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA) Voie du Roman Pays 20, 1348 Louvain-la-Neuve (Belgium). Contact information at EDIRC.
Bibliographic data for series maintained by Nadja Peiffer ().