Quantile Probability Predictions: A Demonstrative Performance Analysis of Forecasts of US COVID-19 Deaths

Mary E. Thomson (), Andrew C. Pollock () and Jennifer Murray ()
Additional contact information
Mary E. Thomson: Northumbria University, UK
Andrew C. Pollock: Statistical Analyst, UK
Jennifer Murray: Edinburgh Napier University, UK

Eurasian Journal of Business and Management, 2021, vol. 9, issue 2, 139-163

Abstract: An analytical framework is presented for the evaluation of quantile probability forecasts. It is demonstrated using weekly quantile forecasts of changes in the number of US COVID-19 deaths. Empirical quantiles are derived using the assumption that daily changes in a variable follow a normal distribution with time varying means and standard deviations, which can be assumed constant over short horizons such as one week. These empirical quantiles are used to evaluate quantile forecasts using the Mean Squared Quantile Score (MSQS), which, in turn, is decomposed into sub-components involving bias, resolution and error variation to identify specific aspects of performance, which highlight the strengths and weaknesses of forecasts. The framework is then extended to test if performance enhancement can be achieved by combining diverse forecasts from different sources. The demonstration illustrates that the technique can effectively evaluate quantile forecasting performance based on a limited number of data points, which is crucial in emergency situations such as forecasting pandemic behavior. It also shows that combining the predictions with quantile probability forecasts generated from an Autoregressive Order One, AR(1) model provided substantially improved performance. The implications of these findings are discussed, suggestions are offered for future research and potential limitations are considered.

Keywords: Forecasts; Accuracy; Probability Forecasting; Composite Forecasts; Coherence; Covid-19 (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
https://eurasianpublications.com/wp-content/uploads/2021/07/EJBM-9.2.4.1.pdf (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ejn:ejbmjr:v:9:y:2021:i:2:p:139-163

Access Statistics for this article

Eurasian Journal of Business and Management is currently edited by Nidžara Osmanagić-Bedenik

More articles in Eurasian Journal of Business and Management from Eurasian Publications
Bibliographic data for series maintained by Esra Barakli ().