Confidence Distributions for FIC Scores

Céline Cunen and Nils Lid Hjort
Additional contact information
Céline Cunen: Department of Mathematics, University of Oslo, P.B. 1053, 0316 Oslo, Norway
Nils Lid Hjort: Department of Mathematics, University of Oslo, P.B. 1053, 0316 Oslo, Norway

Econometrics, 2020, vol. 8, issue 3, 1-28

Abstract: When using the Focused Information Criterion (FIC) for assessing and ranking candidate models with respect to how well they do for a given estimation task, it is customary to produce a so-called FIC plot. This plot has the different point estimates along the y-axis and the root-FIC scores on the x-axis, these being the estimated root-mean-square scores. In this paper we address the estimation uncertainty involved in each of the points of such a FIC plot. This needs careful assessment of each of the estimators from the candidate models, taking also modelling bias into account, along with the relative precision of the associated estimated mean squared error quantities. We use confidence distributions for these tasks. This leads to fruitful CD–FIC plots, helping the statistician to judge to what extent the seemingly best models really are better than other models, etc. These efforts also lead to two further developments. The first is a new tool for model selection, which we call the quantile-FIC, which helps overcome certain difficulties associated with the usual FIC procedures, related to somewhat arbitrary schemes for handling estimated squared biases. A particular case is the median-FIC. The second development is to form model averaged estimators with weights determined by the relative sizes of the median- and quantile-FIC scores.

Keywords: confidence distributions; FIC plots; focused information criteria; median-FIC and quantile-FIC; model averaging; risk functions (search for similar items in EconPapers)
JEL-codes: B23 C C00 C01 C1 C2 C3 C4 C5 C8 (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2225-1146/8/3/27/pdf (application/pdf)
https://www.mdpi.com/2225-1146/8/3/27/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jecnmx:v:8:y:2020:i:3:p:27-:d:379156

Access Statistics for this article

Econometrics is currently edited by Ms. Jasmine Liu

More articles in Econometrics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().