Foundational Issues in Statistical Modeling: Statistical Model Specification and Validation
Aris Spanos ()
Rationality, Markets and Morals, 2011, vol. 2, issue 47
Statistical model specification and validation raise crucial foundational problems whose pertinent resolution holds the key to learning from data by securing the reliability of frequentist inference. The paper questions the judiciousness of several current practices, including the theory-driven approach, and the Akaike-type model selection procedures, arguing that they often lead to unreliable inferences. This is primarily due to the fact that goodness-of-fit/prediction measures and other substantive and pragmatic criteria are of questionable value when the estimated model is statistically misspecified. Foisting one's favorite model on the data often yields estimated models which are both statistically and substantively misspecified, but one has no way to delineate between the two sources of error and apportion blame. The paper argues that the error statistical approach can address this Duhemian ambiguity by distinguishing between statistical and substantive premises and viewing empirical modeling in a piecemeal way with a view to delineate the various issues more effectively. It is also argued that Hendry's general to specific procedures does a much better job in model selection than the theory-driven and the Akaike-type procedures primary because of its error statistical underpinnings.
Keywords: error statistics; model validation; model selection; statistical adequacy; substantive adequacy; statistical information; reliability of inference; pre-eminence of theory; general to specific (search for similar items in EconPapers)
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2) Track citations by RSS feed
Downloads: (external link)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:rmm:journl:v:2:y:2011:i:47
Access Statistics for this article
Rationality, Markets and Morals is currently edited by Bernd Lahno
More articles in Rationality, Markets and Morals from Frankfurt School Verlag, Frankfurt School of Finance & Management Contact information at EDIRC.
Bibliographic data for series maintained by Friederike Pförtner ().