The replicability crisis and the p-value debate – what are the consequences for the agricultural and food economics community?

Thomas Heckelei, Silke Huettel, Martin Odening and Jens Rommel
Authors registered in the RePEc Author Service: Silke Hüttel

No 316369, Discussion Papers from University of Bonn, Institute for Food and Resource Economics

Abstract: A vivid debate is ongoing in the scientific community about statistical malpractice and the related publication bias. No general consensus exists on the consequences and this is reflected in heterogeneous rules defined by scientific journals on the use and reporting of statistical inference. This paper aims at discussing how the debate is perceived by the agricultural economics community and implications for our roles as researchers, contributors to the scientific publication process, and teachers. We start by summarizing the current state of the p-value debate and the replication crisis, and commonly applied statistical practices in our community. This is followed by motivation, design, results and discussion of a survey on statistical knowledge and practice among the researchers in the agricultural economics community in Austria, Germany and Switzerland. We conclude that beyond short-term measures like changing rules of reporting in publications, a cultural change regarding empirical scientific practices is needed that stretches across all our roles in the scientific process. Acceptance of scientific work should largely be based on the theoretical and methodological rigor and where the perceived relevance arises from the questions asked, the methodology employed, and the data used but not from the results generated. Revised and clear journal guidelines, the creation of resources for teaching and research, and public recognition of good practice are suggested measures to move forward.

Keywords: Research; Methods/; Statistical; Methods (search for similar items in EconPapers)
Pages: 32
Date: 2021-12-02
New Economics Papers: this item is included in nep-agr, nep-hme and nep-sog
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://ageconsearch.umn.edu/record/316369/files/Dispap_21_2.pdf (application/pdf)
https://ageconsearch.umn.edu/record/316369/files/Dispap_21_2_2.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ags:ubfred:316369

DOI: 10.22004/ag.econ.316369

Access Statistics for this paper

More papers in Discussion Papers from University of Bonn, Institute for Food and Resource Economics Contact information at EDIRC.
Bibliographic data for series maintained by AgEcon Search ().