Teaching Replication in Quantitative Empirical Economics
Jan Höffler ()
No 2/2014, Replication Working Papers from Institut für Statistik und Ökonometrie, Wirtschaftswissenschaftliche Fakultät, Georg-August-Universität Göttingen, Replication project
Abstract:
In empirical economics, a twofold lack of incentives leads to chronic problems with replicability: For authors of empirical studies providing replicable material is not awarded in the same way as publishing new irreplicable studies is. Neither is authoring replication studies. We offer a strategy to set incentives for replicability and replication. By integrating replication studies in the education of young scholars, we raise the awareness for the importance of replicability among the next generation of researchers and ensure that a big number of scientists get incentives to write replication studies: credit points and the prospect of publications at least of working papers already during their time as students. By raising the number of researchers involved in replication and by providing an infrastructure for sharing their information, on the one hand we help to lower the amount of work researchers need to put into making their studies replicable. On the other hand, we facilitate the dissemination of insights derived from replication studies. This as a side effect imposes a significant threat of detection of irreplicable research, following the cases of recently introduced wiki projects for the revelation of plagiarism. In contrast to previous efforts like the report on the American Economic Review Data Availability Compliance Project, with our project we build the basis for the first replicable review paper on reblicability as we give account of which studies were tested and which results were found in each case. After exploring several dozen studies published in highly ranked journals, we have not yet determined a single case where we see replicability is fully ensured. We identified two main problems: First, not all published results can be obtained from the replication material provided. Second, information about how the used data were obtained from the raw data is hardly ever sufficient. For our investigation, we gave seminars at several faculties. We set up a wiki project for documenting the results of our replications as well as those found in the literature. In our database, we provide information about more than 1800 empirical studies, especially with regards to the availability of material for their replication. We invite for discussion to develop standards for how to make research replicable and how to write replication studies. For this we provide information about existing projects that facilitate the sharing of material for empirical econometric research.
Keywords: Replication; Economic education; Documentation; Data archiving; Statistical software (search for similar items in EconPapers)
JEL-codes: A12 A20 C18 C80 Y80 (search for similar items in EconPapers)
Pages: 13 pages
Date: 2014-03
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)
Downloads: (external link)
http://curriculumconference2013.weaconferences.net ... ence2013-HOFFLER.pdf First publicly available version, World Economics Association conference, 2013 (application/pdf)
http://www.touteconomie.org/afse2014/index.php/mee ... per/viewFile/348/183 Second, revised version, French Economic Association conference 2014 (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (http://www.touteconomie.org/afse2014/index.php/meeting2014/lyon/paper/viewFile/348/183 [301 Moved Permanently]--> https://www.touteconomie.org/afse2014/index.php/meeting2014/lyon/paper/viewFile/348/183)
https://editorialexpress.com/cgi-bin/conference/do ... NOEG2015&paper_id=62 Fourth, revised version, Austrian Economic Association conference 2015 (application/pdf)
https://www.aeaweb.org/conference/2016/retrieve.php?pdfid=1400 Fifth, revised version, American Economic Association Annual Meeting 2016 (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:stg:wpaper:2014_02
Access Statistics for this paper
More papers in Replication Working Papers from Institut für Statistik und Ökonometrie, Wirtschaftswissenschaftliche Fakultät, Georg-August-Universität Göttingen, Replication project Contact information at EDIRC.
Bibliographic data for series maintained by Jan H. Höffler ().