What meta‐research has taught us about research and changes to research practices

John P. A. Ioannidis

Journal of Economic Surveys, 2025, vol. 39, issue 4, 1823-1834

Abstract: Meta‐research has become increasingly popular and has provided interesting insights on what can go well and what can go wrong with research practices and scientific studies. Many stakeholders are taking actions to try to solve problems and biases identified through meta‐research. However, very often there is little or no evidence that specific recommendations and actions may actually lead to improvements and a favorable benefit‐harm ratio. The current commentary offers an eclectic overview of what we have learned from meta‐research efforts (mostly observational, but also some quasi‐experimental and experimental work) and what the implications of this evidence may be for changing research practices. Areas discussed include the study (and differentiation) of genuine effects and biases, fraud (including the impact of new technologies), peer review, replication and reproducibility checks, transparency indicators, and the interface of research practices with reward systems. Meta‐research has offered on all of these fronts empirical evidence that sometimes pertains even to large effects of extreme biases. Continued surveys of research practices and results may offer timely updates of the status of research and its biases, as these may change markedly over time. Meta‐research should be seen as part of research, not separate from it, in their concurrent evolution.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/joes.12666

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jecsur:v:39:y:2025:i:4:p:1823-1834

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0950-0804

Access Statistics for this article

More articles in Journal of Economic Surveys from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().