When the search for truth fails: A computer simulation of the impact of the publication bias on the meta-analysis of scientific literature

Georg P. Mueller ()
Additional contact information
Georg P. Mueller: University of Fribourg

Scientometrics, 2018, vol. 117, issue 3, No 35, 2076 pages

Abstract: Abstract The production of scientific knowledge is a complex social process, where many actors contribute by their publications to the disclosure of the hidden truth. However, due to different methods, analysed samples, and control variables, empirical findings from this process are often contradictory. Thus, quantitative sciences use meta-analyses in order to extract the likely truth from a corpus of publications about a given research question. Unfortunately, this procedure is often impaired by different forms of the so-called publication bias: papers with null-results are sometimes not published due to the publication policy of journal editors and their boards. Similarly, articles with a high news value may have a better chance of being published, even if their findings finally prove to be wrong. Thus the publications used for meta-analyses are often distorted and lead to wrong conclusions about the truth. For this reason the present article develops a formal model of the effects of the publication bias on the results of meta-analyses. It is successfully tested with empirical data and used for studying the conditions, under which meta-analyses disclose, obscure, or revert the underlying truth. As a main result of the related computer simulations it turns out that the publication bias has for true zero-relations other consequences than for true non-zero relations. Moreover, there are situations where certain forms of the publication bias have unexpectedly favourable effects on the disclosure of the truth by meta-analyses.

Keywords: Publication bias; Zero/non-zero relations; News value; File drawer problem; Meta-analysis; Computer simulation; 00A72; 65C20; 91F99 (search for similar items in EconPapers)
JEL-codes: B40 C15 C18 (search for similar items in EconPapers)
Date: 2018
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-018-2942-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:117:y:2018:i:3:d:10.1007_s11192-018-2942-0

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-018-2942-0

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().