Authors and reviewers who suffer from confirmatory bias
J. A. García (),
Rosa Rodriguez-Sánchez and
Additional contact information
J. A. García: CITIC-UGR, Universidad de Granada
Rosa Rodriguez-Sánchez: CITIC-UGR, Universidad de Granada
J. Fdez-Valdivia: CITIC-UGR, Universidad de Granada
Scientometrics, 2016, vol. 109, issue 2, 1377-1395
Abstract Confirmatory bias induces overconfidence in the sense that people believe more strongly than they should in their preferred hypotheses. This work describes a Bayesian-based formal model to study the effect of overconfidence about the causes of manuscript rejection due to confirmatory bias in peer review. In addition, we also present an online tool that helps authors to study their beliefs about the causes of rejection. This tool takes the authors’ self-evaluated probability of misinterpretation (i.e. confirmatory bias) and self-evaluated probability of perceiving a review signal correlated with the true cause of rejection and a sequence of review signals perceived as input, and gives a prediction of whether there is overconfidence and wrongness in the author’s belief that bias in peer review caused rejection. We continue to discuss the effect of confirmatory bias in the editor-reviewer relationship in peer review process and show that when the strength of informative signals about the manuscript quality is sufficiently weak and reviewer’s confirmatory bias is sufficiently severe, there is a strong probability that the reviewer would erroneously identify the manuscript quality, making the editor less inclined to offer the potential reviewer any incentive to accept the invitation to review the manuscript. Based on these, we offer a theoretical explanation of current practices adopted to improve the review performance (e.g., desk rejection).
Keywords: Peer review; Bayesian authors; Bayesian reviewers; Confirmatory bias; Overconfidence; Online tool (search for similar items in EconPapers)
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2) Track citations by RSS feed
Downloads: (external link)
http://link.springer.com/10.1007/s11192-016-2079-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:109:y:2016:i:2:d:10.1007_s11192-016-2079-y
Ordering information: This journal article can be ordered from
Access Statistics for this article
Scientometrics is currently edited by Wolfgang Glänzel
More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla ().