Reproducibility issues with correlating Beall-listed publications and research awards at a small Canadian business school

Panagiotis Tsigaris () and Jaime A. Teixeira da Silva ()

Scientometrics, 2020, vol. 123, issue 1, No 7, 143-157

Abstract: Abstract The issue of “predatory” publishing began to directly affect academics following the creation of two blacklists by a US librarian, Jeffrey Beall. This paper provides a post-publication replication examination of a study that became a high media-profile case. That study involves Derek Pyne, who incorrectly claimed in a 2017 publication in the Journal of Scholarly Publishing that numerous research faculty members at a small business school in Canada were financially remunerated for Beall-blacklisted publications relative to those that did not have such publications. This paper presents new evidence why the claims made in that paper are erroneous. That research claimed to show evidence that Beall’s list of potential predatory journals were positively correlated with internal research awards based on a simple correlation without reporting p-values. We show that the correlation between Beall and ranked journal publications with awards is not statistically significantly different from zero after computing p-values and confidence intervals based on his published results, and by collecting the data from the same public domains as Pyne. We also show that the correlation between Beall and unranked publications with awards depends on only two observations and cannot lead to generalizations.

Keywords: Biases; Beall’s blacklists; Reproducibility crisis; Research spin; Rewards; Underpowered studies (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s11192-020-03353-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:123:y:2020:i:1:d:10.1007_s11192-020-03353-4

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-020-03353-4

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().