Grade Language Heterogeneity in Simulation Models of Peer Review

Thomas Feliciani (), Ramanathan Moorthy (), Pablo Lucas () and Kalpana Shankar ()
Additional contact information
Thomas Feliciani: http://www.rug.nl/staff/t.feliciani/
Pablo Lucas: https://people.ucd.ie/pablo.lucas

Journal of Artificial Societies and Social Simulation, 2020, vol. 23, issue 3, 8

Abstract: Simulation models have proven to be valuable tools for studying peer review processes. However, the effects of some of these models’ assumptions have not been tested, nor have these models been examined in comparative contexts. In this paper, we address two of these assumptions which go in tandem: (1) on the granularity of the evaluation scale, and (2) on the homogeneity of the grade language (i.e. whether reviewers interpret evaluation grades in the same fashion). We test the consequences of these assumptions by extending a well-known agent-based model of author and reviewer behaviour with discrete evaluation scales and reviewers’ interpretation of the grade language. In this way, we compare a peer review model with a homogeneous grade language, as assumed in most models of peer review, with a more psychologically realistic model where reviewers interpret the grades of the evaluation scale heterogeneously. We find that grade language heterogeneity can indeed affect the predictions of a model of peer review.

Keywords: Peer Review; Grade Language; Agent-Based Modeling (search for similar items in EconPapers)
Date: 2020-06-30
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.jasss.org/23/3/8/8.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jas:jasssj:2019-123-2

Access Statistics for this article

More articles in Journal of Artificial Societies and Social Simulation from Journal of Artificial Societies and Social Simulation
Bibliographic data for series maintained by Francesco Renzini ().