Grade Language Heterogeneity in Simulation Models of Peer Review
Thomas Feliciani (),
Ramanathan Moorthy (),
Pablo Lucas () and
Kalpana Shankar ()
Additional contact information
Thomas Feliciani: http://www.rug.nl/staff/t.feliciani/
Pablo Lucas: https://people.ucd.ie/pablo.lucas
Journal of Artificial Societies and Social Simulation, 2020, vol. 23, issue 3, 8
Simulation models have proven to be valuable tools for studying peer review processes. However, the effects of some of these modelsâ€™ assumptions have not been tested, nor have these models been examined in comparative contexts. In this paper, we address two of these assumptions which go in tandem: (1) on the granularity of the evaluation scale, and (2) on the homogeneity of the grade language (i.e. whether reviewers interpret evaluation grades in the same fashion). We test the consequences of these assumptions by extending a well-known agent-based model of author and reviewer behaviour with discrete evaluation scales and reviewersâ€™ interpretation of the grade language. In this way, we compare a peer review model with a homogeneous grade language, as assumed in most models of peer review, with a more psychologically realistic model where reviewers interpret the grades of the evaluation scale heterogeneously. We find that grade language heterogeneity can indeed affect the predictions of a model of peer review.
Keywords: Peer Review; Grade Language; Agent-Based Modeling (search for similar items in EconPapers)
References: View complete reference list from CitEc
Citations: Track citations by RSS feed
Downloads: (external link)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:jas:jasssj:2019-123-2
Access Statistics for this article
More articles in Journal of Artificial Societies and Social Simulation from Journal of Artificial Societies and Social Simulation
Bibliographic data for series maintained by Flaminio Squazzoni ().