A web application for aggregating conflicting reviewers’ preferences

J. A. García (), Rosa Rodriguez-Sánchez, J. Fdez-Valdivia and F. Moya-Anegón
Additional contact information
J. A. García: Universidad de Granada
Rosa Rodriguez-Sánchez: Universidad de Granada
J. Fdez-Valdivia: Universidad de Granada
F. Moya-Anegón: Centro de Ciencias Humanas y Sociales (CCHS)

Scientometrics, 2014, vol. 99, issue 2, No 17, 523-539

Abstract: Abstract Drawing on social choice theory we derive a rationale in which each reviewer is asked to provide his or her second, third, and fourth choice in addition to his/her first choice recommendation regarding the acceptance/revision/rejection of a given manuscript. All reviewers’ hierarchies of alternatives are collected and combined such that an overall ranking can be computed. Consequently, conflicting recommendations are resolved not by asking a third adjudicating reviewer for his/her recommendation as is usual editorial praxis in many scientific journals, but rather by using more information from the available judges. After a brief introduction into social choice theory and a description and justification of the maximum likelihood rule for ranking alternatives, we describe and demonstrate a public available web application that provides easy-to-use tools to apply these methods for aggregating conflicting reviewers’ recommendations. This application might be accessed by editors to aid their decision process in case they receive conflicting recommendations by their reviewers.

Keywords: Peer review; Conflicting recommendations; Social choice theory; Ranking rule; Consensus ranking (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-013-1198-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:99:y:2014:i:2:d:10.1007_s11192-013-1198-y

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-013-1198-y

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().