Optimal Allocation of Proposals to Reviewers to Facilitate Effective Ranking

Wade D. Cook (), Boaz Golany (), Moshe Kress (), Michal Penn () and Tal Raviv ()
Additional contact information
Wade D. Cook: Schulich School of Business, York University, Toronto, Ontario M3J 1P3, Canada
Boaz Golany: Faculty of Industrial Engineering and Management, Technion---Israel Institute of Technology, Haifa 32000, Israel
Moshe Kress: Center for Military Analyses, POB 2250, Haifa 31021, Israel, and Operations Research Department, Naval Postgraduate School, Monterey, California 93943
Michal Penn: Faculty of Industrial Engineering and Management, Technion---Israel Institute of Technology, Haifa 32000, Israel
Tal Raviv: Faculty of Industrial Engineering and Management, Technion---Israel Institute of Technology, Haifa 32000, Israel

Management Science, 2005, vol. 51, issue 4, 655-661

Abstract: Peer review of research proposals and articles is an essential element in research and development processes worldwide. Here we consider a problem that, to the best of our knowledge, has not been addressed until now: how to assign subsets of proposals to reviewers in scenarios where the reviewers supply their evaluations through ordinal ranking. The solution approach we propose for this assignment problem maximizes the number of proposal pairs that will be evaluated by one or more reviewers. This new approach should facilitate meaningful aggregation of partial rankings of subsets of proposals by multiple reviewers into a consensus ranking. We offer two ways to implement the approach: an integer-programming set-covering model and a heuristic procedure. The effectiveness and efficiency of the two models are tested through an extensive simulation experiment.

Keywords: peer review; ranking procedures; set covering (search for similar items in EconPapers)
Date: 2005
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (14)

Downloads: (external link)
http://dx.doi.org/10.1287/mnsc.1040.0290 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormnsc:v:51:y:2005:i:4:p:655-661

Access Statistics for this article

More articles in Management Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().