Aggregating Partial Rankings from Neighbors: Methodology and Empirical Evidence

Pascaline Dupas, Marcel Fafchamps and Deivy Houeix

No 29911, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: Many decisions require ordering alternatives: for example, the selection of top candidates for a competitive academic program or the selection of the poorest individuals for a cash transfer program. One common approach consists in aggregating orderings reported by different observers (e.g., committee or community members), but those orderings are typically partial: not all observers rank all applicants. We introduce a novel type of approach, based on pairwise rankings, to (i) aggregate partial orderings reported by multiple observers and (ii) construct confidence intervals for the resulting aggregate ordering. We identify, both theoretically and using simulations, the conditions under which a pairwise approach dominates rank averaging: when reporting error is low, reported orderings are partial, and observers rank alternatives that are close to each other in their true latent ordering. We introduce improvements to rank averaging and pairwise methods and illustrate them using several datasets. We find that, with partial reported orderings, Borda counts (i.e., simple rank averages) are dominated by the averaging of normalized ranks and should never be used in practice.

JEL-codes: D31 O12 (search for similar items in EconPapers)
Date: 2022-04
Note: DEV
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.nber.org/papers/w29911.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:29911

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w29911

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().