Quality Review of Mass Adjudication: A Randomized Natural Experiment at the Board of Veterans Appeals, 2003–16

Daniel E Ho, Cassandra Handan-Nader, David Ames and David Marcus

The Journal of Law, Economics, and Organization, 2019, vol. 35, issue 2, 239-288

Abstract: We study a unique natural experiment, during which 5–10% of draft opinions by judges of the Board of Veterans Appeals (BVA) were randomly selected for “quality review (QR)” by a team of full-time staff attorneys. The express goals of this performance program were to measure accuracy and reduce remands on appeal. In cases of legal error, the QR team wrote memoranda to judges for correction of draft opinions. We use rich internal administrative data on nearly 600,000 cases from 2003 to 2016 to conduct the first rigorous evaluation of this program. With precise estimates, we show that QR had no appreciable effects on appeals or remands. Based on internal records, we demonstrate that this inefficacy is likely by design, as meeting the performance measure of “accuracy” conflicted with error correction. These findings inform longstanding questions of law, organization, and bureaucracy, including performance management, standards of review, and institutional design of adjudication.

JEL-codes: H11 K23 K40 (search for similar items in EconPapers)
Date: 2019
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/jleo/ewz001 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:jleorg:v:35:y:2019:i:2:p:239-288.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

The Journal of Law, Economics, and Organization is currently edited by Andrea Prat

More articles in The Journal of Law, Economics, and Organization from Oxford University Press Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK.
Bibliographic data for series maintained by Oxford University Press ().