Bias in expert product reviews

Ben Vollaard and Jan van Ours

No 21-042/V, Tinbergen Institute Discussion Papers from Tinbergen Institute

Abstract: Hard evidence on bias in expert reviews and its consequences for ratings is rare. This holds particularly true for conflicts of interest that are thought to be common in non-blind product reviews but are not readily observable: ad hoc relationships between reviewers and producers. We present a textbook case of a long-running expert product review in the food service industry for which we happen to know the reviewer's conflict of interest: being affiliated to one particular producer. As is typical, only insiders were aware of the possible source of bias in the review. The review resembles other non-blind tests of product quality. We obtained detailed data to map the consequences of the conflict of interest. We find evidence of a sizable bias in the reviewers' ratings. Our findings suggest that reviewers' ad hoc relationships with producers, often dismissed as `coming with the job', can be very harmful.

Date: 2021-05-17
New Economics Papers: this item is included in nep-agr and nep-mkt
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://papers.tinbergen.nl/21042.pdf (application/pdf)

Related works:
Journal Article: Bias in expert product reviews (2022)
Working Paper: Bias in expert product reviews (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:tin:wpaper:20210042

Access Statistics for this paper

More papers in Tinbergen Institute Discussion Papers from Tinbergen Institute Contact information at EDIRC.
Bibliographic data for series maintained by Tinbergen Office +31 (0)10-4088900 ().