Measuring the Unmeasurable? Systematic Evidence on Scale Transformations in Subjective Survey Data

Caspar Kaiser and Anthony Lepinteur

Papers from arXiv.org

Abstract: Ordered response scales are ubiquitous in economics, but their interpretation rests on an untested assumption: that numerical labels reflect equal psychological intervals. The contribution of this paper is to provide a systematic assessment of this linearity assumption, developing a general framework to quantify how easily empirical results can be overturned when it is relaxed. Using original experimental data, we show that respondents use survey scales in ways that deviate from linearity, but only mildly so. Focusing on wellbeing research, we then replicate 40,000+ coefficient estimates across more than 80 papers published in top economics journals. Coefficient signs are remarkably robust to the mild departures from linear scale-use we document experimentally. However, estimates of relative effect sizes, which are crucial for policy applications, are unreliable even under these modest non-linearities.

Date: 2025-07, Revised 2025-09
New Economics Papers: this item is included in nep-hap
References: Add references at CitEc
Citations:

Downloads: (external link)
http://arxiv.org/pdf/2507.16440 Latest version (application/pdf)

Related works:
Working Paper: Measuring the Unmeasurable? Systematic Evidence on Scale Transformations in Subjective Survey Data (2025)
Working Paper: Measuring the Unmeasurable? Systematic Evidence on Scale Transformations in Subjective Survey Data (2025)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:arx:papers:2507.16440

Access Statistics for this paper

More papers in Papers from arXiv.org
Bibliographic data for series maintained by arXiv administrators ().