Invitation messages for business surveys: A multi-armed bandit experiment

Johannes J. Gaul, Florian Keusch, Davud Rostam-Afschar and Thomas Simon

No 25-003, ZEW Discussion Papers from ZEW - Leibniz Centre for European Economic Research

Abstract: This study investigates how elements of a survey invitation message targeted to businesses influence their participation in a self-administered web survey. We implement a full factorial experiment varying five key components of the email invitation. Unlike traditional experimental setups with static group composition, however, we employ adaptive randomization in our sequential research design. Specifically, as the experiment progresses, a Bayesian learning algorithm assigns more observations to invitation messages with higher starting rates. Our results indicate that personalizing the message, emphasizing the authority of the sender, and pleading for help increase survey starting rates, while stressing strict privacy policies and changing the location of the survey URL have no response-enhancing effect. The implementation of adaptive randomization is useful for other applications of survey design and methodology.

Keywords: Adaptive Randomization; Reinforcement Learning; Nonresponse; Email Invitation; Web Survey; Firm Survey; Organizational Survey (search for similar items in EconPapers)
JEL-codes: C11 C44 C93 D83 M00 M40 (search for similar items in EconPapers)
Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/312576/1/1919156240.pdf (application/pdf)

Related works:
Working Paper: Invitation Messages for Business Surveys: A Multi-Armed Bandit Experiment (2024)
Working Paper: Invitation Messages for Business Surveys: A Multi-Armed Bandit Experiment (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:zewdip:312576

Access Statistics for this paper

More papers in ZEW Discussion Papers from ZEW - Leibniz Centre for European Economic Research Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().