Social Media as a Recruitment and Data Collection Tool: Experimental Evidence on the Relative Effectiveness of Web Surveys and Chatbots

Emily Beam

No 15597, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: Online technologies enable lower-cost, rapid data collection, but concerns about access and data quality impede their use in global research. I conduct a randomized experiment in the Philippines to test the effectiveness of web-form and chatbot surveys of K–12 teachers recruited through social media and compare their effectiveness with phone surveys of teachers recruited from a pre-existing frame. Chatbot surveys yield higher response rates and higher-quality data than web-form surveys in terms of missed question and item differentiation. The results suggest that chatbot responses match CATI responses on multiple dimensions of quality. Relative to CATI, online methods also yield higher rates or information disclosure on potentially sensitive topics, revealing substantially higher levels of distress among teachers. I show that social-media-based recruitment can be an attractive alternative for targeted sampling and that online surveys can be implemented effectively at a fraction of the cost of phone surveys.

Keywords: social media; chatbots; survey experiments; remote surveys; remote education (search for similar items in EconPapers)
JEL-codes: C81 C83 C93 I21 O15 (search for similar items in EconPapers)
Pages: 46 pages
Date: 2022-09
New Economics Papers: this item is included in nep-exp, nep-pay and nep-sea
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published - published in: Journal of Development Economics, 2023, 162, 103069

Downloads: (external link)
https://docs.iza.org/dp15597.pdf (application/pdf)

Related works:
Journal Article: Social media as a recruitment and data collection tool: Experimental evidence on the relative effectiveness of web surveys and chatbots (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp15597

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().