On the generalizability of using mobile devices to conduct economic experiments

Yiting Guo, Jason Shachat, Matthew Walker and Lijia Wei

Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), 2023, vol. 106, issue C

Abstract: Mobile devices enable experimental economists to collect decision-making data from more heterogeneous samples, thereby increasing the generalizability of their results. This generalizability may be compromised if the device is a relevant behavioural confound. This paper reports on a battery of classic economic games and tasks in which we randomize the decision-making device (computer versus mobile) and the laboratory setup (physical versus remote). Our results offer broad support for conducting decision experiments using mobile devices. For six out of eight tasks, we find robust null results for means of treatment effects as well for differences in variances and general distributions of choices across treatments. This should give researchers confidence to conduct studies via mobile devices and in out-of-lab settings. However, we find two caveats. First, subjects using a mobile device exhibit more risk aversion and offer less during bargaining. These effects persist in the physical lab after controlling for subjects’ observed characteristics. Second, response times and the time taken to read instructions using a mobile device are shorter in the remote setup. These qualifications suggest the importance of ensuring device consistency across treatments.

Keywords: Mobile device; Digitization; Methodology; Experiment; Generalizability (search for similar items in EconPapers)
JEL-codes: C70 C90 C93 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S2214804323000836
Full text for ScienceDirect subscribers only

Related works:
Working Paper: On the Generalizability of Using Mobile Devices to Conduct Economic Experiments (2022)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:soceco:v:106:y:2023:i:c:s2214804323000836

DOI: 10.1016/j.socec.2023.102057

Access Statistics for this article

Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) is currently edited by Pablo Brañas Garza

More articles in Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().