On the Generalizability of Using Mobile Devices to Conduct Economic Experiments

Yiting Guo (), Jason Shachat, Matthew Walker and Lijia Wei
Additional contact information
Yiting Guo: Economics & Management School, Wuhan University

Working Papers from Chapman University, Economic Science Institute

Abstract: Recent technological advances enable the implementation of online, field and hybrid experiments using mobile devices. Mobile devices enable sampling of incentivized decisions in more representative samples, consequently increasing the generalizability of results. Generalizability might be compromised, however, if the device is a relevant behavioural confound. This paper reports on a battery of common economic games and decision-making tasks in which we systematically randomize the decision-making device (computer versus mobile phone) and the laboratory setup (physical versus online). The results offer broad support for conducting decision experiments using mobile devices. For six out of eight tasks, we find robust null results in terms of average treatment effects and variability. This should give researchers confidence to conduct studies out-of-laboratory via mobile phones. However, we find two caveats. First, with respect to decisions, subjects using a mobile phone are significantly more risk averse and offer less during bargaining. Second, decision response times and the time taken to read instructions are significantly shorter for the online-mobile treatment. These caveats suggest the importance of ensuring device consistency across treatments in the digital age of experimentation.

Keywords: mobile phone; digitization; methodology; experiment; generalizability (search for similar items in EconPapers)
JEL-codes: C70 C90 C93 (search for similar items in EconPapers)
Date: 2022
New Economics Papers: this item is included in nep-cbe, nep-exp and nep-ict
References: Add references at CitEc
Citations:

Downloads: (external link)
https://digitalcommons.chapman.edu/esi_working_papers/366/

Related works:
Journal Article: On the generalizability of using mobile devices to conduct economic experiments (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:chu:wpaper:22-05

Access Statistics for this paper

More papers in Working Papers from Chapman University, Economic Science Institute Contact information at EDIRC.
Bibliographic data for series maintained by Megan Luetje ().