A case for conducting business-to-business experiments with multi-arm multi-stage adaptive designs
Jonathan Legare (),
Ping Yao and
Victor S. Y. Lo
Additional contact information
Jonathan Legare: Fidelity Investments
Ping Yao: Fidelity Investments
Victor S. Y. Lo: Fidelity Investments
Journal of Marketing Analytics, 2023, vol. 11, issue 3, No 16, 490-502
Abstract:
Abstract Many businesses conduct experiments to scientifically test, measure, and optimize decisions in areas like sales, marketing, and operations efficiency. While randomized controlled trials (RCTs) or A/B tests are the dominant method for conducting business experiments especially for business-to-consumer marketing, adaptive designs have yet to make extensive inroads outside of the pharmaceutical and medical industries. In this study, we aim to raise awareness of the applicability and advantages of multi-arm multi-stage adaptive designs outside of clinical settings and we use simulations to demonstrate the value of these designs to modern business experiments, with a focus on business-to-business experiments such as testing alternative sales techniques. Our simulation results show that, compared to RCT, multi-arm multi-stage adaptive designs (MAMS) can reduce the sample size requirements and expected time to experiment completion whilst maintaining a similar level of statistical power. We also demonstrate that these benefits can translate into actual cost savings in conjunction with shorter time to market, resulting in higher overall efficiency over the traditional RCTs. MAMS serves as a strong alternative methodology in experiments where not all customers can be contacted at once such as business-to-business campaigns and general live channel programs which typically take weeks to months to complete.
Keywords: Randomized controlled trial; Multi-arm multi-stage; Adaptive design; Simulation study; Experimental design; Business-to-business (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:
Downloads: (external link)
http://link.springer.com/10.1057/s41270-022-00177-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:pal:jmarka:v:11:y:2023:i:3:d:10.1057_s41270-022-00177-4
Ordering information: This journal article can be ordered from
http://www.springer. ... gement/journal/41270
DOI: 10.1057/s41270-022-00177-4
Access Statistics for this article
Journal of Marketing Analytics is currently edited by Maria Petrescu and Anjala Krishnen
More articles in Journal of Marketing Analytics from Palgrave Macmillan
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().