A Simulation-Based Evaluation of Statistical Methods for Hybrid Real-World Control Arms in Clinical Trials

Mingyang Shan (), Douglas Faries, Andy Dang, Xiang Zhang, Zhanglin Cui and Kristin M. Sheffield
Additional contact information
Mingyang Shan: Eli Lilly and Company, Real World Analytics
Douglas Faries: Eli Lilly and Company, Real World Analytics
Andy Dang: Eli Lilly and Company, Real World Analytics
Xiang Zhang: CSL Behring, Quantitative Clinical Sciences and Reporting
Zhanglin Cui: Eli Lilly and Company, Real World Analytics
Kristin M. Sheffield: Eli Lilly and Company, Global Patient Outcomes and Real World Evidence

Statistics in Biosciences, 2022, vol. 14, issue 2, No 5, 259-284

Abstract: Abstract Real-world (RW) data have been a source for creating external control arms to evaluate results from randomized controlled trials (RCTs) in rare diseases and scenarios where randomization to a control group is unethical or unfeasible. However, the validity of any decision making based on such comparative results depends heavily on the appropriateness and quality of the control arm data. FDA guidance lists multiple bias-generating concerns with the use of real-world controls arising from data quality and validity issues, which we frame as a data source ignorability assumption under the potential outcome framework. Hybrid control designs, RCTs with a full treatment group and a small underpowered control group supplemented with RW control data, have the potential to address some of these bias concerns. Statistical methods have been proposed for the analysis of hybrid designs and can adjust for potential violations of the data source ignorability assumption. A simulation study is presented to evaluate the operating characteristics of single and hybrid real-world control methods across the bias-generating scenarios mentioned in FDA guidance. Results suggest that certain methods can adjust for potential biases under these scenarios but may result in reduced efficiency through larger standard errors, or type I error inflation. Implications for the use of such methods and suggestions for additional work are discussed.

Keywords: External control arm; Hybrid control trial; Real-world data; Matching; Bias control (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s12561-022-09334-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stabio:v:14:y:2022:i:2:d:10.1007_s12561-022-09334-w

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/12561

DOI: 10.1007/s12561-022-09334-w

Access Statistics for this article

Statistics in Biosciences is currently edited by Hongyu Zhao and Xihong Lin

More articles in Statistics in Biosciences from Springer, International Chinese Statistical Association
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().