Taking the Analysis of Trial-Based Economic Evaluations to the Next Level: The Importance of Accounting for Clustering

Mohamed El Alili (), Johanna M. Dongen (), Keith S. Goldfeld (), Martijn W. Heymans (), Maurits W. Tulder () and Judith E. Bosmans ()
Additional contact information
Mohamed El Alili: Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute
Johanna M. Dongen: Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute
Keith S. Goldfeld: NYU School of Medicine
Martijn W. Heymans: Amsterdam UMC, Location VU, Amsterdam Public Health Research Institute
Maurits W. Tulder: Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute
Judith E. Bosmans: Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute

PharmacoEconomics, 2020, vol. 38, issue 11, No 8, 1247-1261

Abstract: Abstract Objectives The aim of this study was to assess the performance and impact of multilevel modelling (MLM) compared with ordinary least squares (OLS) regression in trial-based economic evaluations with clustered data. Methods Three thousand datasets with balanced and unbalanced clusters were simulated with correlation coefficients between costs and effects of − 0.5, 0, and 0.5, and intraclass correlation coefficients (ICCs) varying between 0.05 and 0.30. Each scenario was analyzed using both MLM and OLS. Statistical uncertainty around MLM and OLS estimates was estimated using bootstrapping. Performance measures were estimated and compared between approaches, including bias, root mean squared error (RMSE) and coverage probability. Cost and effect differences, and their corresponding confidence intervals and standard errors, incremental cost-effectiveness ratios, incremental net-monetary benefits and cost-effectiveness acceptability curves were compared. Results Cost-effectiveness outcomes were similar between OLS and MLM. MLM produced larger statistical uncertainty and coverage probabilities closer to nominal levels than OLS. The higher the ICC, the larger the effect on statistical uncertainty between MLM and OLS. Significant cost-effectiveness outcomes as estimated by OLS became non-significant when estimated by MLM. At all ICCs, MLM resulted in lower probabilities of cost effectiveness than OLS, and this difference became larger with increasing ICCs. Performance measures and cost-effectiveness outcomes were similar across scenarios with varying correlation coefficients between costs and effects. Conclusions Although OLS produced similar cost-effectiveness outcomes, it substantially underestimated the amount of variation in the data compared with MLM. To prevent suboptimal conclusions and a possible waste of scarce resources, it is important to use MLM in trial-based economic evaluations when data are clustered.

Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s40273-020-00946-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:pharme:v:38:y:2020:i:11:d:10.1007_s40273-020-00946-y

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/40273

DOI: 10.1007/s40273-020-00946-y

Access Statistics for this article

PharmacoEconomics is currently edited by Timothy Wrightson and Christopher I. Carswell

More articles in PharmacoEconomics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().