Alternative evaluation metrics for risk adjustment methods

Sungchul Park and Anirban Basu

Health Economics, 2018, vol. 27, issue 6, 984-1010

Abstract: Risk adjustment is instituted to counter risk selection by accurately equating payments with expected expenditures. Traditional risk‐adjustment methods are designed to estimate accurate payments at the group level. However, this generates residual risks at the individual level, especially for high‐expenditure individuals, thereby inducing health plans to avoid those with high residual risks. To identify an optimal risk‐adjustment method, we perform a comprehensive comparison of prediction accuracies at the group level, at the tail distributions, and at the individual level across 19 estimators: 9 parametric regression, 7 machine learning, and 3 distributional estimators. Using the 2013–2014 MarketScan database, we find that no one estimator performs best in all prediction accuracies. Generally, machine learning and distribution‐based estimators achieve higher group‐level prediction accuracy than parametric regression estimators. However, parametric regression estimators show higher tail distribution prediction accuracy and individual‐level prediction accuracy, especially at the tails of the distribution. This suggests that there is a trade‐off in selecting an appropriate risk‐adjustment method between estimating accurate payments at the group level and lower residual risks at the individual level. Our results indicate that an optimal method cannot be determined solely on the basis of statistical metrics but rather needs to account for simulating plans' risk selective behaviors.

Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://doi.org/10.1002/hec.3657

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:hlthec:v:27:y:2018:i:6:p:984-1010

Access Statistics for this article

Health Economics is currently edited by Alan Maynard, John Hutton and Andrew Jones

More articles in Health Economics from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().