A Multi-Fidelity Rollout Algorithm for Dynamic Resource Allocation in Population Disease Management

Ting-Yu Ho, Shan Liu () and Zelda B. Zabinsky
Additional contact information
Ting-Yu Ho: University of Washington
Shan Liu: University of Washington
Zelda B. Zabinsky: University of Washington

Health Care Management Science, 2019, vol. 22, issue 4, No 10, 727-755

Abstract: Abstract Dynamic resource allocation for prevention, screening, and treatment interventions in population disease management has received much attention in recent years due to excessive healthcare costs. In this paper, our goal is to design a model and an efficient algorithm to optimize sequential intervention policies under resource constraints to improve population health outcomes. We consider a discrete-time finite-horizon budget allocation problem with disease progression within a closed birth-cohort population. To address the computational challenges associated with large-state and multiple-period dynamic decision-making problems, we propose a low-fidelity approximation that preserves the population dynamics under a stationary policy. To improve the healthcare interventions in terms of population health outcomes, we then embed the low-fidelity approximation into a high-fidelity optimization model to efficiently identify a good non-stationary sequential intervention policy. Our approach is illustrated by a numerical example of screening and treatment policy implementation for chronic hepatitis C virus (HCV) infection over a budget planning period. We numerically compare our Multi-Fidelity Rollout Algorithm (MF-RA) to a grid search approach and demonstrate the similarity of sequential policy trends and closeness of overall health outcomes measured by quality-adjusted life-years (QALYs) and the total number of individuals that undergo screening and treatment for different annual budgets and birth-cohorts. We also show how our approach scales well to problems with high dimensionality due to many decision periods by studying time to elimination of HCV.

Keywords: Screening and treatment interventions; Dynamic programming; Markov processes; Simulation; Rollout algorithm; Hepatitis C (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s10729-018-9454-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:hcarem:v:22:y:2019:i:4:d:10.1007_s10729-018-9454-6

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10729

DOI: 10.1007/s10729-018-9454-6

Access Statistics for this article

Health Care Management Science is currently edited by Yasar Ozcan

More articles in Health Care Management Science from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().