 Is Separately Modeling Subpopulations Beneficial for Sequential Decision-Making?Ilbin Lee ()
Operations Research, 2024, vol. 72, issue 6, 2595-2611 Abstract: In recent applications of Markov decision processes (MDPs), it is common to estimate transition probabilities and rewards from transition data. In healthcare and some other applications, transition data are collected from a population of different entities, such as patients. Thus, one faces a modeling question of whether to estimate different models for subpopulations (e.g., divided by smoking status). For instance, there may be a subpopulation whose disease status progresses faster than others, and for such a group, estimating a separate model and applying the corresponding optimal treatment plan can improve their outcomes. This work provides theoretical results and empirical methods for making the decision of whether to model subpopulations separately (called stratifying) or not. We also present how to use our results to select the best stratification among many. We illustrate our results and methods numerically using random instances and a medical decision-making problem from the literature. Because improving medical decisions by tailoring to each subpopulation is a building block of precision medicine, this work advances the use of MDPs in medical decision-making toward the precision medicine paradigm. Keywords: Optimization; models; dynamic programming; treatment; healthcare; estimation; statistics (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:inm:oropre:v:72:y:2024:i:6:p:2595-2611 Access Statistics for this article More articles in Operations Research from INFORMS Contact information at EDIRC. |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.