Mean-variance optimization in finite horizon Markov decision processes and its application to revenue management

Rainer Schlosser and Jochen Gönsch

European Journal of Operational Research, 2025, vol. 325, issue 3, 516-524

Abstract: In many applications, risk-averse decision-making is crucial. In this context, the mean–variance (MV) criterion is widely accepted and often used to find the right balance between maximizing expected rewards and avoiding poor performances. In dynamic settings, however, it is challenging to efficiently compute policies under the MV objective and hence, surrogates like the exponential utility model are often used. In this paper, we consider MV optimization for discrete time Markov decision processes (MDP) with finite horizon. Our approach is based on a system of tractable subproblems with distorted variance that allows to identify mean–variance combinations that cannot be attained. The number of subproblems to solve can be chosen such that a predetermined ex-ante optimality gap is obtained. We illustrate the effectiveness and the applicability of our approach for different revenue management examples. We find that competitive ex-ante and ex-post optimality gaps lower than 0.0001% can be reliably obtained with acceptable computational effort.

Keywords: Revenue management; Risk aversion; Markov decision process; Mean–variance optimization; Dynamic programming (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0377221725002279
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ejores:v:325:y:2025:i:3:p:516-524

DOI: 10.1016/j.ejor.2025.03.030

Access Statistics for this article

European Journal of Operational Research is currently edited by Roman Slowinski, Jesus Artalejo, Jean-Charles. Billaut, Robert Dyson and Lorenzo Peccati

More articles in European Journal of Operational Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().