Can Deep Reinforcement Learning Improve Inventory Management? Performance on Lost Sales, Dual-Sourcing, and Multi-Echelon Problems

Joren Gijsbrechts (), Robert N. Boute (), Jan A. Van Mieghem () and Dennis J. Zhang ()
Additional contact information
Joren Gijsbrechts: Universidade Católica Portuguesa, Católica Lisbon School of Business and Economics, 1649-023 Lisbon, Portugal
Robert N. Boute: Vlerick Business School, Technology and Operations Management Area, 3000 Leuven, Belgium; Katholieke Universiteit Leuven, Research Center for Operations Management, 3000 Leuven, Belgium
Jan A. Van Mieghem: Kellogg School of Management, Northwestern University, Evanston, Illinois 60208
Dennis J. Zhang: Olin Business School, Washington University in St. Louis, St. Louis, Missouri 63130

Manufacturing & Service Operations Management, 2022, vol. 24, issue 3, 1349-1368

Abstract: Problem definition : Is deep reinforcement learning (DRL) effective at solving inventory problems? Academic/practical relevance : Given that DRL has successfully been applied in computer games and robotics, supply chain researchers and companies are interested in its potential in inventory management. We provide a rigorous performance evaluation of DRL in three classic and intractable inventory problems: lost sales, dual sourcing, and multi-echelon inventory management. Methodology : We model each inventory problem as a Markov decision process and apply and tune the Asynchronous Advantage Actor-Critic (A3C) DRL algorithm for a variety of parameter settings. Results : We demonstrate that the A3C algorithm can match the performance of the state-of-the-art heuristics and other approximate dynamic programming methods. Although the initial tuning was computationally demanding and time demanding, only small changes to the tuning parameters were needed for the other studied problems. Managerial implications : Our study provides evidence that DRL can effectively solve stationary inventory problems. This is especially promising when problem-dependent heuristics are lacking. Yet, generating structural policy insight or designing specialized policies that are (ideally provably) near optimal remains desirable.

Keywords: inventory theory and control; logistics and transportation; supply chain management; OM-information technology interface (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://dx.doi.org/10.1287/msom.2021.1064 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormsom:v:24:y:2022:i:3:p:1349-1368

Access Statistics for this article

More articles in Manufacturing & Service Operations Management from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().