Artificial neural networks to solve dynamic programming problems: A bias-corrected Monte Carlo operator

Julien Pascal

No 172, BCL working papers from Central Bank of Luxembourg

Abstract: Artificial Neural Networks (ANNs) are powerful tools that can solve dynamic programming problems arising in economics. In this context, estimating ANN parameters involves minimizing a loss function based on the model’s stochastic functional equations. In general, the expectations appearing in the loss function admit no closed-form solution, so numerical approximation techniques must be used. In this paper, I analyze a bias-corrected Monte Carlo operator (bc-MC) that approximates expectations by Monte Carlo. I show that the bc-MC operator is a generalization of the all-in-one expectation operator, already proposed in the literature. I propose a method to optimally set the hyperparameters defining the bc-MC operator and illustrate the findings numerically with well-known economic models. I also demonstrate that the bc-MC operator can scale to high-dimensional models. With just a few minutes of computing time, I find a global solution to an economic model with a kink in the decision function and more than 100 dimensions.

Keywords: Dynamic programming; Artificial Neural Network; Machine Learning; Monte Carlo (search for similar items in EconPapers)
JEL-codes: C45 C61 C63 C68 E32 E37 (search for similar items in EconPapers)
Pages: 42 pages
Date: 2023-03
New Economics Papers: this item is included in nep-big, nep-cmp and nep-dge
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.bcl.lu/en/publications/Working-papers/172/BCLWP172.pdf (application/pdf)

Related works:
Journal Article: Artificial neural networks to solve dynamic programming problems: A bias-corrected Monte Carlo operator (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bcl:bclwop:bclwp172

Access Statistics for this paper

More papers in BCL working papers from Central Bank of Luxembourg Contact information at EDIRC.
Bibliographic data for series maintained by ().