Valuing programs with deterministic and stochastic cycles

Harry Paarsch and John Rust ()

Journal of Economic Dynamics and Control, 2009, vol. 33, issue 3, 614-623

Abstract: In many dynamic programming problems, a mix of state variables exists - some exhibiting stochastic cycles and others having deterministic cycles. We derive a formula for the value function in infinite-horizon, stationary, Markovian decision problems by exploiting a special partitioned-circulant structure of the transition matrix [Pi]. Our strategy for computing the left-inverse of the matrix [I-[beta][Pi]], which is central to implementing Howard's policy iteration algorithm, yields significant improvements in computation time and major reductions in memory required. When the deterministic cycle is of order n, our cyclic inversion algorithm yields an O(n2) speed-up relative to the usual policy iteration algorithm.

Keywords: Dynamic; programming; Policy; iteration; Deterministic; cycles; Stochastic; cycles; Circulant; matrix; Cyclic; inversion; algorithm (search for similar items in EconPapers)
Date: 2009
References: View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0165-1889(08)00150-4
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:dyncon:v:33:y:2009:i:3:p:614-623

Access Statistics for this article

Journal of Economic Dynamics and Control is currently edited by J. Bullard, C. Chiarella, H. Dawid, C. H. Hommes, P. Klein and C. Otrok

More articles in Journal of Economic Dynamics and Control from Elsevier
Bibliographic data for series maintained by Catherine Liu ().