Swapping the Nested Fixed-Point Algorithm: a Class of Estimators for Discrete Markov Decision Models

Victor Aguirregabiria () and Pedro Mira

No 332, Computing in Economics and Finance 1999 from Society for Computational Economics

Abstract: This paper proposes a procedure for the estimation of discrete Markov decision models and studies its statistical and computational properties. Our method is similar to Rust's Nested Fixed-Point algorithm (NFXP), but the order of the two nested algorithms is swapped. First, we prove that this method produces the maximum likelihood estimator under the same conditions as NFXP. However, our procedure requires significantly fewer policy iterations than NFXP. Second, based on this algorithm, we define a class of sequential consistent estimators, K -stage Policy Iteration (PI) estimators, that encompasses MLE and Holz-Miller, and we obtain a recursive expression for their asymptotic covariance matrices. This presents the researcher with a 'menu' of sequential estimators reflecting a trade-off between efficiency and computational cost. Using actual and simulated data we compare the relative performance of these estimators. In all our experiments, the benefits in efficiency of using a two-stage PI estimator instead of a one-stage estimator (i.e., Hotz-Miller) are very significant. More interestingly, the benefits of MLE relative to two-stage PI are small.

Date: 1999-03-01
References: Add references at CitEc
Citations: View citations in EconPapers (14)

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
Journal Article: Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models (2002)
Working Paper: Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models (1999)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sce:scecf9:332

Access Statistics for this paper

More papers in Computing in Economics and Finance 1999 from Society for Computational Economics CEF99, Boston College, Department of Economics, Chestnut Hill MA 02467 USA. Contact information at EDIRC.
Bibliographic data for series maintained by Christopher F. Baum ().