IDENTIFICATION IN DISCRETE MARKOV DECISION MODELS

Sorawoot Srisuma

Econometric Theory, 2015, vol. 31, issue 3, 521-538

Abstract: We derive conditions for the identification of the structural parameters in Markov decision model under the assumptions of Rust (1987, Econometrica 55, 999–1033) when the payoff function is parametrically specified. Identification in this class of dynamic problems is difficult to establish since the parameters of interest enter the value function nonlinearly, and the value function is only defined implicitly as a fixed point of some functional equation. We show it is sufficient to verify identification in the pseudomodel, which is more tractable as it is originally designed to reduce the computational burden in the estimation problem, for the identification of the data generating parameter of the underling model. Our results extend naturally to a class of dynamic discrete action games commonly used in empirical industrial organizations.

Date: 2015
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.cambridge.org/core/product/identifier/ ... type/journal_article link to article abstract page (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cup:etheor:v:31:y:2015:i:03:p:521-538_00

Access Statistics for this article

More articles in Econometric Theory from Cambridge University Press Cambridge University Press, UPH, Shaftesbury Road, Cambridge CB2 8BS UK.
Bibliographic data for series maintained by Kirk Stebbing ().