Recursive Lexicographical Search: Finding All Markov Perfect Equilibria of Finite State Directional Dynamic Games

Fedor Iskhakov, John Rust () and Bertel Schjerning

The Review of Economic Studies, 2016, vol. 83, issue 2, 658-703

Abstract: We define a class of dynamic Markovian games, directional dynamic games (DDG), where directionality is represented by a strategy-independent partial order on the state space. We show that many games are DDGs, yet none of the existing algorithms are guaranteed to find any Markov perfect equilibrium (MPE) of these games, much less all of them. We propose a fast and robust generalization of backward induction we call state recursion that operates on a decomposition of the overall DDG into a finite number of more tractable stage games, which can be solved recursively. We provide conditions under which state recursion finds at least one MPE of the overall DDG and introduce a recursive lexicographic search (RLS) algorithm that systematically and efficiently uses state recursion to find all MPE of the overall game in a finite number of steps. We apply RLS to find all MPE of a dynamic model of Bertrand price competition with cost-reducing investments which we show is a DDG. We provide an exact non-iterative algorithm that finds all MPE of every stage game, and prove there can be only 1, 3, or 5 of them. Using the stage games as building blocks, RLS rapidly finds and enumerates all MPE of the overall game. RLS finds a unique MPE for an alternating move version of the leapfrogging game when technology improves with probability 1, but in other cases, and in any simultaneous move version of the game, it finds a huge multiplicity of MPE that explode exponentially as the number of possible cost states increases.

Date: 2016
References: Add references at CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
http://hdl.handle.net/10.1093/restud/rdv046 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Recursive Lexicographical Search: Finding all Markov Perfect Equilibria of Finite State Directional Dynamic Games (2014)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:restud:v:83:y:2016:i:2:p:658-703.

Access Statistics for this article

The Review of Economic Studies is currently edited by Thomas Chaney, Xavier d’Haultfoeuille, Andrea Galeotti, Bård Harstad, Nir Jaimovich, Katrine Loken, Elias Papaioannou, Vincent Sterk and Noam Yuchtman

More articles in The Review of Economic Studies from Review of Economic Studies Ltd
Bibliographic data for series maintained by Oxford University Press ().