Finite-stage reward functions having the Markov adequacy property

Victor Pestien and Xiaobo Wang

Stochastic Processes and their Applications, 1993, vol. 46, issue 1, 129-151

Abstract: If X is a countable state space and g is a bounded reward function on Xn, then say g has the Markov-adequacy property if every strategy has a corresponding randomized Markov strategy which gives g the same integral as the original strategy. A complete characterization of functions having the Markov-adequacy property is given. In particular, if g is permutation-invariant and X has at least three elements, then g has the Markov-adequacy property if and only if g has the linear sections property, a condition which is easy to verify.

Keywords: Markov; strategy; randomized; strategy; rewars; function (search for similar items in EconPapers)
Date: 1993
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/0304-4149(93)90088-L
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:spapps:v:46:y:1993:i:1:p:129-151

Ordering information: This journal article can be ordered from
http://http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Stochastic Processes and their Applications is currently edited by T. Mikosch

More articles in Stochastic Processes and their Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().