Coupled Successive Approximations for Markov Programs

Bennett L. Fox
Additional contact information
Bennett L. Fox: Université de Montréal, Montréal, Quebec, Canada

Operations Research, 1982, vol. 30, issue 2, 400-403

Abstract: Each Markov program corresponds to a pair of linear programs. Constructing successive approximations for the primal and dual variables that are respectively decreasing and increasing allows a mutual stopping criterion based on LP duality. This assumes that ordinary successive approximations have determined an optimal or ϵ-optimal policy but not its value function (exactly). The dual variables approximated are those corresponding to the policy used. In this sense, the dual-variable approximation scheme is piggybacked onto the primal-variable approximation scheme. In another sense, the two schemes are coupled by the reciprocal termination criterion that determines when to stop refining the estimates of both the primal and dual variables.

Keywords: 116; coupling; approximations; by; LP; duality (search for similar items in EconPapers)
Date: 1982
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/opre.30.2.400 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:oropre:v:30:y:1982:i:2:p:400-403

Access Statistics for this article

More articles in Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().