A Modified Value Iteration Algorithm for Discounted Markov Decision Processes

Sanaa Chafik and Cherki Daoui
Additional contact information
Sanaa Chafik: Laboratory of Information Processing and Decision Support, University Sultan Moulay Slimane, Beni Mellal, Morocco
Cherki Daoui: Laboratory of Information Processing and Decision Support, University Sultan Moulay Slimane, Beni Mellal, Morocco

Journal of Electronic Commerce in Organizations (JECO), 2015, vol. 13, issue 3, 47-57

Abstract: As many real applications need a large amount of states, the classical methods are intractable for solving large Markov Decision Processes. The decomposition technique basing on the topology of each state in the associated graph and the parallelization technique are very useful methods to cope with this problem. In this paper, the authors propose a Modified Value Iteration algorithm, adding the parallelism technique. They test their implementation on artificial data using an Open MP that offers a significant speed-up.

Date: 2015
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 4018/JECO.2015070104 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jeco00:v:13:y:2015:i:3:p:47-57

Access Statistics for this article

Journal of Electronic Commerce in Organizations (JECO) is currently edited by Pedro Isaías

More articles in Journal of Electronic Commerce in Organizations (JECO) from IGI Global
Bibliographic data for series maintained by Journal Editor ().