Win Stay---Lose Shift: An Elementary Learning Rule for Normal Form Games
Martin Posch
Research in Economics from Santa Fe Institute
Abstract:
In this paper we study a simple learning paradigm for iterated normal form games in an evolutionary context. Following the decision theoretic concept of satisficing we design players with a certain aspiration level. If their payoff is below this level, they change their current action, otherwise they repeat it. We consider stochastic generalizations of this win stay---lose shift principle that average the received payoff over several rounds of the game before comparing it to their aspiration level and allow the strategies to adapt their aspiration level in the course of the play.
Our analysis is twofold. On the one hand we study the evolution of such strategies for the Prisoner's Dilemma; on the other hand we consider contexts where a randomly selected game is assigned to the players. In the presence of such high uncertainty win stay---lose shift strategies turn out to be very successful.
Using computer simulations we address questions as: what is a favorable aspiration level? How many rounds should one observe before updating the current action? What is the impact of noise?
Keywords: evolution; learning; Iterated Prisoner's Dilemma; genetic algorithms; satisficing (search for similar items in EconPapers)
Date: 1997-06
References: Add references at CitEc
Citations: View citations in EconPapers (2)
Downloads: (external link)
http://www.santafe.edu/sfi/publications/Working-Papers/97-06-056.ps (application/postscript)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (http://www.santafe.edu/sfi/publications/Working-Papers/97-06-056.ps [301 Moved Permanently]--> https://www.santafe.edu/sfi/publications/Working-Papers/97-06-056.ps)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:wop:safire:97-06-056e
Access Statistics for this paper
More papers in Research in Economics from Santa Fe Institute Contact information at EDIRC.
Bibliographic data for series maintained by Thomas Krichel (krichel@openlib.org).