 Long-run choice anomalies in reinforcement learning with bounded memoryErin Giffin and Erik Lillethun Journal of Economic Behavior & Organization, 2025, vol. 231, issue C Abstract: Violations of expected utility (EU) maximization have been demonstrated in many settings; however, anomalies are often reduced after repeated choices. We examine if sufficient experiential learning allows convergence to EU-maximization. In the model, a decision maker with long but finite memory repeatedly makes choices in the same decision problem with uncertainty. We focus on the existence and severity of a certain unambiguous type of long-run choice anomaly: ranking reversals (a non-EU maximizing action being most frequently chosen in the long run). We show reversals exist for almost all preferences, even in realistic examples. Reversals tend to happen when payoff differences are heavily skewed. Longer memory does not eliminate the possibility of ranking reversals, but it does make reversals less severe. Our key takeaway is that finite memory can produce major violations of the expected utility ranking even in a model where both memory and the decision-making process are unbiased. Keywords: Expected utility; Choice anomalies; Reinforcement learning; Bounded memory; Markov chains (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:eee:jeborg:v:231:y:2025:i:c:s0167268125000216 DOI: 10.1016/j.jebo.2025.106901 Access Statistics for this article Journal of Economic Behavior & Organization is currently edited by Houser, D. and Puzzello, D. More articles in Journal of Economic Behavior & Organization from Elsevier |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.