Decision making in uncertain and changing environments

Karl Schlag and Andriy Zapechelnyuk

Economics Working Papers from Department of Economics and Business, Universitat Pompeu Fabra

Abstract: We consider an agent who has to repeatedly make choices in an uncertain and changing environment, who has full information of the past, who discounts future payoffs, but who has no prior. We provide a learning algorithm that performs almost as well as the best of a given finite number of experts or benchmark strategies and does so at any point in time, provided the agent is sufficiently patient. The key is to find the appropriate degree of forgetting distant past. Standard learning algorithms that treat recent and distant past equally do not have the sequential epsilon optimality property.

Keywords: Adaptive learning; experts; distribution-free; e-optimality; Hannan regret (search for similar items in EconPapers)
JEL-codes: C44 D81 D83 (search for similar items in EconPapers)
Date: 2009-06
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://econ-papers.upf.edu/papers/1160.pdf Whole Paper (application/pdf)

Related works:
Working Paper: Decision Making in Uncertain and Changing Environments (2009)
Working Paper: Decision Making in Uncertain and Changing Environments (2009)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:upf:upfgen:1160

Access Statistics for this paper

More papers in Economics Working Papers from Department of Economics and Business, Universitat Pompeu Fabra
Bibliographic data for series maintained by ( this e-mail address is bad, please contact ).