UNSTABLE DYNAMICS OF ADAPTATION IN UNKNOWN ENVIRONMENT DUE TO NOVELTY SEEKING

Arkady Zgonnikov () and Ihor Lubashevsky ()
Additional contact information
Arkady Zgonnikov: University of Aizu, Tsuruga, Ikki-Machi, Aizu-Wakamatsu, Fukushima 965-8580, Japan
Ihor Lubashevsky: University of Aizu, Tsuruga, Ikki-Machi, Aizu-Wakamatsu, Fukushima 965-8580, Japan

Advances in Complex Systems (ACS), 2014, vol. 17, issue 03n04, 1-17

Abstract: Learning and adaptation play great role in emergent socio-economic phenomena. Complex dynamics has been previously found in the systems of multiple learning agents interacting via a simple game. Meanwhile, the single agent adaptation is considered trivially stable. We advocate the idea that adopting a more complex model of the individual behavior may result in a more diverse spectrum of macro-level behaviors. We develop an adaptation model based on the reinforcement learning framework extended by an additional processing channel. We scrutiny the dynamics of the single agent adapting to the unknown environment; the agent is biased by novelty seeking, the intrinsic inclination for exploration. We demonstrate that the behavior of the novelty-seeking agent may be inherently unstable. One of the surprising results is that under certain conditions the increase of the novelty-seeking level may cause the agent to switch from the non-rational to the strictly rational behavior. Our results give evidence to the hypothesis that the intrinsic motives of agents should be paid no less attention than the extrinsic ones in the models of complex socio-economic systems.

Keywords: Adaptation; learning dynamics; emergence; individual complexity; novelty seeking (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219525914500131
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:acsxxx:v:17:y:2014:i:03n04:n:s0219525914500131

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219525914500131

Access Statistics for this article

Advances in Complex Systems (ACS) is currently edited by Frank Schweitzer

More articles in Advances in Complex Systems (ACS) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().