Learning by Doing vs. Learning from Others in a Principal-Agent Model

Jasmina Arifovic () and Alexander K. Karaivanov ()
Additional contact information
Jasmina Arifovic: Simon Fraser University, http://www.sfu.ca/~arifovic/

Discussion Papers from Department of Economics, Simon Fraser University

Abstract: We introduce learning in a principal-agent model of stochastic output sharing under moral hazard. Without knowing the agents' preferences and technology the principal tries to learn the optimal agency contract. We implement two learning paradigms - social (learning from others) and individual (learning by doing). We use a social evolutionary learning algorithm (SEL) to represent social learning. Within the individual learning paradigm, we investigate the performance of reinforcement learning (RL), experience-weighted attraction learning (EWA), and individual evolutionary learning (IEL). Overall, our results show that learning in the principal-agent environment is very difficult. This is due to three main reasons: (1) the stochastic environment, (2) a discontinuity in the payoff space in a neighborhood of the optimal contract due to the participation constraint and (3) incorrect evaluation of foregone payoffs in the sequential game principal-agent setting. The first two factors apply to all learning algorithms we study while the third is the main contributor for the failure of the EWA and IEL models. Social learning (SEL), especially combined with selective replication, is much more successful in achieving convergence to the optimal contract than the canonical versions of individual learning from the literature. A modified version of the IEL algorithm using realized payoff evaluation performs better than the other individual learning models; however, it still falls short of the social learning's ability to converge to the optimal contract.

Keywords: learning; principal-agent model; moral hazard (search for similar items in EconPapers)
JEL-codes: D83 D86 C63 (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-bec, nep-cmp, nep-cta, nep-dge, nep-evo and nep-exp
Date: 2007-11

Downloads: (external link)
http://www.econ.sfu.ca/research/RePEc/sfu/sfudps/dp07-24.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:sfu:sfudps:dp07-24

Ordering information: This working paper can be ordered from
Working Paper Coordinator, Department of Economics, Simon Fraser University, 8888 University Drive, Burnaby, BC, V5A 1S6, Canada
http://www.econ.sfu. ... lications/index.html

Access Statistics for this paper

More papers in Discussion Papers from Department of Economics, Simon Fraser University
Address: Department of Economics, Simon Fraser University, 8888 University Drive, Burnaby, BC, V5A 1S6, Canada
Contact information at EDIRC.
Series data maintained by Working Paper Coordinator ().