Near-Term Liability of Exploitation: Exploration and Exploitation in Multistage Problems

Christina Fang () and Daniel Levinthal ()
Additional contact information
Christina Fang: Department of Management and Organization, Stern School of Business, New York University, New York, New York 10012
Daniel Levinthal: Department of Management, The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104

Organization Science, 2009, vol. 20, issue 3, 538-551

Abstract: The classic trade-off between exploration and exploitation reflects the tension between gaining new information about alternatives to improve future returns and using the information currently available to improve present returns. By considering these issues in the context of a multistage, as opposed to a repeated, problem environment, we show that exploratory behavior has value quite apart from its role in revising beliefs. We show that even if current beliefs provide an unbiased characterization of the problem environment, maximizing with respect to these beliefs may lead to an inferior expected payoff relative to other mechanisms that make less aggressive use of the organization's beliefs. Search can lead to more robust actions in multistage decision problems than maximization, a benefit quite apart from its role in the updating of beliefs.

Keywords: exploration and exploitation; maximization; multistage problems; reinforcement learning; softmax choice rule (search for similar items in EconPapers)
Date: 2009
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (13)

Downloads: (external link)
http://dx.doi.org/10.1287/orsc.1080.0376 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ororsc:v:20:y:2009:i:3:p:538-551

Access Statistics for this article

More articles in Organization Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().