Optimal Off-line Experimentation for Games

Theodore T. Allen (), Olivia K. Hernand () and Abdullah Alomair ()
Additional contact information
Theodore T. Allen: Integrated Systems Engineering, The Ohio State University, Columbus, Ohio 43210
Olivia K. Hernand: Integrated Systems Engineering, The Ohio State University, Columbus, Ohio 43210
Abdullah Alomair: Integrated Systems Engineering, The Ohio State University, Columbus, Ohio 43210

Decision Analysis, 2020, vol. 17, issue 4, 277-298

Abstract: Many business situations can be called “games” because outcomes depend on multiple decision makers with differing objectives. Yet, in many cases, the payoffs for all combinations of player options are not available, but the ability to experiment off-line is available. For example, war-gaming exercises, test marketing, cyber-range activities, and many types of simulations can all be viewed as off-line gaming-related experimentation. We address the decision problem of planning and analyzing off-line experimentation for games with an initial procedure seeking to minimize the errors in payoff estimates. Then, we provide a sequential algorithm with reduced selections from option combinations that are irrelevant to evaluating candidate Nash, correlated, cumulative prospect theory or other equilibria. We also provide an efficient formula to estimate the chance that given Nash equilibria exists, provide convergence guarantees relating to general equilibria, and provide a stopping criterion called the estimated expected value of perfect off-line information (EEVPOI). The EEVPOI is based on bounded gains in expected utility from further off-line experimentation. An example of using a simulation model to illustrate all the proposed methods is provided based on a cyber security capture-the-flag game. The example demonstrates that the proposed methods enable substantial reductions in both the number of test runs (half) compared with a full factorial and the computational time for the stopping criterion.

Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1287/deca.2020.0412 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ordeca:v:17:y:4:i:2020:p:277-298

Access Statistics for this article

More articles in Decision Analysis from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().