Opening the ‘black box’ of simulations: increased transparency and effective communication through the systematic design of experiments

Iris Lorscheid (), Bernd-Oliver Heine () and Matthias Meyer ()
Additional contact information
Iris Lorscheid: Hamburg University of Technology
Bernd-Oliver Heine: Hamburg University of Technology
Matthias Meyer: Hamburg University of Technology

Computational and Mathematical Organization Theory, 2012, vol. 18, issue 1, No 3, 22-62

Abstract: Abstract Many still view simulation models as a black box. This paper argues that perceptions could change if the systematic design of experiments (DOE) for simulation research was fully realized. DOE can increase (1) the transparency of simulation model behavior and (2) the effectiveness of reporting simulation results. Based on DOE principles, we develop a systematic procedure to guide the analysis of simulation models as well as concrete templates for sharing the results. A simulation model investigating the performance of learning algorithms in an economic mechanism design context illustrates our suggestions. Overall, the proposed systematic procedure for applying DOE principles complements current initiatives for a more standardized simulation research process.

Keywords: Communication; Design of experiments; Simulation; Standards; Transparency (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (12)

Downloads: (external link)
http://link.springer.com/10.1007/s10588-011-9097-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:comaot:v:18:y:2012:i:1:d:10.1007_s10588-011-9097-3

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10588

DOI: 10.1007/s10588-011-9097-3

Access Statistics for this article

Computational and Mathematical Organization Theory is currently edited by Terrill Frantz and Kathleen Carley

More articles in Computational and Mathematical Organization Theory from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().