Efficient, scalable emulation of stochastic simulators: A mixture density network based surrogate modeling framework

Han Peng and Jize Zhang

Reliability Engineering and System Safety, 2025, vol. 257, issue PA

Abstract: This work focuses on the task of emulating stochastic simulators that generate random results given consistent inputs. Existing stochastic surrogate models can have limitations in characterizing complex output distributions or suffer from data inefficiency and high-dimensionality issues. As a remedy, we propose to introduce Mixture Density Networks (MDNs) as an advanced stochastic surrogate model. Flexible neural networks are utilized to parametrize Gaussian mixture models (GMMs) to capture complex input-dependent output conditional densities. MDNs, like typical neural networks, use multiple layers of nonlinear transformations to effectively manage the potentially high-dimensional or large-volume inputs. Statistically, MDNs eliminate the need for random seed control or replication by directly learning to maximize the training data likelihood. To further enhance MDN model robustness and mitigate over-fitting, we incorporate the hard parameter sharing and variance regularization technique, and Bayesian optimization to search for optimal MDN hyperparameters, unlocking its full potential as stochastic surrogates. The efficacy of our MDN stochastic surrogate model is illustrated through various academic and realistic examples. MDN is demonstrated to be consistently more flexible, accurate, and data-efficient than current stochastic surrogate workhorses.

Keywords: Stochastic surrogate model; Deep learning; Mixture density network; Conditional density estimation; Uncertainty quantification (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832025000092
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:257:y:2025:i:pa:s0951832025000092

DOI: 10.1016/j.ress.2025.110806

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().