Optimality conditions for MCMC in rare event risk analysis

Siu-Kui Au

Reliability Engineering and System Safety, 2026, vol. 265, issue PB

Abstract: Monte Carlo method is an indispensable tool in modern computational risk analysis for its robustness with complex systems that are increasingly ‘black-box’ in nature. Decades of research reveal that the ability to estimate small probabilities efficiently is intimately related to that of generating rare event samples. Subset Simulation offers a simple approach by sequentially propagating populations of samples failing increasing response thresholds. Markov Chain Monte Carlo (MCMC) machine-learns about rare events while maintaining the correct distribution for statistical estimation. Existing research is mostly focused on new algorithms or tuning hyperparameters through heuristics or empirical studies. Beyond conventional objectives, this work presents a general theory that establishes the conditions for an optimal MCMC algorithm in terms of minimizing the correlation between successive samples. It resolves the correlation into ‘failure mixing rate’, a new measure conducive to further analysis, for which the first two derivatives with respect to hyperparameters have been obtained analytically in terms of response gradient. The theory is illustrated with conditional sampling scheme for problems with linear and nonlinear response functions, high dimensions, and multiple failure modes. This work provides a pathway for optimizing MCMC for rare events in risk analysis. A number of questions of theoretical and computational nature are outstanding, calling for future research efforts.

Keywords: First passage problem; Markov Chain Monte Carlo; Optimal proposal; Rare event; Subset simulation (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0951832025007392
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:reensy:v:265:y:2026:i:pb:s0951832025007392

DOI: 10.1016/j.ress.2025.111539

Access Statistics for this article

Reliability Engineering and System Safety is currently edited by Carlos Guedes Soares

More articles in Reliability Engineering and System Safety from Elsevier
Bibliographic data for series maintained by Catherine Liu ().