A model aggregation approach for high-dimensional large-scale optimization

Haowei Wang, Ercong Zhang, Szu Hui Ng and Giulia Pedrielli

European Journal of Operational Research, 2026, vol. 329, issue 3, 890-907

Abstract: Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities, high-dimensional and large-scale optimization problems are becoming increasingly common. Empirically, tasks that seem high-dimensional in machine learning, such as hyper-parameter optimization, often reveal a markedly reduced intrinsic dimensionality. In this paper, we propose a Model Aggregation Method for Bayesian Optimization (MamBO) algorithm to efficiently solve high-dimensional large-scale optimization problems with low effective dimensionality. MamBO addresses the high dimensional and large-scale data set challenges simultaneously with a combination of data subsampling and subspace embeddings. At the same time, a model aggregation method is employed to mitigate the surrogate model uncertainty issue which is largely ignored in the embedding literature and practice. Our proposed model aggregation method reduces this lower-dimensional surrogate model uncertainty and improves the robustness of the BO algorithm. We derive an asymptotic bound for the proposed aggregated surrogate model and prove the convergence of the MamBO algorithm. Several experiments indicate that our algorithm achieves superior or comparable performance to state-of-the-art high-dimensional BO algorithms and is computationally faster.

Keywords: Simulation; Bayesian optimization; High-dimensional large-scale optimization; Embedding uncertainty; Model aggregation (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0377221725008057
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ejores:v:329:y:2026:i:3:p:890-907

DOI: 10.1016/j.ejor.2025.10.004

Access Statistics for this article

European Journal of Operational Research is currently edited by Roman Slowinski, Jesus Artalejo, Jean-Charles. Billaut, Robert Dyson and Lorenzo Peccati

More articles in European Journal of Operational Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().