A cooperative approach to efficient global optimization

Dawei Zhan (), Jintao Wu (), Huanlai Xing () and Tianrui Li ()
Additional contact information
Dawei Zhan: Southwest Jiaotong University
Jintao Wu: Southwest Jiaotong University
Huanlai Xing: Southwest Jiaotong University
Tianrui Li: Southwest Jiaotong University

Journal of Global Optimization, 2024, vol. 88, issue 2, No 2, 327-357

Abstract: Abstract The efficient global optimization (EGO) algorithm is widely used for solving expensive optimization problems, but it has been frequently criticized for its incapability of solving high-dimensional problems, i.e., problems with 100 or more variables. Extending the EGO algorithm to high dimensions encounters two major challenges: the training time of the Kriging model goes up rapidly and the difficulty of solving the infill optimization problem increases exponentially as the dimension of the problem increases. In this work, we propose a simple and efficient cooperative framework to tackle these two problems simultaneously. In the proposed framework, we first randomly decompose the original high-dimensional problem into several sub-problems, and then train the Kriging model and solve the infill optimization problem for each sub-problem. Context vectors are used to link the sub-problems such that the Kriging models are trained and the infill optimization problems are solved in a cooperative way. Once all the sub-problems have been solved, we start another random decomposition again and repeat the divide-and-conquer process until the computational budget is reached. Experiment results show that the proposed cooperative approach can bring nearly linear speedup with respect to the number of sub-problems. The proposed approach also shows competitive optimization performance when compared with the standard EGO and six high-dimensional versions of EGO. This work provides an efficient and effective approach for high-dimensional expensive optimization.

Keywords: Efficient global optimization; High-dimensional optimization; Expensive optimization; Cooperative approach (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10898-023-01316-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jglopt:v:88:y:2024:i:2:d:10.1007_s10898-023-01316-6

Ordering information: This journal article can be ordered from
http://www.springer. ... search/journal/10898

DOI: 10.1007/s10898-023-01316-6

Access Statistics for this article

Journal of Global Optimization is currently edited by Sergiy Butenko

More articles in Journal of Global Optimization from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().