An initialization approach for metaheuristic algorithms by using Gibbs sampling

Erik Cuevas, Oscar Barba-Toscano, Héctor Escobar, Daniel Zaldívar and Alma Rodríguez-Vázquez

Mathematics and Computers in Simulation (MATCOM), 2024, vol. 225, issue C, 586-606

Abstract: Recently, several new initialization techniques have been proposed. Despite their good results in very low dimensions, their performance deteriorated significantly with an increase in the number of dimensions. This paper introduces a new method for initializing metaheuristic algorithms, based on the Gibbs sampling approach. The proposed method samples according to the Gibbs method, a multidimensional Gaussian that completely covers the search space defined by the objective function. In this process, each decision variable is sequentially sampled to ensure that the value of each is dependent only on the value of the variable sampled before it. This process leads to the generation of initial positions with significantly low mutual correlation, which is an advantageous feature that prevents the aggregation of initial solutions in specific areas of the search space. This issue is particularly prevalent in optimization problems with a greater number of dimensions. To test the effectiveness of this method, it was applied in conjunction with a Differential Evolution algorithm. The complete approach has been evaluated using a selection of pertinent and challenging functions in the field. The outcome of these experiments showed that the algorithm can establish a superior set of initial solutions, which allows consistent determination of the global solution, even as the complexity of the problem increases with more dimensions.

Keywords: Gibbs Sampling; Metaheuristic Algorithms; High-Dimensional Optimization; Differential Evolution and Global Solution Search (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378475424001824
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:matcom:v:225:y:2024:i:c:p:586-606

DOI: 10.1016/j.matcom.2024.05.010

Access Statistics for this article

Mathematics and Computers in Simulation (MATCOM) is currently edited by Robert Beauwens

More articles in Mathematics and Computers in Simulation (MATCOM) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().