Metaheuristics and machine learning: an approach with reinforcement learning assisting neural architecture search

Sandra Mara Scós Venske (), Carolina Paula Almeida () and Myriam Regattieri Delgado ()
Additional contact information
Sandra Mara Scós Venske: UTFPR
Carolina Paula Almeida: UNICENTRO
Myriam Regattieri Delgado: UTFPR

Journal of Heuristics, 2024, vol. 30, issue 3, No 4, 199-224

Abstract: Abstract Methaheuristics (MHs) are techniques widely used for solving complex optimization problems. In recent years, the interest in combining MH and machine learning (ML) has grown. This integration can occur mainly in two ways: ML-in-MH and MH-in-ML. In the present work, we combine the techniques in both ways—ML-in-MH-in-ML, providing an approach in which ML is considered to improve the performance of an evolutionary algorithm (EA), whose solutions encode parameters of an ML model—artificial neural network (ANN). Our approach called TS $$_{in}$$ in EA $$_{in}$$ in ANN employs a reinforcement learning neighborhood (RLN) mutation based on Thompson sampling (TS). TS is a parameterless reinforcement learning method, used here to boost the EA performance. In the experiments, every candidate ANN solves a regression problem known as protein structure prediction deviation. We consider two protein datasets, one with 16,382 and the other with 45,730 samples. The results show that TS $$_{in}$$ in EA $$_{in}$$ in ANN performs significantly better than a canonical genetic algorithm (GA $$_{in}$$ in ANN) and the evolutionary algorithm without reinforcement learning (EA $$_{in}$$ in ANN). Analyses of the parameter’s frequency are also performed comparing the approaches. Finally, comparisons with the literature show that except for one particular case in the largest dataset, TS $$_{in}$$ in EA $$_{in}$$ in ANN outperforms other approaches considered the state of the art for the addressed datasets.

Keywords: Optimization; Protein structure prediction; Multilayer perceptron; Thompson sampling (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10732-024-09526-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joheur:v:30:y:2024:i:3:d:10.1007_s10732-024-09526-1

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10732

DOI: 10.1007/s10732-024-09526-1

Access Statistics for this article

Journal of Heuristics is currently edited by Manuel Laguna

More articles in Journal of Heuristics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().