A Q-Learning Hyperheuristic Binarization Framework to Balance Exploration and Exploitation

Crawford, Broderick; Soto, Ricardo; Paredes, Fernando

Keywords: combinatorial optimization, metaheuristics, reinforcement learning, hyperheuristics, Binarization framework

Abstract

Many Metaheuristics solve optimization problems in the continuous domain, so it is necessary to apply binarization schemes to solve binary problems, this selection that is not trivial since it impacts the heart of the search strategy: its ability to explore. This paper proposes a Hyperheuristic Binarization Framework based on a Machine Learning technique of Reinforcement Learning to select the appropriate binarization strategy, which is applied in a Low Level Metaheuristic. The proposed implementation is composed of a High Level Metaheuristic, Ant Colony Optimization, using Q-Learning replacing the pheromone trace component. In the Low Level Metaheuristic, we use a Grey Wolf Optimizer to solve the binary problem with binarization scheme fixed by ants. This framework allowing a better balance between exploration and exploitation, and can be applied selecting others low level components.

Más información

Título según SCOPUS: A Q-Learning Hyperheuristic Binarization Framework to Balance Exploration and Exploitation
Título de la Revista: Communications in Computer and Information Science
Volumen: 1277
Editorial: Springer Science and Business Media Deutschland GmbH
Fecha de publicación: 2020
Página de inicio: 14
Página final: 28
Idioma: English
URL: https://link.springer.com/chapter/10.1007/978-3-030-61702-8_2
DOI:

10.1007/978-3-030-61702-8_2

Notas: SCOPUS