A Learning-Based Particle Swarm Optimizer for Solving Mathematical Combinatorial Problems

Olivares R.; Soto R.; Crawford B.; Ríos, V; Olivares P.; Ravelo, C; Medina S.; Nauduan, D

Keywords: particle swarm optimization, reinforcement learning, learning-based hybridizations, mathematical combinatorial problem

Abstract

This paper presents a set of adaptive parameter control methods through reinforcement learning for the particle swarm algorithm. The aim is to adjust the algorithm’s parameters during the run, to provide the metaheuristics with the ability to learn and adapt dynamically to the problem and its context. The proposal integrates Q–Learning into the optimization algorithm for parameter control. The applied strategies include a shared Q–table, separate tables per parameter, and flexible state representation. The study was evaluated through various instances of the multidimensional knapsack problem belonging to the (Formula presented.) -hard class. It can be formulated as a mathematical combinatorial problem involving a set of items with multiple attributes or dimensions, aiming to maximize the total value or utility while respecting constraints on the total capacity or available resources. Experimental and statistical tests were carried out to compare the results obtained by each of these hybridizations, concluding that they can significantly improve the quality of the solutions found compared to the native version of the algorithm.

Más información

Título según WOS: A Learning-Based Particle Swarm Optimizer for Solving Mathematical Combinatorial Problems
Título según SCOPUS: A Learning—Based Particle Swarm Optimizer for Solving Mathematical Combinatorial Problems
Título de la Revista: Axioms
Volumen: 12
Número: 7
Editorial: Multidisciplinary Digital Publishing Institute (MDPI)
Fecha de publicación: 2023
Idioma: English
DOI:

10.3390/axioms12070643

Notas: ISI, SCOPUS