Assessment of Deep Reinforcement Learning Algorithms for Three-Phase Inverter Control

Menéndez, Oswaldo; López-Caiza, Diana; Tarisciotti, Luca; Ruiz Allende, Felipe; Auat-Cheein, Fernando; Rodriguez, Jose

Abstract

Deep reinforcement learning (DRL) offers outstanding algorithms to develop optimal controllers for power converters with uncertainties and non-linear dynamics. This work comprehensively analyses a model-free control algorithm for three-phase inverters using DRL agents. To this end, different deep deterministic policy gradient (DDPG) agents with variable hyperparameters were conceptualized, designed, and tested. On average, DDPG agents were shown to have excellent performance in the control of power inverters. Indeed, DDPG agents reduce the impact of model uncertainties and non-linear dynamics. To validate the proposed control policy, the two-level voltage source power inverter is simulated. Also, the main features of the control strategy are analyzed in terms of computational cost, root medium square error (RMSE), and total harmonic distortion (THD). Simulated results reveal that the proposed control strategy exhibits strong performance in the current control task, achieving a maximum RMSE of 0.78 A and a THD of 3.17% for a 6 kHz sampling frequency.

Más información

Título según SCOPUS: ID SCOPUS_ID:85185803100 Not found in local SCOPUS DB
Fecha de publicación: 2023
DOI:

10.1109/SPEC56436.2023.10407331

Notas: SCOPUS