Deep reinforcement learning-based non-causal control for wave energy conversion

Wang, Hanzhen; Wijaya, Vincentius; Zeng, Tianyi; Zhang, Yao

Abstract

As one of the most promising renewable energy resources, ocean wave energy has not been widely commercialized compared to wind energy and solar energy due to its high Levelized Cost of Electricity (LCoE). It has been long recognized that wave energy converter (WEC) control can increase the capture width ratio and enhance the robustness of the WEC against extreme sea states. However, some rigid-body WECs have high nonlinearities and soft-body WECs such as Dielectric Elastomer Generators (DEGs)/Dielectric Fluid Generators (DFGs) can barely be precisely modeled. To tackle these challenges, this paper aims to propose an optimal control scheme that has less dependence on the dynamical model by introducing deep reinforcement learning into the foundation of a non-causal optimal control strategy. The gain parameters are adjusted adaptively in real time to account for an increasing understanding of this scheme on the WEC behavior and the incoming wave. Furthermore, by systematically contrasting outcomes obtained with various prediction time steps, this investigation aims to pinpoint the most effective prediction strategy for optimizing energy capture efficiency. The robustness of the proposed control against prediction errors and model uncertainties has been verified by using the realistic wave data gathered from the coast of Cornwall, UK.

Citation

Wang, H., Wijaya, V., Zeng, T., & Zhang, Y. (2024). Deep reinforcement learning-based non-causal control for wave energy conversion. Ocean Engineering, 311(Part 1), Article 118860. https://doi.org/10.1016/j.oceaneng.2024.118860

• Journal Article Type: Article
• Acceptance Date: Jul 28, 2024
• Online Publication Date: Aug 6, 2024
• Publication Date: Nov 1, 2024
• Deposit Date: Oct 10, 2024
• Publicly Available Date: Oct 10, 2024
• Journal: Ocean Engineering
• Print ISSN: 0029-8018
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 311
• Issue: Part 1
• Article Number: 118860
• DOI: https://doi.org/10.1016/j.oceaneng.2024.118860
• Keywords: Wave energy converters, Learning-based control, Wave predictions, Double deep Q network
• Public URL: https://nottingham-repository.worktribe.com/output/38365516
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S002980182402198X?via%3Dihub
• Additional Information: This article is maintained by: Elsevier; Article Title: Deep reinforcement learning-based non-causal control for wave energy conversion; Journal Title: Ocean Engineering; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.oceaneng.2024.118860; Content Type: article; Copyright: © 2024 The Authors. Published by Elsevier Ltd.