Non-Causal Control For Wave Energy Conversion Based on the Double Deep Q Network

Wang, Hanzhen; Wijaya, Vincentius Versandy; Zhang, Yao; Zeng, Tianyi; Dong, Xin

Abstract

To harness maximal wave energy, control and optimization for wave energy converters(WECs) have been investigated for decades. It has been long recognized that WEC control is essentially a non-causal control problem, in which future wave determines current control decisions. This paper introduces double deep Q network into the foundation of the non-causal time variant PD control system, enabling real-time parameter adjustments for dynamic control responses. Additionally, this paper delves into a comparative assessment of the influence of different prediction horizons on the efficiency of energy harvesting. The primary objective of this study is to elevate the control performance of wave energy converters, facil-itating more efficient capture and conversion of wave energy into usable electrical power. The integration of deep reinforcement learning empowers researchers to adapt swiftly to fluctuating waves and ocean conditions, fine-tuning control parameters to enhance overall system efficiency and stability. Taking the point absorber as an example, the effectiveness of the proposed method has been verified. This method can be straightforwardly applied to other types of WEC, such as Dielectric Elastomer Generators and Dielectric Fluid Generators.

Citation

Wang, H., Wijaya, V. V., Zhang, Y., Zeng, T., & Dong, X. (2024, April). Non-Causal Control For Wave Energy Conversion Based on the Double Deep Q Network. Presented at CONTROL 2024: 14th United Kingdom Automatic Control Council (UKACC) International Conference on Control, Winchester, UK

• Presentation Conference Type: Edited Proceedings
• Conference Name: CONTROL 2024: 14th United Kingdom Automatic Control Council (UKACC) International Conference on Control
• Start Date: Apr 10, 2024
• End Date: Apr 12, 2024
• Acceptance Date: Mar 15, 2024
• Online Publication Date: May 22, 2024
• Publication Date: Apr 10, 2024
• Deposit Date: Jul 4, 2024
• Publicly Available Date: Aug 15, 2024
• Peer Reviewed: Peer Reviewed
• Series ISSN: 2766-6522
• Book Title: 2024 UKACC 14th International Conference on Control (CONTROL)
• ISBN: 979-8-3503-7427-8
• DOI: https://doi.org/10.1109/CONTROL60310.2024.10532100
• Public URL: https://nottingham-repository.worktribe.com/output/35713114
• Publisher URL: https://ieeexplore.ieee.org/document/10532100