EDWARD GILLMAN EDWARD.GILLMAN@NOTTINGHAM.AC.UK
Research Fellow
Combining Reinforcement Learning and Tensor Networks, with an Application to Dynamical Large Deviations
Gillman, Edward; Rose, Dominic C; Garrahan, Juan P
Authors
Dominic C Rose
JUAN GARRAHAN JUAN.GARRAHAN@NOTTINGHAM.AC.UK
Professor of Physics
Abstract
We present a framework to integrate tensor network (TN) methods with reinforcement learning (RL) for solving dynamical optimisation tasks. We consider the RL actor-critic method, a model-free approach for solving RL problems, and introduce TNs as the approximators for its policy and value functions. Our "actor-critic with tensor networks" (ACTeN) method is especially well suited to problems with large and factorisable state and action spaces. As an illustration of the applicability of ACTeN we solve the exponentially hard task of sampling rare trajectories in two paradigmatic stochastic models, the East model of glasses and the asymmetric simple exclusion process (ASEP), the latter being particularly challenging to other methods due to the absence of detailed balance. With substantial potential for further integration with the vast array of existing RL methods, the approach introduced here is promising both for applications in physics and to multi-agent RL problems more generally.
Citation
Gillman, E., Rose, D. C., & Garrahan, J. P. (in press). Combining Reinforcement Learning and Tensor Networks, with an Application to Dynamical Large Deviations. Physical Review Letters,
Journal Article Type | Article |
---|---|
Acceptance Date | Apr 4, 2024 |
Deposit Date | Apr 5, 2024 |
Publicly Available Date | Apr 5, 2024 |
Journal | Physical Review Letters |
Print ISSN | 0031-9007 |
Electronic ISSN | 1079-7114 |
Publisher | American Physical Society |
Peer Reviewed | Peer Reviewed |
Public URL | https://nottingham-repository.worktribe.com/output/33293313 |
Files
Main (1)
(965 Kb)
PDF
You might also like
Quantum and Classical Temporal Correlations in (1+1)D Quantum Cellular Automata
(2021)
Journal Article
Numerical simulation of quantum nonequilibrium phase transitions without finite-size effects
(2021)
Journal Article
Downloadable Citations
About Repository@Nottingham
Administrator e-mail: digital-library-support@nottingham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search