Neural Control of Discrete Weak Formulations: Galerkin, Least Squares & Minimal-Residual Methods with Quasi-Optimal Weights

Brevis, Ignacio; Muga, Ignacio; van der Zee, Kristoffer G.

Abstract

There is tremendous potential in using neural networks to optimize numerical methods. In this paper, we introduce and analyse a framework for the neural optimization of discrete weak formulations, suitable for finite element methods. The main idea of the framework is to include a neural-network function acting as a control variable in the weak form. Finding the neural control that (quasi-) minimizes a suitable cost (or loss) functional, then yields a numerical approximation with desirable attributes. In particular, the framework allows in a natural way the incorporation of known data of the exact solution, or the incorporation of stabilization mechanisms (e.g., to remove spurious oscillations).

The main result of our analysis pertains to the well-posedness and convergence of the associated constrained-optimization problem. In particular, we prove under certain conditions, that the discrete weak forms are stable, and that quasi-minimizing neural controls exist, which converge quasi-optimally. We specialize the analysis results to Galerkin, least squares and minimal-residual formulations, where the neural-network dependence appears in the form of suitable weights. Elementary numerical experiments support our findings and demonstrate the potential of the framework.

Citation

Brevis, I., Muga, I., & van der Zee, K. G. (2022). Neural Control of Discrete Weak Formulations: Galerkin, Least Squares & Minimal-Residual Methods with Quasi-Optimal Weights. Computer Methods in Applied Mechanics and Engineering, 402, Article 115716. https://doi.org/10.1016/j.cma.2022.115716

• Journal Article Type: Article
• Acceptance Date: Oct 14, 2022
• Online Publication Date: Nov 25, 2022
• Publication Date: Dec 1, 2022
• Deposit Date: Oct 17, 2022
• Publicly Available Date: Nov 26, 2023
• Journal: Computer Methods in Applied Mechanics and Engineering
• Print ISSN: 0045-7825
• Electronic ISSN: 1879-2138
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 402
• Article Number: 115716
• DOI: https://doi.org/10.1016/j.cma.2022.115716
• Public URL: https://nottingham-repository.worktribe.com/output/12599594
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S0045782522006715?via%3Dihub