Declarative modelling for Bayesian inference by shallow embedding

Nilsson, Henrik; Nielsen, Thomas A.

Abstract

A common problem across science and engineering is that aspects of models have to be estimated from observed data. An instance of this familiar to control engineers is system identification. Bayesian inference is a principled way to estimate parameters: exploiting Bayes~ theorem, an equational probabilistic model is “inverted”, yielding a probability distribution for the unknown parameters given the observations. This paper presents Ebba, a declarative language for proba- bilistic modelling where models can be used both “forwards” for probabilistic computation and “backwards” for parameter estimation. The novel aspect of Ebba is its implementation: a shallow, arrows-based, embedding. This provides a clear semantical account and ensures that only models that support estimation can be expressed. As arrow-like notions have proved useful in modelling dynamical systems, this might also suggest an approach to an integrated language for modelling dynamical systems and parameter estimation.

Citation

Nilsson, H., & Nielsen, T. A. (2014). Declarative modelling for Bayesian inference by shallow embedding.

• Conference Name: 6th International Workshop on Equation-Based Object-Oriented Modeling Languages and Tools (EOOLT 2014)
• Acceptance Date: Jul 14, 2014
• Publication Date: Oct 10, 2014
• Deposit Date: Apr 19, 2016
• Publicly Available Date: Apr 19, 2016
• Peer Reviewed: Peer Reviewed
• Keywords: Bayesian inference, modelling, shallow embedding, arrows
• Public URL: https://nottingham-repository.worktribe.com/output/738418
• Publisher URL: http://dl.acm.org/citation.cfm?doid=2666202.2666208