LF-PPL: A Low-Level First Order Probabilistic Programming Language for
Non-Differentiable Models
Y. Zhou, B. Gram-Hansen, T. Kohn, T. Rainforth, H. Yang, and F. Wood. (2019)cite arxiv:1903.02482Comment: Published in the proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS).
Abstract
We develop a new Low-level, First-order Probabilistic Programming Language
(LF-PPL) suited for models containing a mix of continuous, discrete, and/or
piecewise-continuous variables. The key success of this language and its
compilation scheme is in its ability to automatically distinguish parameters
the density function is discontinuous with respect to, while further providing
runtime checks for boundary crossings. This enables the introduction of new
inference engines that are able to exploit gradient information, while
remaining efficient for models which are not everywhere differentiable. We
demonstrate this ability by incorporating a discontinuous Hamiltonian Monte
Carlo (DHMC) inference engine that is able to deliver automated and efficient
inference for non-differentiable models. Our system is backed up by a
mathematical formalism that ensures that any model expressed in this language
has a density with measure zero discontinuities to maintain the validity of the
inference engine.
Description
[1903.02482] LF-PPL: A Low-Level First Order Probabilistic Programming Language for Non-Differentiable Models
%0 Generic
%1 zhou2019lfppl
%A Zhou, Yuan
%A Gram-Hansen, Bradley J.
%A Kohn, Tobias
%A Rainforth, Tom
%A Yang, Hongseok
%A Wood, Frank
%D 2019
%K non-differentiable probability programming
%T LF-PPL: A Low-Level First Order Probabilistic Programming Language for
Non-Differentiable Models
%U http://arxiv.org/abs/1903.02482
%X We develop a new Low-level, First-order Probabilistic Programming Language
(LF-PPL) suited for models containing a mix of continuous, discrete, and/or
piecewise-continuous variables. The key success of this language and its
compilation scheme is in its ability to automatically distinguish parameters
the density function is discontinuous with respect to, while further providing
runtime checks for boundary crossings. This enables the introduction of new
inference engines that are able to exploit gradient information, while
remaining efficient for models which are not everywhere differentiable. We
demonstrate this ability by incorporating a discontinuous Hamiltonian Monte
Carlo (DHMC) inference engine that is able to deliver automated and efficient
inference for non-differentiable models. Our system is backed up by a
mathematical formalism that ensures that any model expressed in this language
has a density with measure zero discontinuities to maintain the validity of the
inference engine.
@misc{zhou2019lfppl,
abstract = {We develop a new Low-level, First-order Probabilistic Programming Language
(LF-PPL) suited for models containing a mix of continuous, discrete, and/or
piecewise-continuous variables. The key success of this language and its
compilation scheme is in its ability to automatically distinguish parameters
the density function is discontinuous with respect to, while further providing
runtime checks for boundary crossings. This enables the introduction of new
inference engines that are able to exploit gradient information, while
remaining efficient for models which are not everywhere differentiable. We
demonstrate this ability by incorporating a discontinuous Hamiltonian Monte
Carlo (DHMC) inference engine that is able to deliver automated and efficient
inference for non-differentiable models. Our system is backed up by a
mathematical formalism that ensures that any model expressed in this language
has a density with measure zero discontinuities to maintain the validity of the
inference engine.},
added-at = {2019-03-08T01:11:30.000+0100},
author = {Zhou, Yuan and Gram-Hansen, Bradley J. and Kohn, Tobias and Rainforth, Tom and Yang, Hongseok and Wood, Frank},
biburl = {https://www.bibsonomy.org/bibtex/28a628c2751983a8f5fe395b51832d477/kirk86},
description = {[1903.02482] LF-PPL: A Low-Level First Order Probabilistic Programming Language for Non-Differentiable Models},
interhash = {59bb48f0bcf89dad5f321176c1d23899},
intrahash = {8a628c2751983a8f5fe395b51832d477},
keywords = {non-differentiable probability programming},
note = {cite arxiv:1903.02482Comment: Published in the proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS)},
timestamp = {2019-03-08T01:11:30.000+0100},
title = {LF-PPL: A Low-Level First Order Probabilistic Programming Language for
Non-Differentiable Models},
url = {http://arxiv.org/abs/1903.02482},
year = 2019
}