Evaluation of variational and Markov Chain Monte Carlo methods for inference in partially observed stochastic dynamic systems

Abstract

In recent work we have developed a novel variational inference method for partially observed systems governed by stochastic differential equations. In this paper we provide a comparison of the Variational Gaussian Process Smoother with an exact solution computed using a hybrid Monte Carlo approach to path sampling, applied to a stochastic double well potential model. It is demonstrated that the variational smoother provides us a very accurate estimate of mean path while marginal variance is slightly underestimated. We conclude with some remarks as to the advantages and disadvantages of the variational smoother.