Bayesian regression filter and the issue of priors

Abstract

We propose a Bayesian framework for regression problems, which covers areas which are usually dealt with by function approximation. An online learning algorithm is derived which solves regression problems with a Kalman filter. Its solution always improves with increasing model complexity, without the risk of over-fitting. In the infinite dimension limit it approaches the true Bayesian posterior. The issues of prior selection and over-fitting are also discussed, showing that some of the commonly held beliefs are misleading. The practical implementation is summarised. Simulations using 13 popular publicly available data sets are used to demonstrate the method and highlight important issues concerning the choice of priors.

Publication DOI: https://doi.org/10.1007/BF01414873
Divisions: Aston University (General)
Additional Information: The original publication is available at www.springerlink.com
Uncontrolled Keywords: Bayesian framework,regression problems,Kalman filter,Simulations
Publication ISSN: 1433-3058
Last Modified: 11 Mar 2024 08:09
Date Deposited: 22 Sep 2009 15:17
Full Text Link:
Related URLs: http://www.spri ... 1hr600k7023276/ (Publisher URL)
PURE Output Type: Article
Published Date: 1996-09
Authors: Zhu, Huaiyu
Rohwer, Richard

Download

[img]

Version: Accepted Version


Export / Share Citation


Statistics

Additional statistics for this record