Gaussian processes and SVM: Mean field results and leave-one-out


In this chapter, we elaborate on the well-known relationship between Gaussian processes (GP) and Support Vector Machines (SVM). Secondly, we present approximate solutions for two computational problems arising in GP and SVM. The first one is the calculation of the posterior mean for GP classifiers using a `naive' mean field approach. The second one is a leave-one-out estimator for the generalization error of SVM based on a linear response method. Simulation results on a benchmark dataset show similar performances for the GP mean field algorithm and the SVM algorithm. The approximate leave-one-out estimator is found to be in very good agreement with the exact leave-one-out error.

Divisions: Aston University (General)
Additional Information: Massachusetts Institute of Technology Press (MIT Press) Available on Google Books
Uncontrolled Keywords: Gaussian processes,support vector machines
ISBN: 0262194481
Last Modified: 14 May 2024 07:32
Date Deposited: 05 Aug 2009 14:07
Full Text Link:
Related URLs: http://mitpress ... type=2&tid=3272 (Publisher URL)
PURE Output Type: Chapter
Published Date: 2000-10
Authors: Opper, Manfred
Winther, Ole



Version: Accepted Version

Export / Share Citation


Additional statistics for this record