Probabilistic principal component analysis

Abstract

Principal component analysis (PCA) is a ubiquitous technique for data analysis and processing, but one which is not based upon a probability model. In this paper we demonstrate how the principal axes of a set of observed data vectors may be determined through maximum-likelihood estimation of parameters in a latent variable model closely related to factor analysis. We consider the properties of the associated likelihood function, giving an EM algorithm for estimating the principal subspace iteratively, and discuss the advantages conveyed by the definition of a probability density function for PCA.

Divisions: Aston University (General)
Uncontrolled Keywords: density estimation,EM algorithm,Gaussian mixtures,maximum likelihood,principal component analysis,probability model
ISBN: NCRG/97/010
PURE Output Type: Technical report
Published Date: 1997-09-04
Authors: Tipping, Michael E.
Bishop, Christopher M.

Export / Share Citation


Statistics

Additional statistics for this record