Variational Bayesian approach to canonical correlation analysis

IEEE Trans Neural Netw. 2007 May;18(3):905-10. doi: 10.1109/TNN.2007.891186.

Abstract

As a dimension reduction algorithm, canonical correlation analysis (CCA) encounters the issue of selecting the number of canonical correlations. In this letter, we present a Bayesian model selection algorithm for CCA based on a probabilistic interpretation. A hierarchical Bayesian model is applied to probabilistic CCA and learned by variational approximation. This method not only estimates the model parameters, but also automatically determines the number of canonical correlations and avoids overfitting. Experiments show that it performs better compared with maximum likelihood and some other model selection methods.

Publication types

  • Letter

MeSH terms

  • Algorithms*
  • Artificial Intelligence*
  • Bayes Theorem*
  • Computer Simulation
  • Decision Support Techniques*
  • Information Storage and Retrieval / methods*
  • Models, Statistical*
  • Neural Networks, Computer
  • Pattern Recognition, Automated / methods*
  • Statistics as Topic