Polya-gamma augmentations for factor models

Show full item record



Permalink

http://hdl.handle.net/10138/153248

Citation

Klami , A 2014 , Polya-gamma augmentations for factor models . in Proceedings of the 6th Asian Conference on Machine Learning . JMLR: Workshop and Conference Proceedings , pp. 112-128 , Asian Conference on Machine Learning , Nha Trang , Viet Nam , 26/11/2014 .

Title: Polya-gamma augmentations for factor models
Author: Klami, Arto
Contributor: University of Helsinki, Helsinki Institute for Information Technology
Date: 2014-11-26
Language: eng
Number of pages: 16
Belongs to series: Proceedings of the 6th Asian Conference on Machine Learning
Belongs to series: JMLR: Workshop and Conference Proceedings
URI: http://hdl.handle.net/10138/153248
Abstract: Bayesian inference for latent factor models, such as principal component and canonical correlation analysis, is easy for Gaussian likelihoods with conjugate priors using both Gibbs sampling and mean-field variational approximation. For other likelihood potentials one needs to either resort to more complex sampling schemes or to specifying dedicated forms for variational lower bounds. Recently, however, it was shown that for specific likelihoods related to the logistic function it is possible to augment the joint density with auxiliary variables following a P`olya-Gamma distribution, leading to closed-form updates for binary and over-dispersed count models. In this paper we describe how Gibbs sampling and mean-field variational approximation for various latent factor models can be implemented for these cases, presenting easy-to-implement and efficient inference schemas.
Subject: 113 Computer and information sciences
Rights:


Files in this item

Total number of downloads: Loading...

Files Size Format View
acml14.pdf 266.9Kb PDF View/Open

This item appears in the following Collection(s)

Show full item record