Beta 1

Title Variational Bayes Latent Variable Models And Mixture Extensions
Author Bazaou, Slimane
Supervisor Hansen, Lars Kai (Department of Informatics and Mathematical Modeling, Technical University of Denmark, DTU, DK-2800 Kgs. Lyngby, Denmark)
Institution Technical University of Denmark, DTU, DK-2800 Kgs. Lyngby, Denmark
Thesis level Master's thesis
Year 2004
Abstract This thesis is concerned with the problem of applying an approximate Bayesian learning technique referred to as variational Bayes to different Gaussian latent variable models and their mixture extensions. I will try to give a smooth transition between the different models used in this thesis, starting from the single (multivariate) Gaussian model to the more complex Linear Factor and its mixture extension Mixture of Factor Analyzers model, where either/both the hidden dimensionality and the hidden number of components (in the case of mixtures) are unknown. One of the aims of this thesis is to investigate how the Bayesian framework infers the wanted parameters, e.g. number of components in a mixture model, given a model, and how it succeeds in solving the di erent problems related to overfitting. I also investigate which one of these models that perform best for a range of tasks. Throughout the report I will try to discuss the performance of the Bayesian techniques, mainly by comparing it to the standard Maximum Likelihood approach. Each of the models discussed in the thesis are applied to one or more of the following problems: Density estimation, Classification, Signal separation and Image compression. Both synthetic and real data are tested.
Imprint Department of Informatics and Mathematical Modeling, Technical University of Denmark, DTU : DK-2800 Kgs. Lyngby, Denmark
Keywords Graphical Models; Linear latent variable models; Mixture Models; Maximum Likelihood; Bayesian Inference; Variational Bayes
Original Postscript (8.15 MB)
Derived PDF imm3255.pdf (4.22 MB)
Admin Creation date: 2006-06-22    Update date: 2012-12-21    Source: dtu    ID: 154734    Original MXD