Archive for September, 2010

EM vs. mean-field variational approximation

September 10, 2010 Leave a comment

When I derive mean-field (MF) approximation inference for many problems, I observed that MF gives very similar update equations to that of EM. The similarities not only appear on the results, but on the derivation process as well. This afternoon my adviser was out of the office ^_^, so I have some free time to figure out what’s going on between EM and MF. I decided to use a simple problem like Gaussian Mixture Model (GMM) as a model for explanation. Here is the writeup [link]

Deep Belief Networks

September 2, 2010 Leave a comment