# Are there good resources explaining mean field approximation?

I am a computer science master student. In a statistical learning theory course I am taking, mean field approximation was introduced to approximately solve non-factorizable Gibbs distributions that were derived using maximum entropy inference. Our professor has a strong background in physics and often uses terms from statistical physics. Unfortunately, I lack that background. So,

1. Are there any resources explaining mean field approximations from a non-physical/computer science perspective? I couldn't find any.

2. Or alternatively, are there "crash course"-like resources that would allow me to understand one of the more physically motivated explanations without looking up tons of terms?

EDIT: Here are some details that hopefully help to narrow it down: In this course, we are trying to sample from intractable, non-factorizable Gibbs-distributions (mainly in the context of clustering). Apparently, this cannot be done (efficiently), therefore we retreat to a mean-field approximation.

-

## migrated from stats.stackexchange.comMay 22 '12 at 13:24

This question came from our site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.

There is a better site for that. –  mbq May 22 '12 at 13:24
Your best bet is to ask your professor for more details, but actually aside from its historical development within physics, mean-field approximations basically are defined by replacing non-factorizable probability distributions with factorizable ones that have some correlations put in by hand (the "mean fields" or "Weiss fields" of stat.phys.) The extra correlations should be predicted by the distribution, though, so they are calculated self-consistently in the factorizable one. –  wsc May 22 '12 at 13:51
Try > W. D. McComb, Renormalization Methods: a guide for beginners, 2004. The first three chapters give you what you want. –  user9365 May 22 '12 at 20:45
@Mbq: Given that the OP wants a "non-physical" description this might have been better moved to Computation Science, but that's a beta site. –  dmckee May 22 '12 at 21:03
@dmckee You're right, I've... missed. –  mbq May 22 '12 at 22:14

In your case, the algebra is commutative, so you don't need to understand all the fine points related to noncommutative observables in the quantum case, and the mean field will simply be a high-dimensional Gaussian, where the cumulant generating function $W(f)$ is just the exponential of a quadratic form.