In my talk I will give a (very) brief introduction into Bayesian probabilistic models. In general, we are interested in the posterior distribution over the latent variables in such a model. I will explain how we can turn this estimation problem into an optimization one and how to make use of properties of the exponential family of distributions to derive an elegant solution to it.