Kullback-Leibler 1951: D_KL(P||Q) = sum p log(p/q); non-negative, asymmetric, zero iff P=Q; foundation of variational inference + Bayesian model selection.
Kullback-Leibler 1951: D_KL(P||Q) = sum p log(p/q); non-negative, asymmetric, zero iff P=Q; foundation of variational inference + Bayesian model selection.