In mathematical statistics, the Kullback–Leibler divergence, denoted, is a type of statistical distance: a measure of how one probability distribution P is different from a second, reference probability ... Wikipedia