Surprise

Entropy

Formal Definition

Cross Entropy

Kullback-Leibler Divergence