A post on information theory — entropy, KL divergence, and why these ideas show up everywhere in machine learning. Written for the Gradient blog.

Read the full post →