Shannon makes this claim in his 1948 paper and lists this property as one of his justifications for the definition of entropy. We give a short proof of his claim.

Skip to content
# Shannon: averaging operations can only increase the entropy

Notes on Machine Learning & Mathematics

Shannon makes this claim in his 1948 paper and lists this property as one of his justifications for the definition of entropy. We give a short proof of his claim.