Shannon entropy (1948)

Layer 0 — Mathematicsin the information-theory subtree

C Shannon 1948 H = -Σ p log p; modern modern foundational text + Kolmogorov-complexity + 2024 ML-information-bottleneck Tishby.

Related concepts