Typical set + AEP (Shannon-McMillan)

Layer 0 — Mathematicsin the information-theory subtree

Asymptotic-equipartition-property: for iid sequence x^n, P(x^n) approx 2^(-nH(X)) for typical x^n; foundation of source-coding + cryptography.

Related concepts

Explore Typical set + AEP (Shannon-McMillan) on the interactive knowledge graph →