Asymptotic Equipartition Property: -1/n log p(X^n) → H(X) a.s. for ergodic stationary source. Typical set has ~2^{nH} sequences ≈ probability 1. Foundation of source-coding theorems.
Asymptotic Equipartition Property: -1/n log p(X^n) → H(X) a.s. for ergodic stationary source. Typical set has ~2^{nH} sequences ≈ probability 1. Foundation of source-coding theorems.