Information bottleneck (Tishby)

Layer 0 — Mathematicsin the information-theory subtree

Tishby-Pereira-Bialek 1999 / Tishby 2017: minimal-sufficient-statistics via min I(X;Z) - β I(Z;Y). Lossy compression preserving relevant info. Bridges info-theory + ML + L4 efficient-coding.

Related concepts

Explore Information bottleneck (Tishby) on the interactive knowledge graph →