Shannon entropy (information theory) — The Probability Path
Node
Shannon entropy (information theory) (Theorem) in The Probability Path. Era: 1948. Formula: H(X) = -Σ p(x) log p(x). Origin axiom of path: Kolmogorov's axioms of probability. Modern reach: Kolmogorov complexity · Algorithmic information theory.