Shannon entropy explains why clickbait works — SkimNews

Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- Clickbait headlines deliberately withhold information to maximize clicks, functioning as a 'coin mid-toss' that only resolves when the reader clicks through.
- Claude Shannon's 1948 paper A Mathematical Theory of Communication defined information as surprise (probability of a message) rather than meaning, coining the 'bit' after colleague John Tukey.
- Shannon entropy is calculated as H = -∑p(x)log(p(x)); a fair coin flip yields 1 bit, while a rigged coin yielding only heads transmits 0 bits.
- The infamous 1948 Chicago Daily Tribune headline 'Dewey Defeats Truman' perfectly demonstrated Shannon's 1-bit formula — two candidates, roughly equal odds — but was factually wrong, exposing the theory's blind spot for semantic accuracy.
- Ad-funded online publishers 'hacked' Shannon's framework by exploiting attention economics, the article argues, turning the gap between probabilistic information and meaningful content into a revenue model.
- Shannon's underlying goal — reliable communication over noisy channels — gave rise to streaming video, space communications, and digital infrastructure, even as his theory cannot address today's information overload.
- The piece contrasts traditional print headlines like 'Trump wins election' (~1 bit in three words) with clickbait like 'You'll never believe who just won the election,' which carries far more words but far less actual information.
Why it matters: The article reframes a ubiquitous annoyance — clickbait — as a predictable consequence of monetizing attention in an ad-funded web, grounded in a 1948 formula. For publishers and platforms, the diagnosis is unflattering: every uninformative headline is a deliberate trade of meaning for a click, and Shannon entropy quantifies exactly how much informational content is being withheld.
Ask SkimNews


