“David Deutsch demands that explanations be universal, resting on laws no parochial circumstance can overturn. He would ask whether our account of information leans on fallible human agreements or on bedrock physics, whether we are mistaking symbols for substance, smuggling trust in through the back door. His questions will serve as our quality control.”
The Shannon trap
“This is where Claude Shannon calling bits information meant that the field forgot that meaning had been left out of his equations on purpose. That confusion is the Shannon trap. We did a whole episode on it.”
The listening path
- 151
Chapter 2: Information, Energy, & the Physical World
Bitcoin's ledger obeys the rule that governs all knowledge. Shannon shows information costs energy to preserve, Turing shows computation must be embodied in matter, and…
- 156
Chapter 7: Learning as Compression
Bitcoin is a physically anchored compression engine that filters global economic activity into small, verifiable blocks. It learns the way any intelligent system learns,…
- 187
The Shannon Trap
In 1948 Claude Shannon built information theory by excluding meaning from the math, a move that was correct for his engineering problem and costly once the field adopted…
- 188
The Exhaust Principle
Jacob Bekenstein's 1973 result, that a black hole's entropy is proportional to its surface area, has been treated as a paradox for fifty years. A black hole has the most…
- 192
The Universe Demands Horns
Information is physical and verification is asymmetric, and those two facts force a Gabriel's horn topology on anything that wants to keep growing. Most of what the…
In the show’s words
My guess is that this might have happened with physics, computer science and philosophy, with Claude Shannon. The guy who shouts the early confident guess is Claude Shannon.
Ep 187 · 03:20
Entropy isn't disorder, entropy is the absence of constraint, and Shannon, by measuring entropy, measured the exact absence of the thing that makes information actually matter.
Ep 187 · 12:46