Information Theory
topic on 3 shows · 3 statements across 3 episodes
the Knowledge Project 
No Priors 
Big Technology
3 statements about Information Theory, every show
Hassabis: Underlying Physics Is Information Theory in a Computational Universe
“I do think that ultimately underlying physics is information theory. So I do think we're in a computational universe, but it's not just a straightforward simulation.”
Uszkoreit: Training on synthetic data works by amortizing generation compute
“And ironically, and this comes back to a question that many people ask, I think around, does it make any sense to train on generated data? Because information theory, family information theory, very clearly says, nope, you're not going to get more information …”