Cognitive Core

topic on 2 shows · 2 statements across 2 episodes

Latent Space No Priors

2 statements about Cognitive Core, every show

Morris: No Evidence We Can Build Pure Reasoning Models Without World Knowledge
“I don't think we have a lot of evidence that we can build a system like this that like is really, really good at reasoning, but really dumb about the world. Like, I don't know if we have the tools.”
Jack Morris Jul 2, 2025 ▶ 41:31 Information Theory for Language Models: Jack Morris
NO PRIORS Prediction Not checkable as stated
Karpathy: A 1-billion parameter model will suffice as a cognitive core
“I think even a 1,000,000,001, billion suffices. We'll probably get to that point, and the models can be very, very small. And I think the reason they can be very small is fundamentally, I think, just, like, distillation works.”
Andrej Karpathy Sep 5, 2024 ▶ 27:46 No Priors Ep. 80 | With Andrej Karpathy from OpenAI and Tesla

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.