Theory Building
topic on 1 show · 3 statements across 1 episodes
3 statements about Theory Building, every show
Litt: Reinforcement learning struggles to reward intermediate mathematical theory building
“I think what is definitely true is that, like, the skill of, like, developing a theory or, like, building your understanding of some poorly understood object is, like, a fuzzier one. So it might be harder, you know I guess you can try, you can tell it, you kno…”
Litt predicts AI might autonomously build mathematical theories within six months
“My experience is that, like, if they can do it with, like, a hundred bits of hints or whatever in six months, maybe they can do it without hints.”
Litt: Frontier AI models cannot autonomously perform mathematical theory building
“So like, I've tried to get both, both Fable and ChatGPT, 5.6 Sol, I guess, to do some kind of theory building, and it's like, they're not, they definitely are not good at it autonomously, at least with, like, whatever scaffolding I've set up. But with some hin…”