Emergent Capabilities
topic on 3 shows · 3 statements across 3 episodes
Acquired 
the MAD Podcast 
How I Built This
3 statements about Emergent Capabilities, every show
Scaling Neural Networks Produces Emergent Capabilities Unanticipated by Creators
“And the thing about it is that as you scale these digital brains, they end up with more emergent capabilities that no one who built them anticipated.”
Huang: LLM reasoning and emergent capabilities stem naturally from reading text
“Within the world's languages and text, there's a fair amount of reasoning that's encoded in it, and we describe a lot of reasoning things, and so if you were To say that a few step reasoning is somehow learnable from just reading things. I wouldn't be surprise…”
Kanjun Qiu: AI emergent capabilities are artifacts of evaluation metric design
“If your metric is smooth you actually see slow performance improvement over time, and if your metric is relatively discrete or not smooth, that's where you see the emergence, and it's actually more about the evaluation metric Than about the emergence of the ca…”