Douglas: Generalist models will obsolete specialized fine-tuned models
Sholto Douglas · Weekly Recap - Elon Vs Trump, Ukraine's Drone Attack, Cluely Update & OpenAI CRO · Jun 7, 2025 · at 1:34:23
Anthropic researcher Sholto Douglas explains why he expects large unified AI models to outperform domain-specialized models.
0:00 / 0:23exact quote · 23.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I really do think that similar to how we saw with large pre-trained models before with small fine-tuned models made it like, had gains over the sort of GPT-II era, but then were obsoleted by GPT-IV being generally good at everything. I think, to be honest, you're going to see this generalization and learning across all kinds of things that means you benefit from having large single models rather than specialization or area fine-tuned models.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sholto Douglas
Douglas: Frontier Labs Avoid RL Training Directly on ARC-AGI
“And I mean, I think if you are old on Arc AGI, then it would, you'd probably get superhuman at it pretty fast. But I think we're all trying not to RL on it so that it functions as like an interesting held out.”