Anthropic's Claude has better post-training and persona than rival models
Dwarkesh Patel · AI Scaling, Alignment, and the Path to Superintelligence — With Dwarkesh Patel · May 15, 2024 · at 10:40
Dwarkesh Patel compares the technical differentiators between Anthropic's Claude and competing LLMs on the Big Technology Podcast.
0:00 / 0:22exact quote · 23.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Claude seems to have better post training, which is to say, which is the jargon for basically saying like, What kind of personality does it have and how does it break down your question and how does it act? How does it act as a persona of a chat bot? And so all this RLHM stuff you hear as part of the post training and Claude has a more automated way of doing that or anthropic, which controls Claude does.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dwarkesh Patel
Patel: Individuals will eventually train superintelligences in basements
“The cost of training, the systems is declining so fast that Literally you will be able to train a super intelligence in a basement at some point in the future.”
Dwarkesh: AGI requires further algorithmic progress, not just current model scaling
“I don't think we're just right around our corner from AGI and it's just a little additional dash of something. That's all it's going to take. I think, you know, people often ask if all AI progress stopped right now and all you could do is collect more data or …”
Dwarkesh: Lack of continual learning prevents LLMs from replacing human labor
“I think a big bottleneck these models have is their inability to learn on the job, to have continual learning. Their entire memory is extinguished at the end of a session. There's a bunch of reasons why I think this actually makes it really hard to get human-l…”
Patel: Reinforcement learning may not generalize beyond verifiable domains
“I still think I I'm like, I'm not confident that this will generalize to domains that are not so verifiable or text-based.”