Rajpal: Anthropic Claude models had regressions from serving architecture changes
Shreya Rajpal · ⚡️Snowglobe: Simulations for your AI · Sep 25, 2025 · at 23:21
Shreya Rajpal discusses why AI simulation is needed in production to catch unexpected model regressions.
0:00 / 0:04exact quote · 4.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Anthropix kind of cloud models kind of had a regression, right? Because they changed to a new serving architecture.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Shreya Rajpal
Rajpal: Foundation models rarely generate toxic outputs without explicit jailbreaks
“Most of the stuff that the frameworks will recommend is actually stuff that the model providers are already working on. So toxicity, unless you're doing, unless somebody is very explicitly trying to jailbreak what you've built, you know, you won't run into the…”
Rajpal: AI simulations should prioritize product KPIs over generic safety metrics
“So I would actually say that like a lot of the things to simulate are more aligned with like product KPIs or product metrics that actually make Whatever AI system you're building very sticky, rather than, you know, focusing more on, like, traditional safety se…”
Rajpal: Fine-tuning open-source models on synthetic data closes proprietary capability gaps
“Not out of the box, but with a lot of that fine tuning and that the training, et cetera, you are able to kind of close the gap and even have better performance on metrics.”
Rajpal: AI agents resemble autonomous vehicle architectures with cascading ML units
“What patterns really worked well in self-driving cars, which is weirdly a very similar system to, you know, agents of today where you have like these cascading kind of like units that are all machine learning based and, you know, they all kind of like feed int…”
Rajpal: Simulations reveal which failure modes actually require runtime guardrails
“And then, you know, in simulation, figure out, you know, what is actually robust, what isn't, and then the stuff that isn't robust is the stuff that you need guardrails for.”
Rajpal: Product managers already act as AI persona engineers
“Interestingly, there are already persona engineers, and we call them like product managers, basically, you know. So your product managers are already thinking about, okay, I've built this, you know, model or this chatbot or this agent. Who are the personas? Wh…”