model routing
3 statements across 3 episodes · 2 bullish · 1 bearish · 3 people on the record · first statement Sep 20, 2024 by Sander Schulhoff · across every show →
Everything said about model routing, oldest first
Sep 20, 2024 negative
Schulhoff: Researchers should pay for top models instead of engineering routing
“For the most part, designing these systems where you're kind of routing to different levels of intelligence is a really time-consuming and difficult task, and, like, it's probably worth it to just use the smart model
And pay for it at this point if you're look…”
Jan 17, 2025 bullish
Swyx: Anthropic and OpenAI will launch automated API model routing
“And so I pick and OpenAI have both keys that model routing on APIs already. And so I think they'll launch them, especially at some point where you can sort of prioritize the three tradeoffs that are in model routing, cost, speed, intelligence.”
Apr 23, 2025 positive
Prompt routing scales better than model routing as base models improve
“For us, we've actually like figured that the like unit, the like The return on it was not actually that beneficial. What makes sense for us instead is, you know, like we use base models for like the final, like response. What makes sense, what makes more sense…”