Prompt Routing
topic on 1 show · 1 statements across 1 episodes
1 statements about Prompt Routing, every show
Prompt routing scales better than model routing as base models improve
“For us, we've actually like figured that the like unit, the like The return on it was not actually that beneficial. What makes sense for us instead is, you know, like we use base models for like the final, like response. What makes sense, what makes more sense…”