LLM routing
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jan 26, 2025 by William Beauchamp · across every show →
Everything said about LLM routing, oldest first
Jan 26, 2025 bearish
Beauchamp: Dynamic LLM routing is expensive and offers minimal performance edge
“You can try and do, like, a routing thing where you say, for a user, given user requests, we're going to try and predict which of these end models that users enjoy the most. That turns out to be pretty expensive and not a huge source of, like, edge or improvem…”