routing
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jun 26, 2026 by Noam Brown · across every show →
Everything said about routing, oldest first
Jun 26, 2026 neutral
Brown: Benchmark Gains From Routing May Fail in Real-World Use
“One issue you could run into is that you could optimize for certain benchmarks with the routing and then show like, oh yeah, we see this big improvement on these benchmarks. But in real world use cases, it actually ends up not being a significant improvement.”