RouteLLM

2 statements across 1 episodes · 1 bullish · 0 bearish · 2 people on the record · first statement Nov 1, 2024 by Wei-Lin Chiang · said 2 times in 1 episodes since 2024 · across every show →

Mentions by year

brought up most by Alessio Fanelli (2)

tap a year for its mentions
0011212024episodesmentions
0112024episodes it came up in
0010.5212024episodesmentions per episode
2024 2 mentions in 1 episode

every mention, scene by scene, with the transcript →

Everything said about RouteLLM, oldest first

Nov 1, 2024 neutral
Assertion Not checkable as stated
Chiang: There are currently no good benchmarks for evaluating LLM routers
“Right now, currently, there seems to be the, one of the end point when we developed this project was like, there's just no good benchmark for a router.”
Wei-Lin Chiang Nov 1, 2024 ▶ 35:57 In the Arena: How LMSys changed LLM Benchmarking Forever
Nov 1, 2024 positive
Insight
Angelopoulos: Highly effective LLM routers only need simple heuristics like length
“Well, I think that you can build a very, very simple router that is very effective. So let me give you an example. You can build a great router with one parameter, and the parameter is just like, I'm gonna check if my question is hard, and if it's hard, then I…”
Anastasios Angelopoulos Nov 1, 2024 ▶ 36:33 In the Arena: How LMSys changed LLM Benchmarking Forever
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.