LLM router

2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Nov 1, 2024 by Anastasios Angelopoulos · across every show →

Everything said about LLM router, oldest first

Nov 1, 2024 positive
Insight
Angelopoulos: Highly effective LLM routers only need simple heuristics like length
“Well, I think that you can build a very, very simple router that is very effective. So let me give you an example. You can build a great router with one parameter, and the parameter is just like, I'm gonna check if my question is hard, and if it's hard, then I…”
Anastasios Angelopoulos Nov 1, 2024 ▶ 36:33 In the Arena: How LMSys changed LLM Benchmarking Forever
Feb 5, 2025 bullish
Insight
Agarwal: Multi-step agentic systems are driving adoption of LLM routing
“With the rise of agentic systems where people are building multi-step agents, that's also where routing is becoming really popular because you might want to have different tasks point to different LLMs, and then you don't want to build authorization and all of…”
Rohit Agarwal Feb 5, 2025 ▶ 3:14 Why every AI Engineer needs an AI Gateway (ft Portkey.ai CEO)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.