Agent Framework
topic on 3 shows · 8 statements across 6 episodes
Latent Space
Lenny's Podcast
the Startup Ideas Podcast
8 statements about Agent Framework, every show
Schneider: Dedicated agent frameworks are often bloat for finite tasks
“A lot of the times you don't need it. It's just bloat. You can just have a very simple, like a very simple solution for these finite problems, right? It doesn't have to be this over complicated or over engineered thing.”
Wu: Blindly following customer requests leads to AI product local maxima
“Because the field is changing so much at any point in time, you know, a lot of people are kind of in this local, local maximum. And if you just blindly listen to your customers, they'll, they'll be like, yeah, I want a better vector store. Like I want a better…”
Cameron: Models perform better with minimal tools than rigid frameworks
“I think where we're getting to is that these models have gotten smart enough, they've gotten better, better tools that they can perform better when just given a minimalist set of tools and let them run, let the model Control the agentic workflow rather than us…”
Alex Shaw: Base model selection matters much more than agent frameworks
“And if you look at the difference between the same model and the biggest spread across agent frameworks versus the same agent framework and the biggest spread across models, It's much larger across models, which I think goes to show that like improving models …”
Alex Shaw: Agent frameworks can impact benchmark scores by up to 15%
“Agent framework seems to make a difference as well, like up to 15% or something pretty significant.”
Colvin: Agent framework engineering quality lags far behind Python ecosystem
“Looking in general at the ecosystem of agent frameworks, the engineering quality is far below that of the rest of the Python ecosystem.”
Colvin: Agent Frameworks Exist Because AI Models Are Not Clever Enough
“Agents, agent frameworks, graphs, all of this stuff is basically making up for the fact that right now the models are not that clever.”
Anthropic's Schluntz: Avoid agent frameworks and start from scratch with raw prompts
“I think with agent frameworks in general, they can certainly save you some like boilerplate, but I think there's actually this like downside of making agents too easy, where you end up very quickly, like building a much more complex system than you need. And s…”