Qiu: Specialized reasoning planners coordinating sub-agents outperform single monolithic models
Kanjun Qiu · No Priors Ep. 41 | With Imbue Co-Founders Kanjun Qiu and Josh Albrecht · Nov 16, 2023 · at 16:52
Kanjun Qiu, co-founder of Imbue, explains how hierarchical agent architectures achieve general capabilities without requiring individual models to be universally capable.
0:00 / 0:17exact quote · 17.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“You can kind of have this like more general reasoning layer and also a bunch of sub-agents where it, that, That general reasoning layer is actually very specific. It's a specific planner. It's not that good at, like, browsing the web and things like that, but the system itself altogether is more general as a result.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Kanjun Qiu
Qiu: Pragmatic, smaller models will eventually address the majority of AI workflows
“And I suspect we're going to see something similar where a lot of use cases are going to be able to be addressed by something pretty pragmatic and relatively small.”
Qiu: Training a giant monolithic model does not magically solve agent reliability
“It's not like, oh, magical, you know, we train a giant model and stick everything into it and then magically it works. Like it does not work. It'll get better at random parts of the agent loop, but that's not what we want.”
Qiu: Imbue trains state-of-the-art AI models with only 13 or 14 people
“We're kind of like training state, state of the art models with like 14, 13 people.”
Qiu: Self-supervised AI may learn representations akin to human cognition
“There's something really interesting here where maybe machines are learning the same kinds of representations or similar representations to what humans are learning. And maybe they can get to a point where they can actually do the types of things that humans a…”
Qiu: Software output will explode as programming democratizes to non-coders
“Software is just dramatically underwritten because it's so hard to write code today. So, you know, as we said in the future, like, computers will be able to be programmed by regular people. What that means is, like, we're gonna write way, way, way more softwar…”