Qiu: Self-supervised AI may learn representations akin to human cognition
Kanjun Qiu · No Priors Ep. 41 | With Imbue Co-Founders Kanjun Qiu and Josh Albrecht · Nov 16, 2023 · at 2:09
Imbue co-founder Kanjun Qiu describes the technical realizations regarding multimodal self-supervised learning that inspired founding Imbue.
0:00 / 0:11exact quote · 11.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“There's something really interesting here where maybe machines are learning the same kinds of representations or similar representations to what humans are learning. And maybe they can get to a point where they can actually do the types of things that humans are able to do.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Kanjun Qiu
Qiu: Pragmatic, smaller models will eventually address the majority of AI workflows
“And I suspect we're going to see something similar where a lot of use cases are going to be able to be addressed by something pretty pragmatic and relatively small.”
Qiu: Training a giant monolithic model does not magically solve agent reliability
“It's not like, oh, magical, you know, we train a giant model and stick everything into it and then magically it works. Like it does not work. It'll get better at random parts of the agent loop, but that's not what we want.”
Qiu: Imbue trains state-of-the-art AI models with only 13 or 14 people
“We're kind of like training state, state of the art models with like 14, 13 people.”
Qiu: Software output will explode as programming democratizes to non-coders
“Software is just dramatically underwritten because it's so hard to write code today. So, you know, as we said in the future, like, computers will be able to be programmed by regular people. What that means is, like, we're gonna write way, way, way more softwar…”