Kanjun Qiu is describing how Imbue's technical projects directly reflect the unique interdisciplinary backgrounds of individual team members.
Insight
Kanjun Qiu: AI emergent capabilities are artifacts of evaluation metric design
“If your metric is smooth you actually see slow performance improvement over time, and if your metric is relatively discrete or not smooth, that's where you see the emergence, and it's actually more about the evaluation metric Than about the emergence of the ca…”
Opinion
Qiu: AI is currently in an un-reliable analog computer phase
“I think today, you know, we're kind of in the analog computer phase of AI, where You know, ah, these systems, they output things. Errors compound. They're not very reliable.”
Assertion Supported
Kanjun Qiu: Language models trained without code perform poorly at reasoning
“Some companies have tried training language models with no code because they're like, oh, the product we're building, we don't need code. You know, it's a therapist or it's a question answering thing and we don't need code. So we should take code out of our tr…”
Insight
Qiu: Psychological trauma can be conceptualized as computational overfitting
“Trauma is overfitting and actually a good way to overcome trauma. If we look at a lot of therapy It's like by giving more data to me and helping me access the overfit parts and then give them more data.”
Insight
Kanjun Qiu: Self-supervised learning mirrors how humans naturally learn
“Self-supervised learning is interesting because it's how humans learn, you know, most of the time we go around We like Google stuff. We learn on our own. We're not giving supervised labels all the time.”
Disclosure
Kanjun Qiu: 95% of Imbue's work is engineering, not research
“So the company is mostly engineering. You know, I think something people, when people think about AI, they're like, oh, it's research, but really, 95% of the work that we all do is engineering work.”