Gideon Mann, Head of Machine Learning at Bloomberg, references research on productivity gains achieved by developers using GitHub Copilot.
Prediction Not checkable as stated
Mann: Output verification will be the primary blocker for enterprise LLM deployments
“I think that's gonna be one of these evergreen problems, ah, for LLMs, and we're gonna, you know, keep trying to chew on that, ah, for a while, but that's gonna be the big blocker of a lot of the further deployments.”
Prediction Not checkable as stated
Mann: Every software application user interface will eventually integrate an LLM
“You can imagine that every point of interface with software application, there's gonna be a point to have a large language Model in that point of interface, and I think all of those will be interesting and useful”
Prediction Not checkable as stated
Mann: Human intelligence is overrated, making the path to AGI more plausible
“I kind of think human intelligence is a little bit overrated. So I think I'm a little more bullish on AGI. Someone wrote, you know the large, I think it was Ilya Sutskever, you know, maybe the largest models are slightly conscious. I'm not sure I disagree. So …”
Insight
Mann: AI breakthroughs are an overnight success seven years in the making
“It, for me it feels like an overnight success, seven years in the making.”
Insight
Mann: Open source culture in academic machine learning accelerated AI innovation
“The academic machine learning community happened to be one that shared quite a bit. And so companies like Hugging Face and, you know, Google's Colab, you know, enabled sharing of code sharing of technology, and this just really increased the pace of innovation”
Assertion Not checkable as stated
Mann: GPT-3 was vastly better than decades of prior NLP systems
“Two years ago, I remember being shocked at GPT-III when it was released, because it was just so, I'm an old NLP guy, and it was so vastly better than anything that, that we could build for decades.”