Evans: Generative AI Infers Patterns Rather Than Storing Training Data
Benedict Evans · Google Gemini and AI bias · Mar 3, 2024 · at 25:34
Tech analyst Benedict Evans explains the fundamental mechanics of generative AI models during a discussion on machine cognition and AI misconceptions.
0:00 / 0:35exact quote · 35.3s
720p mp4 · rendered on demand · StarZero watermark
“What is generative AI trying to do? Which is, is not actually trying to reproduce any individual thing in the training data. So, you know, when we did image recognition models, 10 years ago, you give it a billion pictures of cats. The purpose is not that it can recognize any individual cat picture. The purpose is it now has a conception of cats. And the same thing when you give a generative model, you know, a billion photographs or a billion bits of text or something. The purpose is not that it's got a database and it can reproduce any of those images or any of those bits of text. The purpose is now that it infers patterns across billions of images or billions of bits of text.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Benedict Evans
Evans: Creators most upset about AI art lack originality
“The really unkind thing one could say is that the people who are most upset about AI art are the people who are making stuff that has no particular authenticity originality. I mean, if you, if you've made, if you wrote 10 vampire romance books last year and yo…”
Evans: The Cambridge Analytica scandal was basically a hoax
“And of course the irony of Cambridge Analytica was it was, in the end, it was basically a hoax. There was nothing there.”
Evans: Skeptics dismissing AI as useless or like NFTs are ignoring reality
“The real idiots are the people who are just saying, oh, none of this works, and it's all nonsense, and it's just a stochastic parrot, and it's useless, and I don't know what it's for and this is all, like, nonsense, and this is a rerun of NFTs. Because these p…”
The DOJ gerrymandered its market definition in the Apple antitrust lawsuit
“The DOJ is suing Apple for having what the DOJ, claiming the DOJ describes as a monopoly of, quote, performance smartphones, which Apple described as gerrymandering, and I'm kind of inclined to agree”