Benedict Evans: ChatGPT's chat UI deceptively implies definitive answers
Benedict Evans · Working out AI questions · May 1, 2023 · at 30:38
Independent tech analyst Benedict Evans analyzes how generative AI interface design shapes user expectations compared to traditional search engines like Google.
0:00 / 0:40exact quote · 40.1s
720p mp4 · rendered on demand · StarZero watermark
“To me, this is part of the challenge of ChatTPT versus Google is that Google says here are 10 links that might be the answer. Whereas ChatGPT says this is the answer, and it's, this is the answer. But it's not, you could argue that what it should be saying is like, here is a synthesis of some stuff I read on the internet. That's kind of what it's actually doing. And like, here are some possibilities for what the answer might be, but because of it, it's got this kind of chat UI, and there's natural language UI, it kind of gives them, this is the answer. And so it's sort of deceptive in that it's not really communicating The limitations, what it's doing and the limitations of what it's doing”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Benedict Evans
Evans: Creators most upset about AI art lack originality
“The really unkind thing one could say is that the people who are most upset about AI art are the people who are making stuff that has no particular authenticity originality. I mean, if you, if you've made, if you wrote 10 vampire romance books last year and yo…”
Evans: The Cambridge Analytica scandal was basically a hoax
“And of course the irony of Cambridge Analytica was it was, in the end, it was basically a hoax. There was nothing there.”
Evans: Skeptics dismissing AI as useless or like NFTs are ignoring reality
“The real idiots are the people who are just saying, oh, none of this works, and it's all nonsense, and it's just a stochastic parrot, and it's useless, and I don't know what it's for and this is all, like, nonsense, and this is a rerun of NFTs. Because these p…”
The DOJ gerrymandered its market definition in the Apple antitrust lawsuit
“The DOJ is suing Apple for having what the DOJ, claiming the DOJ describes as a monopoly of, quote, performance smartphones, which Apple described as gerrymandering, and I'm kind of inclined to agree”