Quora found GPT-3 could not match top human answer quality
Adam D'Angelo · Bringing AI to the Masses with Adam D'Angelo, CEO of Quora · Mar 20, 2024 · at 2:58
Adam D'Angelo, founder and CEO of Quora, discusses early experiments testing OpenAI's GPT-3 model against human-written answers on the platform.
0:00 / 0:16exact quote · 16.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We ran some experiments using GPT-III to generate answers and compare them to the answers that, that humans had written on Quora. And a lot of the time, GPT-III could not write as good of an answer as what the best human answer was that, that, that had been written.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Adam D'Angelo
Adam D'Angelo: LLMs will perform all human tasks cheaper within 5-15 years
“I do think at some point you get to LMs can, they can do Everything, every single thing a human can do for cheaper. Like, I don't see a reason why we don't eventually get there. That may take five, 1015 years.”
Adam D'Angelo: Current LLM architectures are not hitting performance limits
“I don't think so. I mean, I think there are certain things like memory and learning, like continuous learning that are not very easy with the current architectures. I think even those you can sort of fake and maybe are, we're going to be able to get them to wo…”
Adam D'Angelo: Current AI paradigm is far from diminishing returns
“I think the current paradigm is pretty good. And I think we're nowhere near the sort of like diminishing returns of continuing to push on it. And I bet. Yeah, I guess I would just bet that you can keep doing different innovations within the paradigm to get the…”
Adam D'Angelo: Top experts can solve fundamental AI challenges within five years
“Nothing seems fundamentally so hard that it couldn't be solved by the smartest people in the world working incredibly hard for the next five years.”
Adam D'Angelo: AI computer use will automate major work within two years
“And then there's some things like computer use that are still not quite there, but I think we'll almost definitely get there in the next year or two. And when you have that, I think we're gonna be able to automate a large portion of what people do.”