Socher: OpenAI cited Socher's 2018 paper, crediting it with influencing early GPTs
Richard Socher · Former Chief Scientist at Salesforce, Richard Socher | You.com, LLMs, AI Agents, Complex Work · Sourcery with Molly O'Shea · Oct 25, 2024 · at 44:25
Richard Socher describes how his 2018 multi-task NLP paper influenced early GPT model developers at OpenAI.
0:00 / 0:14exact quote · 14.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“That paper was actually cited by OpenAI, and they're still doing research papers. Like, we were told by some of the folks that worked on the first version of GPTs, like one and two, that that actually had influenced them to work more in NLP.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Richard Socher
Socher: AI search competitors fake citations and prioritize marketing over accuracy
“And when we do a lot of comparisons to the competition, usually the competition spends much more money on marketing and design and less on accuracy of the technology and accuracy of the answers and even the citations. A lot of folks just Fake their citations a…”
Socher: You.com invented RAG at web scale before the term existed
“We realized just like with rag where we had invented rag already, we're doing it at a web scale, but it wasn't yet a term.”
Socher: Only 5% to 10% of enterprise AI seats get utilized
“This comes from a lot of organizations that bought
500 thousand plus seats for their product.
And then after a few months, they look into how many users are actually using it.
And it's like five, 10% in the company actually really use it.
And so, you know, the…”
Socher: AI agents will outnumber human web surfers within years
“I think in the next few years, we're going to see more AI agents surfing the web for people than we'll have people surfing the web.”
Socher: Most workers will become managers of AI agents
“That's what's going to happen when intelligence gets cheaper and cheaper. We'll just be all much more efficient. And most of us have to become managers of AI agents doing work for us.”
Socher: Salesforce Research invented prompt engineering in 2018
“On the research side this was in 2018, we finally culminated all my ideas when we invented prompt engineering, and we didn't quite call it prompt engineering, but the basic idea was there, namely that you can prompt a single model with different questions, and…”