Nemade: Google teams only noticed Transformer paper after citations grew
Gaurav Nemade · Why Google Never Shipped LaMDA Its ChatGPT Predecessor · Oct 30, 2023 · at 7:49
Gaurav Nemade was the founding product manager for Google's LaMDA conversational AI project, discussing the internal reception of the 2017 Transformer paper.
0:00 / 0:10exact quote · 10.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think once it started garnering a lot of citations over the months and quarters, that's when people started paying attention, even inside of Google that, Hey, this transformer architecture seems amazing.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Gaurav Nemade
Nemade: Sundar Pichai's politically correct leadership lacks needed candor
“Versus I think I felt that Sundar's responses a lot of time were like very politically correct. I don't blame him. It's like his management style in some way, but I feel that the honest, the brutal honesty and candor, I think was something that I miss. And I f…”
Nemade: Google's early generative chatbot provided suicide methods and alcohol advice
“Like in the initial days of these generative models, as you can imagine, like we were trying to build an end-to-end model for a child bot. It would spew out all sorts of things like, Hey, what are 10 ways to do suicide? It'll give you like the best 10 ways to …”
Nemade: Google could have safely released LaMDA using OpenAI's vetted-access model
“And I think OpenAI did an excellent job with respect to that. Like, they released GPT-III, and they were like, we are just going to give access to researchers who we are going to vet. That's an amazing way to give access. Now it's kind of pretty standard way, …”
Nemade: Google would have taken 2-4 years to ship AI without ChatGPT
“Had ChatGPT not happened, I predict that It would have taken at least two to three to four years for Google to get there just because of the bureaucracy and the speed at which things move.”
Nemade: Google has grown conservative and overly obsessed with PR
“I feel like over the years, Google has become more and more conservative about doing things. They care a lot about PR, like public relations. They care a lot about how their image is shown in the media. And I feel that at least in my experience that played so …”
Nemade: Google is stuck between bottom-up roots and top-down management
“I think Google is struggling to be A top down company when their ethos are bottoms up. I think they're kind of somewhere in the middle and they haven't figured out how to transition from being a top bottom up company to a top down company.”