Jeff Dean, every mention
58 scenes · ← back to Jeff Dean
tap a year for its mentions
every year anyone David Rosenthal 35Ben Gilbert 23
Verbatim, from the transcripts: the passages where Jeff Dean comes up
Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired
- ▶ 13:13 David Rosenthal A large number of people thought it was a really bad thing for Noam and I to spend our talents on, but Sanjay Gamowat, Sanjay of course being Jeff Dean's famous prolific coding partner, thought it was cool.
- ▶ 15:39 David Rosenthal So fast forward to 2003 and Susan Wojcicki and Jeff Dean are getting ready to launch
- ▶ 16:04 David Rosenthal So Jeff Dean borrows Phil and famously uses it to code up his implementation of AdSense in a week, because he's Jeff Dean.
- ▶ 16:35 Ben Gilbert This is a moment where we got to stop and just give some Jeff Dean facts.
- ▶ 16:39 Ben Gilbert Jeff Dean is going to be the through line of this episode of, wait, how did Google pull that off?
- ▶ 16:44 Ben Gilbert How did Jeff Dean just go home and over the weekend rewrite some entire giant distributed system and figure out all of Google's problems?
- ▶ 16:52 Ben Gilbert Back when Chuck Norris facts were big, Jeff Dean facts became a thing internally at Google.
- ▶ 17:02 Ben Gilbert Then Jeff Dean spent a weekend optimizing physics.
- ▶ 17:07 Ben Gilbert Jeff Dean's pin is the last four digits of pi.
- ▶ 17:17 Ben Gilbert To Jeff Dean, NP means no problemo.
- ▶ 17:25 David Rosenthal Also, a wonderful human being who we spoke to in research and was very, very helpful.
- ▶ 20:17 David Rosenthal Jeff Dean hears about this and the work that Franz and the Translate team have done.
- ▶ 20:27 David Rosenthal So Jeff and Noam talk about this on the DoorCash podcast.
- ▶ 20:33 David Rosenthal And Franz is like, no, no, no, no, no, Jeff, you, you don't understand.
- ▶ 21:27 David Rosenthal So Jeff Dean being the engineering equivalent of Chuck Norris, he's like, hmm, let me see your code.
- ▶ 21:34 David Rosenthal Jeff goes and parachutes in and works with the translate team for a few months, and he re-architects the algorithm to run on the words and the sentences in parallel instead of sequentially, because when you're translating a set of…
- ▶ 22:12 David Rosenthal And as Jeff knows very well, because he and Sanjay basically built it with Erz Holze, Google's infrastructure is extremely parallelizable.
- ▶ 22:39 David Rosenthal And Jeff's work with the team gets that average sentence translation time down from 12 hours to 100 milliseconds.
- ▶ 22:53 Ben Gilbert This sounds like a Jeff Dean fact.
- ▶ 22:55 Ben Gilbert Well, you know, it used to take 12 hours, and then Jeff Dean took a few months with it.
- ▶ 33:05 David Rosenthal This is an artifact of history sitting there on YouTube and people at Google, Sebastian, Jeff Dean, all the other folks who are talking about, they get
- ▶ 38:11 David Rosenthal Jeff Dean.
- ▶ 38:12 David Rosenthal And Jeff Dean is telling Andrew about what he and Franz have done with language models, and what Jeff Hinton is doing in deep learning, and of course Andrew knows all this, and Andrew's talking about what he and Sale are doing at Stanford.
- ▶ 39:10 David Rosenthal So, the two of them, Andrew Ng and Jeff Dean, pull in Greg Corrado, who is a neuroscience PhD and amazing researcher who was already working at Google.
- ▶ 39:50 David Rosenthal So, Jeff Dean is working on this system, on the infrastructure, and he decides to name the infrastructure dist-belief, which of course is a pun, both on the distributed nature of the system, and also on, of course, the word disbelief,…
- ▶ 40:43 Ben Gilbert What Jeff Dean wrote with distbelief was the opposite.
- ▶ 44:37 David Rosenthal Here's a quote from Jeff Dean about this.
- ▶ 1:33:46 David Rosenthal We've got Jeff Dean here.
- ▶ 1:35:31 Ben Gilbert It's sort of an activation energy problem where once Ilya said, okay, I'm in, and once he said, I'm in, by the way, Google came back with a big counter, something like double the offer, and I think it was delivered from Jeff Dean…
- ▶ 1:41:28 Ben Gilbert And Jeff Dean and Alan Eustace had also come to the conclusion that disbelief, while amazing, had to be re-architected to run on GPUs and not CPUs.
- ▶ 1:41:41 Ben Gilbert Jeff Dean and John Giandra, who we haven't talked about this episode.
- ▶ 1:44:49 Ben Gilbert It becomes a super popular feature, and Jeff Dean does the math
- ▶ 1:45:09 Ben Gilbert There's a great quote where Jeff goes to Erz Holtzel and goes, we need another Google.
- ▶ 1:52:53 Ben Gilbert Parachuting in, again, led by Jeff Dean, saying, I'm pretty sure our neural networks can do this way better than the classic methods that we've been using for the last 10 years.
- ▶ 1:58:16 David Rosenthal Gnome joins the team, basically pulls a Jeff Dean, rewrites the entire code base from scratch, and when he's done, the transformer now crushes the LSTM-based Google Translate solution.
- ▶ 1:59:01 Ben Gilbert And you wonder why Noam and Jeff Dean are the ones together working on the next version of Gemini now.
- ▶ 1:59:07 David Rosenthal Noam and Jeff Dean are definitely two peas in a pod here.
- ▶ 3:08:58 David Rosenthal So, once Sundar makes these decisions, Jeff Dean and Oriol Vinales from Brain go over and team up with the DeepMind team, and they start working on Gemini.
- ▶ 3:09:11 Ben Gilbert You got Jeff Dean working on it, I'm in.
- ▶ 3:09:12 David Rosenthal If you got Jeff Dean on it, it's probably gonna work.
- ▶ 3:09:24 David Rosenthal Noam joins the Gemini team, and Jeff and Noam are the two co-technical leads for Gemini now, so.
Google Part II: Alphabet (Audio) · Acquired
- ▶ 1:53:20 Ben Gilbert So you had Jeff Dean and Sanjay Jemawat coming from DEC.
- ▶ 1:53:27 Ben Gilbert A lot of the stuff that Jeff did, and of course he became sort of a Google executive, Jeff and Sanjay peer programmed together.
- ▶ 1:53:44 Ben Gilbert And basically, if you look at any big research paper about giant Google infrastructure stuff that was launched from, I don't know, 2000 two-ish, maybe even earlier, through the twenty-teens, Jeff and Sanjay are either the two authors or…
- ▶ 1:55:30 David Rosenthal Or everything Jeff Dean and Sanjay did in the early days of Google.
Google Part I: Origins of Search. How the Best Business in Human History Happened (Audio) · Acquired
- ▶ 59:50 David Rosenthal So pretty quickly they get Urs Holze and then Jeff Dean, who are just these absolute legends.
- ▶ 1:00:34 David Rosenthal Jeff Dean, who they also recruit around the same time, from the senior engineer at deck.
- ▶ 1:00:40 David Rosenthal And Jeff is basically like Google's Dave Cutler.
- ▶ 1:00:43 David Rosenthal So today, Jeff runs AI at Google.
- ▶ 1:01:05 Ben Gilbert We, we spoke with Jeff to prep for this episode, and I watched a handful of talks he's given.
- ▶ 1:09:24 Ben Gilbert So one fun illustration of what does it mean to be on commodity hardware versus enterprise grade hardware.
- ▶ 1:28:23 David Rosenthal So the very first project that Jeff Dean did when he came over from DEC is Larry and Sergey and Erz told him, all right, the VCs say we got to sell ads.
- ▶ 1:28:41 David Rosenthal And so Jeff works with Marissa Mayer, who just joined from Stanford undergrad, and they're like, okay, like, fine, this is going to have to just be text.
- ▶ 1:29:24 David Rosenthal Jeff Dean codes it up so that dynamically, as users are searching, if there's a query that is related at all to
- ▶ 2:51:39 David Rosenthal So, legendary Google engineer Jeff Dean.
- ▶ 2:54:36 David Rosenthal So they launched this thing, you know, Jeff codes it up at the beginning of 2003, kind of call it end of Q one, 2003, they launch AdSense.
- ▶ 3:38:25 David Rosenthal But specifically, thank you to Craig Silverstein, Google's first employee, to Anna Patterson, to Omid Kordestani, Alan Eustace, Clay Bevor, Brett Taylor, Jeff Dean, Jen Fitzpatrick, Danny Sullivan, Nick Fox.
Nvidia Part III: The Dawn of the AI Era (2022-2023) (Audio) · Acquired
- ▶ 15:11 David Rosenthal Three specifically, Greg Corrado, Jeff Dean, and Andrew Ng, the famous Stanford professor.