AlexNet, every mention
39 scenes · ← back to AlexNet
tap a year for its mentions
every year anyone David Rosenthal 31Ben Gilbert 6Jensen Huang 2
Verbatim, from the transcripts: the passages where AlexNet comes up
Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired
- ▶ 6:39 David Rosenthal Ilya Sitzkever, founding chief scientist of OpenAI, who along with Jeff Hinton and Alex Korczewski had done the seminal AI work on AlexNet and just published that a few years before all three of them were Google employees, as was Dario…
- ▶ 47:02 David Rosenthal The other part of it was what Jensen at NVIDIA always calls the big bang moment for AI, which was AlexNet.
- ▶ 48:40 David Rosenthal Along comes AlexNet.
- ▶ 52:00 David Rosenthal So, after AlexNet, the whole computer science world is abuzz.
- ▶ 52:09 David Rosenthal So, after AlexNet, the three of them from Toronto, Jeff Hinton, Alex Koshevsky, and Ilya Sitskiver, do the natural thing,
- ▶ 1:05:48 Ben Gilbert AlexNet, the cat paper, that whole world is about better classifying data.
- ▶ 1:14:24 David Rosenthal And then AlexNet happens, and man, AlexNet's really, really, really good at identifying and classifying images and cat videos on YouTube and the YouTube recommender feed.
- ▶ 1:15:38 David Rosenthal Mark has woken up to everything that's going on at Google after AlexNet and what AI is doing for social media feed recommendations at YouTube.
- ▶ 1:34:39 David Rosenthal Of course, of AlexNet, and DNN Research, and Google, and about to become founding chief scientist of OpenAI.
- ▶ 1:52:35 David Rosenthal They keep iterating on Translate, and then once Jeff Hitton comes on board and AlexNet happens, they switch over to a neural network-based language model for Translate.
- ▶ 1:55:18 David Rosenthal All the efforts that are coming out of AlexNet and then the TPU project of parallelization.
- ▶ 1:59:31 David Rosenthal It was another big change from the AlexNet, Jeff Hinton lineage neural networks.
Google Part II: Alphabet (Audio) · Acquired
- ▶ 3:39:51 David Rosenthal Alex Krzyzewski of AlexNet.
- ▶ 3:40:05 David Rosenthal His collaborator on the AlexNet paper, Ilya Sutskiver, founding scientist of OpenAI, Dario Amadei, co-founder with his sister of Anthropic, Andre Karpathy, until recently chief AI scientist at Tesla, Chris Ola, Noam Shazir, Ian Goodfellow,…
Meta (Audio) · Acquired
- ▶ 4:32:42 David Rosenthal And AlexNet had just happened right at this time, and for whole history of AlexNet, go check out our NVIDIA series where we talk all about that and the importance to AI and ML.
- ▶ 4:33:24 David Rosenthal Yep, and AlexNet and those big AI ML breakthroughs in that era were all around image recognition.
NVIDIA CEO Jensen Huang · Acquired
- ▶ 13:31 Jensen Huang You know, when we saw deep learning, when we saw AlexNet,
- ▶ 15:06 Jensen Huang And so that was incredibly intriguing.
- ▶ 17:32 David Rosenthal But I'm curious in the, you know, there's a couple of years after AlexNet, and this is when Ben and I were getting into the technology industry and the venture industry ourselves.
- ▶ 17:43 Ben Gilbert So right after AlexNet, but before anyone was talking about machine learning and even the mainstream engineering community.
- ▶ 34:35 David Rosenthal I can't reason from AlexNet and your engagement with the research community, uh, and, you know, social media feed recommenders to you deciding and the company deciding we're going to go on a five-year all-in journey on the data center.
Nvidia Part III: The Dawn of the AI Era (2022-2023) (Audio) · Acquired
- ▶ 8:13 David Rosenthal And that was AlexNet.
- ▶ 8:21 David Rosenthal Who submitted the AlexNet algorithm to the ImageNet computer science competition.
- ▶ 8:47 David Rosenthal I mean, until this competition, and until AlexNet, there was no machine learning algorithm that could accurately label images.
- ▶ 9:02 Ben Gilbert Yeah, and if I'm remembering from our episode, basically what happened is the AlexNet team did way better than anybody else had ever done.
- ▶ 12:26 David Rosenthal Yeah, it was pretty useful stuff, and this Alex Knapp moment and these three researchers from Toronto kicked off, you know, Jensen calls it, and he's absolutely right, the Big Bang moment for AI.
- ▶ 13:30 David Rosenthal So, the three people who made up the AlexNet team were, of course, Alex Krzyzewski, who was a PhD student, under his faculty advisor, the legendary computer science professor, Jeff Hinton.
- ▶ 14:45 David Rosenthal So after AlexNet, Alex, Jeff, and Ilya do the very natural thing.
- ▶ 15:17 David Rosenthal The three of them had just formed the Google Brain team within Google to turbocharge all of this AI work that has been unleashed by AlexNet.
- ▶ 26:35 David Rosenthal So the AlexNet example, you're talking about fourteen million images.
- ▶ 41:46 David Rosenthal This is a long way from AlexNet here.
Nvidia: The Machine Learning Company (2006-2022) · Acquired
- ▶ 42:50 David Rosenthal Jensen did not plan Alex net or see it coming cause nobody saw Alex net coming.
- ▶ 46:29 David Rosenthal They call it AlexNet.
- ▶ 47:49 David Rosenthal So AlexNet took these old ideas and it implemented them on GPUs, and to be very specific, it implemented them in CUDA on NVIDIA GPUs.
- ▶ 48:55 Ben Gilbert Right, and so deep learning is generating a lot of buzz, you know, a lot from this AlexNet competition.
- ▶ 50:08 Ben Gilbert So this AlexNet thing, plus then Brian and Andrew Ng's paper, it just collapses all these sort of previously thought to be impossible lines to cross and just makes it way easier and way more performant and way less energy intensive for…
- ▶ 55:58 David Rosenthal Again, AlexNet happens in 2012.
- ▶ 57:06 David Rosenthal Well, I think people had just lost trust and interest, you know, after, like, there were so many years of, like, they were so early with CUDA and early, you know, they didn't even know that this, like, they didn't know AlexNet was gonna…
- ▶ 1:08:24 Ben Gilbert So gaming, you know, through all this, through 2006 to AlexNet, all the way, you know, another decade forward to 20 20,