Convolutional Neural Networks
topic on 3 shows · 4 statements across 4 episodes
the Y Combinator Startup Podcast 
the MAD Podcast 
the a16z Podcast
4 statements about Convolutional Neural Networks, every show
Douglas: Vision transformers outscale CNNs by leveraging global image context
“Convolutional neural networks will be better than a more general, like, a vision transformer for the vast majority of images up to a certain, and up to a certain amount of scale. But past a point, actually, you need to be able to flexibly integrate information…”
Fei-Fei Li: AlexNet was the first time two GPUs powered deep learning
“It's not just convolutional neural network. It was also the first time that two GPUs were put together by Alex and his team. And were used for the computing of deep learning. So, it was really the first moment of data, GPUs, and neural network coming together.”
Fei-Fei Li: AlexNet's architecture mirrored 1980s models, unlocked by GPUs
“The 2012 AlexNet paper on ImageNet Challenge is literally a very classic model, and that is the convolutional neural network model, and that was published in 19 eighties, the first paper. I remember as a graduate student learning that, and it more or less also…”