Karpathy
person on 5 shows · 5 statements across 5 episodes
More or Less 
Latent Space 
Invest Like the Best 
Sourcery 
the a16z Podcast
5 statements about Karpathy, every show
Bornstein: AI code autocomplete 'Tab' features no longer matter much
“Tab was the big thing when we, you know, Karpathy had that famous post. I guess he has a lot of famous posts where he's like, Tab, Tab, Tab. Yeah, exactly. Like that kind of doesn't matter that much anymore.”
Movva: Effective model training requires overfitting before compressing to generalize
“If you have a new data set that you want to train a model for, your first goal should be to overparameterize the model and try to overfit the data that you have to prove that there is a relationship that you can model or memorize, that your learning algorithm …”
Jessica Lessin: Andrej Karpathy has officially joined Anthropic
“Did you guys see Karpathy went to Anthropic?”
Das: Reinforcement learning is an inefficient paradigm requiring massive sample sizes
“One is RL's kind of a shitty paradigm to learn. Karpathy obviously talks about this a lot. It takes a lot of samples to learn some very basic stuff because you only get a reward at the end. You don't actually understand things as it's happening.”
Martin: Andrej Karpathy launched Spotify podcast using NotebookLM Wikipedia summaries
“I think that's what Karpathy did, right? Like he has now a Spotify channel called histories of mysteries, which is basically like, he just took like interesting stuff from Wikipedia and made audio overviews out of it.”