intermediate representations
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Sep 5, 2024 by Andrej Karpathy · across every show →
Everything said about intermediate representations, oldest first
Sep 5, 2024 neutral
Karpathy: Pure End-to-End Imitation Learning Lacks Sufficient Supervision Bits
“Actually, like, end-to-end driving, when you're just imitating humans and so on, you have very few bits of supervision to train a massive neural net. And it's too Too few bits of signal to train so many billions of parameters. And so these intermediate represe…”