GPU Flops
topic on 1 show · 1 statements across 1 episodes
1 statements about GPU Flops, every show
Karpathy: Engineering productivity shifted from GPU FLOPS to agent token throughput
“You would feel nervous when your GPUs are not running. Like you have GPU capability and you're not maximizing the available flops to you. But now it's not about flops, it's about tokens. So what is your token throughput and what token throughput do you command…”