Custom ASICs
topic on 3 shows · 3 statements across 3 episodes
Latent Space 
the MAD Podcast 
All-In
3 statements about Custom ASICs, every show
Casado: A $1B model training run economically justifies a custom ASIC
“No, no, no, a billion dollar training run, a one billion dollar training run, it makes sense to actually do a custom ASIC if you can do it in time. The question now is timeline. Not money. Cause just rough math. If it's a billion-dollar training run, then the …”
CZ: Custom ASICs are rare in HFT because algorithms change too fast
“I don't think it exists on a very large scale. The mark I think the algorithms change too often.”
Custom AI chips become viable only after model architectures stabilize
“As soon as you get to a point where there's some convergence on an architecture that's looks like it's stable and is revenue generating and developers are coming to sort of work on it and confirm that it is like the thing, then you can flip towards doing a cus…”