Compute Costs

“What's interesting is just the compute costs relative to physical infrastructure is actually surprising where, you know, so much money is spent on the compute that the physical infrastructure sometimes is actually lower, but, you know, has very large lead time…”

“I think what will happen is the expensive PhD will become dirt cheap. My bet is a year from now, it'll cost one-fifth to one-tenth of what it does today.”

“The cost of compute reduces over time, just based on hardware costs. It reduces around 30% every two years if you follow NVIDIA roadmap. For the same amount of flops.”