Inference Chips
topic on 6 shows · 6 statements across 6 episodes
Cheeky Pint 
Latent Space 
the a16z Podcast 
All-In 
TBPN 
20VC
6 statements about Inference Chips, every show
Andreessen: Three-year-old Nvidia chips make more money today than when new
“The current models are getting better faster at such a rate that if you are running an NVIDIA, if you're running an NVIDIA inference chip today that's three years old, you're making more money on it today than you did three years ago. Because the pace of impro…”
Pope: The best AI inference chip is also a great training chip
“I think the best inference chip today will be a train, a really good training chip as well.”
Bishop: China manufactures capable inference chips but cannot produce training chips
“China has enough, like they can actually make, looks like decent inference chips. They just can't make the chips they need for training, right?”
Ross: Deploying Cheaper Inference Chips Will Fuel More AI Training
“I think if we were to deploy a lot of much lower cost inference chips what you would see is that same number of GPUs would be sold, but the demand for training would increase because the more inference you have, the more training you need, and vice versa.”
Hoffman predicts the bulk of AI chip demand will be for inference
“And I think there's gonna be a bunch of those kind of coming in, and the bulk of the demand will be on the inference side”
Fei-Fei Li: Edge AI inference chips offer huge market opportunity beyond GPUs
“GPUs are wonderful for training the deep learning algorithms, but I think there is still a lot of space in rapid testing or inference time Chips where it can be used in recognition, you know, in devices, in embedded devices.”