LLM inference market
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Mar 6, 2024 by Soumith Chintala · across every show →
Everything said about LLM inference market, oldest first
Mar 6, 2024 bearish
Chintala: LLM inference market will become a low-margin laundromat business
“My view of the LLM inference market in general is that it's like the laundromat model. Like you, the margins are going to drive down towards the bare minimum, like It's gonna be all kinds of arbitrage between how much you can get the hardware for, and then how…”