Inferencing AI
topic on 1 show · 1 statements across 1 episodes
1 statements about Inferencing AI, every show
McAvoy: LLM training data centers can easily curtail power, unlike inference centers
“They are doing large language model training.
They're doing batch processing.
They're not real-time
Critical.
They're not doing inferencing AI in those data centers, and you can curtail those data centers, like, very very easily, but when you're talking about,…”