AI inference at the edge
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Apr 10, 2025 by Stan Boland · across every show →
Everything said about AI inference at the edge, oldest first
Apr 10, 2025 bullish
Boland: Edge AI Inference Will Require High Silicon Capacity
“I mean, yeah, but with that is coming a lot more sort of chain of thought reasoning, a lot more test time compute, so the token generation is still going up, actually. So I still think there's going to be a large amount of silicon required to be able to do sor…”