Scaling At Inference
topic on 1 show · 1 statements across 1 episodes
1 statements about Scaling At Inference, every show
Sivulka claims Hebbia pioneered inference-time compute scaling
“And this is a technique scaling at inference that was first actually pioneered at Hebbia, and we quickly noticed another scaling law, where if we ran more models and basically more compute at inference time, you could get much better results for very complex t…”