LLM Inference Performance

topic on 1 show · 1 statements across 1 episodes

1 statements about LLM Inference Performance, every show

NO PRIORS Prediction Not checkable as stated

Srivastava: LLM inference performance will commoditize and increasingly run locally

“We think over time, It will get somewhat commoditized, the performance, especially, especially for language models, to be honest. I think, you know, more and more of that stuff should run locally to some degree, I think”

Tuhin Srivastava Mar 21, 2024 ▶ 11:34 No Priors Ep 56 | With Baseten CEO and Co-Founder Tuhin Srivastava

← every entity, every show

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

LLM Inference Performance

1 statements about LLM Inference Performance, every show

Turn any episode into a week of clips.