LLM inference

1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Nov 30, 2023 by Jack Krawczyk · across every show →

Everything said about LLM inference, oldest first

Nov 30, 2023 positive

Prediction Held up

LLM inference costs will decrease significantly in relatively short order

“I think you're gonna see the cost of inference tend to go down. Inference is the cost to actually serve and run the model. I think you're gonna see those things go down in relatively short order.”

Jack Krawczyk Nov 30, 2023 ▶ 1:11:37 The Bard blueprint | Creating value, shipping fast, and advancing AI | Jack Krawczyk (Google)

Turn any episode into a week of clips.

This entire site, about 80 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

LLM inference

Everything said about LLM inference, oldest first

Turn any episode into a week of clips.