LLM Inference Cost

topic on 1 show · 1 statements across 1 episodes

1 statements about LLM Inference Cost, every show

WTF Assertion Supported

LLM inference costs dropped 100x in two years, far outpacing Moore's law

“I think the cost of inference for LLM has gone down by a factor of a hundred in two years. I mean, it's just, it's amazing, right? It's way faster than Moore's law.”

Yann LeCun Nov 27, 2024 ▶ 1:20:25 WTF is Artificial Intelligence Really? | Yann LeCun x Nikhil Kamath | People by WTF Ep #4 · Nikhil Kamath

← every entity, every show

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

LLM Inference Cost

1 statements about LLM Inference Cost, every show

Turn any episode into a week of clips.