AI Model Serving

topic on 1 show · 1 statements across 1 episodes

20VC

1 statements about AI Model Serving, every show

20VC Assertion Not checkable as stated
Shazeer: Centralized AI Inference Batching Is Up to 100x More Efficient
“Obviously though, there's also like economics of scale of both training the best models And serving, like if you want to serve a product, you can do it maybe a hundred times more efficiently if you're serving many, many people at once and kind of batching thin…”
Noam Shazeer Aug 31, 2023 ▶ 23:46 Noam Shazeer: How We Spent $2M to Train a Single AI Model and Grew Character.ai to 20M Users | E1055 · 20VC with Harry Stebbings

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.