Long Context Transformers

topic on 1 show · 1 statements across 1 episodes

No Priors

1 statements about Long Context Transformers, every show

NO PRIORS Opinion
Ma: 100M-Token Enterprises Cannot Afford Long-Context Inference Costs
“So right now, if they have a hundred million tokens, I don't think they can use long context transformers at all because it's way too expensive.”
Tengyu Ma Jun 6, 2024 ▶ 17:43 No Priors Ep. 67 | With Voyage AI Co-Founder and CEO

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.