YaRN
product on 5 shows · 5 statements across 5 episodes · said 7 times in 4 episodes since 2024
the a16z Podcast 3 
Latent Space 2 
In Depth 1 
the Startup Ideas Podcast 1 
the MAD Podcast
Mentions by year, every show
tap a year for its mentions
the a16z Podcast 3Latent Space 2In Depth 1the Startup Ideas Podcast 1
2024 7 mentions in 4 episodes 2 per episode
- The Quest for Community-Trained Open Source AI Models
- How to train a Million Context LLM — with Mark Huang of Gradient.ai
- Create an AI Voice Character app only using AI in less than 40 min (Cursor, Next.js, Daily Bots)
- The secret lever Replit pulled to scale ahead of its competition | Amjad Masad (Co-founder and CEO)
- every mention in 2024, scene by scene →
every mention on every show, scene by scene, with the transcript →
5 statements about YaRN, every show
Schmidt: ChatGPT, Llama, and DeepSeek use Nous Research's YaRN context extension
“Bone here is the lead author of a method we developed called YARN, which is a context window extension method that we released and did the research on. It is now used by every, every model you use nowadays, everything, everything Chachipiti, Lama, DeepSeq, all…”
Huang: Modern LLMs have shifted from ALiBi to RoPE scaling
“Some of the newer architectures don't actually employ it a lot. I think the last architecture that actually really employed it was the Mosaic MPT model class, and then almost all the models these days are all rope scaling, and then effectively you can use yarn…”
YARN and Mesos enable modern on-cluster business intelligence
“On cluster BI is something that's possible now. Thanks to things like Yarn, Mesos, we're seeing a whole new resurgence of operating systems.”
Groschupf: New computation frameworks should be built on Mesosphere, not YARN
“And if I would have to rewrite kind of the code I wrote in 2006, I would not necessarily write it on Yarn. I would maybe write a whole new computation framework on Mesosphere.”