LoRA
topic on 5 shows · 10 statements across 9 episodes · said 37 times in 18 episodes since 2023
Latent Space 21 
the a16z Podcast 12 
the MAD Podcast 2 
Mixergy 1 
20VC 1
Mentions by year, every show
tap a year for its mentions
Latent Space 21the a16z Podcast 12the MAD Podcast 2Mixergy 120VC 1
2026 7 mentions in 4 episodes 2 per episode
- The AI Memory Problem: Why Long Context Isn’t Enough — Dan Biderman, Engram Co-founder & CEO
- Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten
- ⚡️Every product of the future will be a living system — Ronak Malde, Trajectory.ai
- Mercor CEO: Why Application Layer Companies Have No Moat & The Cost of Hiring AI Researchers · 20VC with Harry Stebbings
- every mention in 2026, scene by scene →
2025 14 mentions in 8 episodes 2 per episode
- AI Engineering for Art - with comfyanonymous
- [State of AI Papers 2025] Fixing Research with Social Signals, OCR & Implementation — Team AlphaXiv
- #2290 He’s building an AI media empire
- How OpenAI Builds for 800 Million Weekly Users: Model Specialization and Fine-Tuning
- Google DeepMind Developers: How Nano Banana Was Made
- A Technical History of Generative Media
- The Future of AI Video: How Fal.ai is Making AI Video Faster & Easier
- AI Video Is Eating The World — Olivia and Justine Moore, a16z
- every mention in 2025, scene by scene →
2024 14 mentions in 4 episodes 4 per episode
2023 2 mentions in 2 episodes 1 per episode
every mention on every show, scene by scene, with the transcript →
10 statements about LoRA, every show
Atallah: Model base layer fine-tuning could drop to dozens of dollars
“We might see a future where, like, when you do a fine tune, and you want to, like, change the base model layer, it only costs, like, maybe a few hundred dollars, maybe a few dozen dollars to change it.”
Updating mobile base models breaks per-app LoRAs, creating severe maintenance hurdles
“From a developer point of view, I think it will be very tricky because one, you don't want to have 20 different base models in the phone of the users. The battery will just die. You also don't want to have to update 20 LoRa every time you update the base model…”
Santos: Dream Stories used ChatGPT, Stable Diffusion, and LoRAs for consistency
“We use a number of things. We, at the time we used the chat to PT. We used the stable diffusion. I forget the first model we used. We used to do it. We used LORAS, which was we still do in some regards but LORAS is something that, you know, that you literally …”
Corbitt: No downside to using LoRAs for task-specific model customization
“For the types of training runs that we're interested in, where it's like, hey, I'm doing a relatively lightweight customization of an existing model for a specific task, there's really no downside to using Allura, and there's a lot of, like, upsides from an, l…”
Eugene Cheah: LoRAs will arrive before full Llama 3.1 405B fine-tunes
“I suspect we are going to see more LoRa's first before we get full fine-tuned.”
Fine-tuning a GPT-3 class model with LoRA provides a 10,000x efficiency boost
“I think for something like a GPD three level model, it's a 10,000 X speed up in efficiency while losing nearly not much at all in accuracy.”
Combining MoE and LoRA will eliminate big versus small model trade-offs
“And I do think that's the future so we can get something that is incredibly smart, incredibly huge, but with the latency cost and speed of something, something tiny. So no more big model versus small model paradigm. It's potentially one in the same.”
Rombach: Managing hundreds of LoRAs is unscalable for video control
“Maintaining like a library of hundreds of LoRa's is maybe not like the, Most scalable approach.”
Doshi: LoRA Stable Diffusion Creator Simu Works With Playground AI
“The person that brought Laura's to stable diffusion actually works with us on, on some projects. His name is Simu”