Factory avoids parallel generation because the quality delta fails cost-benefit analysis
Eno Reyes · The AI Coding Factory · May 29, 2025 · at 47:26
Eno Reyes, co-founder of Factory AI, explains the unit economics and engineering trade-offs of parallel model inference.
0:00 / 0:16exact quote · 16.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Originally we had a lot of techniques that would generate a lot of stuff in parallel, and we still know how to do that. And we're very excited to bring that. But right now we don't do it because it's cost prohibitive and the quality Delta Is not enough to justify the cost increase.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Eno Reyes
Enterprises demand full AI delegation, not 15% to 20% speed gains
“I think that the product experience of delegation is really, really immature right now. And most enterprises though, see that as the holy grail, not like going 15% or 20% faster.”
Reyes: Inner-loop coding will soon be fully delegated to AI agents
“The outer loop of software development and what a software developer does, planning, talking with other human beings, interacting around what needs to get done, is something that's going to continue to be very human-driven, while the inner loop, the actual exe…”
Claude 3.7 Sonnet post-training heavily biases the model toward CLI tools
“So for example, Sonnet 3.7 clearly has it smells like cloud code, right? Same with codex. It very much impacted the way that those models want to write and edit code such that they seem to have a personality that wants to be in a CLI based tool.”
Reyes: Developers Should Not Need to Prompt Engineer AI Agents
“A lot of users we believe should not need to prompt engineer agents, right? If your time is being spent hyper optimizing every line and question that you pass to one of these systems, you're going to have a bad time.”
External scaffolding provides higher leverage for coding agents than fine-tuning models
“But our take in general is that freezing the model at a specific quality level and freezing the model at a specific data set just feels like it's lower leverage than continuing to iterate on all these external systems.”