Neil Movva, co-founder of Sail Research, argues that agentic AI workloads will shift from real-time low-latency generation to hours-long persistent tasks optimized for compute efficiency.
“You wanted more persistence, more long horizon tasks, and now it's, to me, very obvious that the future of agentic inference is long horizon tasks. You're gonna run the machine for hours or days at a time. It doesn't matter if it spits out tokens at a hundred tokens per second. Maybe 10 is just fine. If that comes with Corresponding advantages and efficiency.”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from Neil Movva
Opinion
Losing TSMC Wouldn't Be Disastrous Because Intel Is Only 2x Behind
“And my contrarian take is that it wouldn't be that bad. Supply would take a shock for sure, but The best processes that we have in the West, like Intel, not that far behind, at worst, like maybe two X worst performance per watt. And the gap is just far smaller…”
Neil MovvaAug 25, 2026▶ 1:17:13Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
Disclosure
Movva: Sail Research will buy data centers with only 95% uptime
“You'd have missing zero buyers for a data center that is 95% uptime. I'm that first buyer. I will buy 95% uptime.”
Neil MovvaAug 25, 2026▶ 57:26Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
AssertionNot checkable as stated
Nvidia's BF16 Efficiency Barely Improves Across Hopper, Blackwell, and Rubin
“If you look at, you know, Hopper to Blackwell to Rubin, and you compare like for like, what is the performance per watt of a beefload-sixteen multiply? It hasn't improved all that much.”
Neil MovvaAug 25, 2026▶ 1:16:40Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
AssertionNot checkable as stated
TSMC Performance Per Watt Barely Changes From 5nm to 2nm
“If you look at TSMC five nanometer versus four versus three versus two, the performance per watt on these chips doesn't change like a dramatic amount.”
Neil MovvaAug 25, 2026▶ 1:16:56Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
AssertionNot checkable as stated
Cursor Forced Baseten, Fireworks, and Together to Prioritize Low Latency
“The challenge is, all those companies, you could take your pick, Base-Ten, Fireworks together, they all focus on low latency inference. And they were pulled in that direction by one very important customer Cursor.”
Neil MovvaAug 25, 2026▶ 3:42Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
PredictionNot checkable as stated
AI Workloads Will Eventually Shift to 90% Background and 10% Real-Time
“So long-term, I think, you know, we're going to end this year at maybe fifty-fifty background and real-time workloads, but I see this going to ninety-ten in favor of background.”
Neil MovvaAug 25, 2026▶ 6:25Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 60 episodes transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.