Prediction Open · timeframe Mar 2031
Agarwal: AI operational spend will surpass traditional cloud DevOps spend
“So will AI spend surpass cloud spend? I a hundred percent believe that, which means that the AI ops spend surpasses DevOps spend. It's bound to happen.”
Assertion Not checkable as stated
Agarwal: Claims that 80% of code is AI-written are accurate
“There are so many companies coming out and saying, 80% of all of my code base today is written by AI, and that is truth, and that's what we're seeing everywhere as well.”
Opinion
Agarwal: Anthropic's Claude Code is killing the standalone vibe coding startup market
“It is killing that market. I think there is, that market is now finding its own niches, and Anthropic clearly realized that if 50% of my API revenue is going to come from vibe coding, they will Claude code and be like, I can still build the best vibe coding sy…”
Insight
Agarwal: AI startups must prove they offer better returns than backing Anthropic
“And I've heard this in conversations where a VC would be like, do you, do I invest in startups, which is like a risky business and I'm still getting a 10 X return or do I just put my money in Anthropic and I'll just get a 10 X return without doing any work. So…”
Prediction Not checkable as stated
Agarwal: SaaS will become systems of record while AI agents handle execution
“In the current format, SAS companies will just become systems of records. So you had the database, which got obsolete because of a SAS platform, which is just crud on this database, but interesting crud on this database. Now, SaaS platforms I think are the new…”
Assertion Not checkable as stated
Agarwal: Enterprise software budgets have stalled entirely outside of AI initiatives
“Like if you're going and asking for a 100,000 budget or a 500,000 budget, except AI, there is no spend happening in any other software category.”
Opinion
Rohit Agarwal: Retool is no longer very popular
“Retool is no longer very popular, but we were heavy users of it, like in 20, 20, 21.”
Insight
Agarwal: Production software infrastructure makes more money than developer tools
“Production companies make money and are And see just much higher adoption than developer-focused companies.”
Opinion
Agarwal: 80% of engineering tasks can be automated with AI
“80% of this work, I think can be automated with AI.
I still believe you need the last 20%.
So there still has to be a manager of these agents who's telling you,
Okay.
Do this.
Don't do this.
but outside of that, 80% of the work is still getting done fa…”
Assertion Not checkable as stated
Agarwal: Portkey routes 15 trillion tokens daily, up from 1B
“So I think we were probably doing a billion tokens a day a year back. Now we're doing 15 trillion.”
Opinion
Agarwal: Existing AI components suffice to build better systems without new innovation
“I feel that today, even if all innovation were to stop, there is enough fuel in the AI space to see you can still continue to Pick up these Lego pieces and still keep building newer and better systems.”
Opinion
Agarwal: The AI bubble is in valuations, not utility
“So the bubble might be on the valuations. The bubble is not on utility.”
Assertion Contradicted
Agarwal: Claude Opus 4.6 leads Portkey volume despite being the costliest model
“For the first time, we saw four, six Opus, which is the costliest model there is right now, is at the top of the charts in terms of number of tokens spent.”
Insight
Agarwal: 20% stock drops after AI announcements force legacy SaaS into agents
“ServiceNow and Salesforce and Workday and all of these companies are being pushed to innovate. Like in other cases, they're like, we have large go to market motions. There's a revenue that we can easily protect and you don't have to, but because they see these…”
Opinion
Agarwal: Codex is better at writing code, but Claude leads in planning
“Everybody's still saying that Codex is a better model for code generation today, but people still use Claude to think, brainstorm, plan, and then once the plan is ready, it's like, okay, now Codex implemented. Codex is much better at writing code.”
Insight
Agarwal: Vertical AI survives because specialized niches aren't frontier labs' priority
“In their top three priorities, killing Harvey will not be their top three priorities. I mean, they're like, how do I make the next hundred billion in revenue? So, I mean, that is their thought process. So then Harvey can always be like, okay, then my top goal …”
Prediction Not checkable as stated
Agarwal: Software is bifurcating into model labs and traffic control planes
“Almost the software world is getting divided into two. Either you can be an AI lab, which is the intelligence, you're building models, you're doing new stuff. Or you have control over this traffic so that you are doing the harness, application, ops, all of thi…”
Insight
Agarwal: AI coding tools are pushing enterprises to build rather than buy
“Everybody is now saying, let's build first instead of buying first.”
Insight
Agarwal: AI gateways manage material per-request costs unlike traditional API gateways
“Every API request is literally that has a dollar value to it. Like an Opus request with 10,000 tokens is probably 23 cents, and this is, you're making a thousand requests, which means this is 23 dollars worth of API requests that you've made today, or two 30 d…”
Assertion Not checkable as stated
Agarwal: Gemini 2.5 Pro and Claude Opus have overtaken OpenAI models
“Our top two models used to be GPT-Foro, GPT-Five Mini, plots on it. This used to be a top three for a long period of time. Now our top three averages checking between was, is Gemini 2.5 pro, Opus 4.6, Sonnet.”
Insight
Agarwal: Claude Code and Cursor act as harnesses for underlying models
“There's a new class of these applications called harnesses, which are becoming very popular, so look at ClaudeCode, Cursor. They're essentially harnesses in a way that they're applications, but they help you use the underlying models a lot better.”
Insight
Agarwal: Visibility and spending control are enterprises' two biggest AI anxieties
“The two emotions people are very worried about in the AI world, especially larger enterprises, is I don't have visibility on what's happening. It's a black box. It goes wrong. It hallucinates. It can cause problems. My agents can break a lot of these things, r…”
Insight
Agarwal: Production enterprise AI standardizes on three core architectural layers
“If I'm building my AI systems, I need my LLMs, I need my databases I need my operational platform, which is the control plane, like Portkey, and then I need my application harnesses on top. So this is almost like a very simplified enterprise AI architecture, b…”
Insight
Agarwal: Continuous tool loops deliver exponential value over LLM Q&A
“So that's the simplest harness, which is make an LLM call, make a tool call, and then make the loop again, which is just a continuous loop. And that alone is so much more powerful than just a simple Q and A because it's now taking actions. It's telling you nex…”
