The Ledger, every show

“So will AI spend surpass cloud spend? I a hundred percent believe that, which means that the AI ops spend surpasses DevOps spend. It's bound to happen.”

“There are so many companies coming out and saying, 80% of all of my code base today is written by AI, and that is truth, and that's what we're seeing everywhere as well.”

“In the current format, SAS companies will just become systems of records. So you had the database, which got obsolete because of a SAS platform, which is just crud on this database, but interesting crud on this database. Now, SaaS platforms I think are the new…”

“Like if you're going and asking for a 100,000 budget or a 500,000 budget, except AI, there is no spend happening in any other software category.”

“In fact, I would say in production, 90% of the use cases do not use automatic routing. What they want is deterministic flows. As long as the gateway manages authentication authorization for them, it's perfectly fine. The request hitting A specific model that t…”

“So I think we were probably doing a billion tokens a day a year back. Now we're doing 15 trillion.”

“For the first time, we saw four, six Opus, which is the costliest model there is right now, is at the top of the charts in terms of number of tokens spent.”

“Almost the software world is getting divided into two. Either you can be an AI lab, which is the intelligence, you're building models, you're doing new stuff. Or you have control over this traffic so that you are doing the harness, application, ops, all of thi…”

“Our top two models used to be GPT-Foro, GPT-Five Mini, plots on it. This used to be a top three for a long period of time. Now our top three averages checking between was, is Gemini 2.5 pro, Opus 4.6, Sonnet.”

“And again, you can decrease latency massively by building this on the gateway. Rather than building this within your application.”

“I think the future of agents, the way they connect to different services is going to be MCP.”

“I would assume we are probably .5% of total AI API traffic today.”

“This year, next year, you are going to be like, spoke to this person, this is what happened, update my recall. I think that is the world that is like very real. I think it will happen.”

“And we've almost, I think, on Tenex in LLM spend in just four months. And that's because we've seen.”

“In reality, we've seen what gets deployed the most is regex-based guardrails to say, you know, I want to catch for specific words, and then take certain actions based on that. Or I want to catch for empty outputs.”

“I think it's not used as much. I agree. And I think that's something I tell every customer that you need to close the loop and feedback is going to help you. I think the teams that are doing it are really happy. They're not doing it.”

“I think the output side of things will come. Once we've reached stable state, where there are production applications that are stable, and then they want to start optimizing, is when they'll start looking at human feedback as well.”

“I would imagine like with more ambient agents coming in, there might not be a clear start and a clear end. So, it'll be interesting to see how we start solving this problem. Maybe the whole concept of, you know, there's a typical start and a typical end goes a…”

“The more they want platforms like this, and I feel this is similar to what happened with the cloud era back in 2012. You will not have cloud adoption till the time DevOps did not take off, and companies like Datadog, Cloudflare, et cetera, didn't help you buil…”

“So we've got a very large open source footprint. That's almost a half a half a million installs of the open source system across companies.”

“So the gateway, when it runs, has a memory footprint of like, 21 MB, and the way we've been able to do it is just using a very interesting architecture where we're using transformers in JSON to do everything out of the box.”