Portkey

“So that's the simplest harness, which is make an LLM call, make a tool call, and then make the loop again, which is just a continuous loop. And that alone is so much more powerful than just a simple Q and A because it's now taking actions. It's telling you nex…”

“Production companies make money and are And see just much higher adoption than developer-focused companies.”

“There's a new class of these applications called harnesses, which are becoming very popular, so look at ClaudeCode, Cursor. They're essentially harnesses in a way that they're applications, but they help you use the underlying models a lot better.”

“People are no longer worried about cost of AI. They're worried about return of investment, which is like, okay, I'm happy to spend 203 hundred dollars a month on Claude code, but the value that I get from it is much, much higher.”

“Every API request is literally that has a dollar value to it. Like an Opus request with 10,000 tokens is probably 23 cents, and this is, you're making a thousand requests, which means this is 23 dollars worth of API requests that you've made today, or two 30 d…”

“Slowly from then on, it went into, hey, can I start solving software bugs through the same assistant as well? That started happening. So my team started seeing me making more commits and they're like, how are you on calls and still making commits here? Because…”

“Our top two models used to be GPT-Foro, GPT-Five Mini, plots on it. This used to be a top three for a long period of time. Now our top three averages checking between was, is Gemini 2.5 pro, Opus 4.6, Sonnet.”

“I would assume we are probably .5% of total AI API traffic today.”

“So we've got a very large open source footprint. That's almost a half a half a million installs of the open source system across companies.”

“For the first time, we saw four, six Opus, which is the costliest model there is right now, is at the top of the charts in terms of number of tokens spent.”

“And we see, obviously again, software development, engineering teams using it is the highest. Knowledge work is the second, which is large consulting teams or large business teams that are preparing proposals, et cetera.”

“There are so many companies coming out and saying, 80% of all of my code base today is written by AI, and that is truth, and that's what we're seeing everywhere as well.”

“If I'm building my AI systems, I need my LLMs, I need my databases I need my operational platform, which is the control plane, like Portkey, and then I need my application harnesses on top. So this is almost like a very simplified enterprise AI architecture, b…”

“So I think we were probably doing a billion tokens a day a year back. Now we're doing 15 trillion.”

“And we've almost, I think, on Tenex in LLM spend in just four months. And that's because we've seen.”

“Almost the software world is getting divided into two. Either you can be an AI lab, which is the intelligence, you're building models, you're doing new stuff. Or you have control over this traffic so that you are doing the harness, application, ops, all of thi…”

“I think we must have talked to at least 30 to 35 customers of Portkey and their competitors to truly understand the space.”

“They got some of the most discerning customers on the planet, right? So, people like DoorDash, Epic Games, Albertsons, Community Bank of History PG&E.”