The Ledger, every show

“We are starting to see more evidence that models are going to own that more than the 10%, ah, you know, whether it's the new plugins that, ah, you know, Claude has released that shook up the whole SecOps market.”

“I think the, they're gonna get more expensive as the models get better the compute needs are gonna, you know, increase, and then you're gonna get better.”

“So there is a time in the next year and two where we'll start to see these directionally, yes all the token prices are going down. But as the models are maturing, we are starting to see that, you know, the opposite effect as well, where, you know, the cost is …”

“The inference market is one of the largest or so the fastest growing CAGR. So what we are seeing is about 94% CAGR. And then, you know, today, I think around 20, 26, we are looking at an eighty billion dollar sort of market. But soon by 2030 it's gonna be a 1.…”

“I would say enterprises don't optimize for accuracy of a model, right? So they're more so optimizing for reliability and trust. So it's very it's very, I think, in today's age with this new, ah, level of capability that the models have, getting the accuracy ri…”

“The advantage is towards startups who get this right. Because I can't imagine an existing behemoth going back and saying, okay, now I already have your trust in you know, reliability and everything. I can take care of that, but I'm going to reinvent and now be…”

“Anything that has a human-to-human touchpoint should be the last one that should get automated. Today we're just probably seeing that first, ah, sort of spike, but then that should probably, you know, die out soon, I feel.”

“It's a great product disguised as services. So it's, I'm sure there's merit to the product but the launching vehicle is services, right? Because these are hard to understand products that you have to take to the customer.”

“Until then, I wouldn't say, don't even pretend that you're building a product because that'll hurt you more than it'll help you. Because you're basically thinking that you're building product, the cycles go there, but then they'll really just start to look lik…”

“Having said that, I think it's also very difficult to get things right because the same three things are accessible to everyone. So really to stand out and then build something amazing in this day and age is going to be you know, exciting nevertheless, right?”

“Every month, if you will, there is a new model, right? That's beating the old model, and visibly adopted already, and people are moving to the new models and the data is just flowing, like you're generating data, you're sort of getting access to new data creat…”

“The whole big bet of open AI, you know, trying to build these target and other You know, big data centers is not that they just want to train on this, because that cost is a one-time cost, right? So you train ones, you sort of run inference for a lifetime. So …”

“And I'm betting that I'm, companies like Sierra and others will figure this out soon. But if they don't, then I think the spike has to come down.”

“Voice to me is still going to be the frontier through which people will interact with AI.”

“When you build something, you typically build with the CTO in mind, thinking I'm going to build this and I'm going to go and sell to the CTO. The CTO is where you sell, but then you actually get a check from CFO, where it's used by the CAO. So all of that mapp…”

“You need to think of your first customer, not in terms of revenue, but in terms of credibility, right? So they've added so much credibility to my tag that I could actually I didn't even have a startup at that point, but whatever I started afterwards, with this…”

“So, the boldest thing that we did was we did not renew the contract with Walmart, because they said, you know, continue the MLOps product, and we said, we'll be an LLM Ops company, and Walmart was not ready for LLM Ops at that point, but we said, okay, fine, w…”

“Today's AI you know, the problem of AI is not intelligence. But it's an integration problem, right? So you have to figure out how to integrate this into the right workflows, gain the right end users, and then sort of work with.”

“Enterprises are actually looking for solutions to their problems. And quite often what happens is the big companies that they're working with, the managers, the VP and below levels, like the directors and managers, they actually don't approve of the, Call it t…”

“And, you know, funny enough that the first customer for our MLOps product was Walmart, the largest giant in, in retail. And, you know, they bought it not for themselves, but they wanted to open it up for all their suppliers.”