The Ledger, every show

“If I have an AI model go generate a contract, and I generate a contract 20 times, and, you know, all 20 times, it's just three percent different. And, like, that, I, that, that kind of slop introduces all new kinds of risk for my organization that the code ver…”

“I've been fully convinced that the whole agent observability and eval space is going to be a massive space. I'm super excited for what brain trust is doing, excited for, you know, Langsmith, all the things. And I think what you're going to, I mean, this is lik…”

“There's a part of the company that is sort of do or die for the agent wave. And it only happens to be more of my focus simply because it's existential that we get it right.”

“The thing that I think is, is probably going to be a much bigger The idea over time is any agent on any system, again, using Box as a file system for its work.”

“DevRel is hot, like the hottest thing of all time right now. I like, if you could produce a fricking factory of DevRel people, like there's just like unlimited jobs right now on the other end of that. Cause we're gonna, everybody needs their Services and APIs …”

“Most of the economy does not have enough engineers to then maintain all those systems, to update to all those systems, to figure out the relationship between the business problem and what the code needs to do to go and actually manage that.”

“In five years from now, both, they will be, you know, a hundred times bigger in inference. Anthropic will be a hundred times bigger in inference. Gemini will be a hundred times bigger in inference and so on.”

“I don't think any lab would ever change the answer that it's giving based on advertising. I think it's going to give you the answer and then it's going to give you related and recommended things from, you know, from the bidding system.”

“I just don't think that open AI has a challenge raising money. So I don't know that. I don't know that there's sort of some kind of pressure that can be exerted on them from the cap table side.”

“You're not in an IDE. You're not coding alongside it. You're just setting off a task, and it's going to go and do a bunch of work for you. And now, obviously, it's very clear that that's the dominant paradigm that we're going to be in. Codex has proven it. You…”

“And we will wake up in five or 10 years and it'll actually kind of feel like relatively normal. Like it, there's not going to be some kind of crazy. It's not going to be the sci-fi movie. It's going to be that, that, that we just have incrementally better cons…”

“About 30% of our code right now Is, is coming from AI.”

“I will regularly talk to three, five, ten-person startup founders that, that self-report they might be getting somewhere on the order of, like, three to five to 10 X productivity improvements.”

“By 2005, other than the fact that our resources were in the cloud versus, you know, you had to go to a data center. In our case, we actually still went to the data center. Like, not that much about the company building process was different. Today, in 25, ever…”

“There, there's like all, there is incumbent advantage in distribution, but that is it. There's no other, other real advantage.”

“And they're not going to retool their entire internal engineering workflows to move at 10 X the pace. And so a brand new startup can go and do that and then instantly get the scale of a larger company.”

“So this is why, this is just lays the foundation for why we're going to see just a massive upgrade cycle in the enterprise.”

“You need to have purpose-built solutions that, that solve sort of tailored use cases. Those can be very big use cases, like all of AI coding, but you probably don't want to be in a position where you have to kind of bootstrap this or build it all out yourselve…”

“This is not a panacea type of solution where you could take an existing workflow, drop AI directly into it, and then all of a sudden that workflow will be, you know, three X better. You usually do have to re-engineer the work to take advantage of AI.”

“Claude this week announced a new capability that will generate files for you, and even though we're two and a half years, you know, nearly three years into the ChatGPT moment, it's the first time Where an AI system can, I believe, generate reliably a kind of h…”

“As long as you are really good about what context you're giving the AI and how you are effectively grounding the AI in trustworthy data with the right kinds of prompts and a high enough quality model. you can nearly eradicate the, you know, all of, if not th…”

“Like if Pfizer or Eli Lilly took a little bit longer to adopt AI as a result of, you know, wanting to be more pragmatic, that'll be totally fine. They're not going to get disrupted. Like they have enough of market position. They have enough distribution. They …”

“The companies just mentioned, like, I don't think the, those spaces have been so utterly disrupted that, that that they can't catch up once they land on a final architecture.”

“We don't need any kind of new breakthrough architecture. We have the, we have an architecture that, that already kind of works as the core scaffolding for agents.”

“It won't just be like, oh, it's CRM, but with AI, because Mark Benioff in Salesforce is going to do CRM with AI. Like he's going to figure out a way to do that. He's they're very good at executing like that will happen.”

“Agents basically completely blows that up because all of a sudden you can have AI agents that effectively contain the labor of that job function in the software itself. So you can go to a company and you can say, I know you only have three lawyers, but my agen…”

“If your market is not truly transformed by AI, don't touch it. It's not, it's just not worth it because you're going to be fighting against a headwind that is just unnecessary to fight against. Like go after markets where AI like fundamentally changes like the…”

“Where the expert engineers are like, I don't mind that it's a slot machine where I'm pulling it and I see what comes out because I know I can still get 10 X productivity.”

“I think prompting doesn't go away anytime soon, simply because the leverage you get on the set of instructions you're going to give the AI at the start. It's still going to be massive.”

“I don't perceive that open AI is constrained by anything strategically at this point vis-a-vis the Microsoft relationship.”

“They have a model called Grok for Heavy that has multiple agents go off and execute basically the same task and then go, they go and review their answer for, Which answer they think is, these agents think are the best result. And so this is a great example of …”

“I thought it was obviously a ridiculous You know, ridiculously bad situation deeply, obviously, you know, offensive and dangerous, but also not really that much of a meta story about AI simply because you can get these models to do anything you want.”

“So I would more bet not on one of these very large multi-tens of billions of dollar deals, simply because there's other paths to get there that are not as complicated.”

“David Solomon at Goldman Sachs, Has given this anecdote of they can write now an SEC filing or an S one for an IPO in like a few minutes that used to take a number of analysts, you know, a few days.”

“Well, until you, until the human literally is not a seat on the system, I think you don't remove the end user license as a component.”

“For startups in the AI world, the equivalent of that is I think there's a lot of categories now where there is no actually software incumbent in that category where AI agents all of a sudden let you go build software for that category. Legal, healthcare, educa…”

“I think if you ask like 90%, if you ask the world population, you know, you probably find that 90 plus percent just don't care enough. They just don't like, they don't care about the tabs on their software and the modules on their dashboard. Like it's like the…”

“You can now put together an otherwise million dollar marketing video for a couple hundred bucks of tokens.”

“Think about AI is actually a change to the labor model of using the software. So what can you do in a world where you can effectively create digital workers that That can go automate anything, you know, within the confines of your software.”

“So the whole idea is what if you can have agents across your enterprise software talk to other agents in other enterprise software And I think for all of us as an ecosystem, this is going to completely change what interoperability looks like, what the future o…”

“So, so we can now effectively think about our software as having labor attached to it, which for all of us building enterprise software is like a completely mind bending, you know, concept where we're no longer just limited by the number of people that we sell…”

“What is the new network effect in a world of AI? And it's some degree of that user working with an agent to create something by creating something that data feeds back into the agent's futures capabilities. And you get this sort of flywheel that, that ends up …”

“We send it 500 documents, and we ask for 40 data fields back from the documents, and so it has to get every single data field correct, and we only do a single pass, so we send the document to the model, we get a single pass back. Right now, the best score is a…”

“I don't think we made it too hard to go public. I think actually it's good to have a, of an, a heightened degree of scrutiny and regulatory pressure on being a public company. It is, is, absolutely net positive for the average shareholder that we have all of t…”

“You probably shouldn't vibe code into production yet.”

“If you ask it to pull out data from a short document, it's going to basically be a hundred percent accurate on that. If you ask it to pull out data from a 200 page document, And you only give it one shot to do it. It's going to get 75% accuracy.”

“But like, I don't, I just don't think we're at peak software. Like, if you go to the businesses and government agencies that I've been to, We're just, we're, you know, we are not at like peak digitization.”

“I think that the startups that are doing something more disruptive, i.e., you know, pure agents that, you know, go after a particular role or function, like those will probably work better than trying to be like the AI CRM company.”