AI agent

“He's worried about there's going to be a world of just sort of like all these AI agents that are out trying to do malicious things, and that we're going to need like our own like good defensive AI agents out there making sure we don't get scammed out of all of…”

“What we're going to see out of reasoning, out of long thinking is that it's really going to unlock the possibility of agents to do actions on your behalf, which, you know, has sort of always been possible, but it's just never been quite good enough.”

“10 years from now, this may be the standard to interact and control and monitor a lot of these agents. If they're truly everywhere and doing, you know, so much of the work that we as humans don't want to spend our time doing, this is going to be the way that w…”

“The AI agents, incidentally, will do exactly the same thing. They will absolutely, like, The AI agents will bullshit you just like a human employee will if you don't, like, if you're not technical enough to, like, call them out on their bullshit and be like, n…”

“These agents aren't good at writing from scratch. They're good at processing instructions and doing and turning them into some text output, right? For code, that's actually really useful, right? If I can describe in English what I'm looking for, An agent can o…”

“It also kind of feels like learning how to manage a person. Where it's like, how do I actually communicate you know, the things that they need to know in order to make a good decision? And how do I make sure that they know you know, how I'm going to evaluate a…”

“When I see things like, oh, twenty-twenty-five is the year of agents, I get very concerned, and I kind of feel like, you know, this is the decade of agents, and this is going to be quite some time. We need humans in the loop.”

“If I look at the next frontier, I would say there are three things, right? One is memory the other one is tools used, and then the third, which I think is perhaps the most important thing, is entitlements which is basically, if I'm gonna take action, what enti…”

“Because one thing that we don't talk about is the legal liability, by the way, until some real laws change, are going to be with humans and institutions humans build. And as long as that is true, we're gonna have to really make sure the human is in the loop, a…”

“Yeah, I mean, I think that has been the dream, which is, can these agents Become your computers. And they do the computer use for you. And that absolutely, I think is the direction of travel.”

“What I think will happen is all of us are going to be creating software, but there is going to be a job called a software engineer. It's going to be different, but I look at it, right? You are really taking a software engineer and saying you're now a software …”

“Now, like having a sophisticated reasoning model and your prefrontal cortex work together whereas a lot of the mundane Stuff is getting done by even some core agent or what have you. That I think is definitely the frontier.”

“Usage-based pricing. Where people are paying an agent for completing a task, or people have recurring tasks, and they pay based on, you know, every single use of the task, and they normalize this system based on, like, how much it would take to hire a person t…”

“I'm kind of viewing it as you're more and more entering a workspace of reviewing Work than actually doing it. And you are managing the expectations from your clients and the expectations and the work from your AI agents, right? You're effectively instructing t…”

“Probably in five years, we'll look back, we'll be like, well, AI agents, there wasn't even a thing at all, right? We were actually doing all these different things.”

“Agents that can write code, ah, is actually the easy part. The hard part Is the infrastructure around it. Sometimes I call it the habitat for which the agent lives in.”

“So around, you know, late 23, early 24, we decided to put all our resources into agents.”

“I don't think we're going to get to a point where you can go tell an agent, hey, go find me a, you know, business idea and go test all of them. I don't think we'll get there anytime soon.”

“I keep telling my team, we need to be okay with building crappy products today, ah, because two months down the line, the models will get better, and your business, your product will suddenly become viable.”

“And this idea of like a sovereign individual, someone so empowered by technology, so empowered by these agents. That is able to create enormous amount of wealth individually is, is is, is going to be the norm.”

“Making sure that, because as you go longer, the, there's like an, ah, there's like a goal drift. The agent might start doing things that you don't like, but having those guardrails of testing along the way, ah, will make it so that it stays more coherent, ah, …”

“I think there's a limit on how much the training can increase reliability, but I think the environment feedback and the ability to try things really fast is the way to get to the upper echelon of reliability.”

“Or plus, which I assume we're going to get to in the next couple of years, you can really spin up a thousand agents, give them a lot, thousand problems, and reliably be confident that like, 95% of them is going to work.”

“If we go 10 years into the future, The vast majority of work that gets done in 10 years from now will be work that today is in that category. It's the work that like right now we can't even attack because we're like, I'm not going to hire somebody, pay them a …”

“Agents basically completely blows that up because all of a sudden you can have AI agents that effectively contain the labor of that job function in the software itself. So you can go to a company and you can say, I know you only have three lawyers, but my agen…”

“Because I think incumbents are only going to be the agent providers for their existing install base, which means that there's going to be tons of opportunity for so many more agents that those incumbents aren't already selling into.”

“And I think that's exactly what we're seeing happen with crypto right now is that crypto is plugging in as a platform. That enables agents to transact natively. So instead of going and trying to operate in a browser over the legacy rails, they just call the sm…”

“Do not give it access to emails would be my number one piece of advice or probably anything. Cause it's not clear how safe it is. And it's probably almost certainly gonna probably a lot of people being prompted injected by it right now”

“I think that's a natural next step. Like, okay, I'm gonna book a restaurant. My bot will reach out to the restaurant bot and do the negotiation. Like, because it's more efficient.”

“Developing an intuitive fuel, like a hands-on fuel for The agents, their limitations, their capabilities, and very specifically around what we're talking about here is like, what type of tools the agents work well with? where do they get stuck? And once you s…”

“And APIs. They hate using websites. Yes. They only, like, they want to use APIs. They want to write code.”

“Agents are, like, not legal entities that could, like, sign documents, for instance. So, you know, as long as that's true, like, you actually, like, need a human to be, like, the liability sink and to be, you know, to have standing.”

“The whole idea of, like, the human money versus agent money, like, that's kind of where this probably goes at some point, is, like, the, right now the agents are transacting, if you have them transact, they're going to transact in human money, because that mak…”

“I think by end of the year you'll have, you know, agents which are running for hours. And like maybe hundreds of agents collaborating on the single task.”

“If you can solve for verification, which is essentially, you know, you can solve the testing part you can actually automate all the software engineering. That was sort of our key insight that like, you know, verification is the loop, which sort of keeps agent …”

“What we found out is that because AI agents are able to take on the simplest part of the workflow, so they're able to triage 99% of cases, that one percent is usually going to be the most complex cases that need to be reviewed by a human, and you need a really…”

“There's really only three building blocks that you need. So you have the compliance documents, the standard operating procedure, so what the company deems As necessary to verify at the onboarding level or at any other parts of the life cycle of that entity. On…”

“You don't need a classifier anymore because AI agents are able to read a set of standard operating procedure and reason over an image or reason over sort of unstructured data and know that this is possibly chargeback fraud. You don't need a specialized classif…”

“You have to have an active system that can actively solve problems for you to get to AGI. That was always clear to us. So agents are that path.”

“I think that's one of the not having continual learning currently is one of the things holding back agents from doing full tasks. You know, I think they're really useful for aspects of tasks right now, and you can patch them together and do some really cool th…”

“I haven't seen the result yet, which I would expect once this is really delivering that full value, which I think will come in the next six to 12 months.”

“I think the conclusion that this essay points to is that as we get better at building AI native software. It's going to look a lot more like the agent wrapping software deterministic tools rather than deterministic software wrapping an AI.”

“It turns out that, like, the thing that was hampering the world was being worried about security and privacy and all the things that could go wrong, and when you, like, worry a bit less, you're like, oh my god, these things are unbelievably powerful.”

“We have this general agent that every night will go, And read through all of the agent conversations that employees have had, and look for things that could have done better, and pieces of context that if it had, up front, it would have done more efficiently.”

“A lot of what I see with companies is they spend a lot of time getting An agent working, but never thinking how to make the agent improve every day. And I think that's like always the biggest unlock.”

“Whenever someone has a conversation with the agent that is the flags an issue or a bug or something that feels like the conversation didn't go as smoothly, that creates a bug. That bug triggers an agent that's going to go and modify the code base and the promp…”

“You should separate the agent that, and the systems that are actually emitting code from the system that is talking to customers and the system that is reasoning about the conversations with customers and translating into product roadmap. Basically three separ…”

“And so I think controllability is probably the single biggest breakthrough that we need for agents at every single level.”

“And now I actually think with the power of agents and AI broadly speaking, it's much closer to Goliath versus Goliath. Like, I think, but maybe the startup is like a mecha Goliath that is like vastly enhanced by the power of agents and AI, and you know, the la…”