AI model

“Now, if you move to specialized hardware that is sort of much more brain-like and that runs a bunch of you know, that sort of runs in parallel with a bunch of tiny little cores that, that you're going to be able to run these models sort of insanely faster.”

“The models bake in biases and preferences that were in the model and the data and the team that built it at the time that it was being constructed.”

“I had been telling people for a while, I thought that The level two to level three jump was going to happen, but then the level three to level four jump was, level two to level three was going to happen quickly, and then the level three to level four jump was …”

“I think we were hanging out with some AI researchers recently, and they were sort of disappointed that the models are not, you know, but they don't demonstrate as much human-like agency you know, even after all these innovations with, you know, climbing the sc…”

“It's, I think maybe the reason why these models are not great design yet, it's like on the art side you've got diffusion, on the problem solving side you've got LMs, and it's not clear that people have figured out how to, you know, marry techniques together ye…”

“By editing this system prompt, I'm able to explain to the AI model how I write emails in general, so that I don't have to do it every single time.”

“These AI models are now capable of doing things like that, where it's actually anticipating all of the things that will need to happen as a result of my daughter waking up with the flu and helping me do those things.”

“All of programming is going to flow through these models. It's going to look very different in the future. You're going to need to control the UI.”

“So I think it's still possible for anyone to build an app tier on top of a model, and you have to sort of abstract yourself and say, yeah, the model is just like SQL was to me. And so I think that, I mean, I always dreamt of a moment when AI slash machine lear…”

“And that's the reason why using exam-like benchmarks with AI models is a bad idea. They're not going to tell you how close we are to AI. Because human exams weren't designed to measure intelligence. They were designed to measure task-specific skill and knowled…”

“Eventually we imagine AI models or millions of AI models perhaps working together will be able to do the work That whole human organizations can do. They'll be able to do the kind of work that the entire scientific community currently does.”

“I would say that interpretability is a lot more like biology. It's a lot more like neuroscience. So I think those are kind of the tools. There is some more, more, more mathematics there, but I think it's more like trying to understand the features of the brain…”

“And an organization meter studied this very systematically and found yet another scaling trend. They found that If you look at the length of tasks that AI models can do, it's doubling roughly every seven months.”

“And this kind of picture suggests that over the next few years, we may reach a point where AI models can do tasks that don't just take us minutes or hours, but days, weeks, months, years, et cetera.”

“You know, if you look at some of these data providers, they've got humans reading information from say public filings and put it in that structured format. You know, the bulk of the work that we're doing, what we're seeing is models are already more accurate t…”

“I keep telling my team, we need to be okay with building crappy products today, ah, because two months down the line, the models will get better, and your business, your product will suddenly become viable.”

“There are people who are, like, trying to put stuff out that is, like, as damaging as possible for the model, you know, how can I make it past the filter and get into the model would be totally like secretly useless.”

“If there is a ceiling, then the commoditization for that task is going to hit much sooner, right? You actually can't stay on the edge longer by moving to the next model, figuring out how to prompt the next model. The task saturates, right? So the commoditizati…”

“The truth is, even if you have a perfectly aligned, you know, quote unquote, like intent aligned model, It's going to be used by a corporation or a startup to build an agent for that user. And then the question is, can you trust the startup that's building the…”

“What you'll find without any, these are for fine tuning, without any like technical fine tuning, you can go so far with just prompting. If you're being really careful about this, you will find that the AI gets things wrong predictably.”

“Maybe the model is the distribution then, like we're saying, and maybe similarly how for TikTok, It became about, obviously, the videos, and we can create a video, but you could also, like, you could let creators pull from the song catalog. You know, Instagram…”

“I think if you look at the capabilities of any of these models, It's like, they're very, very jagged. So there's some things they're exceptional about and there's some things that they're just absolutely terrible about.”

“The models themselves have incrementally improved this year, but there haven't been like major steps forward that have shaken everything up, which is, has a knock on effect. Many episodes ago, we talked about how it was It felt easier than ever to pivot and fi…”

“I think in some sense, you're right that like everyone is going to become a manager in the future, or at least that's my hot take. But in order to get there are steps along the way and you have to really build a lot of trust in the model and understand what it…”

“The whole idea, like there's these things that are like stochastic parrots or glorified autocompletes, like these people just don't know what they're talking about.”

“When you train AI models, like image models or, and even language models the representations that you get inside them look a lot like the representations you see in the brain.”

“Out of the box, the model wanders. It doesn't know your data well, so it guesses. And guessing at that scale is how you get plausible-looking code that silently breaks.”

“The bottleneck here is not Not the model's intelligence. As long as you set the models up right, they are already smart enough to do extraordinary work on your code base.”

“So there's just sort of huge gaps, I think, still, but it may only be one or two tweaks that are required to fix those kind of gaps, just to be clear, but I think that's pretty, pretty obvious there are there, and that's why you get this kind of jagged intelli…”

“One is what is the 10 X check? What is more ambitious and delivers 10 X more value for only two X the effort. Right. And so for whatever reason, coming out of latent space, this helps the model, like really visualize”

“The execution is out, right? The execution is gone and the model is going to do that better. The wisdom to choose is still, I think the. The missing bottleneck. And to me, that all comes from which signals are not in the models.”

“I think the best companies that I've met in YC, they are on the right side of model development. And what these models need is with a little bit of steering, with a lot of data, there's just so much alpha that you can derive.”

“And I think this is where folks with experience, folks that have spent, you know, decade plus in this industry, they know how to create something like this because they can leverage the model's underlying capability to create something that's just world-class.”

“I mean, I really think, I think we're at this, like, amazing moment in the world where the bottleneck is not the progress of the AI models. The bottleneck is diffusing that through the rest of the world and helping the world adapt to this amazing technology th…”

“I truly believe these models are already just incredibly powerful. Like, they should be so powerful to fuel, you know many, many points of expansion of GDP growth, and I think it's, like, up to smart people with vision and ambition to make all that happen.”

“There's no, ah, you know, real impediment to making that be a much more automated loop, where the model itself decides it's going to explore, or maybe with a nudge from some people, ah, at the various highest level, like, oh, why don't you try some new ideas a…”

“I think models are not necessarily going to be that good at it. So you're going to have people steering a lot of AI assisted computation in order to accomplish great things and more quickly. But that essence of what it is you want your models to do is the key …”

“The models have been getting a lot better at sort of agent-based, longer-running coding tasks, and it seems pretty clear that they are now actually pretty capable, and depending on exactly your definition of junior engineer, it seems pretty spot on, I would sa…”