AI model

“You know, we're not trying to be an AI model company. We're trying to help industries create AI models. Mostly we're trying to help developers.”

“I think you're at the level where it could probably generate things and, you know, I think it would still be a lot of, you know, human loop, but you could generate probably let's say I don't know, a class project type of project.”

“You can probably easily 10 X that, you know, I wouldn't be surprised if there's a five hundred million dollar model that's trained in the next year or two.”

“The data requirements tend to go up like with the square root of the amount of computation, because you're going to train a bigger model and then you're going to throw more data at it.”

“So, and at the same time, like, I don't think anyone's seen a wall in terms of how good this stuff is. So I think it will just, it's just gonna keep getting better. I don't know what stops it.”

“So I really don't subscribe to this view that there's going to be like one or five AIs. I think this is like completely misguided and fundamentally wrong. There are going to be hundreds of millions of AIs or billions of AIs, and they'll be aligned to individua…”

“Building in the open with open source is actually more part of the solution than part of the problem, because obviously control of power as you democratize it much more and biases you actually include in the process. People who are impacted by these biases,…”

“Models aren't products and infrastructure isn't a product.”

“In a world of AI, if you don't have highly organized, optimized, sanctioned, and trusted data, what do you want, you know, your models to do? Just kind of train on, on, on a data lake. I call it a landfill. You know, I mean, you have no idea what the hell is i…”

“You know, for entrepreneurs or startups that are listening in, I do believe that you don't have to train or fine tune a new model in order to create a legitimately useful product.”

“And so I feel like these computer brains are going to kick our ass a lot faster in this domain than they do in English.”

“I think models in my mind are like, 50, 60% is the workaround, and how do you leverage your current investment is 30, 40% work that goes in from the groups, from our customers as well.”

“The expensive part is now becoming cheap is the models, the availability, the usage of the platform. Those were the things that were really expensive. I think you, if you do a cost craft you know, curve right now, and the investments you all are making into th…”

“The day will come when you have models which can do science autonomously, like build, deliver on big science projects.”

“Assuming that the model should be well behaved is, I think, a wrong assumption. You need to make the assumption that the model should know everything. And then on top of that, have some modules that moderate and guardrail the model.”

“And then the one other potential source of immense scale in the long run may be sovereigns as people want to customize models that are specific to their region or customs or language or culture or whatever it may be.”

“You go to many of the incumbent software and services vendors, and despite having done this task, you know, for years, they have not actually captured the information you'd want to teach a model.”

“The models in this generation, and they're just not smart, coherent enough, and they're still fighting this uphill battle to get them to do tasks that are valuable, and, like, I don't think you're gonna eliminate headcount in the first 10 people.”

“Like, I think we could pause model development today and still get a million times more economic value impact from today's generation of models than we've fully realize.”

“At some point, the model might have the capability, let's say, to self-correct. Let's call it self-correction. And as soon as it hits that capability, you can see how, wow, bootstrapping now is trivial. And of course, it's not going to be that blanket across a…”

“Most companies are not going to build their own models over time. They might tweak them a little bit, but I think a lot of companies are going to build, are going to use the applications that use the software and the models underneath.”

“Currently at the current AI capability, I don't think the models are good enough to create a good course. But I think they're good to become the front end to the student and interpret the course to them.”

“I think the same thing is likely to be true here, where there'll be certain people who start to grab parts of the market. You know, LinkedIn became the sort of enterprise identity social network, or whatever you want to call it, right? Your resume social netwo…”

“If every time there's a new release of an AI model, somehow it decreases your value, it probably indicates you're not actually a solution. You're, you might be a slight value add on top of the models. I think there's a number of startups that unfortunately sor…”

“Over the long term, if you allow this appropriation, one worry is that there's not going to be an incentive to invest in the production of information, in the production of robust and vigorous journalism, and so that's why getting that piece right is going to …”

“I don't think that models are actually getting commoditized. I think what you see is you see price dumping. And so you see people giving it out for free, giving it out at a loss, giving out at zero margin. And so they see the prices coming down and they assume…”

“I think even a billion. Billions of ISIS. We'll probably get to that point and the models can be very, very small.”

“Most of the sort of alpha or most of the specials stuff that you build is on top of models. It's either the orchestration layer or the software around it.”

“These models can't just one shot all of these really complex legal tasks or in these other domains like tax and provide other professional services. And so what you have to do is you have to build a platform that is kind of constantly expanding and constantly …”

“People criticize these models for hallucinating, but if you think about it, the process of scientific research just involves hallucination, right? That's what creativity is.”

“This could possibly change overnight, but it's still near the floor. I think they're still extremely defective as agents.”

“As these AI models get better, these competitions of who's the best hacker or coder Are going to have to move to a whole different level where you assume that the developer is using AI to solve the challenges because otherwise it's going to be way too easy.”

“For things like math or soon code that are verifiable, they will get solved very quickly.”

“I think we'll get to a point where I'll almost be irrational to not listen to the model, right, where people trust the model's recommendation. And like, maybe for legal reasons, we'll still have the human pressing the button and making the final sign off. But …”

“I think that they'll play a role in creating their own evals, where they, like, yeah, where they might come up with certain criteria for what a good response looks like, and humans validate that criteria. However, I think you often need to ground this in, like…”

“Well, I think the models will be able to delineate between the valuable human knowledge and the human knowledge that's not valuable. And that maybe you have doctors that create like a bunch of evals for this particular task and the model realizes like, wow, li…”

“And I hope we can get to a place where our models have a more precise understanding of their own level of uncertainty. Because you know, if they already know the answer, they should just kind of tell you it. And if it takes them a day to actually figure it out…”

“Yeah, we are a super expensive tool call. You know, if you're a model, you can either ask me, you know, meat bag over here to you know, help with something and I'll try to think really slowly. In the meantime, it could have like used browser and read like a hu…”

“People talk about hallucinations as a big problem with AI models. You know, we feel like, you know, a bigger problem for us is not even hallucinations. It's about Like, you know, most of the times you can't even, you know, find that information. Sometimes it's…”

“And then on the data side, RL environments are really important these days, but constructing those environments Has traditionally been expensive. Models are pretty good at writing environments, so it's another area where you can sort of recursively self-improv…”

“Like, I don't think our environments alone will suffice just because, I mean, it depends on how you think about our environments, but oftentimes these are very, very rich trajectories are very, very long. And so it's almost like inconceivable that a single rew…”

“So I find that there are a lot of these tasks where humans have a huge information advantage still, because they've not figured out the plumbing or whatever's needed to get information to the AI model.”

“When we think of the best partners we've worked with, I don't think the models are doing what they do anytime soon. And I think what's interesting is I think the role of law firm partners actually doesn't change that much in the same way. I don't think the rol…”

“None of this is public. This will, won't go into the models for a long time.”

“The story is that we're getting a lot of the intelligence and capabilities in all the domains of society, like, for free as we get better and better models, and it's not, like, exactly fundamentally what's going on, and there's some blind spots, and some thing…”

“We're not seeing that with AI models today. They kind of, they're born into a world for, and they exist for a very short context window, and then they just, like, disappear. And yeah, there are things that you can kind of do to, like, continue them, but it's v…”

“Go ahead and like look at all the published work and synthesize that and then try to come up with something novel and it's not able to do it. And I can give it a lot of time and it's still not able to do it.”

“This idea that the models, you just let them think for a week or whatever, and then they respond, it's, it sounds nice, and yes, the benchmarks look great, but it's not very practical when working because like, okay, you ask the model a question, and then you …”

“There are some benchmarks where the models will just not improve if they have more inference budget. So I think a lot of factual factual retrieval kind of questions fall into this category of if you ask a person when was Abraham Lincoln born and they don't kno…”

“I use it day to day for a lot of this kind of stuff, and I think they're at a point now where They've actually been at a point for a while now where I feel like I can just trust the outputs, arguably more than I could trust the output from a human.”

“Well, I mean, ironically, it's probably working on AI. Yeah, I have some, I have a couple of neuroscience friends at OpenAI and Anthropic, who, it's like, we would joke, like, oh, you left neuroscience. Like, no, no, no. It is just way easier to do neuroscienc…”

“We use that constructively at science like that. So we know that that is. That is true because we can get alignments between animal brain neural recordings and AI model internal representations.”