Coding Models

“You're seeing what the coding models today are capable of building end-to-end systems, like coding for days. Sometimes a week.”

“Coding is one of those areas where, because it's verifiable, I think that there is a good path to using reinforcement learning to improve coding models quickly.”

“But the thing that happened with like the last generation of coding models is you can actually take sets of documents and create synthetic docs that are so good that the lawyers can't tell the difference between whether they're created, you know, by an actual …”

“They have advantages, all, all advantages one needs to have to be that, but they underestimated the importance of coding models. And so they're far behind the frontier right now. So again, they could catch up totally capable, totally competent team, but today …”

“Compute might become a bottleneck again, because previously, like if you want to train a new model, say you want to generate new synthetic data and then, or write a new algorithm, it might take a few weeks. And during that period of time, you don't, you might …”

“I'm pretty sure this, here's a prediction. I'm pretty sure every coding model on the market will still do this in a year. Every coding model on the market will take that instruction seriously. And if I tell it, here's a bunch of issues, go fix it. They will ju…”

“And we're, you know, we're approaching a certain plateau in how good coding models could get.”

“Look, I think effectively the consumer interfaces are going to have Full coding models underneath, right? And the right harnesses and like the right scales and the ability to persist and run somewhere securely in the cloud, locally and in the cloud. So all tho…”

“And I think one of the conclusions is, is like there's no such thing as a coding model. You know, like, that's not a thing. Like, you're talking to another human being, and it's good at coding, but like, it's got to be good at everything.”

“At the same time, the coding model is as remarkable as they are. They'll reshuffle the economics of tech. We're seeing this with the SaaSpocalypse. Certain companies will be stronger beneficiaries of AI. Others will be Damaged because maybe their only moat was…”

“Coding is really like creative problem solving that maps very well back into the real world. I think there's a huge correlation. They need to be really good at creative problem solving, and that's a skill. That's an abstract skill. You can apply to code, but l…”

“All of their revenue comes from having the best coding model, which is very different than having a lot of revenue because you have a hit consumer product, because you have to keep training the next model.”

“Oligopoly. This is how the cloud, well, this is how the cloud played. I think probably the best analog we have is the cloud, right?”

“I heard rumors that, that Grok doesn't want to release the coding model until it's better than one specific other lab out there. So they're going to wait and see when it's actually better for the, to, they can have that marketing point.”

“You can imagine you know, the world converging on a few companies have really powerful coding models. They basically release a nerfed version of that to the public at large, and basically have a competitive advantage by having, you know, a super intelligent co…”