Claude 3

“We've had a commercial product for the last three years, but it wasn't until the Claude III family of models, when Claude started getting really good at coding, that things started to accelerate.”

“I used the same project to do this, to try to repeat the demo that I made for myself a month afterwards, and it wasn't anywhere as smart. So cloud three got dumber, but it looks like I like made up the demo or something, but no, like literally I just reran the…”

“The Claude three, we were training a model at the frontier that was state of the art with a team that was much, much, much smaller. Than any other lab.”

“One of the things that I've learned early days at Anthropic was, like, we've discovered, especially with, like, cloud three training, when you taught the model some of the self-knowledge of, like, hey, like, you actually don't have a physical body to operate, …”

“I was a part of the post-training fine-tuning team. We only had, like, what, like, 10, 12 people involved”

“People said, like, Cloud II is, like, so much better at, like, writing and, like, has a certain personality, even though it was, like, unintentional at all. And we did not pay that much attention and didn't know even how to, like, productionize this property o…”

“Pre-Claude III, it was close to a hundred percent OpenAI.”

“I mean, we ourselves have been experiencing this where we've been, you know, very successful with Claude Free, and we've been you know, going and doing the supermarket sweep to grab as many chips as we can to, like, serve all the customers we have. The chip …”

“The only claim I'm going to make is it certainly got a lot more complicated and weird to explore than previous systems or other language models that have been developed.”

“I think you could release, like, pretty much everything as open source today. I think maybe even clawed free, and things would be fine. Like, it would be a little spicy, maybe surprising stuff would happen, but probably broadly fine.”

“Instead of having this entity, like GPT-IV, that's an assistant that just pops up in your face that you have to kind of, like, punch your way through and continue to have to deal with as a headache, instead, there's ways to kindly coax Claude into having the a…”

“Like there's, I think we see increasingly interest in open source, but the reasoning abilities are still just like lagging behind Cloud three or GPT four. And I think like for a lot of the applications that it kind of, it probably depends on the types of appli…”