Disclosure
Clark: Anthropic is developing audio and video capabilities for Claude
“Claude can now see images. Obviously we're working on other so-called modalities as well. You know, it would be nice for Claude to be able to listen to things. Be nice for Claude to understand movies. All of that stuff is going to come in time.”
Insight
Clark: AI models need long-term storage instead of massive context windows
“Well, our AI systems today are kind of operating with short term memories that are millions of numbers in length, and it feels very unintuitive. Ultimately, we want them to instead be able to bake stuff into some kind of long term storage, and that's going to …”
Prediction Not checkable as stated
Clark: Consumer AI subscriptions will become a massive market like Netflix
“I think there's going to be this very large growing business of basically a subscription model where people will have a personal AI or multiple AIs that they use, just like you or I might have a Netflix account or whatever.”
Disclosure
Clark: Anthropic will always keep an accessible consumer product
“We're always going to have some Like, top of funnel, easy to access consumer thing, because we just can't ignore how useful this is to people, you know, and useful it is to writers especially.”
Disclosure
Clark: Live web search connectivity is 'definitely coming' to Claude
“And on the web question, we're working on it. There's a bunch of Kind of computer security stuff to work through and some safety things, but that's definitely coming.”
Prediction Not checkable as stated
Clark: Developers will build and release open-source AI agents
“People are definitely going to build, like, open source agents and release them as well, and we're going to have to contend with that where the environment of the internet will be changed by this in a bunch of hard to predict ways.”
Disclosure
Clark: Dario Amodei's early Constitutional AI concept sounded completely crazy
“On, I think, like, week four we were talking about RL and language models, and Jared was like, oh, Dario says we're just gonna write a constitution for the AI and it'll just follow that. And I remember being like, that's completely crazy. Why would this ever w…”
Insight
Clark: AI Safety Talent Pool Heavily Overlaps With Effective Altruism
“Of the group of people in the world that have spent a long time thinking about AI, are really good at math and science, and have worried about some of the safety issues, there is a huge overlap with this community of people called effective altruists, and so s…”
Assertion Not checkable as stated
Clark: Claude 3 is far more complex and weird to explore than previous LLMs
“The only claim I'm going to make is it certainly got a lot more complicated and weird to explore than previous systems or other language models that have been developed.”
Assertion Supported
Clark: Anthropic does not train models on Claude user conversations
“No, no, no, no. That is not a thing that we do at all. Yeah.”
Prediction Not checkable as stated
Clark: AI-native startups will do much more with fewer people
“My bet is that you're going to see new companies get formed, which do a lot more with a lot less in terms of people. They're going to figure out how to be, like, much smarter and perform a lot better than that than equivalently scaled companies that don't use …”
Disclosure
Clark: Claude Redirects Election Inquiries to Factual Websites
“So we have some election work, and if you talk about American candidates, and we're extending this to other regions, Claude is like, oh, it looks like you're talking to me about elections.
Go to this factual website.”
Disclosure
Clark: Anthropic's internal engineering philosophy is 'do the dumb thing that works'
“So at Anthropic, we have this public value statement, which is do the simple thing that works. But actually internally, we sometimes say an even cruder version, which is do the dumb thing that works”
Disclosure
Clark: Anthropic operates Frontier Red Team for national security evals
“Anthropic has a line of work on what we call the Frontier Red Team, where we are doing national security relevant evaluations.”
Disclosure
Clark: Anthropic runs internal 'Claudification' project across its workflows
“We have a project internally called Claudification. Everything at Anthropic has Claude in it at some point. And one of the ideas of Claudeification is just get us all to use this stuff well. I talked about my colleague, Catherine, but there are many examples w…”
Disclosure
Clark: Anthropic builds on Amazon Trainium, Google TPU, and Nvidia chips
“I can't get too much into the specifics, but I can just say we've sort of publicly stated that we're Working on both Tranium chips and also TPU chips. We also work on NVIDIA chips as well.”
Disclosure
Clark: Anthropic is grabbing all available chips to meet Claude 3 demand
“I mean, we ourselves
have been experiencing this where we've been, you know, very successful with Claude Free, and we've been you know, going and doing the supermarket sweep to grab as many chips as we can to, like, serve all the customers we have. The chip …”
Disclosure
Clark: OpenAI deliberately downplayed GPT-3's release to test public discovery
“We actually tried to lowball the system in that we published a research paper called like language models are few shot learners. I don't think we even tweeted about it. We tried to like public publish it publicly, but also be like very quiet and see, see how q…”
Disclosure
Clark: Anthropic previously put too much safety training into its models
“Actually, like, we've gone through this at Anthropic. We've, like, over put too many of the safety ingredients in some of our models before, and it's led to them seeming annoying to people.”
