foundation model

“The world is not just in text, it's also in images, so I think That will certainly expand in, in that direction, and we'll have these bigger models that will have all these modalities and that's kind of the pre-training part of the work, where we really want t…”

“You really, I think you're best off with a specialized model trained on the data that's very relevant to the thing, the task you want to solve. Your second best bet is to start with a foundation model that understands the broad space and fine tune it. Again, o…”

“We're very high conviction that at the application layer you will have tremendous value and at the chip layer you will have tremendous value.”

“Getting the best talent is important. I think it's getting easier over time. I think it's because every major Company building in AI, the foundation models, is making it easier to fine tune, making it easier to bring your data, which becomes a moat, to be able…”

“Our moonshot is really to make virtual cells at Arc and simulate human biology with foundation models, and, you know, we'd like to figure out something that feels useful for experimentalists, people who are skeptical about technology, you know, they just want …”

“Right now, currently, I would say that the complexity of the application itself is very high and is not subsumed in the foundation model. And so I think these things are not as straightforward as they appear and the benchmarks can be misleading.”

“I don't think foundation models. A product. I don't think a chatbot is a product. I think the value will be further up.”

“The models are kind of diff commodities, and the chatbot isn't the right UI or the right product, and the companies aren't going to be able to build all of that stuff themselves, so therefore they're low-level infrastructure.”

“When you had models, you know, let's say a few years ago, you'd have to give it very, very tight guidance, very specific instructions that you didn't want it to deviate from, and as the models got smarter, you could kind of give it broader and broader guidance…”

“That's just the first part of this, is meeting the robotics needs in the current technology, because we don't yet have a frontier foundation model that's robust enough for robotics.”