hardware

“Hardware has, my understanding is has a kind of a longer time scale. So you need to design hardware, you need to manufacture it, you know, maybe on the order of three to five years or something like that. So you know, people are taking different bets but the, …”

“There is this feedback loop where somehow The model architectures that take advantage of hardware become popular, and the hardware will also kind of evolve to optimize a little bit for that kind of architecture, and software framework software frameworks will …”

“My view is actually hardware is still the bottleneck, and AI is also a little bit of bottleneck, but, like, I don't think there's any, like, obvious breakthroughs we need. I think it's just work.”

“Even if your model is theoretically more efficient, if somebody goes and runs it and it's two times slower one of the things that, that we've learned is that if you're in that situation, it's just going to be dead on arrival. So you want to be designing your a…”

“If, and if you get, Curious enough about software, you ultimately end up in hardware, right?”

“Definitely in the vibe coding era, there are a crop of engineers that they don't think about hardware at all, and we don't have that luxury.”

“Most open labs are trying to make models that can be run on as wide of hardware as possible rather than targeting just like a single chip.”