Mojo

“There is a thousand flash attentions out there for us to build. You just got to make it easy for us to build them. So like Triton definitely helps. But it's still, Not easy. You know, it still requires kind of really understanding the VPU architecture, writing…”

“Mojo as a fundamental frontend would be replacing PyTorch, not, like, augmenting PyTorch. So, in that sense, I don't see a synergy in more deeply, like, integrating Mojo.”

“Modular is Mojo's first customer. Like we have more Mojo code in our repository than any other language. And it's open source. Like, and we open source like 650,000 lines of Mojo code.”

“The winning team for the hackathon took that four person team. And one day they had not used Mojo before they hadn't programmed GPUs before. And they had built a training system. They wrote an atom optimizer, a bunch of training kernels. They built a simple ba…”

“We're beating the tree DAO reference implementation that everybody uses, for example, right? Written fully in Mojo. Again, all of our, GPU kernels are written in Mojo. You can go see the history of the team building this, and it was done in just a few weeks, r…”

“Mojo is not just a little faster than Python, it's faster than Rust. So it's like tens of thousands of times faster than Python, and it's in the Python family.”

“The max framework and the mojo language, free to use on NVIDIA and CPUs, any scale, go nuts, do whatever you want.”