PyTorch, every mention
9 scenes (2026), the whole family · ← back to PyTorch
every year 2026 anyone Andrej Karpathy 27Shawn Wang 26George Hotz 25Chris Lattner 11comfyanonymous (Comfy) 6Alessio Fanelli 6Evan Feinberg 5Thomas Sohmers 4Batuhan Taskaya 4Ankur Goyal 4
Verbatim, from the transcripts: the passages where PyTorch comes up
🔬 Why Transformers Hit a Wall the Moment Physics Shows Up — Anima Anandkumar, Caltech
- ▶ 6:52 Anima Anandkumar So instead of writing in, like, PyTorch, it's like a PyTorch-like abstraction, but you can, like, kind of, you know, write it in Lean, and so it can be fully formalized in Lean. 2 times in the scene
- ▶ 1:17:47 Anima Anandkumar It's part of the PyTorch ecosystem.
Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten
- ▶ 25:17 Shawn Wang Even, but I'm surprised by the race condition one because, uh, I thought PyTorch was a graph that, like, guarantees that you at least, you know, execute things in the right order.
The Future of AI Infra: from Kubernetes to Agent Sandboxes — Akshat Bubna, Modal CTO
- ▶ 14:59 Akshat Bubna It's not universally true that everyone else can autoscale, and we've gone deeper into it on the tech side, but we've incorporated GPU snapshotting to the product so we can actually, uh, take the GPU state, like your Torch compiler model,…
🔬 "The Most Innovative Diffusion Research Is Happening in Drug Discovery, Not Image Generation"
- ▶ 59:07 Evan Feinberg I will say that the last line of, of PyTorch I've written is much further back in history than the most recent line of PyTorch that Sergey has committed. 2 times in the scene
- ▶ 1:28:44 Evan Feinberg When we were, you know, coding and PyTorch .17 building, you know, the first, you know, when Sergey was scaling transformers on PyTorch, the first one to do that, and we were scaling graph neural nets in PyTorch, one of the first ones to… 3 times in the scene
AI-Native Engineering: 100% adoption, 5x search throughput, unlimited tokens — Mikhail Parakhin
- ▶ 30:56 Mikhail Parakhin Uh, you know, like you can grab, uh, XGBoost and you can grab some, some PyTorch module and then grab some, you know, Grap and other tools and combine them.
Agent Inference at the "Speed of Light" — How NVIDIA moves like a $4.3 Trillion Startup
- ▶ 11:13 Kyle Kranen And then, and then we built, you know, like when deep learning was getting big, we built, we built Torch and, and,
Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis
- ▶ 1:36:59 Shawn Wang I, I don't know if this is something that affects your analysis at all, because I don't have any appreciation for the, or the, the sizes that we're talking about here, that JAX is helping TPUs win, or JAX is winning relatively to PyTorch,…