PyTorch

2 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Sep 30, 2025 by Nick Joseph · said 22 times in 4 episodes since 2025 · across every show →

Mentions by year

brought up most by Ankit Gupta (5), Nick Joseph (3), Michael Truell (1), Jensen Huang (1), Francois Chaubard (1)

tap a year for its mentions
008115220252026episodesmentions
01220252026episodes it came up in
00418220252026episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about PyTorch, oldest first

Sep 30, 2025 neutral
Disclosure
Joseph: Anthropic had to hack PyTorch profiler for large-scale GPU clusters
“The PyTorch profiler was, like, pretty good, actually, throughout for a single GPU. You want to, like, profile a GPU, the PyTorch profile would work. But if you wanted to profile a job on 100,000 of GPUs, that, like, hadn't really been done much, and then that…”
Nick Joseph Sep 30, 2025 ▶ 16:37 Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI · Y Combinator
Sep 30, 2025
Disclosure
Anthropic built custom distributed training to scale beyond Facebook's infrastructure
“We don't want to outsource this to some package because A, we're about to go to a bigger scale, like PyTorch, for instance, they had a package for doing this. But we were going to go to a bigger scale than Facebook had been to. And you don't want to have a dep…”
Nick Joseph Sep 30, 2025 ▶ 12:24 Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI · Y Combinator
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.