NCCL, every mention
2 scenes · ← back to NCCL
tap a year for its mentions
every year anyone Stuart (Stu) 2
Verbatim, from the transcripts: the passages where NCCL comes up
Multi-GPU Kernels, Intelligence per Watt, Heterogeneous Inference, and More | YC Paper Club · Y Combinator
- ▶ 10:34 Stuart (Stu) Um, one is to use off-the-shelf libraries like Nickel, uh, which only expose coarse-grained communication primitives and leave a lot of bubbles in the hardware execution.
- ▶ 18:36 Stuart (Stu) Uh, for example, Nickel's default mode, uh, forces intermediate buffers, um, which adds extra data movement between the sender and the receiver.