LLM training job

1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jul 5, 2024 by Yi Tay · across every show →

Everything said about LLM training job, oldest first

Jul 5, 2024

Insight

Tay: A single bad GPU node kills an entire distributed LLM training job

“If there's one bad note, it kills the entire job, right? So, like, the fact of, like, the game became, like, just eliminating bad notes from the thing, right?”

Yi Tay Jul 5, 2024 ▶ 51:36 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

LLM training job

Everything said about LLM training job, oldest first

Turn any episode into a week of clips.