StarZero All shows Try the podcast clipper →

Megatron MOEs

part of Megatron

1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jun 1, 2026 by Ethan He · across every show →

Everything said about Megatron MOEs, oldest first

Jun 1, 2026 positive
Assertion Supported
Ethan He: Megatron MoE was first to train trillion-parameter MoEs at 40% MFU
“The Megatron MOEs was the first It was the first framework open source to be able to train these MOEs at very large scales, like a hundred billion parameters to even trillion parameters efficiently at like 40% MFU.”
Ethan He Jun 1, 2026 ▶ 1:41:50 Inside xAI: Building Grok Imagine in 3 Months, Videogen vs World Models, and Video Agents— Ethan He
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more