SwiGLU, every mention
1 scene · ← back to SwiGLU
tap a year for its mentions
Verbatim, from the transcripts: the passages where SwiGLU comes up
The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
- ▶ 1:05:37 unnamed speaker Swiglue, GQA, Rope, RMSNorm, um, and then obviously the big one is encoder, decoder versus decoder. 8 times in the scene