SwiGLU
topic on 1 show · 1 statements across 1 episodes · said 8 times in 1 episodes since 2024
Mentions by year, every show
tap a year for its mentions
Latent Space 8
2024 8 mentions in 1 episode
every mention on every show, scene by scene, with the transcript →
1 statements about SwiGLU, every show
Tay: Complex architecture modifications fail due to an implementation lottery
“A lot of architecture changes, right, the moment they are, like, tedious to implement, like, nobody, like, SuiGuru is a simple thing, right?
[4306] Yi Tay: Just split it and then get it.
[4307] Yi Tay: It's a very simple thing to implement.
[4309] Yi Tay: Mayb…”