GPT-J, every mention
7 scenes · ← back to GPT-J
tap a year for its mentions
every year anyone William Beauchamp 3Varun Mohan 1
Verbatim, from the transcripts: the passages where GPT-J comes up
🕰️ The Oral History of Windsurf (ft. Varun Mohan, Scott Wu, Jeff Wang, Kevin Hou, Anshul R)
- ▶ 48:44 Varun Mohan But beyond that, I think Eleuther is a pretty special group, especially it's been now probably more than a year and a half since they released like GPTJ, which was like back when open source GPT-III Curie, which was comparable.
Outlasting Noam Shazeer, Crowdsourcing Chai AI w/ 1.4m DAU — with William Beauchamp, Chai Research
- ▶ 18:34 William Beauchamp And so we took an API for, let's just say it was, I think it was GPTJ, which was the six billion parameter open source transformer style LLM. 2 times in the scene
- ▶ 1:02:17 William Beauchamp And both of us were using GPT, uh, J.
[Paper Club] 🍓 On Reasoning: Q-STaR and Friends!
- ▶ 12:47 unnamed speaker So the first answer in the present is in the presenter results. 2 times in the scene
- ▶ 13:45 unnamed speaker This is, like, not fucking reasoning at all as far as my IQ test is concerned, but as far as GPT-J-A-Six-B is concerned, they're good on this, like, we cannot take this for granted. 2 times in the scene
RWKV: Reinventing RNNs for the Transformer Era
- ▶ 46:10 unnamed speaker GPT-J was the original Luther reproduction of GPT-III, and then GPT-Neo was the bigger GPT-J. 2 times in the scene
FlashAttention-2: Making Transformers 800% faster AND exact
- ▶ 58:56 unnamed speaker If you think about a loser and like the work that they've done, GPTJ was like, great.