GPT-NeoX

2 statements across 1 episodes · 2 bullish · 0 bearish · 1 people on the record · first statement Aug 31, 2023 by Eugene Cheah · said 7 times in 2 episodes since 2023 · across every show →

Mentions by year

brought up most by Eugene Cheah (6)

tap a year for its mentions
003161202320242025episodesmentions
011202320242025episodes it came up in
0030.561202320242025episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about GPT-NeoX, oldest first

Aug 31, 2023 positive
Assertion Not checkable as stated
GPT-NeoX Documentation Became Reference Notes for Subsequent Open-Source LLMs
“GPT Neo X was that it was one of the major models that had everything fully documented and they like, why they make this change in the architecture and so on and so forth. And that became like Basically reference notes for all other subsequent open source mode…”
Eugene Cheah Aug 31, 2023 ▶ 46:33 RWKV: Reinventing RNNs for the Transformer Era
Aug 31, 2023 bullish
Assertion Supported
RWKV Matches GPT-NeoX Performance at Equal Parameter and Data Scales
“RWKV is a modern recursive neural network with transformer-like level of LMM performance, which can be trained in a transformer mode. And this part has already been benchmarked against GPT-NeoX in the paper, And it has similar training performance compared to …”
Eugene Cheah Aug 31, 2023 ▶ 31:59 RWKV: Reinventing RNNs for the Transformer Era
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.