GPT-II

2 statements across 2 episodes · 1 bullish · 0 bearish · 2 people on the record · first statement Sep 21, 2023 by Amjad Masad · across every show →

Everything said about GPT-II, oldest first

Sep 21, 2023 neutral
Assertion Not checkable as stated
Masad: Machine learning on code did not work effectively until GPT-2/GPT-3
“Every year or two while starting Replit, I would go look at the state of the art on ML on code and nothing ever really worked all that well up until GPT-II. And you can like take GPT-II and fine tune it and like try to make it write code and was like kind of o…”
Amjad Masad Sep 21, 2023 ▶ 3:43 No Priors Ep. 33 | With Replit's CEO & Co-Founder Amjad Masad
May 22, 2024 positive
Assertion Supported
Alexandr Wang: Scale partnered with OpenAI on the first GPT-2 RLHF experiments.
“So we partnered with OpenAI at that time to do the very first experiments on RLHF on top of GPT-II.”
Alexandr Wang May 22, 2024 ▶ 5:57 No Priors Ep. 65 | With Scale AI CEO Alexandr Wang
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.