GPT-III
2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Feb 28, 2023 by Raza Habib · across every show →
Everything said about GPT-III, oldest first
Feb 28, 2023 positive
Habib: OpenAI's 1.3B InstructGPT beat the 100x larger GPT-3 via RLHF
“In the InstructGPT paper that OpenAI released, they compared, you know, a one or two billion parameter model with instruction tuning and RHF to the full GPT-III model and people preferred that despite the fact it was a hundred times smaller.”
Nov 1, 2024 bullish
Hu: 10T parameter models will spark a GPT-3 level innovation leap
“I think the type of level of potential innovation could be the same leap we saw from GPT-II, which was around one billion Parameters that was released with the paper of a scaling loss, which was one of these seminal papers that people figure out, okay, this is…”