RLHF
2 statements across 2 episodes · 1 bullish · 1 bearish · 2 people on the record · first statement Apr 25, 2023 by Denis Yarats · across every show →
Everything said about RLHF, oldest first
Apr 25, 2023 positive
Yarats: Rejection sampling significantly boosts LLM quality before full RLHF
“Full blown, like RLHF is, you know, definitely something we're going to look into that, but there is like several many steps that you can have in between that significantly can increase your quality. So for example, I mean like even using something like a reje…”
Sep 14, 2023 negative
Guo: Major AI Labs Insource Annotators Due to Vendor Quality Deficits
“One thing that I've seen with significant research labs is like still continued insourcing of annotators for both pre-training sets and LHF because some of the external services and marketplaces can't get to the level of quality that they're looking for in par…”