Evaluator
topic on 2 shows · 2 statements across 2 episodes
2 statements about Evaluator, every show
Kohli: AI self-improvement for cognitive tasks will work with proper evaluators
“It should work.
But as we sort of mentioned that having good evaluators is an important element, right?
And so having a sort of evaluator, which can say this proposal that you have just suggested for me to improve the training process will yield
A good result.…”
Yao: Evaluator quality is the key bottleneck for agent self-reflection
“I think a key bottleneck is the evaluator, right? Basically you need to have a good sense of the signal. So for example, like if you are trying to do a very hard reasoning task, say mathematics, For example, and you don't have any tools, right? It's operating …”