User Feedback
topic on 3 shows · 5 statements across 5 episodes
We Live to Build 
the Knowledge Project 
Latent Space
5 statements about User Feedback, every show
Biderman: AI models must learn to autonomously filter out erroneous user feedback
“Increasingly the models will get better, and increasingly they'll know more things than we do, so the model in some way has to learn and understand and kind of, like, discern what, which feedback is valuable and which feedback should be ignored.”
Rizzoli: Consumer Feedback Builds AI Engagement, Not Real Intelligence
“And that can be good for developing engagement, but for developing intelligence,
What actually needs to be done is to go and find the gaps in the knowledge of the actual model, and it's harder for non-experts to evaluate that.”
RWKV Prioritizes User Feedback Over Benchmark Evals for Dataset Additions
“The reason why we add things to the data set was never about improving evals. It's about directly in response to user feedback.”
Founders resist user feedback due to fear of negative reactions
“One thing I always see is a lot of startups resistant to getting user feedback, customer feedback, even though people preach it all the time, like get user feedback, put it in front of users. And I think it's always been, you know, oh, that's, why don't they w…”