domain expert
also referred to as: domain experts
2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Feb 14, 2025 by Winston Weinberg · across every show →
Everything said about domain expert, oldest first
Feb 14, 2025 positive
Weinberg: Vertical AI evaluation requires senior domain experts, not junior staff
“And the reality is you have to hire very good lawyers who can actually evaluate these systems, and the same within tax and these other areas, and they can't be too junior, because if they were too junior and they were able to eval it, they would be senior, rig…”
Apr 10, 2025 positive
Foody: AI models will propose evaluation criteria for domain experts to validate
“I think that they'll play a role in creating their own evals, where they, like, yeah, where they might come up with certain criteria for what a good response looks like, and humans validate that criteria. However, I think you often need to ground this in, like…”