evals
also referred to as: eval
2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Nov 30, 2023 by Jack Krawczyk · across every show →
Everything said about evals, oldest first
Nov 30, 2023 positive
Evaluation suites have replaced traditional PRDs in AI product development
“You're, in language models, your eval is your prior product requirements document. It's a probabilistic based system, and so the way you construct what you will evaluate it against effectively dictates what the product is that's going to be built.”
Jul 24, 2025 positive
Intellectually fascinating technical problems efficiently drive peer-to-peer customer acquisition
“I think that people without us having to force them to or ask them to, they are just interested in solving the problem around evals and they find it intellectually fascinating on their own. And I think that leads to a lot of organic knowledge sharing. A lot of…”