tool calling evals
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Aug 4, 2025 by Soham Ganatra · across every show →
Everything said about tool calling evals, oldest first
Aug 4, 2025 negative
Ganatra: Existing AI tool-calling benchmarks are not production-ready
“Tool calling has a lot of different evals. You have seen the function tool calling evals. You have multi-function, like, multi-tune tool calling evals. But, like, none of them are actual, like, production quality. Like, none of them are actually something that…”