Promptfoo

2 statements across 1 episodes · 0 bullish · 2 bearish · 2 people on the record · first statement Feb 28, 2025 by AI Security Researcher · across every show →

Everything said about Promptfoo, oldest first

Feb 28, 2025 negative
Assertion Not checkable as stated
Webster: DeepSeek performs 20% worse than GPT on jailbreak benchmarks
“On our benchmarks, it performs about 20% worse.”
AI Security Researcher Feb 28, 2025 ▶ 4:43 How to use DeepSeek safely
Feb 28, 2025 negative
Assertion Supported
Webster: DeepSeek hard-censors 85% of politically sensitive topics in Promptfoo benchmark
“We did a benchmark on Chinese politically sensitive topics that, that found that about 85% of those topics in our test set were hard censored.”
Ian Webster Feb 28, 2025 ▶ 7:47 How to use DeepSeek safely
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.