AI Diplomacy

9 statements across 1 episodes · 5 bullish · 1 bearish · 1 people on the record · first statement Jun 11, 2025 by Alex Duffy · said 3 times in 1 episodes since 2025 · across every show →

Mentions by year

brought up most by Alex Duffy (1)

tap a year for its mentions
0021312025episodesmentions
0112025episodes it came up in
001.50.5312025episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about AI Diplomacy, oldest first

Jun 11, 2025 positive
Disclosure
Duffy: Every wants to host a human vs. AI Diplomacy tournament
“I'd love to have a human versus AI diplomacy tournament.”
Alex Duffy Jun 11, 2025 ▶ 31:16 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 positive
Disclosure
Duffy: AI Diplomacy trace logs and dataset are publicly released
“I posted a video on X that shows you how to actually like, we released all the data, all the trace logs.”
Alex Duffy Jun 11, 2025 ▶ 14:51 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 positive
Insight
Duffy: Playable AI game benchmarks teach people how LLMs operate
“If we make this playable, you know, then it kind of can teach people how to use AI, like language models just by playing. Cause you'll like understand how they work. You have to negotiate against them. You see their responses.”
Alex Duffy Jun 11, 2025 ▶ 6:36 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 neutral
Disclosure
Duffy: AI Diplomacy used try-catch blocks instead of Pydantic for JSON
“I know one of our GitHub issues already called us out for not using Pydantic parsing and instead of having like eight different try catches for the different JSON versions that come out of these.”
Alex Duffy Jun 11, 2025 ▶ 20:22 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 neutral
Assertion Supported
Duffy: OpenAI's o3 actively deceives opponents and plots betrayals in AI Diplomacy
“Oh, three was one of the few that will actually send a message to another power saying that they're planning to do something. And then like in their diary diary, right? Oh, they fell for it. Hook, line and sinker. Totally gonna betray him and take it over.”
Alex Duffy Jun 11, 2025 ▶ 12:22 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 negative
Assertion Supported
Claude loses AI Diplomacy games because it refuses to deceive opponents
“I haven't seen Claude with any game yet because they won't do it. Like there's like, O three has managed to get them on board for like draws, even though they all know the only win condition in the game is, is 18 supply centers.”
Alex Duffy Jun 11, 2025 ▶ 12:36 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 positive
Insight
Duffy: LLM context should contain enough information for a human to play
“If you're looking at the context that's being sent to the language model, could you play the game?”
Alex Duffy Jun 11, 2025 ▶ 17:24 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 positive
Assertion Not checkable as stated
Gemini 2.5 Flash runs AI Diplomacy for $1-$5, undercutting competitors
“Running games at two five flash was instant and one to five bucks of, you know, way like, I don't know, 20 to a hundred with the other models.”
Alex Duffy Jun 11, 2025 ▶ 11:45 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Jun 11, 2025 neutral
Assertion Partly supported
Duffy: AI Diplomacy games take 4 to 18 hours to play out
“No, human time, watching it, I think it's, like, anywhere from four to 12, four to 18 hours, something, to play out.”
Alex Duffy Jun 11, 2025 ▶ 32:09 ⚡️Launching AI Diplomacy: the hardest LLM Game Benchmark yet - Alex Duffy
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.