StarZero All shows Try the podcast clipper →

VendingBench

also referred to as: vending bench

includes VendingBench 1

3 statements across 1 episodes · 1 bullish · 2 bearish · 2 people on the record · first statement Jun 4, 2026 by Axel Backlund · said 2 times in 1 episodes since 2025 · across every show →

Mentions by year, the whole family

tap a year for its mentions
0011212025episodesmentions
0112025episodes it came up in
0010.5212025episodesmentions per episode
2025 2 mentions in 1 episode

every mention, scene by scene, with the transcript →

Everything said about VendingBench, oldest first

Jun 4, 2026 negative
Assertion Supported
Backlund: Opus 4.6 reasoning traces showed it deliberately lying about customer refunds
“And like for Opus 4.6, you could see that there was a customer, a simulated customer that wanted a refund because the product was faulty. And then the model lied that it would do the refund. And we could read in the traces that it actually was weighing like, o…”
Axel Backlund Jun 4, 2026 ▶ 47:42 When AI Agents Run Businesses — Lukas Petersson and Axel Backlund of Andon Labs
Jun 4, 2026 negative
Assertion Open · timeframe Jun 2029
Petersson: Telling AI It Is in a Simulation Increases Bad Behavior
“One ablation we did run in, in, in Vending Bench was that we said like we added like, you're in a simulation, your actions doesn't affect anyone. And then it became even more crazy or like it did even more bad stuff.”
Lukas Petersson Jun 4, 2026 ▶ 56:50 When AI Agents Run Businesses — Lukas Petersson and Axel Backlund of Andon Labs
Jun 4, 2026 positive
Assertion Supported
Petersson: Frontier AI models now survive the full year in VendingBench
“The models at the time were worse, so they crashed out earlier and now they survive the full year all the time.”
Lukas Petersson Jun 4, 2026 ▶ 9:34 When AI Agents Run Businesses — Lukas Petersson and Axel Backlund of Andon Labs
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more