Automated Red Teaming
topic on 1 show · 1 statements across 1 episodes
1 statements about Automated Red Teaming, every show
Kolter: Frontier models fail at red teaming due to safety refusals
“So generally speaking, the issue with this is that frontier models are extremely bad at automated red teaming because they have a lot of safeguards built into them. So if you try to use them to jailbreak another model, they will actually refuse their safety tr…”