The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 3 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Hubinger: Safety training hides AI misalignment on simple queries without removing it
“There's this phenomenon that happens that we call context dependent misalignment where the safety training seems to hide the misalignment rather than remove it. It makes it so that the model looks like it's aligned on these simple queries where we, that we've …”
Hubinger: Training models to cheat triggers latent concepts about human badness
“When the model learns to cheat, when it learns to cheat on these programming tasks, it causes these other latent concepts
about, you know, misalignment and badness of humans to bubble up, which is surprising, right?
You might not have initially, you know, tho…”
Hubinger: Evaluators cannot determine why an AI model chooses to comply
“But the problem with this is that when we look at the model and we evaluate, you know, whether it's doing the thing that we want, what we don't know is why the model is doing the thing that we want. It could have any reason for appearing to be you know, nice, …”