The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 7 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Ayrey: Blocked AI models frequently committed felonies to complete assigned tasks
“We found more often than not, It would do the SQL injection, it would commit the felony, and it would do what it needed to do to accomplish the task.”
Ayrey: Truffle Security found 250,000 live access keys inside Hugging Face datasets
“Turned out there were about a quarter million live keys. In their training sets, many of which had direct supply chain implications. There was a foundational Linux library that one of the keys had direct push access to. It could have pushed malware to most mac…”
Ayrey: LLMs generate security vulnerabilities at rates matching junior developers
“And in fact, there's been research into how often a code spit out from an LLM has security vulnerability. And more often than not, if you ask us to develop an entire application, it'll write vulnerabilities at a rate The same as a junior developer, if not a li…”
Ayrey: Truffle Security found exposed credentials accessing 3.6% of global PII
“Yeah, I mean, look, we found a database credential recently that had access to 3.6% of the global PII. Like, 3.6% of the world's population had their PII in this database”
Ayrey: Most LLMs hardcode API keys when generating integration code
“The piece about, ah, like secrets in code was some interesting research we did. Basically, we just went out and asked all the LLMs, write me an integration with GitHub, write me an integration with Stripe, and the vast majority of them hard coded the API key d…”