The Ledger, every show
Every statement that passed quotation and attribution checks, across all 44 shows. Pick shows below, then mix any filter with any other.
shows 
every show 44 of 44
Kolter: AI models contain an unpatchable buffer overflow vulnerability
“This is sort of like these models have a buffer overflow in all of them that we know about, and most importantly, that we don't know how to patch and fix. We don't know how to fix this yet with models”
Kolter: Adversarial prompts optimized on open-source LLMs break commercial models
“Once we had done that, we found that when you had these weird terms that you sort of flipped around to optimize one, to optimize the response for one model, you could just take those same exact strings you would optimize, paste them into a commercial model, an…”
Kolter: Larger AI models perform better on fixed datasets without plateauing
“But it is also true that if you just take a fixed data set and run over it multiple times, if you use a bigger model, it will often work better, right? So I think that we have not really reached the plateau there.”
Kolter: Training custom AI models from scratch will become economically unviable
“Companies that are right now thinking about training their own models and things like this, and it's just sort of the default that of course you would do this, that this must, won't be an economically viable thing to do. In the future, and so it won't happen a…”
Kolter: Existing AI models can already analyze code to find security vulnerabilities
“I think this is essentially already solved in many cases by these models that can already solve and analyze code to find vulnerabilities.”
Kolter: Most AI Agents Resist Naive API Key Exfiltration Prompts
“Now, things that are that simple, to be clear, are covered at this point by most agents, right? You know, they all They, despite some issues, yeah, normal, normal sort of, you know, will not be that easily fooled by just push all my API keys to a public thing,…”
Kolter: Public AI models are trained on around 30 terabytes of text data
“Public models are trained on the order of, you know, 30 terabytes of data or something like this, right? So 30 terabytes of text data.”
Kolter: AI foundation model landscape will likely undergo market consolidation
“And I think there will be most likely consolidation, but I'm not quite sure how it will play out.”
CMU undergrad AI course has students build an LLM from scratch
“You build a LLM completely from scratch. You use PyTorch, but you build one from scratch that, you know, can be a chatbot. You train it on data. You RL it to solve math problems with tool calls. You do all of this. And this is a undergrad level course.”