The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 8 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 1 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Zaharia: Small models excel at creative generation but struggle with factual recall
“It's surprisingly good at just freeform, like kind of fluent text generation. So you can tell it to like create a story or create a tweet or create a scientific paper abstract, and it does a pretty good job at that. And before that, whenever I talked to my, yo…”
Zaharia: 6B parameter models can achieve instruction following with 50x less data
“We just had a larger data set of, you know, human-like conversations, and we had this you know, very kind of modest size open source model that's only six billion parameters, only trained on less than one terabyte of text. So like, 50 times less data than GPD …”
Goyal: Impira's document extraction tech became totally irrelevant with LLMs
“Well, I went through this myself watching the technology that we built to do document extraction at Impura become, you know, totally irrelevant.”
Khan: Bill Gates challenged OpenAI to build an AI passing AP Biology
“It turns out that Bill Gates, when he saw GPT-III, he's like, oh, this is cool. But we all know GPT-III really didn't have a good handle on knowledge, and he told the OpenAI team, he's like, I'll be impressed if this could pass the AP Biology exam. He literall…”
Valenzuela: It takes 12-24 months to understand new AI breakthroughs
“The moment something gets released, like, let's say transformers or a particular piece of technology that you think would be interesting or could be worth experimenting with, I think it takes a collective set of months, like, 12, 24 months sometimes to underst…”
Gil: Five years ago, Anthropic barely existed and OpenAI was early
“Anthropic basically didn't exist five years ago. OpenAI was still quite early. I think GPT-III just came out and SpaceX was trading at 80, a hundred, something like that.”
Zhao initially overlooked GPT-3 because it seemed limited to marketing copy
“I personally, I have to admit, I slept on it. On GPT-III, even saw GPT-III, it feels like, what is this thing useful for? It's like, yes, for marketing, for content writing, for creative first draft. Didn't really click for me.”