why aren't all 10 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Opinion
Labenz: GPT-4 to GPT-5 capability leap matches GPT-3 to GPT-4
“And if you look back to GPT three, you know, there's a huge leap. I would contend that the leap is similar from GPT four to five.”
Assertion Supported
Mensch: 2020-2021 AI research suffered from flawed scaling laws in GPT-3 and Gopher
“There was also a misconception on GPT-free and basically in 20, 21, every paper made this mistake.”
Assertion Not checkable as stated
Misra claims he built the first known implementation of RAG using GPT-3
“And I got GPD three to do in context learning, few short learning, and you know, it was kind of the First, at least to me, it was the first known implementation of RAG, Retrieval Augmented Generation, which I used to solve this problem of querying, getting GPT…”
Disclosure
Adam D'Angelo: Quora built Poe because GPT-3 answers failed to match humans
“The way we got to it was we, in early, we started experimenting with using GPT-III to generate answers. For Quora. And we compared them to the human answers and sort of realized that they weren't as good, but what was really unique was that you could instantly…”
Assertion Not checkable as stated
AI App Day-90 Retention Increased Consistently With GPT Model Upgrades
“There's an example of an AI-native companionship product where they actually did this test where they used GPT-one, GPT-two, GPT-three, and they actually tracked the cohort of user retention using each of the models. And it's very clear as the model quality im…”
Assertion Not checkable as stated
Mensch: AI industry stopped publishing open research after GPT-3
“And all of a sudden in with GPT-free, this tide kind of reversed and companies started to be more opaque about what they were doing because they realized there was actually a very big market. And all of a sudden in 20, 22, on the important aspects of AI and on…”
Disclosure
Amodei: Python made up only 0.1% to 1% of GPT-3's training data
“When we looked through it was like, you know, it's hard to estimate, but it was something like, you know, maybe .1% to one percent of the data that we scraped was Python data.”
Assertion Not checkable as stated
Schroeder: Emerging market VCs held multi-day offsites on GPT-3 ramifications
“Every venture capitalist I met has already had a multi-day offsite to stop and reflect about what its ramifications can mean in the medium term and what it may mean, not only for their portfolios, but their theses.”
Assertion Partly supported
Masad: GPT-3 slashes parser development time from weeks to 15 minutes
“GPT-III is incredibly good at parsing. If you give it a malformed JSON, it will still parse it. Writing parsers is one of the hardest things you can do in programming. Writing parsers in GPT-III is one of the easiest thing you could do. You could spend 15 minu…”
Assertion Supported
Misra: GPT-3 prompt matrix rows exceed atoms in all known galaxies
“If you just take just the old first generation GPT-III model, which had a context window of 2000 tokens and a vocabulary of 50,000 next tokens or 50,000 tokens, then the size of it, the number of rows in this matrix is more than the number of atoms across all …”