why aren't all 6 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Assertion Not checkable as stated
Altman: AI progressed to PhD-level intelligence across most areas in five years
“In five years we have gone from this, like, thing that could barely write a sentence to a thing that is like, you know, PhD level intelligence in most areas.”
Opinion
Altman: No Great Businesses Were Built on GPT-3 Except Copywriting
“But, with the possible exception of copywriting, no great businesses were built on GPT-III.”
Assertion Supported
Chollet: Base LLMs Score Under 10% on ARC-AGI-1
“So basal alarms were scoring extremely low on V-one, like sub-ten percent, basically. And, I mean, it was true of the original, like, GPT-III actually scoring zero, but that's even true of the latest basal alarms today, you know, as of March.”
Assertion Not checkable as stated
Truell: ChatGPT supposedly cost only 1% more to train than GPT-3
“But it rumored that to go from GPT-III, which, you know, had existed for a while and didn't You know, impressed some people, but was certainly not the breakout moment ChatGPT was. To ChatGPT, it was like a one percent increase in the training costs.”
Assertion Not checkable as stated
OpenAI built a slow, internal web browsing prototype called Truthbot
“OpenAI even had a bot when I worked there called the Truthbot, which John, John built with this team. Where you could ask it a question and it'll go and search the web, and then it'll give you an answer with some sources. And it was very slow, and it was built…”
Assertion Supported
Joseph: Public estimates placed GPT-3 training cost at $5 million
“Like the public estimates for GP three, I remember, were that it cost five million dollars to train, which you're like, on the one hand, five million is kind of a lot, but it's like a lot for an individual person. It's not really a lot from like a company pers…”