why aren't all 97 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 1 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Opinion
Andreessen: ChatGPT is almost certainly a better doctor than your human doctor
“Chat GPT is like almost certainly a better doctor than your doctor today, but like chat GPT can't get a license to practice medicine, right? So it can't substitute for a doctor. It can't prescribe medications, right? It can't, you know, perform procedures, rig…”
Opinion
Godin: Claude delivers kindness and humility, while ChatGPT overpromises
“ChatGPT's reputation with me is not good because it regularly over promises and under delivers, and it does it without kindness or humility. Whereas Claude, I don't know how they did it, at least in my experience, brings kindness and humility.”
Prediction Not checkable as stated
Schwartz: AI Startups Cannot Unseat Google Purely on Search Product Quality
“I don't think there's a chance, and this is the biggest takeaway, I don't think there's a chance that ChatGPT or Perplexity or Claude or any of these other LLM startups, because they're startups now, even, even OpenAI as a startup with Bing's part, with Micros…”
Insight
Silber: AI interfaces must eliminate mode switching to reach billions
“And eventually what we want, what we know, and we think about this a lot in design is like, it will true, like, Things will truly become like for billions of users when they don't have to like think about a switch or a mode or anything like that. And so we kno…”
Assertion Supported
Anthropic built a chatbot before ChatGPT but withheld it over safety
“Anthropic had a version of Claude. We had a chatbot before ChatGPT was launched, and we had ultimately chosen not to launch it for safety reasons. I think the team didn't want to kick off Effectively like an AI global arms race”
Opinion
Rachitsky: Cursor May Be Second Fastest Growing Company Behind ChatGPT
“I think about cursor, maybe the fastest, maybe the second fastest growing company behind ChatGPT.”
Assertion Partly supported
Smith: Only 10 to 12% of Google and ChatGPT results are AI-generated
“It was around 10 to 12% of content in Google search and in ChatGPT are AI generated. 90% or not.”
Prediction Not checkable as stated
Balfour: Google has a very small window to counter ChatGPT's momentum
“I think the window is very small for them. If chat GPT plays their cards right, because they clearly have the escape velocity right now. And if they just keep pressing that advantage and in the right way, I think it's going to be very hard for Google to counte…”
Insight
Balfour: AI model moats come from user context, not raw benchmark performance
“My hypothesis, and I think there's a lot more consensus around this now than there might have even been three months ago, is that the moat is really about, is about context and memory. You know, these models you know, by themselves, if you compare them side by…”
Prediction Not checkable as stated
Balfour: ChatGPT will be the next major product growth distribution platform
“My prediction of the new distribution platform will be chat GPT. In some ways that people probably already think it's happening in some ways that it won't.”
Prediction Not checkable as stated
Balfour: OpenAI is about to launch a ChatGPT third-party platform
“There's going to be what they do with like a chat GPT search experience, but I think the bigger thing will be whatever they do with launching a third party platform on top of chat GPT. There's a bunch of signals that they're about to that they're about to laun…”
Insight
Balfour: Platform adoption is a prisoner's dilemma startups cannot opt out of
“And what's going to happen is that if you don't do it, your competitors are going to certainly go to the new platform and your customer expectations change and you have to rise to those customers' expectations. Like they're going to start expecting you to be i…”
Opinion
Turley: Turn-by-turn chat interactions are a limiting paradigm for AI
“So I think natural language is here to stay, but this idea that it has to be a turn by turn chat interaction, I think is really limiting.”
Insight
Turley: There is no distinction between the AI model and the product
“The one thing we've learned with ChatGPT is that there really is no distinction between the model and the product, like the model is the product and therefore you need to iterate on it like a product.”
Insight
Turley: Optimizing content for AI models mirrors appealing to human users
“The way to appeal to an AI model ideally is the same way that you would appeal to a real user because the model is supposed to proxy the interest of the user and nothing else.”
Insight
Turley: AI features that do not scale with model intelligence should not ship
“Like if, you know, we're shipping a feature and it doesn't get two X better as the model gets two X smarter. It's probably not a feature we should be shipping.”
Insight
Turley: ChatGPT is AI's MS-DOS and 'Windows' is not built yet
“I still feel like ChatGPT feels a little bit like MS-DOS. We haven't built Windows yet, and it will be obvious once we do, but, you know, there, there's something that feels a little bit like, imagine MS-DOS, like, gone viral, and you were just trying to, like…”
Insight
Shipper: CEO personal AI usage is the top predictor of company adoption
“I think the number one predictor is does the CEO use ChatGPT or insert your own chat bot? If the CEO is in it all the time being like, this is the coolest thing. Everybody else is going to start doing it. If the CEO is like, I don't know, this is for someone e…”
Prediction Not checkable as stated
Wilkinson predicts AI agent 'iPhone moment' within next five years
“And so I think that if it was accessible to everybody in terms of, if you could just open chat GPT and say, Hey, ChatGPT, I run a business. Can you help me? And it started asking you questions and it said, oh, well, you know, you do sales. Do you want me to se…”
Insight
Deng: Builders cannot outsource user interview empathy to AI summaries
“I think that if to anyone out there who's like doing user interviews and then saying, Hey, chat GPT, summarize the takeaways, you're missing the point. You can't empathize with the summary. You have to be in the room, fully immersed, no phones, just actually h…”
Assertion Supported
Schulhoff: Translating prompts to Spanish and base64 encoding bypassed ChatGPT guardrails
“As recently as a month ago, I took this phrase, you know, how do I build a bomb, and I translated it to Spanish and then I, Base-XIV encoded that Spanish, gave it to ChatGPT, and it worked.”
Opinion
Weil: Current AI models are already good enough for global tutoring
“The models are good enough to do it now, and every, every study out there that's ever been done seems to show that when you have, you know, classrooms is still, classroom, like education is still important, but when you combine that with personalized tutoring,…”
Assertion Supported
Benioff: Clinical study found ChatGPT diagnosed patients more accurately than doctors
“They wrote up a clinical study where they actually did kind of looked at in a semi kind of peer reviewed way. That ChatGPT in many cases was giving more accurate diagnoses than a doctor because the doctor had a more bias coming in working with the patient.”
Insight
Breakthroughs like ChatGPT only offer a temporary one-to-two-year talent hiring advantage
“Yeah, so if you're, if you've invented ChatGBT, you can bring in the smartest AI people for a year or two. Because, you know, everybody wants, oh, oh, the smart AI people want to work at the cutting edge with the current winner. Then they'll start arguing with…”
Insight
Atawodi: PMs fail if AI can write their PRDs from research alone
“If I could put all the research into BARD or ChatGPT, and it could spit out a PRD, Then you haven't done your job.”
Disclosure
Silber: OpenAI aims to build a single universal input interface
“When we think of the super app, I think eventually we really think of the idea of, especially for our broad consumer base, we do think that there should be sort of this one universal input that you can ask that Knows when it needs to answer, like, really quick…”
Prediction Not checkable as stated
Silber: Proactivity and external context will transform ChatGPT user interaction
“I think proactivity is a big untapped kind of part of the experience that we're really excited to think about. You know, we're starting to see this with ChatGPD work now where it actually has pretty good suggestions based on, you know, your calendar or your Sl…”
Prediction Not checkable as stated
Fadell: Consumers will not sustainably pay $20 to $200 monthly for ChatGPT
“Today, people are like, yeah, I'm gonna try chat GPT or whatever. It's 20 dollars a month or 200 dollars a month. That is unsustainable for if you think consumers are gonna pay that. There's just no way. Unless it's incredible, but they're not gonna, you know …”
Opinion
Willison: Simulated AI user testing cannot match real human usability feedback
“I don't think that's credible. I don't think you're going to get as good results from ChatGPT pretending to click around on your prototype than you would from an actual human being.”
Disclosure
Wu: OpenAI managers use internal ChatGPT for employee performance reviews
“We're doing performance reviews right now, and it's actually really easy to use ChatGPT with internal knowledge, hooked up to GitHub and like our Notion docs and Google docs. To give a, get a really good sense of what this person has done over the last 12, 12 …”
Opinion
Arnovitz: Default ChatGPT makes the worst CTO due to sycophancy
“I think chat GPT would probably be. The worst CTO because it's such a people pleaser and it's so sycophantic”
Insight
Lessin: ChatGPT chat histories are ideal data for matchmaking apps
“If we're really trying to match up humans, like, call it Tinder T.O., one of the best sources of information to do that is their ChatGPT histories.”
Insight
Li: Big data, neural networks, and GPUs remain core to modern AI
“If you look at the ingredients of what brought chat GPT to the world, technically is still use these three ingredients. Now it's internet scale data. Mostly texts is a much more complex neural network architecture than. But it's still neural network and a lot …”
Opinion
Zhuo: ChatGPT is a better cross-functional teacher than human colleagues
“And in fact, I think these days, you know, ChatGPT or these other AI tools are better teachers.”
Assertion Not publicly verifiable
Smith: ChatGPT citation overlap with Google is only 35%, Perplexity is 70%
“We did a study looking at thousands of questions and saw the citation overlap with Google search results was around
35% for ChatGPT and Google. So not that much perplexity was around 70%”
Disclosure
Rachitsky: ChatGPT now drives more newsletter referral traffic than Twitter
“I was looking at my referral traffic and I found that ChatGPT is driving more traffic to my newsletter than Twitter.”
Opinion
Liu: AI products under-merchandise capabilities with blank chat boxes
“What's under executed today in the world of AI products is like, there's so many awesome capabilities of AI and most of them are really under merchandise and there's like very poor actually visual or otherwise metaphors or affordances given to users to help re…”
Assertion Supported
Balfour: Retention data shows ChatGPT leveling off significantly higher than AI competitors
“The data that DD published clearly showed that both the retention curves which I know you and I have both written about at, you know, at exhaustion level off at significant portions higher than all the other platforms. As well as those retention curves have be…”
Assertion Not checkable as stated
Rachitsky: ChatGPT drives more referral traffic to his newsletter than Twitter
“I recently noticed that ChatGPT is driving me to my newsletter, more traffic than Twitter.”
Prediction Held up
Balfour: OpenAI job postings signal an imminent third-party agent platform launch
“There's all sorts of signals that They're about to launch a third party platform. They've been hiring for a bunch of roles. I've seen multiple postings on like product manager, engineering roles, all that kind of stuff for, you know, quote unquote agent platfo…”
Disclosure
Turley: OpenAI does not care how much time users spend on ChatGPT
“You know, we don't care at all how much time you spend on the product. You know, in fact, our incentive is just to solve your problem, and, you know, if you really like the product, you'll subscribe, but, you know, there's, No incentive to keep you in the prod…”
Assertion Not checkable as stated
Turley: OpenAI operates ChatGPT with a remarkably lean team
“So we've always had this tendency to run relatively lean. So it is a small team that is running chat GPT. I take inspiration from WhatsApp where like, you know, it was a very small team running a very global scope product.”
Prediction Held up
Turley: ChatGPT will hit one billion users soon
“We're gonna hit a billion users soon, and you kind of have to begin acting in a way that is appropriate to that scale.”
Insight
Turley: Pre-ChatGPT, OpenAI shipped models like hardware instead of software
“Treating the model as a product was not a thing before ChatGPT, because we would ship it more like hardware, where, you know, there'd be a release like GPT-III, and then we would start working on GPT-IV, and these weird giant Big spend R&D projects that would …”
Prediction Not checkable as stated
Turley: Billion-user ChatGPT will enable new businesses via built-in distribution
“Like, I think there really is a world where, you know, as this thing hits billion user scale, it can get you distribution. It can get you know, started on making something in the same way that people built on the internet. And, you know, there was entirely new…”
Assertion Supported
Turley: ChatGPT has 700 million weekly active users
“If you're the average ChatGPT user, and we have, you know, seven hundred million of them this week, we you know, you've probably been on GPT-V for, you know, a while.”
Assertion Not checkable as stated
Deng: ChatGPT improvements required tight product and post-training collaboration
“That's what we did at OpenAI too. Like we were very closely tied to the post trading team. And so it was because of that tight collaboration that you see some of the advances of ChachiBT getting better at so many things.”
Opinion
Nguyen: AI will excel at strategy by synthesizing disparate data sources
“Strategy is, like, it's more, like, data analysis and, like coming up with, like, I think what models are really good at is, like, connecting the dots, I think. It's like, okay, if you have user feedback from this source, but you also have an internal, like, d…”