why aren't all 6,166 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 36 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Opinion
Howard: Autonomous AI coding agent Devin produces low-quality, useless software
“Devon's an agent you know, a bunch of tools, tool calls, and tied together with an OpenAI model, if I understand correctly. Yeah, and it actually ended up definitely supporting our thesis, which is, there are so many places we wished we could have got involved…”
Opinion
Jeremy Howard sees no reason to believe Artificial Superintelligence will occur
“I have no particular reason to believe that will happen, and for every point until we get there, if we ever get there, by definition, there's going to be humans interacting with AI, and so that's what I care about, is how do we do that In an optimal way.”
Opinion
Mike Palmer: Tableau acts as superficial wrapping paper for data
“And I think that Tableau is wrapping paper in Japan. You really wanted the toothbrush, but somehow what you really got was wrapping paper.”
Opinion
Mike Palmer: Microsoft Fabric is a marketing rebrand of legacy software
“And I'm directly accusing Microsoft here. I think their application products are not good in their cloud products. I think fabric is a run it back strategy on office through 65, where they just provide a marketing name to some longstanding old products.”
Opinion
Mike Palmer: Google's Looker acquisition failed by locking out non-experts
“Google's experiment with Looker has failed, and with Looker, they built a LookML, which by the way, I would say back in 2017, it was probably the best product on the market, but they built a product for experts, and they ensured that it was going to be a produ…”
Prediction Not checkable as stated
Sigma CEO Mike Palmer says text-to-SQL AI products are a joke
“So I think these products are a joke. I don't think that they're going to succeed and we don't care about them.”
Prediction Not checkable as stated
Levie: Proposed US tariffs will cause a total economic disaster
“If as of, you know, Tuesday afternoon, you know, the tariffs that have been proposed, if those roll through you know, this is going to be a total disaster.”
Assertion Supported
Chollet: 50,000x LLM scaling yielded flat progress on ARC benchmark
“Because between, like, GPT-II and GPT-IV. There's been this 50,000 X scale up of base models that has resulted in, in, in basically a flat curve. On Arc.”
Opinion
Kiela: Core language model development is almost solved and plateauing
“It's not even really about language models anymore. That has almost been solved, right? That's kind of why you see things plateauing off a little bit as well.”
Opinion
Kiela: Long-context LLMs are inherently incredibly wasteful
“Long context models are inherently incredibly wasteful. You're paying for all this compute, and that's maybe why some of the companies that are trying to really sell long context model, long context window models, they will make more money from that, right?”
Opinion
Misra: CapCut relies on simple UI and TikTok distribution rather than AI
“Whereas I think Capco's approach is much more traditional. They're actually just trying to do exactly what Canva did, which is, okay, let's make the UI simpler and add a few more buttons and essentially bootstrap it to TikTok and distribute it like crazy.”
Opinion
Misra: AI video has no positive use cases in documentary footage
“But on the documentation side, there's no good thing that AI video can do. Not one good thing, right? Like there's, it's all bad. There's nothing good.”
Assertion Not checkable as stated
Ada uses runtime guardrails to prevent inaccurate AI responses entirely
“Increasingly, we make those assurances in runtime, so it's actually not possible for ADA to deliver an inaccurate response.”
Opinion
Masad: Traditional AI coding tools do not matter compared to agents
“So all the stuff that we built around coding AI, I don't think it matters. What really matters is being able to chat with an agent and get an application on the other end.”
Prediction Not checkable as stated
Masad: Long-tail SaaS products will disappear due to AI software generation
“As, you know, non-professional software engineers are able to build their own software I think that the demand for the, you know, plethora of SaaS that we have today will also go down, and that will reduce, because you'll be able to generate software on the fl…”
Prediction Not checkable as stated
Masad: Total software engineer headcount will stay roughly constant
“So I think I think the population of software engineering will probably be constant and not grow all that much.”
Opinion
Borgman: Tabular acquisition gives Databricks marketing win, not open-source control
“I think probably the biggest thing that they get out of the acquisition is the ability to tell the market, That they can do iceberg two and not look like they had made a mistake with Dell with Delta. You know, that, that they can, they get sort of a marketing …”
Prediction Not checkable as stated
Habib predicts AI will be able to run companies within five years
“This is AI that in three to five years is going to be able to run companies.”
Opinion
Benaich: The AI existential risk debate was overblown
“I felt like the extra risk kind of debate was kind of overblown .”
Opinion
Bernhardsson: GPU alt-clouds are real estate businesses adding little stack value
“It's like sort of like almost like real estate, right? Like they own sort of, you know, real estate and they rent it out, arguably sort of, you know, we work, you could say, if you want to be, you know, a little cynical, but like not a ton of value, like highe…”
Assertion Not checkable as stated
Delangue: China is likely the current leader in open-source AI
“China has been publishing much more open source AI lately. I would argue that they're probably the leader today of open source AI which is surprising to some, but for example, in, in video, they've been leading in, in open source AI.”
Insight
Delangue: Traditional software startup rules are outdated for AI
“A lot of the things that we learn with traditional software are like outdated with AI.”
Prediction Not checkable as stated
Socher: AI scaling will hit logarithmic leveling off in reasoning gains
“I do think we are going to hit a sort of logarithmic kind of leveling off off like how much more data will give us that much more reasoning, right?”
Insight
Socher: Nvidia will match AI hardware startups' 100x gains before startups reach scale
“By the time you get that out and it's actually scalable and it can really train it and all the software is ready for it. And I can now go on AWS and spawn up your new hardware, like, Nvidia will also have been a hundred X faster with their latest and greatest …”
Assertion Not checkable as stated
Socher: Half of competitors' AI search citations are random, irrelevant links
“Some of our competitors, half of their citations are Independent, random links that have nothing to do with the sentence that they're behind.”
Prediction Not checkable as stated
Pomel: Paul Graham's 'Founder Mode' essay will do more harm than good
“My worry about the founder mode, and everything that gets pulled down to a very short piece like that, is that I think it's going to be used and abused in all sorts of different ways, because there's so much context that goes into every single word in there, l…”
Insight
SDR and CSM roles often serve as a crutch, says Aaron Katz
“In my experience, it can often, both of those functions can be a crutch for a broader issue inside of the company.”
Prediction Not checkable as stated
Scaling compute and GPUs alone won't yield autonomous enterprise AI
“I'm not an expert in the field, but I believe that this is gonna we need Another giant leap of innovation to get there. I'm not sure just throwing compute and increasing the number of GPUs without some fundamental discovery, it's gonna create this.”
Insight
Liu: Fully autonomous agentic AI approaches are fundamentally challenged
“And the key here is you can't automate end to end things with AI, right? And that's why I think like the agentic auto GPT like approach is really challenged because, you know, there's, it's just too hard for AI to kind of reason about every single step, break …”
Prediction Not checkable as stated
Most major software companies will eventually integrate a Web3 database
“And so there's this asymptotic cost curve that will come down, and at some point, our belief is that most major software companies will actually have a Web three database as part of their stack.”
Prediction Not checkable as stated
Evans: VR headsets will not replace smartphones as primary computing platforms
“You're not going to wear a headset, no matter how light and cheap it is, all day outdoors. I would not have worn it walking here, even if it weighed a hundred grams and had completely perfect pass-through. Therefore, it can't replace your phone. Therefore, we …”
Insight
Valenzuela: AI researchers face existential crisis as model scaling solves problems
“A lot of them are going through an existential crisis of sorts. It was maybe a lot of things you were trying to solve and work are just going to be solved by training larger models.”
Assertion Not checkable as stated
AI content creation now surpasses the bottom 80% of marketing employees
“AI can generate content that has gone from laughably bad to, like, better than the bottom 25% of marketing employees to, like, maybe better than the bottom 80% of marketing employees and on a trajectory to continue progressing there.”
Opinion
Traynor: There is no line of sight to a trillion-dollar European company
“Like I don't see a line of sight to a trillion dollar company in Europe full stop.”
Opinion
dbt CEO Tristan Handy: The modern data stack concept is dead
“I don't think the modern data stack is a useful idea anymore.”
Prediction Not checkable as stated
Eiso Kant: AI will recycle world data into synthetic data within years
“And so this is kind of our view and our, if you extend this a couple of years out, and this is where some people will probably have objection with us. We think that this will go so far. That we will kind of recycle all of the world's real data into higher qual…”
Opinion
Srinivas: Google is making a mistake chasing OpenAI with Gemini
“Hence why, like, you know, I actually think Google is making a big mistake by trying to do whatever OpenAI is doing, right, like, going after them with the large, oh, I'm not, they're having GPT-IV, I'm going to turn Gemini.”
Opinion
Srinivas: Building a web search index is harder than competing with GPT-4
“We believe that building your own index is even harder than trying to compete with GPT-IV because it's not a problem that's just solved with money.”
Disclosure
Srinivas: Perplexity will not crawl websites that block web crawlers
“Yeah, I mean, like, if they don't want to be crawled, we shouldn't crawl them. You know, that's just being how the internet has worked. Like, you know, people have the robots, the text file, and like, you know, if they don't let you do it, then you should just…”
Opinion
Srinivas: Citing web sources in AI search constitutes legal fair use
“And it's actually fair use. The fact that you're attributing credit is fair use.”
Opinion
Mathew Lodge argues prompt engineering is a fallacy and merely trial-and-error
“And so the idea that there's something called prompt engineering, engineering in the sense of you're applying an approach because it's going to give you the output that you desire. Is a complete fallacy. At best it's trial and error. It's prompt trial and erro…”
Assertion Not checkable as stated
Goshen: Scaling LLM size is already showing diminishing returns
“And we're already start seeing diminishing returns. I mean, you take the architecture, you increase the size of the models or, and you see that At these levels of scale where, you know, we are dealing with things, diminishing returns, we start seeing it.”
Prediction Not checkable as stated
Shah: AI models attempting medical diagnoses will kill patients
“I mean, they just keep going there. I'm going to do diagnoses because it's grand or it's challenging, but I mean, they're going to kill somebody.”
Assertion Not checkable as stated
Socher: You.com solved AI hallucinations before anyone else
“We figured that, I don't know, problem of hallucinations out before anyone else.”
Assertion Not checkable as stated
Socher: Microsoft Bing copied You.com's AI image generation feature
“That was eventually copied, and Bing also has that feature now within Bing.com.”
Prediction Not checkable as stated
Socher: Plumbers will eventually earn more than marketers as AI automates knowledge work
“Probably at some point, your plumber might get more than your marketer because the marketer can use tools and be way, way more efficient, but the plumber AI is going to take a very long time because None of the plumbing companies are collecting data, having ro…”
Assertion Not checkable as stated
Riparbelli: LLMs are not production-ready for 95% of intended tasks
“They're not production ready for 95% of the tasks that people think that they want to use them for.”
Prediction Not checkable as stated
Riparbelli: Most harmful AI misuse will emerge from open source models
“And I think we'll see that a lot of harmful use of these technologies will emerge from kind of like the open source world.”