The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 83 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Socher: Existing AI plus more compute can cure diseases and aging
“With existing technology and giving it more data and more compute, we can already cure a lot of diseases. We can already cure many of the aspects of aging. We can already build better fusion like reactors and systems. We can already create new materials.”
Socher: AI scaling will hit logarithmic leveling off in reasoning gains
“I do think we are going to hit a sort of logarithmic kind of leveling off off like how much more data will give us that much more reasoning, right?”
Socher: Nvidia will match AI hardware startups' 100x gains before startups reach scale
“By the time you get that out and it's actually scalable and it can really train it and all the software is ready for it. And I can now go on AWS and spawn up your new hardware, like, Nvidia will also have been a hundred X faster with their latest and greatest …”
Socher: Half of competitors' AI search citations are random, irrelevant links
“Some of our competitors, half of their citations are Independent, random links that have nothing to do with the sentence that they're behind.”
Socher: You.com solved AI hallucinations before anyone else
“We figured that, I don't know, problem of hallucinations out before anyone else.”
Socher: Microsoft Bing copied You.com's AI image generation feature
“That was eventually copied, and Bing also has that feature now within Bing.com.”
Socher: Plumbers will eventually earn more than marketers as AI automates knowledge work
“Probably at some point, your plumber might get more than your marketer because the marketer can use tools and be way, way more efficient, but the plumber AI is going to take a very long time because None of the plumbing companies are collecting data, having ro…”
Socher: AI will do for biology what calculus did for physics
“AI is kind of what Calculus did for physics. AI will do for biology in the sense that it'll help us weave back together lots of very complex pieces that build these complex systems that then have certain properties.”
Socher predicts AI will reach superhuman capabilities in any domain with simulation
“I think we can basically predict where AI will certainly have superhuman capabilities. And those are all scenarios and all domains where we can either have a simulation and or a verification tool.”
Socher: AI hallucinations can be helpful when exploring novel proteins
“But I do think hallucinations can be also very helpful for AI when you want it to explore novel kinds of proteins.”
Socher: Physical constraints will prevent an AI hard takeoff
“And as bullish and excited as I am about AI, I'm not a believer in this crazy hard takeoff. I think, yes, things will accelerate, but there are certain things that will just require time because of physics and constraints in the real world, such as like long-t…”
Socher: Singapore or China probably more likely to adopt AI economic modeling
“My hunch is like Singapore or China will probably be more likely to try to use those ideas. Say, hey, we all agree, or we at least make it very clear that this is our objective function. And then, you know, we're going to really try our best to set the various…”
Socher: Chinese open source companies distilled knowledge from OpenAI and Anthropic models
“The few large closed labs, Anthropic and OpenAI, took almost everything they could from the open internet trained a model, but then the Chinese open source companies basically siphoned a lot of that knowledge out of those closed source models by distilling it.”
Socher: Recursive's $410M AWS agreement will likely be its smallest compute deal
“That will probably be one of the smallest compute deals that will happen in, in our future.”
Socher: Recursive's early Eureka system outperforms months of human endeavor
“Our system, the sort of first instantiation of this Eureka machine and a very narrow domain can already outperform months and sometimes years of human endeavor on particular problems.”
Socher: Top AI models have run out of high-quality human text data
“I think a lot of the top models, you can't add multiple orders of magnitude more text to them, because there isn't that much more text around.”
Socher: Open-source models will make value capture harder for foundation model companies
“Once others can go out into the world and an open source, a massive, large language model it's gonna be harder and harder to capture that value.”
Socher: No company has made significant progress in conscious, self-aware AI
“There is no company that has made any significant progress in conscious, self-aware, self-reflective AI. And hence, it's very hard to predict when it will ever happen because we're making no progress towards it.”
Socher: There will never be another severe AI winter
“There will never be an AI winter again, the way we've seen in the past. If at all there will be an AI winter, it'll be like a California type winter.”
Socher: Web traffic from AI agents will surpass humans within years
“I think in the next few years, we're going to see more AI agents surfing the web. Then people surfing the web”
Socher: Startups cannot be 10x better than Google on simple consumer search
“If you think about it from first principles, there is nothing you can do to be 10 X better.”
Socher: I bet an OpenAI founder AGI won't happen by 2026
“I actually have a bet with one of the OpenAI founders about whether we'll reach AGI I think we have like two years left for the bet, and I'm pretty sure I'll still win the bet.”
Socher: Salesforce research team invented prompt engineering in 2018
“As part of the research team, we actually invented, ah, prompt engineering in 2018”
Socher: Don't train LLMs from scratch without hundreds of millions of responses
“And yeah, I don't think you should attempt it unless you have, you know, hundreds of millions of responses that to really like train your own model versus just fine-tune it a little bit. Like certainly not from scratch.”
Socher: Generating protein sequences with LLMs will transform medicine next decade
“They use large language models to generate new protein sequences. And I think that will change all of medicine in the next decade in a massive way.”
Socher: Only a few dozen horizontal AI companies will see major success
“I do think there will be probably only a few dozen horizontal companies that are going to be really major breakout successes. But there will be thousands of vertical application, what you call it, sort of vertical companies that are successfully using AI for t…”
Socher says AI verifiers will change all programming and the digital economy
“All of programming will change, and that will be a major impact on the entire digital economy, which is the knowledge economy, and so on.”
Socher: Recursive will build AI-for-AI before tackling physical sciences
“So at Recursive, we are fairly sure that we have to start with AI for AI and then make it really, really good at doing research on creating better AI so that it has the equivalent of 50,000 PhDs in terms of knowledge and its own capabilities, and only then go …”
Socher: Grounding models in search results largely resolved factual hallucination
“And so I think the initially people thought, oh, we need neuro symbolic reasoning, blah, blah, to do all this. We just needed more examples of don't hallucinate now, like, take real facts from a search engine, and then mostly summarize those. And then those, l…”
Socher: Profluent closed multi-billion dollar contracts with Eli Lilly
“They've now closed, like, multi-billion dollar contracts with Eli Lilly at Profil and his company because they've created new kinds of proteins that are, for instance, even better than CRISPR-Cas-Nine and at gene editing and being even more specific and target…”
Socher: AI's job impact depends on price elasticity of demand
“And my theory here after thinking about this for quite some time is largely dependent on the elasticity of the demand of the product when its prices go down.”
Socher: AI economic policy simulation unlikely in US for very long time
“I don't think this is very feasible in the United States for a very, very long time. It's just so much identity politics and special interest groups and how, you know, super PACs and so on are like, get funded. That is very, very unlikely to be used.”
Socher: Parallel Bio secured FDA approval to skip certain animal trials
“That company alone has already gotten FDA approval to skip certain animal trials.”
Socher: Compute is the biggest constraint for AI scientific machines
“Compute is the biggest constraint.”
Socher: A lot of Neolab AI startups will not succeed
“We are, and I struggle with this sometimes, the Neolab category. I don't love it because I think a lot of them will not succeed.”
Socher: Testing students' writing requires removing internet and using paper
“If you want to test how students write essays, you probably have to take away the internet and just have them do some handwritten essays sometimes if that's still what you want to test for.”
Socher: Lower-performing workers benefit most from initial AI automation
“In the beginning of this industrial revolution and workflow sort of process automation that we're seeing, the bottom half of performers actually benefit the most.”
Socher: Top programmers get limited AI benefits but provide its training data
“Currently, the top programmers don't actually benefit that much from AI, but they're informing AI a lot, and they're giving better training data to it.”
Socher: AI will give every child a personal tutor within years
“Now, what do really wealthy people currently have where AI still hasn't done that yet, but we will obviously in the next few years. It's like a billionaire can have a personal tutor for their kids. AI will be a personal tutor for your kids.”
Socher: Cheaper AI will skyrocket intelligence usage across tasks and personal assistants
“As intelligence gets cheaper and cheaper, We won't just lose all the jobs that currently require intelligence. We will just use intelligence in more and more places. I think overall, the amount of, like, tasks that, you know, we believe require some decent amo…”
Socher: Scaling laws will show major progress in non-text modalities
“I think we're going to see incredible progress in scaling laws in just these new modalities.”
Socher: Transformer results would take 10x compute and engineering with LSTMs
“Probably if it wasn't for transformers, it would have just been like 10 X more engineering and data needed to get to similar results, even with like past models like LSTMs and so on.”
Socher: Generative AI disrupts fields where verification is faster than creation
“Whenever it's very slow to create an artifact in your space, an image, a text document, and so on, very slow to create it, but very quick to verify its correctness, then Gen AI is going to, like, massively disrupt that space.”
Socher: 95% step accuracy yields 50% failure rates in 15-step AI tasks
“Even if your agent is 95% accurate, but now it's doing, like, 14, 15 steps, each of which is 95% accurate, and you multiply, you know.951549, now, half the time, the overall sequence is wrong, right?”
Socher: You.com gets more queries through APIs than consumer product
“We definitely get a lot more queries coming in through APIs than we do over like the normal consumer you.com product at this point.”
Socher: Pursuing consumer and enterprise motions simultaneously is generally a bad idea
“It's generally a bad idea. I would discourage everyone from doing it. You need a lot more extra funding. You need a lot of very smart people who execute at extremely high levels. It makes everything harder.”