The Wisdom Wall
13 quotable lessons, heuristics and mental models. Every one is playable at the moment it was said. No fortune cookies allowed.
“the two most useful thought exercises we do in labs, one is like visualize the gap between what the models can do today and how most people use it. It can be closed that gap. That's one. And the other one is imagine what the models are bad at now that they're actually going to be really good at in six months. And let's…”
“if you get to, like, 50% as good as you would have done yourself, I don't think that's good enough, and it won't speed you up. And in fact, it's like, I don't know, I could have just done this myself, and now, now, then at least I would have known what it's done. When you start clearing this sort of like 75 to 80%…”
“once you get a service as widespread as Instagram or as widespread as Facebook or WhatsApp, it's hard to introduce a new behavior there. Um, you know, we did it with stories. I think they've since done it with reels, uh, but it's almost like one, you get one per generation.”
“I've learned to not really trust day of or even week of model reactions. You don't really know until you've put it through its paces. And so like, I almost just completely block out the noise in the first couple of days of any new model release, because I don't know, everybody has maybe their like toy, like example…”
“I've learned to not really trust day of or even week of model reactions. You don't really know until you've put it through its paces. And so like, I almost just, Completely block out the noise in the first couple of days of any new model release, because I don't know, everybody has maybe their like toy, like example…”
“the two most useful thought exercises we do in labs, one is like visualize the gap between what the models can do today and how most people use it. It can be closed that gap. That's one. And the other one is imagine what the models are bad at now that they're actually going to be really good at in six months. And let's…”
“we're still asking people to understand way too many concepts of like, what is, what is, you know, the difference between like my sandbox environment and production or like connected MCP as myself or others, or how should I store data?”
“even if somebody has a like two X better AI powered, you know, doc editor, you're going to move all your stuff up. Maybe, probably not.”
“the scaling laws, I think, paint a picture of what is possible, but is not predetermined. Like, to actually get there, there's a lot of, actually, really difficult, both machine learning and engineering work”
“I think it's, it's less that there's a lot of social media, um, sort of oriented folks that have now moved into AI. It's more that I think a lot of the best product people were focused on that, you know, even four years ago, you know, pre-chat GPT, uh, you know, pre the emergence of a lot of these LLMs. Um, so I think…”
“you would see an emergence of a creative tool and whether they were able to sort of transcend that to being a network that you come back to was often not the case.”
“For us, the coding piece, beyond just the fact that coding is a really high value economic activity, I really see the model's ability to plan, write code, solve problems as not just being useful for software engineering, but being really critical path to the kind of like agentic behavior we want to build long-term.”
“They're often the like power users, extreme users that are telling you something about the edge of what's possible. And then you can kind of try to generalize it more, more broadly too”