Prediction Not checkable as stated
Masad: Professional programmers will see 2x to 10x productivity gains from AI
“But I think if you project forward, those people will also get a lot more tools and going to get more productive, going to hit superhuman productivity. But the professional programmers, this is where actually you start to have that two X, five X, 10 X multiple…”
Prediction Held up
Masad: Useful AI coding agents are 6 to 18 months away
“My feeling is this is within reach, even in the current capabilities. Like if you hold constant the current capabilities, this is when reach within reaching the order of, you know, six to 18 months.”
Prediction Not checkable as stated
Masad: Programmers will act like managers of AI within 3-5 years
“Like I think software could fundamentally change in the next four, three to five years where it looks totally different to someone sitting, sitting today and looking at it into the future. Maybe it looks something like programmers tend to be more like engineer…”
Prediction Not checkable as stated
Masad: Fully automated AI bounty hunters will autonomously earn money
“In the future, I could see people creating bounty hunters that are fully automated. So can you create an AI that can go earn money for you while you sleep?”
Prediction Not checkable as stated
Masad: Bitcoin will long-term become the TCP/IP of money
“I still believe, I think Bitcoin is going to be long-term, the TCP IP of money, but there's going to be a lot of services that could also be Stripe and others and Square that is built on that, like on that set of rails.”
Assertion Partly supported
Masad: A non-coder built a $250k ARR startup in months using Replit
“We've profiled a, an entrepreneur That has a quarter million ARR startup in a few months, and they haven't, you know, earlier this year, they didn't know how to code.”
Insight
Masad: Replit's Moat Is Unifying the Entire Code-to-Deployment Feedback Loop
“The real advantage is the end-to-end journey from the first line of code to the deployment, to getting crashes in production, to making edits, to all of that feedback cycle, which typically in most cases is divided between GitHub and VS Code and AWS and all of…”
Prediction Not checkable as stated
Masad: Full-Stack Dev Platforms Will Enable AI Training Over Large Action Spaces
“And this is, I think, where we're going to get the kind of Richness of training data that allows you to train over a large action space, and that's really exciting.”
Prediction Partly held up
Masad: Commercial AI providers will not release completion models going forward
“Now all the models are chat models. You know, they're not going to be releasing any completion model going forward. And so if you want to build a completion based product, it's actually fairly difficult to do it using commercial APIs.”
Insight
Masad: Training models has become a founder status symbol over product needs
“I think a lot of founders now see it as a point of pride or status to train a model. And the moment we put out the three billion parameter model, like three or four copycats came out of after that. And I, I'm not a fan of what's happening in, in the open sourc…”
Disclosure
Masad: Pitched Zuckerberg in 2022 on open-sourcing LLMs via Open Compute playbook
“And I got a meeting with Zuck actually, and I pitched Zuck on this idea. And I remember around the time he did the open compute project. So what open compute was like Google and AWS are going to keep all their data center secrets because it's a company advanta…”
Prediction Not checkable as stated
Masad: Open-source AI models will eventually match commercial models in performance
“I think on a long enough timescale, obviously there's going to be open source models that are as good as commercial models, but the current landscape makes it hard to kind of imagine how it would play out.”
Insight
Masad: The right hacker mindset is just-in-time learning around AI
“I think embedded in their answer is this attitude of like, if it becomes a problem, I will learn it, right? If the AI can't do it, I will learn it. And I think that's the right attitude for hackers is that you learn just in time to be able to do that task.”
Assertion Not checkable as stated
Masad: Machine learning on code did not work effectively until GPT-2/GPT-3
“Every year or two while starting Replit, I would go look at the state of the art on ML on code and nothing ever really worked all that well up until GPT-II. And you can like take GPT-II and fine tune it and like try to make it write code and was like kind of o…”
Assertion Not checkable as stated
Masad: Replit users see 30% to 50% productivity boost on coding
“Based on our research of how people are using our products. We think it's 30 to 50% more productivity on coding itself.”
Assertion Not checkable as stated
Masad: Replit data delivered a 50% improvement over open-source model
“And then we applied some more tokens from replets data that gave us a 50% improvement over the model that we open source.”
Assertion Supported
Masad: Replit's 3B model outperformed open-source models 20x its size
“And it was state of the art model was better than most open source code models at the time, even things, 20 exit size.”
Assertion Supported
Masad: Users can buy a startup prototype for $50 to $100
“You can go to Replit and get a startup prototype for startup or an MVP for startup for as little as like, 50 dollars or a hundred dollars in some cases.”
Assertion Supported
Masad: 2012 'Naturalness of Software' paper proved NLP models apply to code
“There was this seminal paper in 2012 called on the naturalness of software. And basically a bunch of researchers try to apply NLP to code. And what they found is that actually code Can be modeled like any language. That's why they call it naturalness is becaus…”
Disclosure
Masad: Replit is building container infrastructure to embody AI agents
“Right now we're doing the hard work of building infrastructure on Replit. Like we are building this service that sits inside the container that embodies the AI In the development environment such that it can do things like go to the internet, like install a pa…”
Amjad Masad