Ng: Use A/B testing to hone gut instincts, not just pick variants
Andrew Ng · Andrew Ng: Building Faster with AI · Y Combinator · Jul 10, 2025 · at 20:39
Andrew Ng advises startup founders at Y Combinator on building faster product feedback loops.
0:00 / 0:31exact quote · 31.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I don't just use the result of A-B test to pick product A or product B. My team will often sit down and look carefully at the data to hone our instincts, to speed up, to improve the rate at which we're able to use the first tactic to make high quality decisions. I often sit down and think, gee, I thought, you know, this product name will work better than their product name. Clearly, my mental model they use is wrong, so really sit down and think, to update our mental model using all of that data to improve the quality of our guts on how to make product decisions faster.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Andrew Ng
Ng: Advising people not to learn to code is terrible career advice
“Over the last year, a bunch of people have advised others not to learn to code on the ground so AI will automate it. I think we'll look back on this as some of the worst career advice ever given, because as better tools make software engineering easier, more p…”
Ng: Employees across every job role should learn how to code
“I have a controversial opinion, which is, ah, I think it's time for everyone of every job role to learn to code, and in fact, on my team, you know, my CFO, my head of talent, my recruiters, my front desk person, all of them know how to code, and I actually see…”
Ng: AI existential risk claims are ridiculous hype used to aid fundraising
“This idea that AI is so powerful, we might accidentally lead to human extinction. That's just ridiculous, but it is a hype narrative that made certain businesses look more powerful, and it got Yeah, ramped up and actually help certain businesses fundraising go…”
Ng: Sensationalized AI danger hype is being weaponized against open-source software
“And I feel like this has been used as a weapon against open source software as well, right? Which is really unfortunate.”
Ng: California's SB 1047 would have harmed open-source AI without improving safety
“So I think typing up dangers, supposed false dangers of AI, in order to get regulators to pass laws, like the proposed SB-SB-Ten-Forty-Seven in California, which, thank goodness, we shut down, Would have put in place really burdensome regulatory requirements t…”