AI engineer and author Chip Huyen discusses why developers struggle to decide what to build despite having powerful generative AI coding tools.
Opinion
Huyen: Internet data is maxed out, making post-training the key AI differentiator
“At some point, we are actually, like, have kind of maxed out on, like, internet data, right? And then people, like, text data, people max out. I think a lot of people are doing, like, with other data, like audios and videos, and, like, everyone's trying to thi…”
Opinion
Huyen: AI data labeling startups face severe customer concentration risk
“It's very lopsided, right? Because like, is there only like a very small numbers of frontier labs, right? And they want a lot of data. And there's like a massive amount of like startups or companies providing data. So like, you can see these companies, like th…”
Insight
Huyen: Engineering managers prefer headcount while VPs prefer AI coding agent subscriptions
“Would you rather have access could you rather have, give everyone on the team, like very expensive. Coding agent subscriptions, or you get an extra head count, right? Let's say it's like maybe like and almost everyone could say the managers could say head coun…”
Assertion Not checkable as stated
Huyen: A randomized engineering trial found top performers gained most from Cursor
“He was like, okay, here's more like currently like best performing, average performing, and lowest performing. And then there's a randomized trial. So like they give like half of each group, like access to like cursor. And then he was noticed like over time, I…”
Insight
Huyen: Evaluate Marginal Gains and Switching Costs Before Adopting New AI Tech
“And I think it's a specific question you should ask them is like, first, Like if how much of the improvements could you get, like from like optimal solutions versus non-optimal solutions, right? And sometimes they were like, actually it's not much, right? And …”
Insight
Chip Huyen: Sampling strategy is very underrated for boosting model performance
“Sampling strategy, I think is something extremely important. It can have you boost the performance in a huge way and very, very underrated.”