Crivello: Meta's Llama 4 Has Good Evals but Bad Vibes
Flo Crivello · What AI and LEGO Have in Common | Flo Crivello on TBPN April 7th · Apr 10, 2025 · at 12:26
Flo Crivello, founder of AI agent platform Lindy, discusses model evaluation and the performance of Meta's newly released Llama 4 model.
0:00 / 0:09exact quote · 9.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I will say, I feel bad for saying that because I have friends like the Lama team, but boy, like Lama for the vibes are really bad. Like the emails are good and the vibes are quite bad actually.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Flo Crivello
Crivello: Meta AI VP and Researchers Resigned Over Unethical Practices
“The VP of AI research at Meta resigned and so have a couple members of the core research team seemingly in protest for what they deemed to be unethical practices.”
Crivello: Zuckerberg Threatened to Fire Meta AI Org Over Targets
“I think Zach is, is massively raising the temperature and I think he's basically threatened to like Destroy the whole org or, like, fire happy org or, like, similar stuff like that if they don't hit certain targets by a certain date, and I think that's led to …”
Crivello: High-revenue enterprise AI startups are becoming modern shelfware
“There are some very hot AI startups out there in the enterprise that are basically shelfware. Like, their revenue is skyrocketing, and they're meeting very little adoption internally.”
Crivello: Bearish on consumer AI agents because consumers are time-rich and money-poor
“I am actually quite bearish for consumer agents. I think, like, consumers are time rich and money poor, right? It's like, they don't want to trade time for money like that, which is why I think, like, Google Assistant and Alexa, like, they've been really failu…”
Crivello: Drop-in AI worker replacements for businesses will arrive in 12-18 months
“I think, like, there is going to be a transformational moment for businesses where you have, like, the holy grail of AI agencies, like, what we call the drop-in replacement for a human worker. And I think that's coming in, like, 12 to 18 months.”
Flo Crivello: A 10% AI Extinction Risk Is Unacceptably High and Under-Discussed
“Look, even if it was low, like, 10%, that's unacceptably high. If you listen to the Dwarcush podcast on EI 20, 27, that's the part, I love Dwarcush, I love the podcast, but that's the part where I'm like, what? At some point they talk about Pidoum, and one guy…”