Midha: Anthropic's velocity came from standardizing on the transformer architecture
Anjney Midha · Why AI Labs With Unlimited GPUs Still Fail — Anjney Midha, AMP · Jun 18, 2026 · at 26:35
Anjney Midha, CEO of AMP and early AI investor, discusses how architectural standardization enables rapid model scaling.
0:00 / 0:19exact quote · 19.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Like, one of the reasons Anthropic has had extraordinary sort of velocity is because they picked the transform architecture and said, this is simple, let's double down on it, right? And now, luckily, there's enough investment going into space that we can afford other architectures, but at the time, investment was just too fragmented into other architectures, so that arguably unlocked scaling.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Anjney Midha
Midha: The 'NeoCloud' concept is mostly marketing speak
“I think this whole idea of NeoCloud being somehow this new category is a lot of marketing speak. There are really good, reliable, trusted data center providers in America who've been around 20 plus years.”
Google DeepMind's six-month internal embargo shelves commercially valuable research papers
“I mean, what's worse is the paper is actually not even being Published anymore because there's a six month embargo inside of DeepMind, right? Like we've heard about this where a paper comes out and then I think there's a six month embargo window where if anybo…”
Most AI clusters fail to hit Google's 96% node utilization standard
“My co-founder, Seb came from he built the Borg export GQM scheduler at Google, and there, I think, 95% was considered an outage, so 96% node utilization is, should be standard, and most single-time clusters are not running at that”
Up to 20% of US data centers risk cancellation from community backlash
“Up to 20% of all data centers this year in the US, my understanding is are at risk... Of not getting the community support they need to get brought up.”