Assertion certainty 4/5 debate potential 1/5

Burger: vLLM Runs on 500,000 GPUs at Any Moment

Elena Burger · How Open Source Became AI's Backbone | Inferact with a16z · Aug 5, 2026 · at 1:01

Elena Burger introduces Simon Moe, co-founder of Inferact and lead maintainer of open-source LLM inference engine vLLM.

0:00 / 0:10exact quote · 10.4s

▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark

“Today we're here with Simon Moe, co-founder of Infraact, and a lead maintainer of VLLM, the open source inference engine, now running on half a million GPUs at any moment.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

The claim, plainly

Open-source inference engine vLLM runs on half a million GPUs at any given moment.

a quote alone can be ambiguous, so this restates it with the references and context of the conversation around it resolved. AI-written; the tape below the player is the source.

How this resolves

Requires telemetry or deployment data confirming that open-source vLLM was running concurrently across at least 500,000 GPUs as of August 2026. Because self-hosted open-source software does not have complete public centralized telemetry, concurrent active global GPU counts are private and unmeasurable directly through public data.

prediction date: 2026-08-05, stated by the speaker

Mentioned

Infraact Simon Moe vLLM

⚑ Spot an error? Report it

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Burger: vLLM Runs on 500,000 GPUs at Any Moment

Turn any episode into a week of clips.