pixels
2 statements across 2 episodes · 1 bullish · 0 bearish · 2 people on the record · first statement Nov 25, 2025 by Justin Johnson · across every show →
Everything said about pixels, oldest first
Nov 25, 2025 bullish
Johnson: Pixels offer a more lossless world representation than tokenized text
“And then like you actually lose something if you translate to this like purely tokenized representations that we use in LLMs, right? Like you lose the font, you lose the line breaks, you lose sort of the two D arrangement on the page. And for a lot of cases, f…”
Jun 1, 2026 neutral
Ethan He: Training transformers directly on raw image pixels is impossible
“If you're trying, if you can technically, theoretically train image or video models on pure pixels, but the problem is that the, it's a lot of tokens. So like one image, like it's a thousand by a thousand is like one million tokens, one million pixels. It's im…”