Image Data
topic on 2 shows · 2 statements across 2 episodes
the MAD Podcast 
the a16z Podcast
2 statements about Image Data, every show
Izmailov: Text data carries more structural information per token than images
“So for example, we can approximate it from the scaling laws and we can, for example, say that text data has more structural information according to this measure than image data at the same kind of amount of yeah, tokens.”
Song: 3D AI Models Face Severe Data Scalability Bottleneck Compared to 2D
“Three D data has this scalability issue, and you If you compare that with like images, everyone can, you know, use their cell phone to take a photo or, you know, take a video. Whereas if you try to do the same with three D is very difficult. You either have to…”