Text
topic on 10 shows · 13 statements across 13 episodes · said 3 times in 3 episodes since 2016
Top Founders 2 
BG2 Pod 
Latent Space 
No Priors 
the Official SaaStr Podcast 
WTF is with Nikhil Kamath 
Catalyst 
the MAD Podcast 
the a16z Podcast 
Big Technology
Mentions by year, every show
tap a year for its mentions
Top Founders 2
every mention on every show, scene by scene, with the transcript →
13 statements about Text, every show
Battaglia: Weather is Markovian unlike text sequences in language models
“Weather is actually different from text in a fundamental way. In fact, most physical processes are. They are what's called Markov, in that the most recent state of the system determines the subsequent state.”
Text and language function fundamentally as compression methods for 3D perception
“The way I think about it is, at Siemens, right, we had sort of a three-dimensional world, then we invented text. As like a, in a way, a compression method, right? So you had, we invented text in order to communicate with each other in a common way, in a way th…”
Rajpal: Most AI audio applications are a 'voice sandwich' around text
“I think like most audio applications today are like a text sandwich, or sorry, a voice sandwich with like kind of text in the middle.”
Patel: AI labs have tapped out human-written internet text data
“Humans post on the internet every day, and we've already tapped that out, right? Kind of more or less on a text.”
Autoregressive models succeed on text because language is discrete and finite
“And the reason it works for text and not for other things is because text is discrete. So there is a finite number of possible things that can happen, right? There's a finite number of words in the dictionary. There's a, you know, so if you can discretize your…”
Alexandr Wang: Cross-modality training produces no positive transfer between video and text.
“I think the main thing, fundamentally, is I think there's very limited generality that we get from these models and even for multimodality, for example my understanding there's no positive transfer from learning in one modality to other modalities. So like tra…”
Shulman: Generative audio AI lags text and images by one to two years
“So I think very roughly you can think audio is like one to two years behind images and text. And so you kind of have to think today like text was in 20, 22 or something like this.”
Shazeer: Text Is a Thousand Times More Information-Dense Than Images
“An image is worth a thousand words, but it's like a million pixels. So like the text is like a thousand times as dense.”
Shazeer Estimates Text Is 1,000 Times More Information-Dense Than Images
“An image is worth a thousand words, but it's like a million pixels. So like the text is like a thousand times as dense.”
LeCun: Most human knowledge is non-linguistic, not captured in text
“How much of human knowledge is present and described in text? And my answer to this is a tiny portion. Like most of human knowledge is not actually language related. It's completely non-linguistic.”
LeCun: Most Human Knowledge Is Not Represented in Any Text
“Like most of human knowledge is not represented in any text in existence.”
Snyder: Text is the single largest output produced by any business
“In businesses, whatever your business is, text is actually the thing you produce the most of.”