Computation
topic on 7 shows · 10 statements across 9 episodes
the Y Combinator Startup Podcast
the Knowledge Project
No Priors
Invest Like the Best
the Green Blueprint
the a16z Podcast
20VC
10 statements about Computation, every show
Amin: Computation is the 21st century's equivalent to oil or steel
“In the 21st century, it really is like the material is computation. It's kind of like if in the past there was oil, you know, or steel or whatever it is, today it's computation. And so the more we can give that to more people, the more interesting things happe…”
Efficient AI systems concentrate compute overwhelmingly on high-risk decisions
“It's the efficient way to run a computation, right? You don't want to spend too much intelligence or you don't have to, and you want to spend a lot of intelligence, overwhelmingly a lot in situations where there's high risk.”
Vijay Pande: Proper data representation makes computation natural
“If I asked you, like, 25 plus 17, that's really easy to do. If I gave you that same problem in Roman numerals, you'd probably have to think about that back into Arabic and then do the computation and put back into Roman. Some representations make computation n…”
Phillips: Next-gen smart meters require three core technical capabilities
“There are just these three main topics that I've been talking about, which is getting access to the right data, so high-resolution waveform data. It's well known how to do that. It's mature technology, we know how to do that. Having enough computation so that …”
Shazeer: Total Computation Is the Single Most Critical Factor in AI Training
“We can get a lot of, we can get a lot of data, but like, really, actually the number one thing that's important is how much computation you do to train it.”
AI Data Needs Scale With the Square Root of Compute
“The data requirements tend to go up like with the square root of the amount of computation, because you're going to train a bigger model and then you're going to throw more data at it.”
Lasenby: Geometric algebra requires more underlying compute but simplifies code
“Underlying, you've got an algebra of A much bigger algebra than three-dimensional space where I've got three vectors. So actually, computationally, there's more going on. There's more going on. Yeah, but at a higher level, you know, I can get code to do all th…”
Lasenby: Computation is no longer a bottleneck for geometric algebra
“I don't think it's not computational anymore, because we're building up more and more tools.”
Granger: CRDTs and theoretical trends will reshape software computation
“We're gonna see these start to eek more and more and more into the system as we try and find ways to work against that new machine. And it's those trends that are ultimately going to, you know, reshape the way we think about computation as a whole, and then ho…”
Arbesman: Embedding computation into physical objects drastically accelerates systemic complexity
“It's probably been accelerated significantly due to the fact that we now have computation embedded within everything else. There's only so many Levels of kind of like levels of hierarchy of complexity you can have if you don't have the ability to have code wit…”