Distributed Systems
topic on 4 shows · 7 statements across 7 episodes
Latent Space
the MAD Podcast
the a16z Podcast
Big Technology
7 statements about Distributed Systems, every show
McGrath: AI Frontier Is Bottlenecked by Shortage of Hybrid Systems-ML Talent
“I think we're still having trouble not at OpenAI, but I think as a whole, producing lots of people that do lot, want to do lots of both systems work and ML work. And I think if you're trying to push the frontier, you don't know which Place is currently bottlen…”
Masad: Distributed systems are bottlenecked by architecture design, not code volume
“The bottleneck to really good distributed systems is, is design and not like the amount of number of codes you can generate.”
Distributed data systems impose a massive complexity tax over single-node hardware
“There's just this huge tax that you pay to have to build a distributed system that scales out and can do, like, you know, distributed transactions and shuffling data and, you know, if you were gonna design something for kind of modern hardware, you could make …”
Mónica: Crypto research is making the internet a safer place
“Crypto is ushering a new era of research in distributed systems, in security, and in cryptography. And all of these technology advances are actually making its way towards the internet into a safer internet.”
Narula: Fundamental approaches to distributed systems haven't changed since the 1980s
“Most of the ideas that are being used now, like actor paradigms, for example, which some people may be familiar with. I mean, these are from the eighties, right? Nothing's really changed in how we attack distributed systems.”
Hindman: Organization-tailored distributed systems prevent software portability across companies
“Because people are building distributed systems in such a personalized way and a personalized for their organization or their company, you can't easily build a distributed system in one organization and move it to another organization.”
Granger: Shared mutable state in distributed systems is a disaster
“We learned very quickly that, ah, you know, shared mutable state is a disaster in that world, and then we have to do something else. And there's nothing simpler than just keeping a log of every single thing that ever came into the system, right?”