Morin: AI Hardware Supply Chain Is Operating at Complete Capacity
“Everyone is compute constrained and everyone You know, at every manufacturer is trying to develop, manufacture chips, RAM, the entire supply chain is operating at, you know, complete capacity to fill the demand.”
Glyman: Manual expense reports are obsolete and books should close themselves
“Like, I don't think people should do expense reports. It's crazy. All the data is digital in the first place. You were, You're an adult, you know, who's, you know, allowed to buy things on behalf of your company. Expenses should do themselves, right? If we hav…”
12B parameter AI models are the sweet spot for 16GB RAM
“A twelve billion model is the sweet spot for a machine with 16 gigabytes of RAM. This is where most people should live.”
Garry Tan: Hardware and Parameter Limits Prevent AI from Eliminating Jobs
“This is actually an answer to one of the questions, which is like, will there be jobs or whatever? It's like, as long as there are limits on RAM, actually like there will be. So I don't know. I mean. Kind of an interesting one, right? Literally you can't have …”
Kalinowski: Losing silicon or RAM forces catastrophic hardware redesigns
“If your silicon goes out, if you can't buy your silicon, you can't buy your chip. Now you have to redesign your board and you have to find something else that might work. This is a catastrophic redesign. If you can't get the RAM you wanted in the form factor y…”
Burazin: CPU is the most expensive AI sandbox compute resource
“The most expensive thing is the CPU. Second, the RAM. This is almost free. It's very inexpensive.”
Eskildsen: AWS S3 storage is two orders of magnitude cheaper than RAM
“If you put data in memory, it costs maybe two to five dollars per gigabyte of data you put in memory, right? And if you put it in an S-III bucket to data, it costs about two cents per gigabyte. Like a true two order of magnitude cheaper.”
RWKV Token Inference Only Requires Current and Next States in RAM
“If you really, really want to, like, save RAM, You, it is possible for you to do token by token inference, so that you don't need to keep your states in history. You only need to keep your current token state and your next.”
Benjamin: Simulating 45 qubits classically requires 0.5 petabytes of RAM
“So, 45 qubits required 0.5. This wasn't my work. This was work elsewhere in the community. It required 0.5 half a petabyte of RAM, basically.”