The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 10 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Cerebras WSE-3 runs Llama inference 70x faster than NVIDIA GPUs
“Cerebris came out that the wafer scale engine three can serve llama 70 B at 2.1 thousand sorry, 202,100 tokens per second and serves llama four or five B at nearly 1000 tokens per second. So this, you know, to give you an understanding, like this is about 70 t…”
Cerebras avoids model parallelism in production due to communication overhead
“There's a lot of communication overhead with model parallelism. You have to share activation tensors, and that is why in this paper and, you know, in production, Cerebra's focus on data parallelism. So all of this is mentioned in the paper as well, but model p…”
GPUs cannot handle unstructured sparsity as efficiently as Cerebras hardware
“So both cerebris and GPUs can handle structured sparsity But GPUs are not designed to handle unstructured sparsity, whereas what I've just mentioned before is able to handle this unstructured sparsity.”
No competing AI framework disaggregates model storage from compute like Cerebras
“Like basically not, no one is doing anything close to where you're disaggregating. Model storage from compute. And none of these examples above do that either.”
Cerebras WSE-3 per-core SRAM eliminates central memory bandwidth bottlenecks
“So what Cerebrus has done for the wafer scale engine three is that instead of storing all these weights and values, weights and values off chip, Cerebrus stores everything on chip in SRAM. So every single one of the cores on the wafer scale engine three has it…”
Cerebras WSE-3 features 900,000 cores, 44GB SRAM, and 4 trillion transistors
“And so the wafer scale engine three, as I mentioned, 900,000 cores, 44 gigabytes of SRAM, four trillion transistors, and I do add a note here that the paper focuses on wafer scale engine two, and so the wafer scale engine three is, you know, just an upgraded v…”
Cerebras MemoryX scales to 2.4 petabytes to support 120-trillion-parameter AI models
“And you know, it scales from four terabytes to 2.4 petabytes, Supports models with up to 120 trillion parameters and then it utilizes DRAM and flash storage.”
Cerebras weight streaming prunes up to 90% of data without accuracy loss
“And so memory, and so as MemoryX streams weights through SwarmX, it eliminates zero and near zero values, and so this reduces bandwidth requirements significantly, pruning up to 90% of the data while maintaining accuracy.”
Cerebras streams weights from MemoryX and computes updates externally
“And instead of storing all the weights that the compute units need on
[737] Sarah Chieng: On the compute unit, it's storing it externally in an external memory service. In this case, it's called memory X. And during training, these weights are streamed from me…”
Cerebras weight streaming is exclusively for training, while inference runs on SRAM
“The memory X and swarm X, this whole waste streaming system is just used for is just used for training. So for inference, you just using the SRAM, you know, at 44 gigabytes on the chip, and then you can network multiple chips together to support larger models.”