SRAM Machine
product on 1 show · 1 statements across 1 episodes
the Y Combinator Startup Podcast
1 statements about SRAM Machine, every show
Smulyanski: On-die SRAM accelerators excel at LLM decode due to high bandwidth
“The SRA machine basically keeps the entire weight matrix in SRA memory on DAI, so the, you got a lot more bandwidth, right, because it's on chip, right, so you can access, you know bytes over cycles, right, the chip interconnect is also fast, you can go, like …”