Pope: MatX will sell AI inference chips first due to lower risk
“Our product is both training and inference, but I think the first sales will be an inference. That's mostly just a market effect where It's easier to buy, like, it's not as big of a risk to go to buy an inference cluster than as a training cluster.”
Pope: MatX raised a $500M Series B co-led by Jane Street
“So we this is a we've raised a series B round. It's led by Jane Street and Situational Awareness Situational awareness, that is Leopold Ashenbrenner's fund. He wrote the definitive book on, on, on where, on AGI and where it's going. And then Jane Street, they'…”
Pope: MatX combines SRAM and HBM for cheap, low-latency AI chips
“It is actually possible to do both in the same chip. You, it's kind of an obvious thing. You say you take the HPM, you take the SRAM, put them together in the same chip, you put the weights in SRAM, and you put the all of the inference data in HPM. That is wha…”
Pope: Large systolic arrays are unbeatable in area and power efficiency
“Make a really large systolic array. You can't beat that in area or power efficiency.”
Pope: MatX splits large systolic arrays without sacrificing efficiency
“Take a really large systolic array, but have a way to split it up into pieces without losing efficiency. So sort of that is the core of the design for us.”
Pope: 4-bit precision will probably be the primary AI format, like Nvidia
“We think probably the main thing will be similar to where NVIDIA is at, which is four bit precision.”
Pope: Chip tape-outs cost $30M and fail 50% of the time
“The ideal, which companies tend to hit about 50% of the time is that your first tape out costs like thirty million dollars your first... The ideal is that your first tape out is actually, is your production thing. So you do a tape out, you make maybe a thousan…”
Pope: MatX trains small LLMs from scratch daily for hardware co-design
“So our ML team is actual, real ML research. What they do every day is they train small LLMs from scratch, focusing on numerics and attention.”