TRM
company on 3 shows · 6 statements across 3 episodes
the Y Combinator Startup Podcast
Founder's Journal
Startups For the Rest of Us
6 statements about TRM, every show
Chaubard: Sudoku, mazes, and rolling sums are incompressible reasoning problems for LLMs
“In HRM and TRM, they use Sudoku as an incompressible problem. Similarly, and so are mazes. Those are incompressible problems. Rolling sum, incompressible problem.”
Chaubard: Recursive models tested on one step retain nearly full performance
“If you actually train on 16, and you test on only one, you get, like, seven eighths of the performance, or, like, almost all the performance. So it's actually quite interesting that this is just overdone, too much compute, and it doesn't actually help you all …”
Chaubard: 7M parameter TRM scored 87% on ARC Prize 1
“And so it's a twenty-eight million parameter model for HRM. Now she brings it down to a seven million parameter model. It actually gets from 70% to 87% on on ArcPrize one. And does actually quite well on ArcPrize two as well.”
Gupta: Current TRMs and HRMs are task-specific, not general-purpose
“One of the things that's really interesting about these TRMs and HRMs is they're not general purpose models, right? These were Task specific models, right? The model trained to do Sudoku cannot do ArcPrize inherently. It has to be trained on the ArcPrize set t…”
Walling: Bootstrappers should measure Total Reachable Market instead of TAM
“TAM, total addressable market, is top down. It's coming from the MBA at Harvard saying, well, we could capture 30, 50, 80% of an entire market and then it's worth decabillion dollars. That's top down. When you are bootstrapping or mostly bootstrapping, I think…”
Hiring a CEO lacking task-relevant maturity in the core function will fail
“I have to think through this TRM thing for people, because if the main task of the business, they're lower medium on, it's never going to work. Right. Adrian was really high on recruiting people from the Philippines. Like I did not, I never, I detected it goin…”