Commodity LLM
topic on 1 show · 1 statements across 1 episodes
1 statements about Commodity LLM, every show
Tamir: Per-token commercial LLM costs are unscalable for every enterprise query
“And if you pay a commodity LLM, which right now does usually beat out open source LLMs, you're going to end up paying per token and you can't scalably, if you have the right size of a business, do this for every query or every kind of use case.”