proprietary models
also referred to as: proprietary model
3 statements across 2 episodes · 3 bullish · 0 bearish · 2 people on the record · first statement Dec 28, 2023 by Arthur Mensch · across every show →
Everything said about proprietary models, oldest first
Dec 28, 2023 positive
Dec 28, 2023 bullish
Aug 5, 2026 bullish
Moe: Open-weight inference can hit 500 tokens/sec, 2-3x faster than proprietary APIs
“But for open weight, when you are running it, every provider can offer potentially even 10 different levels of speed going from like the slowest mode, which can be a lot cheaper to 400 tokens per second almost up to 500 in many cases for some workloads. And th…”