Inference Providers
topic on 2 shows · 3 statements across 2 episodes
3 statements about Inference Providers, every show
Atallah: AI market is massively supply-constrained with inference providers constantly short
“Right now we're in a massively supply constrained market where and it's likely going to be supply constrained for a while where all the inference providers are short, pretty much constantly short.”
OpenRouter finds benchmark performance varies wildly across inference providers
“We always are like benchmarking all the models on all of the inference providers, all the open weight providers and finding really different results constantly. And the results change over time.”