ML application architecture
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jun 21, 2024 by James Brady · across every show →
Everything said about ML application architecture, oldest first
Jun 21, 2024 neutral
Brady: Handling LLM Non-Determinism and Latency at Scale Is Unsolved
“There isn't some kind of industry-wide accepted way of handling that at massive scale. There are definitely patterns and anti-patterns and tools and whatnot, but it's not like this is a solved problem. So I would expect that it's not going to go down easily as…”