hierarchical inference
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement May 1, 2024 by Swami Sivasubramanian · across every show →
Everything said about hierarchical inference, oldest first
May 1, 2024 neutral
AWS VP: LLM architectures will shift to hierarchical edge-and-cloud inference
“So, I expect LLNs to evolve in the same way, where there are a lot of, ah, decisions, especially if you have a powerful computing device, ah, which, ah, many smartphones and others, ah, to be having that, You can actually run some of those, ah, simple LLM thin…”