MLP
also referred to as: mlps
3 statements across 2 episodes · 0 bullish · 2 bearish · 2 people on the record · first statement Jun 6, 2025 by Emmanuel Ameisen · across every show →
Everything said about MLP, oldest first
Jun 6, 2025 neutral
Ameisen: Anthropic's circuit tracing tool ignores attention heads and only decomposes MLPs
“These are just MLPs. So the model has both attention heads and multi-layer perceptions MLPs. We don't just do it. Like we completely ignore attention or like we don't try to decompose it at all. So there's some prompts where like all of the interesting stuff i…”
Jun 6, 2025 negative
Aug 3, 2026 negative
Editing isolated facts in MLP weights fails to update multi-hop downstream reasoning
“So if you know that the best university in the world is Waterloo, then the answer should be Waterloo. But if I wasn't just one-shotting the question and I was to ask it to like, use its knowledge to think and then give me a second answer, or like, should I hir…”