in-context learning

also referred to as: in context learning

3 statements across 3 episodes · 2 bullish · 1 bearish · 3 people on the record · first statement Oct 11, 2024 by Ankur Goyal · across every show →

Everything said about in-context learning, oldest first

Oct 11, 2024 positive
Assertion Supported
Goyal: In-context learning outperforms fine-tuning in many large-context cases
“There's a lot of cases now, especially with large context models, where in context learning just beats fine tuning.”
Ankur Goyal Oct 11, 2024 ▶ 1:20:55 Production AI Engineering starts with Evals
Apr 27, 2025 negative
Assertion Not publicly verifiable
Providing agents with RAG factory blueprints yielded zero benchmark score improvement
“When you try and move that into a benchmark setting with already pre-trained models, just using in-context learning, it's just not that helpful. A thousand lines of Python telling you how to make this kind of factory unit, which it may not be directly applicab…”
Jack Hopkins Apr 27, 2025 ▶ 22:00 ⚡️Factorio Learning Environment: the ultimate Game Agent Eval — Jack Hopkins
Feb 5, 2026 positive
Insight
Bissell: Activation Steering and In-Context Learning Are Quantitatively Equivalent
“He actually has a paper that, as well as some, you know, others from the team and elsewhere, that go into the essentially equivalence of activation steering and in-context learning, and how those are from a, he thinks of everything in a cognitive neuroscience …”
Mark Bissell Feb 5, 2026 ▶ 30:57 Goodfire AI’s Bet: Interpretability as the Next Frontier of Model Design — Myra Deng & Mark Bissell
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.