prompt engineering
10 statements across 10 episodes · 2 bullish · 5 bearish · 10 people on the record · first statement Jun 11, 2024 by Mike Conover · across every show →
Everything said about prompt engineering, oldest first
Jun 11, 2024 negative
Conover: LLMs do not need anthropomorphic personas for high-quality reasoning
“Our experience has been that You can get really, really high quality reasoning from roughly an agentic system without needing to be too cute about it. You can describe the task and you know, within well-defined bounds you don't need to treat the LLM like a per…”
Jun 21, 2024 bearish
Brady: Prompt Engineering Won't Be a Durable Differentiating Skill
“I don't think that prompt engineering is going to be a kind of durable differential skill that people will hold. I do think that the way that you set up the ML problem to kind of ask the right questions, if you see what I mean, rather than the specific phrasin…”
Sep 20, 2024 negative
Schulhoff: Hiring Dedicated Prompt Engineers Makes No Sense for Most Companies
“I have always viewed prompt engineering as a skill that everybody should and will have, rather than a specialized role to hire for. That being said, there are definitely times where you do need just a prompt engineer. I think for AI companies, it's definitely …”
Sep 27, 2024 negative
Shunyu Yao argues modern LLMs make prompt engineering tricks obsolete
“I feel like in some sense, I feel like prompt engineering, even it's like a slightly negative word at the time, because it refers to all those kind of weird tricks that you have to apply. But I think we don't have to do that anymore. Like given today's progres…”
Nov 28, 2024 positive
Schluntz: Developers must iterate on agent tools rather than just prompts
“You need to iterate on tools rather than just a prompt. And I think a lot of people, when they make tools for an LLM, they kind of treat it like they're just writing an API for a computer and it's sort of very minimal. It's sort of just the bare bones of what …”
Dec 2, 2024 neutral
Simons: Base AI models provide a 10x lift; agent scaffolding adds 3-4x
“The model is like this sort of like 10 X multiplier. You're, how good the bottom line model is, huge, huge swing. And then kind of what you can do on top of that, you can squeeze out three, four X kind of more. And so that's kind of where the realm of, you kno…”
Dec 24, 2024 bullish
Ben Allal: AI industry will shift to fine-tuning over prompt engineering
“And I think we're going back to fine tuning where we realize these models are really cosplay. It's better to use just a small model. We try to specialize it. So I think it's a little bit of a cycle and we're going to start to see like more of fine tuning and l…”
May 7, 2025 bearish
Sep 11, 2025 neutral
Jan 17, 2026
Reggio: The real challenge in operational AI is codifying unwritten SOPs into prompts
“The challenge is really articulating and refining prompts to reflect. Reflect the execution of the SOP and like reflect all the sort of institutional knowledge that isn't written down so that agents can properly replace like the humans or the contractors that …”