Barry McArdle: Passing too much context into LLM prompts confuses the model
Barry McArdle · Embedded AI: The Questions Every CEO is Asking · Jun 2, 2023 · at 25:04
Barry McArdle, co-founder and CEO of Hex, discusses prompt engineering strategies for AI features within Hex's data workspace platform.
0:00 / 0:12exact quote · 12.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think we've been, we were tempted early on to try to shove as much context as we could in. You kind of figure like the more I can tell this model, the better. And you realize you can pretty easily confuse a model in terms of the amount of context you're passing.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Barry McArdle
Barry McArdle: Context building and model chaining are AI's hardest work
“And I think that is really actually the hard work in many ways of Incorporating AI into your product, right? Like it feels really simple. Like you can go get an API. Anyone listening to this today could go to the open air website and get an API key. It's every…”
Barry McArdle: AI foundation models and API calls are already commodities
“I think the models themselves and being able to send a request to one of them is, is already a commodity.”
Barry McArdle: Hex does not use customer code to train AI models
“We're not using it to train models. I should be very clear. Like that's one thing we've been very upfront with our customers about, like we're not training models where they would expect to ever have like some code they've written be a completion for someone e…”