Verrilli: Hex and AI match two weeks of 2017 Amazon L7 work
“You know, you can pull data now on a hex thread. That is basically what it would take a week, two weeks with an Amazon L seven, you know, a data scientist in 2017.”
Catanzaro: AI Data Prep Workloads Are Far Less Predictable Than BI Analytics
“I think one of the things that we saw with analytics that, you know, was surprising to some of the people in the data infrastructure space was that, like, the workloads were actually quite predictable. They were quite predictable because, like, many of them we…”
Barry McArdle: Hex enforces a rule to never automatically run AI code
“We have a rule as we're building these features. It's like, we don't run the code for you. Like we will generate the code. We will show it to you, but we want to keep the human in the loop.”
Barry McArdle: Passing too much context into LLM prompts confuses the model
“I think we've been, we were tempted early on to try to shove as much context as we could in. You kind of figure like the more I can tell this model, the better. And you realize you can pretty easily confuse a model in terms of the amount of context you're pass…”
Barry McArdle: Context building and model chaining are AI's hardest work
“And I think that is really actually the hard work in many ways of Incorporating AI into your product, right? Like it feels really simple. Like you can go get an API. Anyone listening to this today could go to the open air website and get an API key. It's every…”
Barry McArdle: AI foundation models and API calls are already commodities
“I think the models themselves and being able to send a request to one of them is, is already a commodity.”
Barry McArdle: Hex does not use customer code to train AI models
“We're not using it to train models. I should be very clear. Like that's one thing we've been very upfront with our customers about, like we're not training models where they would expect to ever have like some code they've written be a completion for someone e…”