Shopify

“There's over one million Shopify merchants coming soon, including some really big ones like Glossier and Viore. this week, Salesforce announced that they're also in”

“The database that was the most difficult for me to scale during that time, and that was the most aggravating to be on call for, was Elasticsearch. It was very, very difficult to deal with, and I saw a lot of projects that were just being held back in their amb…”

“And a lot of that was really just the you know the Kardashians would drive very, very large amounts of data to Shopify as they were rotating through all the merge and building out their businesses. And we just needed to make sure we could handle that, right? A…”

“Internally we have this system. We talked about it briefly once at NeurIPS. We have a huge HSTU-based system that models the whole companies.”

“Usually people's intuition here, by the way, is that I increase my images. I'll have more because they look nicer. You know, designers all look sparse and big images. Like, usually your sales tank, right?”

“So you could see that it approaches really a hundred percent by now. It's hard not to do your job now without interacting deeply, at least with one tool.”

“We run it at 30 milliseconds, a tiny model, like three hundred million parameters, In, but we run it in 30 milliseconds end to end for search when you type a query, and then we produce all the possible things with what you can mean by that query and some, you …”

“And I would claim the super interesting part here is that you could see that the distribution becoming more and more skewed. The top percentiles grow faster. So that means the people in the top 10 percentile, they, their consumption grows faster than 75 and so…”

“Airflow is great, but Airflow is more about you have something and you want to repeatedly run it in production on schedule. It's less about you as a team developing things and being able to share and you grabbing the standard pipeline and saying, hey, I want t…”

“The other thing I would claim you could see is that CLI-based tools and tools that don't require you to look at the code becoming more popular, and you could see, yeah, various versions of Cloud Code and Codex and Pi and internal development tools taking off e…”

“If you don't have the historical data, All you can do is prompt agents in the vacuum, and they will do exactly what you prompt them to do.”

“Just even yesterday, Andrej Karpathy was famous in tweeting about, oh, there's some ways that you can organize your agents to store the data and then look up the data so that you don't have to research or lose context every time. And a little bit tongue-in-che…”

“Our search recently we moved from, it's hard to win, quote, from 800 QPS to 4200 QPS with the same quality just by pure optimizations and not a research loop that kept Running and changing code in our index surf on the same number of machines, just increasing …”

“And we effectively fund unlimited tokens for everybody. We do try to control the models that people use, but from the bottom, not from top. Like we basically say, hey, please don't use anything less than Opus.”

“Internal goal was to hit 0.7 correlation with add to cart events, for example, like that, that if we run real A, B test experiment, that it should go and replicate same sort of success that, that humans had or lack thereof.”

“Recently we're looking at it, and we had to bring back CRPs, you know, Chinese restaurant process. It's a, like, way of aggregating and like naturally grow clustering across specifically to answer questions that like you were just posing on how, how if buyers …”

“That's why we at Shopify, when we tried multiple, and we constantly try multiple models, multiple companies, we found that for small, particularly with low latency applications, when you have low latency and or if you need longer context lengths, Liquid was th…”

“I haven't found a good PR review tool that, that does what I think should be done”

“It actually, in terms of the overall time to deploy, it's total time savings if you spend more time on a longer model, like, thinking for an hour, because then you don't have to spend all that time During testing and rolling, you know, rolling back the deploym…”