Assertion Not checkable as stated
Parakhin: Top AI models write code with fewer bugs than average humans
“I would claim by now, good model writes code on average with fewer bugs than average human.”
What-if
Parakhin: Liquid AI could beat frontier models with equal compute
“I think if they if they had similar level of compute, they would be very competitive and maybe even beat the largest models, at least from what I've seen.”
Assertion Not checkable as stated
Parakhin: CLI AI tools outpace IDEs like Cursor at Shopify
“The other thing I would claim you could see is that CLI-based tools and tools that don't require you to look at the code becoming more popular, and you could see, yeah, various versions of Cloud Code and Codex and Pi and internal development tools taking off e…”
Insight
Parakhin: Effective PR review requires largest pro-level models, not fast tools
“At PR review time, you want to run the largest models. That means codex or cloud code is not going to cut it. You need to have pro-level models if you really want to stem the tide of bugs from going into production”
Insight
Parakhin: Slower AI PR reviews actually save total deployment time
“It actually, in terms of the overall time to deploy, it's total time savings if you spend more time on a longer model, like, thinking for an hour, because then you don't have to spend all that time During testing and rolling, you know, rolling back the deploym…”
Disclosure
Parakhin: Liquid is the only genuinely competitive non-transformer architecture Shopify found
“That's why we at Shopify, when we tried multiple, and we constantly try multiple models, multiple companies, we found that for small, particularly with low latency applications, when you have low latency and or if you need longer context lengths, Liquid was th…”
Opinion
Parakhin: Liquid-transformer hybrids are probably the best neural network architecture available
“I think especially in their hybrid form, when combined with Transformer, like in Mamba fashion, they probably the best architecture I'm aware of, like, period.”
Assertion Not checkable as stated
Parakhin: Bing Sydney's personality was deliberately engineered, not purely emergent
“What almost everybody doesn't fully realize is that it wasn't by accident that Sydney was Sydney. I mean, we spent a lot of effort on personality shaping. We, I mean, it was a bit of my Yandex legacy where previously we did this Alice digital assistant which w…”
Assertion Not checkable as stated
Parakhin: Daily AI tool adoption at Shopify approaches 100 percent
“So you could see that it approaches really a hundred percent by now. It's hard not to do your job now without interacting deeply, at least with one tool.”
Disclosure
Parakhin: Shopify funds unlimited tokens and discourages models below Opus
“And we effectively fund unlimited tokens for everybody. We do try to control the models that people use, but from the bottom, not from top. Like we basically say, hey, please don't use anything less than Opus.”
Opinion
Parakhin: Jensen Huang is directionally correct on developer token budgets
“I do think Jensen gotten a lot of bad press saying, oh, of course you're, you know, this the cake seller says we don't need enough cakes, you know, like, of course. But I actually think that's undeserved. I think he, he's actually right. I do think. He's direc…”
Disclosure
Parakhin: No existing third-party AI PR review tool meets his standards
“I haven't found a good PR review tool that, that does what I think should be done”
Prediction Not checkable as stated
Parakhin: Human-centric CI/CD systems must be redesigned for AI agents
“Clearly the old thing were designed for humans will need to be morphed into something new.”
Opinion
Parakhin: Airflow is poorly suited for rapid ML experimentation compared to Tangle
“Airflow is great, but Airflow is more about you have something and you want to repeatedly run it in production on schedule. It's less about you as a team developing things and being able to share and you grabbing the standard pipeline and saying, hey, I want t…”
Insight
Parakhin: Auto-research excels at obvious optimizations but fails on out-of-distribution tasks
“Autoresearch is very good at doing kind of obvious things that you don't have bandwidth to do, or you didn't notice, or maybe you're not aware of like some standard practices. It is not good at doing something completely out of distribution, something that, yo…”
Insight
Parakhin: Simulating customers without historical data produces ungrounded agent responses
“If you don't have the historical data, All you can do is prompt agents in the vacuum, and they will do exactly what you prompt them to do.”
Insight
Parakhin: Increasing product image size usually tanks ecommerce sales
“Usually people's intuition here, by the way, is that I increase my images. I'll have more because they look nicer. You know, designers all look sparse and big images. Like, usually your sales tank, right?”
Insight
Parakhin: AI assistants engage users best when polite but slightly edgy
“What we learned in those experiments is you want to be polite, but you want to be a little bit on edge, and that draws people in.”
Assertion Not checkable as stated
Parakhin: Shopify built agent memory systems before Karpathy proposed them
“Just even yesterday, Andrej Karpathy was famous in tweeting about, oh, there's some ways that you can organize your agents to store the data and then look up the data so that you don't have to research or lose context every time. And a little bit tongue-in-che…”
Insight
Parakhin: Content-addressed caching yields big compute savings by deduplicating cross-team work
“The main savings are coming from the fact that you ran it, you got your job done, and you moved on. Then somebody else in some department you don't know existed, runs the same task, but on the newer version. Like right now, you can't, in, in most of the organi…”
Assertion Not checkable as stated
Parakhin: Shopify increased search throughput 5x to 4,200 QPS via auto-research
“Our search recently we moved from, it's hard to win, quote, from 800 QPS to 4200 QPS with the same quality just by pure optimizations and not a research loop that kept Running and changing code in our index surf on the same number of machines, just increasing …”
Disclosure
Parakhin: Shopify aimed for 0.7 correlation between SimGym and real add-to-carts
“Internal goal was to hit 0.7 correlation with add to cart events, for example, like that, that if we run real A, B test experiment, that it should go and replicate same sort of success that, that humans had or lack thereof.”
Disclosure
Parakhin: Shopify uses large HSTU architecture to model merchant trajectories
“Internally we have this system. We talked about it briefly once at NeurIPS. We have a huge HSTU-based system that models the whole companies.”
Insight
Parakhin: Counterfactual behavioral modeling was impossible before LAMPS and HSTUs
“Being able to model something complex as human beings or companies and model counterfactuals on it where you can have interventions in the future and optimize when to make intervention, what kind what kind of intervention to make. It's such an unlock that prev…”