Everything Illia Polosukhin said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Polosukhin: AI agent CEOs will run organizations and replace middle management
“I really think one of the most interesting cases is organizations that are run completely by AI, right? Where quote unquote CEO role is taken by AI agent. Who's tasked by, you know, by community or board of directors or whatever is oversight governance is to, …”
Polosukhin: Decentralized AI training is unrealistic due to GPU bandwidth requirements
“And the reality right now that the requirements on bandwidth, right? Like people who are training these models right now, they have like a, you know, 800 gigabit connect right between the GPUs, right? So Maybe you have a hundred megabits on between this, usual…”
Polosukhin: Web3 and AI will start replacing traditional SaaS software
“So I think a lot of between web three and AI, a lot of SaaS will actually start being replaced because right now what SaaS is, is like one database. With a specific UI for a specific problem.”
Polosukhin: Transformers will be very hard for alternative architectures to match
“The simplicity of this architecture and like, indeed, like the amount of optimization that's going into this right now is just, it will be really hard to match”
Polosukhin: First organizations run by AI agents will emerge in 2023
“I think we'll see, you know, first organizations like this, probably even this year where Potentially with a simpler mission, some kind of more straightforward like KPI metrics, but where kind of this information propagation and onboarding of people happens al…”
Polosukhin: DAOs will be the first place AI managerial agents emerge
“I think DAOs is, and especially what happened with DAOs, there was a lot of people who were really excited about DAOs kind of as a concept. And so they put a lot of time running them, but it's actually a very like not interesting job, right? It's like you onbo…”
Polosukhin: Society needs human alignment rather than AI alignment
“So I have this view that we need human alignment instead of AI alignment. So right now, kind of when we talk about, you know, hey, we need to align AIs with like human values, but the reality is that, you know, all the problems that exist, they all exist becau…”
Polosukhin: 2024 US election will see fake AI candidates and tailored agendas
“I think there will be probably next year will be very interesting in US because I think this will be a place where everybody will just take whatever their toys have in toolbox and do it even just for kicks, right? Even if it's not malicious, although some play…”
Polosukhin: Repurposed crypto mining GPUs cannot meet frontier AI training needs
“The challenges, the GPUs there are like, not the ones that AI folks want to use, right? Like kind of all the AI is really zeroed in on like, how do we get a 100 or H 100 and the GPUs that like folks used for Ethereum mining and like similar is like older ones …”
Polosukhin: Decentralized Web3 Marketplaces Will Be More Effective for AI Data Labeling
“I think decentralized kind of a web three marketplace is a more effective way to do this.”
Polosukhin: Staked Buy-Ins Enforce Data Quality Better Than Employment Contracts
“There's an actual, like very clear, like economic game theory where people have buy-ins. They lose them if they like do poor quality of work. And so they have Like way more incentive to do this versus like, let's say if you're working on a contract, there's li…”
Polosukhin: Internal knowledge search beats external search at inference time
“The fact that this model is, like, doing a really effective search in kind of this knowledge space means that probably, like, pushing more into that concept is more useful than doing more searches at inference time because, like, it means you already lost all …”
Polosukhin: LSTMs Were Too Slow for Production as Documents Scaled
“The state of the art at this time was LSTMs, Recurring Neural Networks, which you could not launch in production at all because they're too slow and take a fair bit of time to process as documents scale.”
Polosukhin: Blockchain accounts turn AI agents into paying economic actors
“If we, you equip them with a blockchain account, right? They are now becoming an economic agent that is able to pay other people and pay other AIs to do work, right?”
Polosukhin: Platforms will adopt SSL-style cryptographic locks for content verification
“I think one of the imported pieces will be kind of a green lock, similar to SSL transition on the content, right? Like as you go to YouTube, as you go to you know, New York times, you actually will see that like, Hey, this content been signed by this party and…”
Polosukhin: Law enforcement lacks tools to identify AI-generated media
“The people are using these tools now in very malicious ways right now. And law enforcement don't have a, like really good ways to deal with this. And so I think everything from this, like on camera, like signing, we need this now, like they really have no way …”
Polosukhin: Inference demands vastly more aggregate compute than AI model training
“I think an inference is really interesting because we do need so much more compute for inference than we need for training, right? Like it's a very interesting like economy of scale. You train once, like Lama trained once and then everybody runs it everywhere.”
Polosukhin: Future SaaS interfaces will be hybrid AI agents and dynamic UIs
“It will be a hybrid. So I like in my imagination right now, at least I expect like you can describe a business process, which is like, Hey, you know, when we have a new creative from like marketing department, Spin up a Twitter campaign and create me a dashboa…”
Polosukhin: Market full of Transformer-optimized accelerators will launch by 2024
“And so like, we're going to have a, you know, a market full of hardware accelerators, which are still optimized for transformers, or at least like similar structured architectures hitting the market like this year and next year.”
Polosukhin: NEAR pivoted to blockchain after payment issues with AI data labelers
“We started looking into blockchain just like to solve our own problem. The AI kind of exponential explosion didn't happen at the time. And so we saw an opportunity of, we can actually build a blockchain that we would use to solve this first and focus on that w…”