Opinion
Gomez: Early AGI and EA ecosystem felt like LARPing a new religion
“The whole AGI effective altruist this whole ecosystem, it never resonated with me. It felt like cause playing. It felt like people were LARPing a new religion and all of this stuff like create God.”
Opinion
Gomez: Anyone selling AI doom and gloom is wrong
“Anyone who's selling you doom and gloom, I think is wrong.”
Assertion Not checkable as stated
Gomez: Modern Transformers look strikingly similar to the original 2017 architecture
“And so one of the big shocks is how over the past eight years, how little things have changed. Like it, it's really surprising to me. That the Transformers we train today looks so similar to what was back then.”
Assertion Not checkable as stated
Gomez: Google failed to lean into language modeling early, unlike OpenAI
“To say they didn't lean hard enough into language modeling, like just pure Sequence modeling of text on the internet. That's, I think the accurate statement. That's what OpenAI did early and uniquely well.”
Prediction Open · timeframe Jun 2030
Gomez: Discrete diffusion models will not replace the Transformer
“Now there are these discrete diffusion models, which do diffusion, which has been super popular for, like, image understanding, image generation. It's doing that same process for language models, but I still don't see that replacing the transformer.”
Insight
Gomez: Creating AI reasoning models is dramatically cheaper than pre-training
“It's easy to create a reasoning model. It's dramatically cheaper than pre-training. And so it's accessible. And so there's this huge intelligence uplift that comes for really quite little effort.”
Prediction Not checkable as stated
Gomez: AI models will probably surpass the best doctors at prescribing drugs
“Is it better than the world's best doctor at prescribing drugs? Probably not. Will it get there? Probably.”
Disclosure
Gomez: Synthetic data makes up the majority of Cohere's training data
“Synthetic data is incredibly effective. It's now the majority of the data that we train on for creating something like command A.”
Assertion Not checkable as stated
Gomez: AI agents cut financial research tasks from a month to hours
“So we can take something that used to be a month. And bring it down to, you know, four hours, eight hours.”
Assertion Supported
Gomez: Google quickly integrated Transformer architecture into Search and Translate
“No, they jumped all over it. So it went to production inside of search, inside of translate, like the existing product suite. And so they, to say that they didn't adopt the transformer architecture would not be correct.”
Insight
Gomez: Hardware lock-in raises the bar to replace Transformer architectures
“They built so much infrastructure specialized to the transformer. And so it's like we dug ourselves into this. Well like we now have chips that are being optimized explicitly to that architecture. And so to move architecture, it requires so much effort, energy…”
Prediction Not checkable as stated
Gomez: AI reasoning models will expand into medicine and physical sciences
“We've just scratched the surface at the moment. It's mostly focused on, you know math problems and this sort of thing. There is a whole world of applications that we need to make it work work in medicine, you know, everything from the pure sciences, physics, c…”
Assertion Not checkable as stated
Gomez: Existing AI models fail on non-English enterprise documents
“The current technology that exists doesn't serve their needs, especially in the enterprise world. Like maybe you can get them to speak good enough Japanese at chitchat, but for actual enterprise documents, everything breaks down like immediately.”
Insight
Gomez: AI agents differ from SaaS by requiring full human organizational context
“I think one thing that's different about agents and AI compared to other SaaS is that usually you're trying to do something that a human is doing in the organization. And To do that, you need the con, you need the same context that human has.”
Assertion Not checkable as stated
Gomez: The enterprise AI proof-of-concept phase has largely passed
“So there's that phase of like POC or figuring things out. It feels like it's passed us by now. Like most organizations know the opportunity. They know what they want to do, and they really just need help to go execute on it.”
Opinion
Gomez says RNN and LSTM architectures were complicated and ugly
“Previous RNN models, LSTM models, which were quite complicated and kind of in some ways ugly.”
Insight
Gomez: Multimodal AI capabilities are table stakes for enterprise data
“But there's also like multimodal is Essential for understanding enterprise data, like PDF documents, where there's graphs and this type of thing, or understanding slide decks. A lot of the modalities that enterprises work in are visual. So it's sort of table s…”
Assertion Supported
Gomez: Oracle implemented hundreds of AI use cases using Cohere
“But with, you know, a company like Oracle, which has all of this workplace software in fusion apps and NetSuite, they've implemented hundreds of use cases themselves using Coheres models.”
Disclosure
Google Brain accidentally hired Aidan Gomez as an undergrad intern
“I think I got in through an administrative mistake because my manager thought I was a PhD student.”
Prediction Held up
Gomez: Specialist AI models will emerge for drug creation and material sciences
“There will be specialist models that emerge to help in things like in pharma, right? The creation of new drugs in material sciences for advanced materials.”
Prediction Held up
Gomez: Cohere's Command model will soon become multimodal
“Command command a isn't currently multimodal, but you can imagine Very soon it will be.”
Aidan Gomez