The Ledger, every show

“I do believe that they are incorrect around multimodality being, or images being a core component of that.”

“I do say these large models as well should be viewed as fiction, creative models, not fact models, because otherwise we've created the most efficient compression in the world. Does it make sense you can take terabytes of data and compress it down to a few giga…”

“When governments decide, and I don't believe they've decided yet, that having an AGI is the number one thing, tens of billions, hundreds of billions will go into building bigger models.”

“I think the bad guys, I'm going to put that in quotes have access to these models already and thousands and thousands of A-one hundreds.”

“You will see ChatGPT level models running on the edge on smartphones in five years, which will be crazy.”

“DeepMind's salary budget is 1.2 billion a year.”

“There is no such thing as an unbiased model.”

“As part of that, every nation will need their own data sets, which again, have from broadcaster data. They will need their own open models that can stimulate innovation internally as well.”

“Google spend twenty billion dollars a year on AI.”

“DeepMind's salary budget is 1.2 billion a year.”

“DeepMind's salary budget is 1.2 billion a year.”

“Now we have MedPOM-II that exceeds doctor levels. So that was a Google announcement yesterday.”

“I think that you can change the nature of a doctor because a lot of this stuff is kind of very basic. I think, you know, you had Babylon Health and others trying that chatbot. It wasn't ready. Now you've got this. Everyone should have their own AIs looking out…”

“From next week, we're going to build our language models in the open and share what works and what doesn't work.”

“Well, this is what we're doing right now. We're working with our multinational partners, lots more to be announced soon, and multiple governments for a framework for what good data looks like to feed these models, to stimulate innovation and localization.”

“If you want to have distribution, what do we do? We went to Amazon and said Bedrock, because then it gives us a 100,000 SageMaker SMEs, and we just have to give them the models that they can then take to the private data, and we get a share of all of that.”

“There is no such thing as an unbiased model.”

“People are offering us tens of millions per model”

“Google will spend twenty billion dollars a year on AI.”

“DeepMind's salary budget is 1.2 billion a year.”

“You need these chips lined up with interconnect, and we've got 7000 A-one hundreds now.”

“It's had the best apart from maybe Japan, yes.”

“Character AI has something like two hours a day of engagement per session”

“And so they could surprise us all, but let's face it, Siri's crap, you know?”

“Humans will trust it anyway. They trust Google Maps. They trust all these things. And so it's good enough for humans to trust right now.”

“So right now we're deploying four million tablets to every child in Malawi.”

“We are working with multiple movie studios at the moment who are saving millions of dollars, just implementing stable diffusion by itself, let alone these other technologies.”

“With the additional breakthroughs that are coming through, it'll be 25 frame images a second. That's a hundred times speed up over a hundred times just from getting it out there and people interested in doing that.”

“So like now we're training on hundreds and soon thousands of Bollywood movies to create Bollywood video models with our partnership with Eros you know, and that is exclusively licensed.”

“And again, I think this is the future, not just zero shot, multiple models interacting with each other is the way full stop.”

“Google spend twenty billion dollars a year on AI.”

“The next step is one to one. It remembers what you're asking for, like a cookie or an embedding. And then it's you plus a thousand of these language models all going and doing your bidding, the agent based kind of thing.”

“So you'll have big global models, on-device models, And I think open works for that, because you don't need to have all the data open.”

“If you have a business that's focused on innovation at the core, that's not actually a business. It becomes a business when that innovation becomes product, becomes distribution, when it has an advantage on data and other things. Those are real moats.”

“It's not about more data, it's about better data.”

“So DALI-II, when OpenAI had that and they introduced a bias filter, any non-gendered word, they had a random gender and a random ethnicity. So you typed in sumo wrestler and you'd get Indian female sumo wrestler.”

“You will have AI first publishers. So if you remember kind of Vox and these things when they kind of kicked off, they wanted to be generated, they wanted to be a technology first. You're gonna have a new wave of AI first publishers that aren't just AI, but it'…”

“Next year it will settle, and then it'll go ubiquitous.”

“So I started supporting the whole space at Luther and beyond, giving jobs to the developers, compute for the model creators, funding the various notebooks from disco diffusion to these other things, you know, giving grants to people like mid journey that were …”

“You know, on GitHub stars, we've overtaken Ethereum and Bitcoin cumulatively. It took them 10 years. We got there in like three, four months.”

“So to give you an example, we just got a seven million hour grant on Summit, one of the fastest supercomputers in the US.”

“Now, as of the release of Distilled Stable Diffusion, it will run in a couple of seconds on an iPhone, and we have neural engine access, because our view of the future is creating models that aren't necessarily bigger, but that are customizable and editable.”

“And then I think on a breakthrough side, computational biology will be the biggest one.”

“So we train the whole internet and like stable diffusion is a 100,000 gigabytes in a two gigabyte file.”

“We will release an open MedPalm model. Well, med stable GPT.”

“And originally I thought you got communities, you gotta make them kind of coordinated. Could a DAO work or a DAO of DAOs? And that's how stability started. After about a week, I realized that was not gonna work and it was incredibly difficult. So then I figure…”