The Ledger, every show

“The reality is we have more compute available to us than Microsoft or Google.”

“I think that there's only going to be five or six foundation model companies in the world in three years, five years.”

“India, all of the outsourcing jobs in programming will go, because GPT-IV can go level three Google programmer exam and pass it.”

“Why would you need a human for that if the AI gets better and better at coding? Just tell it what you want. I want to create an app for 20 minute VC that has these features. Of course it will go and build it automatically. Where is the human coder in that?”

“I think that there's only going to be five or six foundation model companies in the world in three years, five years. ... I think it's going to be us, NVIDIA Google, Microsoft OpenAI, and Meta and Apple probably are the ones that train these models.”

“I think that there's only going to be five or six foundation model companies in the world in three years, five years. I think it's going to be us, Nvidia, Google, Microsoft, OpenAI, and Meta, and Apple probably are the ones that train these models.”

“I think that there's only going to be five or six foundation model companies in the world in three years, five years. I think it's going to be us, Nvidia, Google, Microsoft OpenAI, and Meta and Apple probably are the ones that train these models.”

“The reality is no models that are out today will be used in a year.”

“The reason I signed that letter, because I think there's a six month pause to get all of our shit together before things go completely insane, and next year this is everywhere, and everyone's investing in everything, and it's just absolute chaos.”

“The reality is no models that are out today will be used in a year.”

“We've got to stop pre-training big models on all the crazy crap of the internet. And like, we've got to do it fast because this is coming like a train.”

“Google will be one of the main winners here. They have the LLMs, they have the hardware.”

“The value is not in any proprietary models or data.”

“The reason I signed that letter, because I think there's a six month pause to get all of our shit together before things go completely insane, and next year this is everywhere, and everyone's investing in everything, and it's just absolute chaos.”

“No, they're building an AGI to turn the world into utopia. It's written in their path to AGI thing, that they think this can basically bring about utopia.”

“And so, like, I think this will be a bigger economic impact than COVID.”

“50% of all code on GitHub is AI generated now.”

“Because they're going to regulate all innovation out of Europe, and not embrace this technology to drive them forward.”

“So my take is that foundation models will all be open source for the deep learning phase.”

“I am certain that system will outperform anything in the West within five years.”

“There's only like a hundred people who can train models in the world. Like it's not really a science. It's more an art, like losses explode all over the place when you try to do something.”

“I think that a productive outcome of that regulation is anything above a certain level of flops needs to be registered similar to, well, bio weapons and things that have the potential for dual use.”

“I think that small models will outperform large models massively, like I said, the Hive model aspect”

“There is no such thing as an unbiased model.”

“I think that there's only going to be five or six foundation model companies in the world in three years, five years.”

“I think this will be a bigger economic impact than COVID.”

“The reality is no models that are out today will be used in a year.”

“I think this is bigger than the printing press. It's bigger than anything.”

“I call them organic free-range models, the ones we're building with no web scrape data.”

“TPUs are the most scalable architecture, like we have zero failure rate with our TPU language model training, whereas with GPUs it's like there's an ECC error”

“Governments will not run on black boxes.”

“Certain Chinese companies paying 1.2 million dollar salaries for PhDs.”

“Already you're seeing GitHub stars leading to a hundred million dollar funding rounds with zero traction and zero business model.”

“Because there is no doubt this is more important than five G.”

“As part of that, every nation will need their own data sets, which again have from broadcaster data. They will need their own open models that can stimulate innovation internally as well.”

“Realizing that India and other nations will leapfrog to intelligence augmentation, just that they leapfrog to mobile, they will embrace this technology far quicker than we will in the UK even.”

“If you're a financial services institute, you can't have a single piece of crawl data in there.”

“We had datacomp, which is the next generation lion that we funded the compute for, whereby at a quarter of the parameters of OpenAI's clip, it outperforms for the beta data quality.”

“I think he is right to be worried. Like, again, you look at Google's announcements yesterday, they were talking about this day after Palm Two, You suddenly look at the new Google page where they've got the language model, and it's just text, and where are the …”

“The reality is no models you that are out today will be used in a year.”

“It's massively deflationary. The biggest drivers of CPI inflation in the US were education and healthcare. And that was almost all administrative and bureaucratic. In the next few years, guess what gets disrupted? Those. But they don't get disrupted this year …”

“We had hundreds of millions of images opt out of stable diffusion because we were the only company in the world To offer opt out of data sets.”

“They were designed to be reasoning machines, not fact machines.”

“Assume that every child will have their own AI in a few years, because that will change the nature of schooling.”

“I already use GPT-IV as a therapist and things like that.”

“Because the metaverse, obviously, is a complete waste.”

“But who is best for a chatbot? Who has the most data for a chatbot? Meta.”

“More on that, a bit of a moral imperative to make this technology available to everyone because we're now going to very narrow superhuman performance and everyone should have access to that.”