The Ledger, every show
Every statement that passed quotation and attribution checks, across all 44 shows. Pick shows below, then mix any filter with any other.
shows 
every show 44 of 44
Wang: GPT-4 writes beautifully but lags significantly in reasoning and factuality
“Already GPT-IV is a much better writer than I am, just in terms of, you know, not making grammar mistakes and being able to structure very flowing prose and, you know, being able to write very beautifully, but it's much worse than me at reasoning. It's much wo…”
Alexandr Wang: Scale partnered with OpenAI on the first GPT-2 RLHF experiments.
“So we partnered with OpenAI at that time to do the very first experiments on RLHF on top of GPT-II.”
Alexandr Wang: JPMorgan has 150 petabytes of data; GPT-4 used under one.
“JP Morgan's proprietary data set is a 150 petabytes of data. GPT-IV is trained on less than one petabyte. Of data.”
Alexandr Wang: Scale AI will launch recurring held-out LLM benchmark leaderboards.
“So one is that we're going to launch these private held out evaluations and have leaderboards associated with these evals for the leading LLMs in the ecosystem. And we're going to rerun this contest periodically. So every few months we're going to do a new set…”
Alexandr Wang: Multimodality faces a scarcity of quality data for personal agents.
“So multimodality as an entire space is one where for the same reasons that we've like exhaust a lot of the internet data, there's a lot of scarcity for good multimodal data that can empower these personal agents and these personal
Use cases.”
Wang: Scale AI originally started as a medical care AI agent
“We wanted to build like, an AI agent, funnily enough, for doc, for, to help people, like, get medical care. And it was, like, the writing, it was a great example of an idea that I think will ultimately exist. Like, I think we're even seeing it now. Like, AI ag…”
Wang: Japan and South Korea will establish AI Safety Institutes
“The UK has an AI safety Institute. The U S is an AI safety Institute. It looks like, you know, Japan and Korea are going to add AI safety institutes all in the mission of ensuring that there's proper test and evaluation of these AI systems.”
Wang: Biological Foundation Models Will Drive Rapid Pharmaceutical Breakthroughs
“Progress in pharmaceuticals in particular is an area where I think we'll see very rapid progress. You know, I I've spent a lot of time there just personally, because it's an area that I find very interesting. There's been incredible advancements in biological …”
Alexandr Wang: Scale AI built the first sensor-fusion data engine for AVs.
“And so we built, The very first data engine that supported sensor fused data. So support a combination of two D data plus three D data. So lidars plus cameras that were built on onto the vehicles. And then that very quickly became an industry standard across a…”