The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 126 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 6 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Fanelli: Anthropic scrapes 6,000 pages per referral, compared to OpenAI's 250
“Google would be a two to one crawl to referral ratio, so for every two pages, they will read, they will send you one visitor. He said OpenAI is 250 to one, so they'll read 250 of your pages and send you one person. And Anthropic was like 6000 to one. So they'l…”
Sridhar: High HLE benchmark scores do not translate to deep research products
“The benchmarks, at least the ones that we are seeing, they don't directly translate to the product. There's definitely some technical challenges that you can benchmark against, but they don't really, like if I do grade on
HLE, that doesn't really mean I'm a g…”
Google Was Firefox's Main Code Contributor Before Launching Chrome
“And then the team that is now the Chrome team believe, and I, my, I don't know this for a fact, but I'm pretty sure Google was the main contributor to Firefox for a long time in terms of code.”
Bryk: Google and Bing completely fail when given paragraph queries
“Traditional search engines like Google or Bing, they're actually designed for humans typing keywords. If you give a paragraph to Google or Bing, they just completely fail.”
Bryk: Google and Bing rely on limited keyword algorithms due to constraints
“Google and Bing work, and they're just not using new methods. There are all sorts of reasons for that. Like, one, like, Google has to be comprehensive over the web, so they're, and they have to return in 400 milliseconds. And those two things combined means th…”
Bryk: Google Search hadn't changed in a decade by 2021
“And then there was Google which felt like it hadn't changed in a decade because it really hadn't. And it like, you would give it a simple query, like, I don't know shirts without stripes, and it would give you a bunch of results for the shirts with stripes.”
Bryk: Superintelligent models like GPT-5 will fail using Google Search
“You could have a world, and we are going to have this world, where you have, like, GPT-V level systems and beyond that could, like, answer any complex request. Unless it requires some, like, if you say, like you know, give me a list of all the PhDs in New York…”
Cheah: RWKV organization has less compute than a single Google researcher
“So our entire organization has less compute than a single researcher in Google.”
He: Mixtral's top-k before softmax routing hurts MoE upcycling performance
“We actually found the mix-throughs approach didn't work as well as expected, because the original model, the original switch transformer from Google uses a softmax and topk for a reason. And because of upcycling, if you switch to topk, then softmax, it actuall…”
Carlini extracted production models from Google and OpenAI with legal permission
“We ran the attack that let us, yeah, stole several of OpenAI's models. With their permission... We notified everyone who was vulnerable to this attack. Some Google models were vulnerable. Some open AM models were vulnerable. There were one or two other people …”
Tay: Google and OpenAI built general models three years before academia
“Places like Google and Meta, OpenAI, we will be working on things, like, Three years ahead of everybody else, and then suddenly, like, then Academia would be, like, still working on, like, these task-specific things.”
Huang: Google's internal AI tooling was far superior to competitors
“Google was using AI for systems before everybody else too, right? They invented a transformer, and their internal set of tooling was just so far superior to everything else. Like, it's really hard for people to go back after seeing that.”
Only Tech Giants Will Build In-House AI Infrastructure Long-Term
“I think a lot of these companies over in the long run, like, you know, they're accepted maybe super big ones, like, you know, the Facebook and Google, they're always gonna build their own ones, but like everyone else, like some extent, you know, I think they'r…”
Patel: Nvidia and Google control over 80% of advanced AI silicon manufacturing capacity
“To simplify it, NVIDIA has a little bit more than half, and Google has, like, 30%, right, through Broadcom. So it's like, the total capacity for everyone else is much lower, and they're all sharing it”
Patel: Google is co-designing TPU v5 and TPU v6 with Broadcom
“TPU, you know, all the way through to all, TPU v-five, which is the one they're in production of now, and six, and, you know, all these are all gonna be you know, co-designed with Broadcom.”
Patel: Google, OpenAI, and Anthropic are developing multi-datacenter training
“One of the big bottlenecks is how much power and how many chips you can get into a single data center. So, like, A, Google and OpenAI and Anthropic are working on this, right?”
Patel: Google will avoid deploying local laptop models to retain control
“I don't think Google is going to deploy a model that I can run on my laptop to help me with code or help me with, you know, XYZ. They're always going to want to run it on the cloud for control.”
Jeremy Howard: Fast.ai won Stanford's DawnBench in 10 days using progressive resizing
“We only found out about this 10 days before the competition finished but, you know, we basically got together an emergency bunch of our students, and Rachel and I, and sat for the next 10 days, and just tried to crunch through, and Try to use all of our best i…”
Chatbase customer model usage is split 50% OpenAI, 50% Anthropic and Google
“Maybe 50% is still on Okunai. Yeah. Yeah. And then 50 on everything else. Yeah. But everything else is like mainly Anthropic and Google.”
Ludwig: 2B parameter LLMs can run on embedded vehicle hardware
“You can run that model on embedded system.
Definitely.”
Andreessen: Google had internal chatbots between 2017 and 2021 but withheld them
“Between 20 17 and 20, 21, I mean, that was the era of which like companies like Google had internal chatbots, but they weren't letting anybody use them.”
Jeff Dean: ML chip design requires predicting research workloads 2-6 years out
“As a hardware designer for ML in particular, you're trying to design a chip starting today
And that design might take two years before it even lands in a data center, and then it has to sort of be a reasonable lifetime of the chip to take you three, four, or f…”
The National Science Foundation has returned thousands of times its public cost
“It has been probably the best investment the American popular public has ever made. Thousands X return on their investments. I mentioned Google earlier, Databricks, all these researchers came from NSF funding”
Altman, Nadella, and Pichai publicly committed to adopting MCP around April
“And then like, you had this like inflection point around April with like Sam Altman and Satya and Sundar and all posting about like MCP and that they're going to adopt MCP at Microsoft, at Google. At OpenAI and that was really like the big inflection point.”
Google, Microsoft, Amazon, OpenAI, and Anthropic joined AAIF as platinum members
“You have Google, Microsoft, Amazon Block, Bloomberg, Cloudflare, OpenAI, Anthropic. Just a platinum member, create a foundation.”
Lambert: All major frontier AI labs will build their own search indexes
“I think they'll all do end up doing their own index and it should, it's one of those things that's like Google should have an advantage again, but who knows if they do.”
McCloy: AI Search Products Lack Google's Robust Abuse Detection
“None of these products have as much Attention to detail or engineering put into them in terms of, like, moderation and abuse detection and, like, being defensive against the fact that the Internet's a wild place, as Google does, right?”
Justine Moore: Veo 3 lacks image-to-video with audio, reverting to Veo 2
“Cause the thing to know about VO three that I think a lot of people don't know until you use it is you actually can't do image to video with audio.
Google hasn't released that yet.
I would assume for trust and safety reasons in the interface, you can start wit…”
Olivia Moore: Google Flow defaults to Veo 2 and fails on mobile
“Flow and VO, it's, like, VO two is actually the default, and you have to, like, navigate a bunch of, like, little hidden buttons to change it to VO three. So there's, like, YouTube videos with, like, millions of hits of just, like, how do I find VO three withi…”
Mallick: Google was first to market with live video API input
“So we were actually the first to market with also video input”
Basu Mallick: Google was first to introduce tool chaining for live APIs
“Again, we were very proud because we introduced tool chaining first, so you could change search and code execution to all kinds of analysis.”
Conrad: NVIDIA avoids customer concentration to prevent hyperscaler price setting
“It's really bad for NVIDIA if you have customer concentration, and Microsoft and Google and Amazon, like, Oracle to, like, buy up your entire supply and then you have four or five customers or so who pretty much get to set prices.”
Google's internal culture became significantly more aggressive and startup-like post-ChatGPT
“The culture has really shifted internally to be a lot more startup, be fast moving. Aggressive, and at least folks I talk to are optimistic about Google's chances to win this.”
Agarwal: Google AI Overviews Uses Speculative Decoding With Distilled Models
“And this was actually used, so I guess the cool application of this I can mention is the next slide, which is AI overviews at Google. I don't know if people have seen this or this kind of thing. Like, there is this thing that comes up, and that actually uses t…”
Swix: Google's entire SigLIP vision team left to join OpenAI
“I think the most recent notable move, I think the entire vision team from Google Lucas Beyer and all the other authors of Siglip left Google to join OpenAI”
Kilpatrick: Multimodal Live API provides 80% of Project Astra experience
“I think most probably like 80% of that experience you could get out of the box with the multimodal live API.”
Kilpatrick: Flash models will continue surpassing previous Pro model capabilities cheaply
“We keep seeing this jump where the capabilities of the pro models get superseded by the flash models as the next generation comes. So if you look at our two point O flash model is actually on like every dimension, a stronger and better model than the previous …”
Kilpatrick: Google hot-swaps experimental models without allowing developers to pin old versions
“Framing it as experimental is, is really to try to signal that like one, you shouldn't use this thing in production.
like it's
You know, rate limits are usually the limitation to stop people from doing this, but to like the model might change.
And in certain …”
Sehgal: Deep research evals should categorize research behavior, not domain verticals
“And really what we tried to do is like, stay away from like verticals, like travel or shopping and things like that, but really try and go into like, what is the underlying research behavior
Type that a person is doing.”
Sridhar: Google launched Deep Research horizontally rather than for a single vertical
“Our primary goal was
Not to specialize in, in, in a particular vertical or target one type of user. We just want to put this in the hands of like we had like this busy parent persona and like various different user profiles and see like what people try to use …”
Sridhar: Deep Research Uses Base Gemini With Custom Post-Training
“Yeah, I don't think we have special access, per se. It's pretty much the same model. We, of course, have our own post-training work that we do, and Y'all can also, like, you know, you can fine tune from the base model and so on.”
Sehgal: Google shipped a 5-minute Deep Research mode fearing user drop-off
“I remember we actually built two versions of deep research. We had like a hardcore mode that takes like 15 minutes. And then what we actually shipped is a thing that takes five minutes. And I even went to Eng and I was like, there has to be a hard stop, by the…”
Taylor: Google Suggest was the first browser-based typeahead autocomplete
“Google Suggest, which Kevin Gibbs was the tech lead for, was the first kind of type ahead autocomplete, I believe, in a web browser, and now it's just pervasive in search boxes that you sort of see a type ahead there.”
Bret Taylor's Rewrite Slashed Google Maps Bundle Size to 20KB
“The on GZIP bundle size for all of Google maps. When I rewrote it was 20 K GZIP, it was like much smaller for the entire application. It went down by like 10 X.”
Google's SWE-bench submission utilized thousands of trajectories and selection strategies
“The Google submission down below, I think ran thousands of trajectories and then has a strategy for choosing the best.”
Exa runs core search subsystems with one or two people each
“And so it's like the crawling system, the AI processing system, and then the serving system. Those are all like, you know, teams of like hundreds, maybe thousands of people at Google. But for us, it's like one or two people each typically, but”
Swyx: Apple Intelligence is the largest transformer rollout since Google's BERT
“It is the probably the largest scale rollout of transformers yet after Google rolled out BERT for search”
Crivello: Horizontal Platforms Win Because Core Infrastructure Is Universal Across Verticals
“And I think that the reason for that is because search in each vertical has more in common with search than it does with each vertical. And search is so expensive to get right. Like Google is a big company. That it makes a lot of sense to aggregate all of thes…”