Poolside

“It's already awesome that Mistral was able to raise that much, that Toolside is able to raise that much, but it's a trickle compared to what Open Air is raising, compared to what Anthropik is raising.”

“Our data split is about 50, 50 between language and code.”

“And so you're going to see a strong emphasis of us of also bringing poolside into enterprises, into complex environments where there might be 10,000 or a 100,000 developers, where the model needs to continuously learn and be fine-tuned on their data, where it'…”

“Well, the first thing that I think is at this point, almost uncontested, but frankly, when I was building source, most people didn't think would happen is the fact that the majority, if not all developers in the next couple of years in the world will adopt som…”

“We didn't take Megatron or DeepSpeed or kind of the big open source frameworks for training large language models. As our base, we built our own from scratch and we built our own distributed training for our pre-training stage.”

“We went through about 3200 or 3200 people that we ended up putting on the list. And we had this location column, like think genuinely Google spreadsheet, you know, like where's someone based. And at some point we looked at all these locations and we're like, w…”

“But in terms of what we're delivering to the end user, we're starting with a direct competitor to get up Copilot X. And so natural language, multi-turn dialogue system. Where developers give instructions of what they want done while they're in their editor. Th…”

“We've decided to scale up rev nets, reversible layers. So, so to the best of our knowledge, I think we're training the world's largest models using reversible layers that, that we've seen at least that nothing else that we're aware of publicly.”

“We don't think we're more than three years out to that point where a non-engineer, someone with no coding, you know, software development background is able to come and give one of those high level vague things of what they want built, right? Cause that's what…”

“We deliver this AI pair programming assistant full application stack with the models, I think fully vertically integrated with our own foundation models trained from scratch, but then also exposing those models with an API to allow other people to build all th…”

“And I think what we'll see in the next couple of years is a lot of model companies ourselves as well. We go into these enterprises. We find high value use cases. We use our agents to get to 60 or 70% You know, of quality, and then use additional reinforcement …”

“But we have a phrase at poolside, which is over time, everything collapses into the models.”

“So Project Horizon, in a nutshell, is today announced a two gigawatt campus. We can actually go far beyond two gigawatts on the site that we're in.”

“Models reach the frontier. That's right now. I think we see a straight line towards this.”

“And so what you're seeing from us is that before the end of this year, we're starting construction on a 250 megawatt data center. It's natural gas powered with grid connection as a backup, and it will house an incredible amount of compute, but it will be the f…”

“So at the beginning of Q four, end of Q three, so next year, we've got the first compute coming online. And then we're finalizing in Q one, 20, 27, the first you know, 250 megawatts, but already next summer, the next 250 megawatts starts construction. It's a s…”

“And what I found to be one of the best advice I got a very long time ago, whenever you find yourself in that situation, well, this is when you want to start finding the experts to join you, but how do you find the experts? Because you yourself aren't. And here…”

“Right now we have over a million of those environments and tens of millions of revisions, putting us in like the thirty million range.”

“And still today, if we look at where, like, researchers for pool sites sit, they sit predominantly, you know, 95% outside of Silicon Valley.”

“So we today operate on workstations that go into SCIFs. We operate on servers that are, you know, on-prem or even as far as air-gapped.”

“And so we're starting to open up much more broader outside of software development and come back to what we've always said, like we want to be able to power all of knowledge work in the world.”

“That's our upcoming family of models, Laguna, where we'll have a small, a medium, and a large. So small is finishing training in a couple of weeks, medium actually starts training this week and large starts training as our 41,000 GB 300 come online.”

“They are the anchor tenant on our data center.”

“It is not that I can linearly add more GPUs and train increasingly a more larger model. If I do so, the time it takes becomes exponentially longer.”

“To energize, 250 megawatts is about half a billion dollars worth of physical infrastructure. So in the case of gas turbines, it's gas turbines, but there's different paths to it. Building a data center, like the powered shell that brings together all of the eq…”

“Renewables only, in combination with the battery capacity that you would need to power a data center if you want renewable only, it's just not economically viable yet.”

“When we're building 250 megawatts, We're doing it with a less than 450 person on site workforce with very skilled tradesmen and construction workers that we're bringing over there and we're housing over there versus a world where you might need traditionally 2…”

“So when you take all those margins out, all of a sudden you can start seeing that you can serve your tokens, 2030, 40% cheaper than someone else.”

“I'm not yet convinced that gross margins in our industry will look like a SaaS company, like 80% plus. I think when we're talking about a commodity as intelligence, that we build value added services on top. Right. It's a foundation model company. On one hand,…”

“When we talk about this big multi-gigawatt project, we've got about eight years worth of construction that we are planning out there”

“They're companies like Poolside. They're building out tens of thousands of B-two hundred, GB-two hundred chips. You know, there's other folks like Reflection who are who are building out. Tens of thousands of B 200 chips.”