Amazon S3

“And as a matter of fact, once you transcode the data compresses better. So from those services writing to, for example, S three or other data lake, like object stores, you can actually write them faster because now they are now smaller. So there's no. Overhead…”

“A lot of these virtual machines actually underlying them don't use real file systems. They use these like network file systems where things are actually cached over the network actually in S three. So when you're grepping, you're actually making network calls …”

“Actually the most interesting one is we had one customer that will literally Take the entire code base inside the sandbox and every, I forgot what the time sequence was. They would just dump it all into a JSON and then push that to S three. And that's it.”

“So, okay, you might give up three orders of magnitude in write latency, but actually you don't have to give anything else up. And then you have this true two orders of magnitude decrease in the base cost of the system. That's a great compromise if you're build…”

“If we had raised a whole bunch of venture funding, we probably would have done it and said, we'll figure it out later. Somehow we'll figure out how to make the math work. But we didn't have any money. So we had to start from first principles and figure out how…”

“And then there's the acceleration of like alternative architectures, you know, storage. Why don't you just dump everything in S three, which is very cheap. And then, you know, you could use iceberg on top to add some structure to it. You can, we talked about D…”

“We use SG as so like the storage layer for our data warehouse, and we use Spark, Presto, Snowflake as our query engines.”

“We run a Databricks on S-III, but we pull data into Databricks from Snowflake, so we have a connection between the two.”

“Wasabi is six dollars a terabyte per month compared to 23 dollars per terabyte per month for Amazon S III, for example.”

“We have what's called 11 nines of durability, which is the same as Amazon S III.”

“And the technology advantage is we've written our own file system, which takes advantage of some new kinds of storage technologies.”

“For Amazon to simply drop price, they could do it, but unlike diapers, you know, storage is a multi-billion dollar product for Amazon, and it just seems unlikely to me that they're going to do that.”

“You can leave all of your data in S three, which is essentially your lowest cost option, right? In the cloud. And you can spin up these EC two nodes as needed as demand increases for whatever workload you're doing. And as a result, you have all this cost flexi…”

“What a token can do, Is that when the network utility, or rather the application utility is low so there are no hard drives to go store things on, on Filecoin, so why would I want to use Filecoin instead of Amazon S III? Well, I now see that Filecoin is worth …”

“So what we do is the data is permanently stored in blob storage in S-three. It's the only permanent store of the data.”