The Ledger

Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.

clear all ✕

why aren't all 6 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable

Insight
Chia: Shard granularity is exceptionally difficult to alter post-implementation
“Once you shard by a certain level of granularity, it's very hard to redesign your system to try and think about it a different way.”
Daniel Chia Feb 25, 2019 ▶ 4:59 Dynamic Range Sharding with Spanner // Daniel Chia, Google Spanner (FirstMark's Data Driven NYC)
Insight
Daniel Chia: Sharding database tables purely by entity keys risks giant hot shards
“The problem here is that, you know, one day you're going to get some singer that's so popular and so prolific and has so many songs that That one singer shard is gonna be huge, and then you are kind of in trouble, right? You either need to do a lot of special …”
Daniel Chia Feb 25, 2019 ▶ 8:06 Dynamic Range Sharding with Spanner // Daniel Chia, Google Spanner (FirstMark's Data Driven NYC)
Insight
Daniel Chia: Row-based sharding can outperform dynamic range sharding for uniformly random workloads
“In fact, this is a case where one of the earlier methods of sharding just by row would potentially work better, because if your incoming new workload is just randomly Distributed across rows perfectly. It will distribute across all the shards very well.”
Daniel Chia Feb 25, 2019 ▶ 14:23 Dynamic Range Sharding with Spanner // Daniel Chia, Google Spanner (FirstMark's Data Driven NYC)
Insight
Chia: Location services allow dynamic database sharding over hardcoding
“The really nice thing about having a location service is that you can adaptively change your shards rather than having to hard code it upfront.”
Daniel Chia Feb 25, 2019 ▶ 10:08 Dynamic Range Sharding with Spanner // Daniel Chia, Google Spanner (FirstMark's Data Driven NYC)
Insight
Daniel Chia: Dynamic sharding systems struggle to quickly adapt to sudden workload shifts
“One of the biggest problems you can face with a dynamic sharding system is that it takes a while for us to adapt to your workload.”
Daniel Chia Feb 25, 2019 ▶ 13:46 Dynamic Range Sharding with Spanner // Daniel Chia, Google Spanner (FirstMark's Data Driven NYC)
Insight
Algorithmic sharding on full primary keys degrades database query locality
“With every shard being on a side lead on a different row, sorry, every row being on a different shard, you end up needing to check all shards to answer this query, which kind of defies this prior, this criteria of locality that I talked about earlier.”
Daniel Chia Feb 25, 2019 ▶ 7:19 Dynamic Range Sharding with Spanner // Daniel Chia, Google Spanner (FirstMark's Data Driven NYC)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.