ceph
Upgrading a Ceph Multi-Site S3 Platform from Squid to Tentacle
A practical Ceph RGW upgrade plan for multi-site S3 platforms, covering replication validation, canary rollout, S3 acceptance tests and the limits of rollback.
apache spark
Spark on Kubernetes Reserves CPU It Never Uses. Here’s the Overcommit Fix.
Spark sets executor CPU requests equal to limits, so a Kubernetes cluster reserves twice the CPU it uses and refuses to schedule pending pods. Kubernetes has no native overcommit. Here is the mutating-webhook operator I use to fix it.
AI
Tesla’s .SMOL Format Shows Why Most Enterprise Data Lakes Are Architecturally Wrong
When Tesla published patent WO2024073080 describing a new file format internally called “.smol”, the headline was simple: 4x reduction in IOPS for AI training. Most people read this as a hardware story. It isn’t. It’s a data architecture story. And it exposes a structural weakness in how most enterprise data Read more
AI
GPUs Changed Everything. Storage Is the Bottleneck Again.
GPUs are no longer the bottleneck. Data movement is. I recently attended an online talk that stayed with me longer than most.Not because of a new GPU announcement, but because it clearly articulated something I have seen repeatedly over the years, across very different systems. That message, strongly emphasized by Read more
data
🚀 Just discovered TigerBeetle DB – and it’s redefining what’s possible in financial database performance
As someone who’s spent years optimizing data storage performance, I’m genuinely impressed by TigerBeetle’s bold architectural choices: https://lnkd.in/eS3bfHHQ 🎯 Single-core design for maximum throughputInstead of fighting contention with complex locking, they funnel all writes through one optimized core. For high-contention financial workloads (think central bank switches processing millions of transactions), Read more