When Tesla published patent WO2024073080 describing a new file format internally called “.smol”, the headline was simple: 4x reduction in IOPS for AI training. Most people read this as a hardware story. It isn’t. It’s a data architecture story. And it exposes a structural weakness in how most enterprise data Read more
If you are running Ceph Squid with a mix of managed and unmanaged OSDs, there is one thing worth stating clearly upfront: There is no in-place adoption mechanism in Squid. You cannot “import” an existing OSD into the orchestrator. If an OSD was deployed manually or predates your orchestrator setup, Read more
GPUs are no longer the bottleneck. Data movement is. I recently attended an online talk that stayed with me longer than most.Not because of a new GPU announcement, but because it clearly articulated something I have seen repeatedly over the years, across very different systems. That message, strongly emphasized by Read more
Introduction Benchmarking remains a critical (and often underestimated) tool when designing or validating large-scale data platforms. While many teams rely on synthetic workloads or production replays, standardized benchmarks still play a key role when comparing architectures, tuning clusters, or validating infrastructure choices. TPCx-HS is one of those benchmarks: designed to Read more
Bring the IOPS dude ! As a solutions architect working with MinIO storage solutions, I’ve seen firsthand the challenges that come with on-premises deployments using hard disk drives (HDDs). While HDDs may seem like a cost-effective option initially, they can introduce significant performance bottlenecks that impact the overall efficiency and Read more
Beware the AGPL! you may end with a product orphan from its S3 storage… MinIO has long been a popular open-source S3-compatible storage solution, but their strategy has shifted dramatically—especially since the release of their new AIstor product, now positioned as their main enterprise S3 offering. Over the past year, Read more
Alpha Feature in Production… Good Idea? The most promising approach, journal-based mirroring, offers near real-time replication and faster failover. However, it’s currently an alpha feature in the Ceph CSI driver and relies on rbd-nbd, which introduces significant risks: For documentation on Ceph RBD mirroring see IBM documentation For details, see Read more
Most discussions about PVC focus on on-prem deployments, but many of these technologies are equally relevant in the cloud, especially when using managed block storage like AWS EBS, which caps at around 64K IOPS. By contrast, OpenEBS LocalPV (ZFS or LVM) can attach directly to NVMe-backed local disks, unlocking true Read more
As someone who’s spent years optimizing data storage performance, I’m genuinely impressed by TigerBeetle’s bold architectural choices: https://lnkd.in/eS3bfHHQ 🎯 Single-core design for maximum throughputInstead of fighting contention with complex locking, they funnel all writes through one optimized core. For high-contention financial workloads (think central bank switches processing millions of transactions), Read more
MinIO has just announced that the open source project is now in maintenance-only mode: no new features, no regular PR review, only best-effort community support.If your data lake, AI workloads or internal S3-compatible storage rely on MinIO, this is no longer a theoretical risk – it’s an operational one. Over Read more