Bring the IOPS dude ! As a solutions architect working with MinIO storage solutions, I’ve seen firsthand the challenges that come with on-premises deployments using hard disk drives (HDDs). While HDDs may seem like a cost-effective option initially, they can introduce significant performance bottlenecks that impact the overall efficiency and Read more
Beware the AGPL! you may end with a product orphan from its S3 storage… MinIO has long been a popular open-source S3-compatible storage solution, but their strategy has shifted dramatically—especially since the release of their new AIstor product, now positioned as their main enterprise S3 offering. Over the past year, Read more
Alpha Feature in Production… Good Idea? The most promising approach, journal-based mirroring, offers near real-time replication and faster failover. However, it’s currently an alpha feature in the Ceph CSI driver and relies on rbd-nbd, which introduces significant risks: For documentation on Ceph RBD mirroring see IBM documentation For details, see Read more
Most discussions about PVC focus on on-prem deployments, but many of these technologies are equally relevant in the cloud, especially when using managed block storage like AWS EBS, which caps at around 64K IOPS. By contrast, OpenEBS LocalPV (ZFS or LVM) can attach directly to NVMe-backed local disks, unlocking true Read more
As someone who’s spent years optimizing data storage performance, I’m genuinely impressed by TigerBeetle’s bold architectural choices: https://lnkd.in/eS3bfHHQ 🎯 Single-core design for maximum throughputInstead of fighting contention with complex locking, they funnel all writes through one optimized core. For high-contention financial workloads (think central bank switches processing millions of transactions), Read more
MinIO has just announced that the open source project is now in maintenance-only mode: no new features, no regular PR review, only best-effort community support.If your data lake, AI workloads or internal S3-compatible storage rely on MinIO, this is no longer a theoretical risk – it’s an operational one. Over Read more
Freelance Senior Solutions Architect helping companies design, harden, and scale their data, cloud, and AI platforms – without blowing up cost or complexity. With 15+ years of experience (including a PhD in numerical optimization & AI and 10 years in HPC), I step in when performance, reliability, and scalability really Read more
Introduction In the world of big data, storage solutions are the backbone of any architecture. As an expert solutions architect, I have relied on various storage solutions to ensure data integrity and availability. Recently, I discovered a critical flaw in MinIO’s tiering feature, introduced in RELEASE.2022-11-10T18-20-21Z, that poses a significant Read more
Thanos is a widely adopted open-source project that extends Prometheus’ capabilities, offering long-term storage, global querying, and downsampling. It’s a powerful tool for monitoring and observability, but like any complex system, it has its quirks. Thanos is cloud native and use s3 as its main storage backend. It can have Read more