Pepitedata
  • Home
  • Services
  • Audits
  • Expert Call
  • About
  • Blog
  • Contact

S3-compatible storage

A one kilobyte object fanning out into fifteen metadata copies, one per drive of the erasure set
object storage

Object Storage for Data Platforms at Scale

A production guide to running object storage at scale: why object count is a capacity axis, how prefix design and the background scanner set your real SLAs, and how to choose engines, media and release channels.

By Julien Laurenceau, 6 days2026-09-30 ago
Wireframe illustration of a LiDAR point cloud scan of powerlines and terrain, split into a dense grid of many small tile blocks on the left and a few larger tile blocks on the right, same data
object storage

Why File Count Matters as Much as File Size on Object Storage

Switching tile formats on a LiDAR ingestion pipeline cut output object count by roughly 25x at the same data volume, independent of compression. Here is why object count is its own cost and performance axis on object storage, and what to check before you scale a pipeline that writes many small files.

By Julien Laurenceau, 1 month2026-08-22 ago
Diagram: MinIO erasure-coding storage inflation on small objects: per-drive xl.meta metadata replicated across the erasure set
data

Stop using MinIO as a NoSQL database: why S3 object stores collapse on small-file workloads

Two MinIO platforms, same root cause: used as a NoSQL store. Field notes on LIST IOPS, XFS directory limits, scanner & heal SLAs, the erasure-coding storage-efficiency inversion on small objects, and why Apache Cassandra (or Ceph) is the right answer on-prem in 2026.

By Julien Laurenceau, 5 months2026-05-17 ago
data

When the Lakehouse Works, but the Operating Model Breaks… Especially On-Premises

Note: This article was inspired by a LinkedIn post by Can Sinan A. on the hidden operational cost of an Iceberg migration, especially when governance moves from one access-control plane to several layers: catalog, storage and engine configuration Introduction Many organizations are modernizing their data platforms with lakehouse architectures, and Read more

By Julien Laurenceau, 5 months2026-05-04 ago
ceph

Migrating Unmanaged OSDs to Managed OSDs in Ceph Squid

Migrating unmanaged OSDs is one of the operations I run for Ceph clients: Ceph storage consulting. If you are running Ceph Squid with a mix of managed and unmanaged OSDs, there is one thing worth stating clearly upfront: There is no in-place adoption mechanism in Squid. You cannot “import” an Read more

By Julien Laurenceau, 8 months2026-02-05 ago
apache spark

Apache Spark smoke tests on kubernetes

Introduction Benchmarking remains a critical (and often underestimated) tool when designing or validating large-scale data platforms. While many teams rely on synthetic workloads or production replays, standardized benchmarks still play a key role when comparing architectures, tuning clusters, or validating infrastructure choices. TPCx-HS is one of those benchmarks: designed to Read more

By Julien Laurenceau, 9 months2026-01-12 ago
data

The Hidden Costs of Using HDDs in On-Premises MinIO Deployments

Hidden storage costs are one of the targets of a data platform cost optimization review. Bring the IOPS dude ! As a solutions architect working with MinIO storage solutions, I’ve seen firsthand the challenges that come with on-premises deployments using hard disk drives (HDDs). While HDDs may seem like a Read more

By Julien Laurenceau, 10 months2025-12-15 ago
data

MinIO’s Community Edition: The End ? 🚨

Beware the AGPL! you may end with a product orphan from its S3 storage… MinIO has long been a popular open-source S3-compatible storage solution, but their strategy has shifted dramatically, especially since the release of their new AIstor product, now positioned as their main enterprise S3 offering. Over the past Read more

By Julien Laurenceau, 10 months2025-12-15 ago
data

🚨 MinIO goes into maintenance mode

MinIO has just announced that the open source project is now in maintenance-only mode: no new features, no regular PR review, only best-effort community support.If your data lake, AI workloads or internal S3-compatible storage rely on MinIO, this is no longer a theoretical risk: it is an operational one. Over Read more

By Julien Laurenceau, 10 months2025-12-15 ago
  • Privacy Policy
  • Mentions légales
  • CGV
  • Cookies
Hestia | Developed by ThemeIsle