PepiteData Julien Laurenceau
  • Home
  • Services
  • Audits
  • Expert Call
  • About
  • Blog
  • Contact

object storage

A long row of identical storage bays in which every arriving crate is funnelled into the single lit bay at one end.
object storage

Inside the Amazon S3 Object Index, Part 1: Why Key Order Creates Hot Partitions

Amazon S3 partitions its object index by key prefix in UTF-8 binary order, not by hash. That choice gives you prefix listing for free and turns a sequential, date-first prefix into a hot partition that answers with 503 Slow Down.

By Julien Laurenceau, 2 days ago
Two warehouses linked by conveyors illustrate S3A rename copying objects to new keys and deleting the originals.
apache spark

Spark Output Committers on S3, MinIO and Ceph: Stop Committing by Rename

S3A committers avoid copying Spark output during commit, but they do not publish a dataset atomically. This guide shows how to configure and verify them in upstream Spark, what changes on Amazon EMR, and how to protect readers and concurrent writers.

By Julien Laurenceau, 3 weeks ago
One gold object fanning out into six copies arranged as two groups of three, one per zone
ceph

Ceph in Production: RBD, RGW and CephFS

A field guide to Ceph in production: which surface serves which workload, what failure domains cost in replicas, how the upgrade lifecycle really rolls back, and what key rotation does not do.

By Julien Laurenceau, 2 months2026-09-30 ago
The same payload volume split into a few large objects or many small objects, with an exaggerated pile of metadata tags
object storage

Object Storage for Data Platforms at Scale

Size an object store against bytes, object metadata, request demand and maintenance time. A practical worksheet for small files, retention, erasure coding and release-channel choices.

By Julien Laurenceau, 2 months2026-09-30 ago
Three server racks labeled A, B and C joined by a closed oval conveyor loop where one amber crate labeled 405 circulates endlessly, never docking at the open slot on rack C
MinIO

MinIO delete-marker convergence: how the Silo fork fixed the 405 replication loop

The 405 storm had three root defects in the delete-marker path. PR #162 fixed the first attempt; PR #184 fixes retries, purge status and MRF healing in the Silo fork.

By Julien Laurenceau, 2 months2026-09-15 ago
Two industrial conveyor lanes in dark graphite, the upper lane continuous and the lower lane cut short with a small amber end cap
MinIO

MinIO Community in Production: Assess the Risk You Are Running

MinIO Community Edition has had no release since October 2025 and the repository is archived. Three CVEs will never be patched there. Here is how to assess what your cluster is actually exposed to, and where the maintained community fork fits in.

By Julien Laurenceau, 2 months2026-09-14 ago
Two MinIO sites locked in a closed replication loop: delete markers stamped 405 circulate endlessly between two racks, piling up instead of converging
MinIO

MinIO site replication bug: how 684 million HTTP 405s exposed the delete-marker loop

HEAD probes on delete markers answer 405 and replication counts that as success. 20M stuck versions turned the loop into 684M useless requests in 48 h.

By Julien Laurenceau, 2 months2026-09-06 ago
A row of mechanical counters wired into a cable trunk, with one brass counter whose output cable is cut and connects to nothing
MinIO

MinIO Replication Drops Objects Into a Counter Nobody Reads

During a MinIO replication incident three of the signals you reach for mislead you. The 405 on HeadObject is the success path, a retried 429 is invisible, and worker queue overflow logs nothing under the default priority. The counter that tracks dropped objects is incremented in four places and read in none.

By Julien Laurenceau, 2 months2026-09-04 ago
Ceph security update illustration showing Tentacle 20.2.4 and Squid 19.2.6 releases
ceph

Ceph CVEs: auth service entities with insecure key types

Ceph 20.2.4 and 19.2.6 patch four authentication and authorization CVEs. The remediation also needs CephX key rotation, client checks, and RGW multisite planning.

By Julien Laurenceau, 3 months2026-08-24 ago
The same abstract point-cloud terrain packaged as many small tiles or a few larger containers
object storage

Why File Count Matters as Much as File Size on Object Storage

Compression, object population and request count measure different things. Compare point-cloud packaging, range reads, update costs and cleanup with an explicit synthetic sizing example.

By Julien Laurenceau, 3 months2026-08-22 ago

Posts pagination

1 2 3 Next
  • Privacy Policy
  • Mentions légales
  • CGV
  • Cookies
Hestia | Developed by ThemeIsle