PepiteData Julien Laurenceau
  • Home
  • Services
  • Audits
  • Expert Call
  • About
  • Blog
  • Contact

prefix-partitioning

A long row of identical storage bays in which every arriving crate is funnelled into the single lit bay at one end.
object storage

Inside the Amazon S3 Object Index, Part 1: Why Key Order Creates Hot Partitions

Amazon S3 partitions its object index by key prefix in UTF-8 binary order, not by hash. That choice gives you prefix listing for free and turns a sequential, date-first prefix into a hot partition that answers with 503 Slow Down.

By Julien Laurenceau, 2 days ago
Two panels. Top: a single MinIO bucket overflowing with small files, a worried Tux, and a dead directory tree on a tombstone. Bottom: the same objects split across four prefix-partitioned buckets under separate folders, with a healthy green directory tree.
MinIO

MinIO on XFS: Inode Exhaustion and Prefix Design for Lots of Small Files

MinIO has no NameNode. It puts the namespace on XFS as real directories and xl.meta files. On Lots of Small Files that means you can exhaust inodes while df -h still looks fine, and a flat leaf can stall PUT, LIST, scanner, and ILM together. Here is the on-disk model, the inode math, and a prefix recipe that keeps XFS inside a regime you can operate.

By Julien Laurenceau, 4 months2026-07-27 ago
  • Privacy Policy
  • Mentions légales
  • CGV
  • Cookies
Hestia | Developed by ThemeIsle