Pepitedata
  • Home
  • Audits
  • Expert Call
  • About
  • Blog
  • Contact

data

Two panels. Top: a single MinIO bucket overflowing with small files, a worried Tux, and a dead directory tree on a tombstone. Bottom: the same objects split across four prefix-partitioned buckets under separate folders, with a healthy green directory tree.
MinIO

MinIO on XFS: Inode Exhaustion and Prefix Design for Lots of Small Files

MinIO has no NameNode. It puts the namespace on XFS as real directories and xl.meta files. On Lots of Small Files that means you can exhaust inodes while df -h still looks fine, and a flat leaf can stall PUT, LIST, scanner, and ILM together. Here is the on-disk model, the inode math, and a prefix recipe that keeps XFS inside a regime you can operate.

By jlu, 2 days2026-07-27 ago
Erasure coding is efficient on big files but degrades to many inefficient copies on small files
MinIO

MinIO and Small Files: When Erasure Coding Becomes 15x Replication

MinIO fixed the HDFS NameNode limit, but it has no index: it writes one xl.meta per object on every drive of the erasure set. On 5 servers of 12 NVMe, MinIO picks a 15-wide set by default, so each small object is stored 15 times over. A worked sizing that looks fine for two years and dies in days.

By jlu, 6 days2026-07-23 ago
Abstract network of three connected data-center clusters representing a Ceph multi-site S3 upgrade
ceph

Upgrading a Ceph Multi-Site S3 Platform from Squid to Tentacle

A practical Ceph RGW upgrade plan for multi-site S3 platforms, covering replication validation, canary rollout, S3 acceptance tests and the limits of rollback.

By jlu, 2 weeks2026-07-17 ago
AI

Model Fusion Beats the Frontier Model. The Cost Case.

OpenRouter put numbers on a pattern agent builders already use: a panel of models with a judge synthesizer beats the best single model, and a budget panel matched frontier quality at half the cost. What that means for your AI platform.

By jlu, 1 month2026-06-23 ago
AI

Distilling frontier reasoning into a local model: what actually works

A small coding model mocked on r/LocalLLM is actually a clean case of execution-verified distillation. Here is how the method works, when distilling a frontier model into a cheap local one pays off, and the three things the hype leaves out.

By jlu, 1 month2026-06-22 ago
Abstract visualization of Sail engine bridging Rust and Spark technologies
apache spark

Sail: When Apache Spark Meets Rust (A Practitioner’s Deep Dive)

Sail is an open-source Apache Spark replacement written in Rust. It drops the JVM, speaks Spark Connect, and runs 4 to 6 times faster than Spark with native accelerators on ClickBench. A deep dive into its architecture, benchmarks, and production readiness.

By jlu, 1 month ago
Abstract illustration of GPU data flow and infrastructure optimization with geometric chip patterns
AI

Why Your GPU Infrastructure Costs 40% More Than It Should

Most AI infrastructure teams spend 35-60% more on GPU compute than they need to. The cause isn’t cloud pricing. It is architecture, and it is fixable.

By jlu, 1 month ago
Abstract grid of glowing compute cells densely packed into reserved cluster capacity
apache spark

Spark on Kubernetes Reserves CPU It Never Uses. Here’s the Overcommit Fix.

Spark sets executor CPU requests equal to limits, so a Kubernetes cluster reserves twice the CPU it uses and refuses to schedule pending pods. Kubernetes has no native overcommit. Here is the mutating-webhook operator I use to fix it.

By jlu, 2 months ago
Diagram: MinIO erasure-coding storage inflation on small objects — per-drive xl.meta metadata replicated across the erasure set
data

Stop using MinIO as a NoSQL database — why S3 object stores collapse on small-file workloads

Two MinIO platforms, same root cause: used as a NoSQL store. Field notes on LIST IOPS, XFS directory limits, scanner & heal SLAs, the erasure-coding storage-efficiency inversion on small objects, and why Apache Cassandra (or Ceph) is the right answer on-prem in 2026.

By jlu, 2 months2026-05-17 ago
data

When the Lakehouse Works, but the Operating Model Breaks… Especially On-Premises

Note: This article was inspired by a LinkedIn post by Can Sinan A. on the hidden operational cost of an Iceberg migration, especially when governance moves from one access-control plane to several layers: catalog, storage and engine configuration Introduction Many organizations are modernizing their data platforms with lakehouse architectures. The Read more

By jlu, 3 months2026-05-04 ago

Posts pagination

1 2 3 Next
  • Privacy Policy
  • Mentions légales
  • CGV
  • Cookies
Hestia | Developed by ThemeIsle