Spark sets executor CPU requests equal to limits, so a Kubernetes cluster reserves twice the CPU it uses and refuses to schedule pending pods. Kubernetes has no native overcommit. Here is the mutating-webhook operator I use to fix it.
Bring the IOPS dude ! As a solutions architect working with MinIO storage solutions, I’ve seen firsthand the challenges that come with on-premises deployments using hard disk drives (HDDs). While HDDs may seem like a cost-effective option initially, they can introduce significant performance bottlenecks that impact the overall efficiency and Read more
Most discussions about PVC focus on on-prem deployments, but many of these technologies are equally relevant in the cloud, especially when using managed block storage like AWS EBS, which caps at around 64K IOPS. By contrast, OpenEBS LocalPV (ZFS or LVM) can attach directly to NVMe-backed local disks, unlocking true Read more