Over the past year my team and I have been building an AI product that needed to serve large LLM model files reliably, quickly, and privately.

We assumed the existing tooling would “just work”:


Git LFS

Hugging Face repos

S3 / MinIO

generic object stores



But once we started working with multi‑GB safetensors, gguf, ONNX, and datasets,...