Hello, everyone.

There are now many ways to run an LLM on a Mac, but exporting a PyTorch model for Apple Silicon and executing it in a lightweight runtime is still an evolving path. How much faster is it, and does 4-bit quantization change the output?

Today, I am looking at ExecuTorch's experimental MLX delegate, released in May 2026. It enables...