LocalAI is a self-hosted, local-first inference server designed to behave like a drop-in OpenAI API for running AI workloads on your own hardware (laptop, workstation, or on-prem server).

The project targets practical “replace the cloud API URL” compatibility, while supporting multiple backends and modalities (text, images, audio, embeddings, and...