How I cut my AI inference bill by 80% - moving from OpenAI to self-hosted models

My OpenAI bill was $400/month. After moving to self-hosted models on a single Hetzner GPU box, it's $80/month and falling. Here's the playbook. The OpenAI bill I was using GPT-4o for ~3M input tokens/day for a RAG app and ~500K output tokens/day. About $450/month. The killer was the output tokens. What I tried Option 1: Smaller OpenAI models... Weiterlesen: How I cut my AI inference bill by 80% - moving from OpenAI to self-ho…