What does one token actually cost you?

I rent GPUs by the hour. For a long time I couldn't tell you what a single token cost me. I knew the hourly rate, and I knew the API providers' price sheets. The number in between, my cost per million tokens on my server, I was guessing. Turns out almost everyone self-hosting is guessing too. The math itself is one line: $ per million tokens =... Weiterlesen: What does one token actually cost you?