A token is not a word, and your chat box is not the bill

When a tool says a request used "1,000 tokens", it's tempting to read that as 1,000 words. It isn't. A token is the unit a model's tokenizer cuts text into. Sometimes that's a whole word, sometimes a piece of one, sometimes a space glued to a number, and sometimes a few bytes that don't make a readable character on their own. That gap matters as... Weiterlesen: A token is not a word, and your chat box is not the bill