Tokens are an important foundational concept that underlie how we interact with LLMs. @greggyb and myself recorded a quick video to demystify what a token actually is and unpack several other related concepts.








What's in the video



What is a token? Tokens are the basic unit of input and output that LLMs operate on.
What is...