Months after ChatGPT launched, I still could not have told you what a token was. I had been using it since the first public launch and was basically having novel-long conversations with it. I had no idea that every time I hit "enter," my text was being chopped into pieces before the model even looked at it.
It turns out, those pieces (tokens)...
🛡️ VERIFIED CYBER INTELLIGENCE ID: #3386400