1 post on tokenization, newest first.
What tokens are, how LLMs split text with word, character and subword (BPE) tokenization, and why tokens shape context windows, cost and speed.