Skip to main content

In the context of search, streams of text are broken up into tokens, which are the unit for indexing text. Tokens are more commonly called a "word.