Tokenising

Charlie Hull
« Back to Glossary Index

The process of identifying the elements of a sentence, such as phrases, words, abbreviations, and symbols, prior to the creation of an index.




Glossary Comments

If you think we've got something wrong or you can suggest a term we should feature in the Glossary, let us know here:

« Back to Glossary Index