lex

(verb)

verb

1. (computing) To perform lexical analysis; to convert a character stream to a token stream as a preliminary to parsing.