Lexical analysis is the process of taking an input string of characters (such as the source code of a computer program) and producing a sequence of symbols called “lexical tokens”, or just “tokens”, which may be handled more easily by a parser. A token, in computing, is a segment of text, regardess whether it be …