1.The lexer actually does some of the work of figuring out where in a message it is, but the parser still ties everything together.
lexer实际上完成了指出它位于消息中的哪个地方的一些任务，但是解析器仍将所有内容放在一起。
2.Additionally there is implemented a IDL lexer, which allows to use the preprocessor library as the lexing component of a IDL oriented tool.
此外还实现了一个IDLlexer，允许将预处理器库用作某个面向IDL的工具的lexing组件。
3.Whenever possible, try to develop separate tests for your lexer and your parser.
只要有可能，请尝试为您的lexer和解析器开发单独的测试。
4.The lexer for this example is more complicated than the one for the calculator; quite a bit so.
该示例中的lexer比计算器的更为复杂；复杂得多。
5.So this lexer does not recognize any keywords (except true and false, which are needed by the preprocessor itself).
因此，这个lexer不识别任何关键字（除了true和false，因为预处理器本身需要它们）。
6.A lexer is a software component that pides text strings into inpidual words, or tokens, so that the inpidual words can be indexed.
lexer是一个能将文本字符串分成单个命令，或者标记的软件组分，这样使得单个命令可以被检索到。
7.On the basis of the test tool of executing characteristics of programs, we modify the lexer and parser to implement it.
该工具是在程序执行特征测试工具的基础上，将其词法分析器和语法分析器加以修改而实现的。
8.These directives are used to define the tokens the lexer can return.
这些指令用来定义lexer可以返回的记号。
9.The lexer is the part of our language knowledge that says "this is a sentence; this is punctuation; twenty-three is a single word. "
词法分析器是我们的语言知识中识别“这是一个句子；这是标点；twenty-three是一个单一的词”的那一部分。
10.The symbols produced by the lexer are called terminals or tokens.
lexer生成的符号称为终结符（terminals）或者记号（tokens）。