Skip to main content

Crate cl_token

Crate cl_token 

Source
Expand description

§Token

Stores a component of a file as a Lexeme, TKind, and [struct@Span] The Token defines an interface between lexer and parser

Structs§

Token
A unit of lexical information produced by a Lexer

Enums§

Lexeme
The (possibly pre-processed) lexical information, in the form of a String, u128, or char
TKind
The lexical classification of a Token.