Struct cl_lexer::Lexer

pub struct Lexer<'t> { /* private fields */ }

The Lexer iterates over the characters in a body of text, searching for Tokens.

Examples

// Read in your code from somewhere
let some_code = "
fn main () {
    // TODO: code goes here!
}
";
// Create a lexer over your code
let mut lexer = Lexer::new(some_code);
// Scan for a single token
let first_token = lexer.scan()?;
println!("{first_token:?}");
// Loop over all the rest of the tokens
for token in lexer {
    match token {
        Ok(token) => println!("{token:?}"),
        Err(e) => eprintln!("{e:?}"),
    }
}

Implementations

impl<'t> Lexer<'t>

pub fn new(text: &'t str) -> Self

Creates a new Lexer over a str

pub fn scan(&mut self) -> LResult<Token>

Scans through the text, searching for the next [Token]

pub fn line(&self) -> u32

Returns the current line

pub fn col(&self) -> u32

Returns the current column

Trait Implementations

impl<'t> Clone for Lexer<'t>

fn clone(&self) -> Lexer<'t>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'t> Debug for Lexer<'t>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'t> From<&Lexer<'t>> for Loc

fn from(value: &Lexer<'t>) -> Self

Converts to this type from the input type.

impl<'t> IntoIterator for Lexer<'t>

type Item = Result<Token, Error>

The type of the elements being iterated over.

type IntoIter = LexerIter<'t>

Which kind of iterator are we turning this into?

fn into_iter(self) -> Self::IntoIter

Creates an iterator from a value.