lexer

Type Members

1. abstract class AbstractTokenIterator extends Iterator[Token]

   

2. trait Lexer extends AnyRef

   

3. case class Token(kind: TokenKind, span: Span, problem: Option[String] = None) extends Product with Serializable

   

4. case class TokenKind(name: String, data: Boolean = false) extends Product with Serializable

   
   name

   the token name or identifier

   data

   if true, the token's source text should be used in toString representations, if false, the token name should be used