scala.meta.internal.tokenizers
LegacyScanner
Related Doc:
package tokenizers
A character buffer for literals
Parse character literal if current character is followed by \', or follow with given op and return a symbol literal token
To prevent doc comments attached to expressions from leaking out of scope onto the next documentable entity, they are discarded upon passing a right brace, bracket, or parenthesis.
Determines whether this scanner should emit identifier deprecation warnings, e.g.
Determines whether this scanner should emit identifier deprecation warnings,
e.g. when seeing macro' or then', which are planned to become keywords in future versions of Scala.
read next token, filling TokenData fields of Scanner.
read next token, filling TokenData fields of Scanner.
Initialize scanner; call f on each scanned token data
read fractional part and exponent of floating point number if one is present.
read fractional part and exponent of floating point number if one is present.
copy current character into cbuf, interpreting any escape sequences, and advance to next character.
copy current character into cbuf, interpreting any escape sequences, and advance to next character.
Read a number into strVal and set base
Read a number into strVal and set base
Produce next token, filling curr TokenData fields of Scanner.
append Unicode character to "cbuf" buffer
append Unicode character to "cbuf" buffer
a stack of tokens which indicates whether line-ends can be statement separators also used for keeping track of nesting levels.
a stack of tokens which indicates whether line-ends can be statement separators
also used for keeping track of nesting levels.
We keep track of the closing symbol of a region. This can be
RPAREN if region starts with '('
RBRACKET if region starts with '['
RBRACE if region starts with '{'
ARROW if region starts with case'
STRINGLIT if region is a string interpolation expression starting with '${'
(the STRINGLIT appears twice in succession on the stack iff the
expression is a multiline string literal).
Precondition: ch == '/' Returns true if a comment was skipped.
read next token and return last offset