Package | Description |
---|---|
org.antlr.v4.runtime |
Modifier and Type | Class and Description |
---|---|
class |
Lexer
A lexer is recognizer that draws input symbols from a character stream.
|
Modifier and Type | Field and Description |
---|---|
protected TokenSource |
UnbufferedTokenStream.tokenSource |
protected TokenSource |
BufferedTokenStream.tokenSource |
Modifier and Type | Field and Description |
---|---|
protected Pair<TokenSource,CharStream> |
Lexer._tokenFactorySourcePair |
protected static Pair<TokenSource,CharStream> |
CommonToken.EMPTY_SOURCE |
protected Pair<TokenSource,CharStream> |
CommonToken.source |
Modifier and Type | Method and Description |
---|---|
TokenSource |
UnbufferedTokenStream.getTokenSource() |
TokenSource |
TokenStream.getTokenSource()
Gets the underlying
TokenSource which provides tokens for this
stream. |
TokenSource |
Token.getTokenSource()
Gets the
TokenSource which created this token. |
TokenSource |
CommonToken.getTokenSource() |
TokenSource |
BufferedTokenStream.getTokenSource() |
Modifier and Type | Method and Description |
---|---|
void |
BufferedTokenStream.setTokenSource(TokenSource tokenSource)
Reset this token stream by setting its token source.
|
Modifier and Type | Method and Description |
---|---|
Symbol |
TokenFactory.create(Pair<TokenSource,CharStream> source,
int type,
String text,
int channel,
int start,
int stop,
int line,
int charPositionInLine)
This is the method used to create tokens in the lexer and in the
error handling strategy.
|
CommonToken |
CommonTokenFactory.create(Pair<TokenSource,CharStream> source,
int type,
String text,
int channel,
int start,
int stop,
int line,
int charPositionInLine) |
Constructor and Description |
---|
BufferedTokenStream(TokenSource tokenSource) |
CommonTokenStream(TokenSource tokenSource) |
CommonTokenStream(TokenSource tokenSource,
int channel) |
UnbufferedTokenStream(TokenSource tokenSource) |
UnbufferedTokenStream(TokenSource tokenSource,
int bufferSize) |
Constructor and Description |
---|
CommonToken(Pair<TokenSource,CharStream> source,
int type,
int channel,
int start,
int stop) |
Copyright © 1992-2013 ANTLR. All Rights Reserved.