org.antlr.v4.runtime

Class CommonTokenFactory

java.lang.Object

org.antlr.v4.runtime.CommonTokenFactory

All Implemented Interfaces:

TokenFactory<CommonToken>

public class CommonTokenFactory
extends Object
implements TokenFactory<CommonToken>

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	copyText Copy text for token out of input char stream.
static TokenFactory<CommonToken>	DEFAULT

Constructor Summary

Constructors

Constructor and Description
CommonTokenFactory()
CommonTokenFactory(boolean copyText) Create factory and indicate whether or not the factory copy text out of the char stream.

Method Summary

Methods

Modifier and Type	Method and Description
CommonToken	create(int type, String text) Generically useful
CommonToken	create(Pair<TokenSource,CharStream> source, int type, String text, int channel, int start, int stop, int line, int charPositionInLine) This is the method used to create tokens in the lexer and in the error handling strategy.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT

public static final TokenFactory<CommonToken> DEFAULT

copyText

protected final boolean copyText

Copy text for token out of input char stream. Useful when input stream is unbuffered.

See Also:

UnbufferedCharStream

Constructor Detail

CommonTokenFactory

public CommonTokenFactory(boolean copyText)

Create factory and indicate whether or not the factory copy text out of the char stream.

CommonTokenFactory

public CommonTokenFactory()

Method Detail

create

public CommonToken create(Pair<TokenSource,CharStream> source,
                 int type,
                 String text,
                 int channel,
                 int start,
                 int stop,
                 int line,
                 int charPositionInLine)

Description copied from interface: TokenFactory

This is the method used to create tokens in the lexer and in the error handling strategy. If text!=null, than the start and stop positions are wiped to -1 in the text override is set in the CommonToken.

Specified by:

create in interface TokenFactory<CommonToken>

create

public CommonToken create(int type,
                 String text)

Description copied from interface: TokenFactory

Generically useful

Specified by:

create in interface TokenFactory<CommonToken>