Package net.sourceforge.pmd.cpd

Class AntlrTokenizer

java.lang.Object

net.sourceforge.pmd.cpd.AntlrTokenizer

All Implemented Interfaces:

Tokenizer

public abstract class AntlrTokenizer
extends java.lang.Object
implements Tokenizer

Generic implementation of a Tokenizer useful to any Antlr grammar.

Field Summary

Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer

DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN

Constructor Summary

Constructors

Constructor	Description
AntlrTokenizer()

Method Summary

Modifier and Type	Method	Description
protected abstract AntlrTokenManager	getLexerForSource(SourceCode sourceCode)
void	tokenize(SourceCode sourceCode, Tokens tokenEntries)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AntlrTokenizer

public AntlrTokenizer()

Method Detail

getLexerForSource

protected abstract AntlrTokenManager getLexerForSource(SourceCode sourceCode)

tokenize

public void tokenize(SourceCode sourceCode,
                     Tokens tokenEntries)

Specified by:

tokenize in interface Tokenizer