Package net.sourceforge.pmd.cpd.internal
Class JavaCCTokenizer
- java.lang.Object
-
- net.sourceforge.pmd.cpd.internal.JavaCCTokenizer
-
-
Field Summary
-
Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer
DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN
-
-
Constructor Summary
Constructors Constructor Description JavaCCTokenizer()
-
Method Summary
All Methods Instance Methods Abstract Methods Concrete Methods Modifier and Type Method Description protected abstract TokenManager
getLexerForSource(SourceCode sourceCode)
protected TokenFilter
getTokenFilter(TokenManager tokenManager)
protected TokenEntry
processToken(Tokens tokenEntries, GenericToken currentToken, java.lang.String filename)
void
tokenize(SourceCode sourceCode, Tokens tokenEntries)
-
-
-
Method Detail
-
getLexerForSource
protected abstract TokenManager getLexerForSource(SourceCode sourceCode)
-
getTokenFilter
protected TokenFilter getTokenFilter(TokenManager tokenManager)
-
processToken
protected TokenEntry processToken(Tokens tokenEntries, GenericToken currentToken, java.lang.String filename)
-
tokenize
public void tokenize(SourceCode sourceCode, Tokens tokenEntries) throws java.io.IOException
-
-