Package net.sourceforge.pmd.lang.java.cpd

Class JavaTokenizer

java.lang.Object

net.sourceforge.pmd.cpd.impl.TokenizerBase<JavaccToken>

net.sourceforge.pmd.cpd.impl.JavaCCTokenizer

net.sourceforge.pmd.lang.java.cpd.JavaTokenizer

All Implemented Interfaces:

Tokenizer

public class JavaTokenizer
extends JavaCCTokenizer

Constructor Summary

Constructors

Constructor	Description
JavaTokenizer(net.sourceforge.pmd.lang.java.internal.JavaLanguageProperties properties)

Method Summary

Modifier and Type	Method	Description
protected TokenManager<JavaccToken>	filterTokenStream(TokenManager<JavaccToken> tokenManager)
protected TokenManager<JavaccToken>	makeLexerImpl(TextDocument doc)
protected void	processToken(TokenFactory tokenEntries, JavaccToken javaToken)

Methods inherited from class net.sourceforge.pmd.cpd.impl.TokenizerBase

getImage, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JavaTokenizer

public JavaTokenizer(net.sourceforge.pmd.lang.java.internal.JavaLanguageProperties properties)

Method Detail

makeLexerImpl

protected TokenManager<JavaccToken> makeLexerImpl(TextDocument doc)

Specified by:

makeLexerImpl in class TokenizerBase<JavaccToken>

filterTokenStream

protected TokenManager<JavaccToken> filterTokenStream(TokenManager<JavaccToken> tokenManager)

Overrides:

filterTokenStream in class TokenizerBase<JavaccToken>

processToken

protected void processToken(TokenFactory tokenEntries,
                            JavaccToken javaToken)

Overrides:

processToken in class TokenizerBase<JavaccToken>