Package net.sourceforge.pmd.cpd
Class JavaTokenizer
- java.lang.Object
-
- net.sourceforge.pmd.cpd.internal.JavaCCTokenizer
-
- net.sourceforge.pmd.cpd.JavaTokenizer
-
- All Implemented Interfaces:
net.sourceforge.pmd.cpd.Tokenizer
public class JavaTokenizer extends net.sourceforge.pmd.cpd.internal.JavaCCTokenizer
-
-
Constructor Summary
Constructors Constructor Description JavaTokenizer()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected net.sourceforge.pmd.lang.TokenManager
getLexerForSource(net.sourceforge.pmd.cpd.SourceCode sourceCode)
protected net.sourceforge.pmd.cpd.token.TokenFilter
getTokenFilter(net.sourceforge.pmd.lang.TokenManager tokenManager)
protected net.sourceforge.pmd.cpd.TokenEntry
processToken(net.sourceforge.pmd.cpd.Tokens tokenEntries, net.sourceforge.pmd.lang.ast.GenericToken currentToken, java.lang.String fileName)
void
setIgnoreAnnotations(boolean ignoreAnnotations)
void
setIgnoreIdentifiers(boolean ignore)
void
setIgnoreLiterals(boolean ignore)
void
setProperties(java.util.Properties properties)
void
tokenize(net.sourceforge.pmd.cpd.SourceCode sourceCode, net.sourceforge.pmd.cpd.Tokens tokenEntries)
-
-
-
Field Detail
-
CPD_START
public static final java.lang.String CPD_START
- See Also:
- Constant Field Values
-
CPD_END
public static final java.lang.String CPD_END
- See Also:
- Constant Field Values
-
-
Method Detail
-
setProperties
public void setProperties(java.util.Properties properties)
-
tokenize
public void tokenize(net.sourceforge.pmd.cpd.SourceCode sourceCode, net.sourceforge.pmd.cpd.Tokens tokenEntries) throws java.io.IOException
- Specified by:
tokenize
in interfacenet.sourceforge.pmd.cpd.Tokenizer
- Overrides:
tokenize
in classnet.sourceforge.pmd.cpd.internal.JavaCCTokenizer
- Throws:
java.io.IOException
-
getLexerForSource
protected net.sourceforge.pmd.lang.TokenManager getLexerForSource(net.sourceforge.pmd.cpd.SourceCode sourceCode)
- Specified by:
getLexerForSource
in classnet.sourceforge.pmd.cpd.internal.JavaCCTokenizer
-
getTokenFilter
protected net.sourceforge.pmd.cpd.token.TokenFilter getTokenFilter(net.sourceforge.pmd.lang.TokenManager tokenManager)
- Overrides:
getTokenFilter
in classnet.sourceforge.pmd.cpd.internal.JavaCCTokenizer
-
processToken
protected net.sourceforge.pmd.cpd.TokenEntry processToken(net.sourceforge.pmd.cpd.Tokens tokenEntries, net.sourceforge.pmd.lang.ast.GenericToken currentToken, java.lang.String fileName)
- Overrides:
processToken
in classnet.sourceforge.pmd.cpd.internal.JavaCCTokenizer
-
setIgnoreLiterals
public void setIgnoreLiterals(boolean ignore)
-
setIgnoreIdentifiers
public void setIgnoreIdentifiers(boolean ignore)
-
setIgnoreAnnotations
public void setIgnoreAnnotations(boolean ignoreAnnotations)
-
-