Class CsTokenizer

  • All Implemented Interfaces:
    net.sourceforge.pmd.cpd.Tokenizer

    public class CsTokenizer
    extends java.lang.Object
    implements net.sourceforge.pmd.cpd.Tokenizer
    This class does a best-guess try-anything tokenization.
    Author:
    jheintz
    • Field Summary

      • Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer

        DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN
    • Constructor Summary

      Constructors 
      Constructor Description
      CsTokenizer()  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void setIgnoreUsings​(boolean ignoreUsings)  
      void setProperties​(java.util.Properties properties)  
      void tokenize​(net.sourceforge.pmd.cpd.SourceCode sourceCode, net.sourceforge.pmd.cpd.Tokens tokenEntries)  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • CsTokenizer

        public CsTokenizer()
    • Method Detail

      • setProperties

        public void setProperties​(java.util.Properties properties)
      • tokenize

        public void tokenize​(net.sourceforge.pmd.cpd.SourceCode sourceCode,
                             net.sourceforge.pmd.cpd.Tokens tokenEntries)
        Specified by:
        tokenize in interface net.sourceforge.pmd.cpd.Tokenizer
      • setIgnoreUsings

        public void setIgnoreUsings​(boolean ignoreUsings)