net.sourceforge.pmd.cpd
Interface Tokenizer

All Known Implementing Classes:

AbstractTokenizer, AnyTokenizer

public interface Tokenizer

Field Summary

static java.lang.String	DEFAULT_SKIP_BLOCKS_PATTERN
static java.lang.String	IGNORE_ANNOTATIONS
static java.lang.String	IGNORE_IDENTIFIERS
static java.lang.String	IGNORE_LITERALS
static java.lang.String	OPTION_SKIP_BLOCKS Enables or disabled skipping of blocks like a pre-processor.
static java.lang.String	OPTION_SKIP_BLOCKS_PATTERN Configures the pattern, to find the blocks to skip.

Method Summary

void	tokenize(SourceCode sourceCode, Tokens tokenEntries)

Field Detail

IGNORE_LITERALS

static final java.lang.String IGNORE_LITERALS

See Also:

Constant Field Values

IGNORE_IDENTIFIERS

static final java.lang.String IGNORE_IDENTIFIERS

See Also:

Constant Field Values

IGNORE_ANNOTATIONS

static final java.lang.String IGNORE_ANNOTATIONS

See Also:

Constant Field Values

OPTION_SKIP_BLOCKS

static final java.lang.String OPTION_SKIP_BLOCKS

Enables or disabled skipping of blocks like a pre-processor. It is a boolean property. The default value is true.

See Also:

OPTION_SKIP_BLOCKS_PATTERN, Constant Field Values

OPTION_SKIP_BLOCKS_PATTERN

static final java.lang.String OPTION_SKIP_BLOCKS_PATTERN

Configures the pattern, to find the blocks to skip. It is a string property and contains of two parts, separated by |. The first part is the start pattern, the second part is the ending pattern. Default value is "#if 0|#endif".

See Also:

DEFAULT_SKIP_BLOCKS_PATTERN, Constant Field Values

DEFAULT_SKIP_BLOCKS_PATTERN

static final java.lang.String DEFAULT_SKIP_BLOCKS_PATTERN

See Also:

Constant Field Values

Method Detail

tokenize

void tokenize(SourceCode sourceCode,
              Tokens tokenEntries)
              throws java.io.IOException

Throws:

java.io.IOException