Uses of Interface
org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess

Packages that use TokenPreProcess

Package	Description
org.deeplearning4j.text.tokenization.tokenizer
org.deeplearning4j.text.tokenization.tokenizer.preprocessor
org.deeplearning4j.text.tokenization.tokenizerfactory

Uses of TokenPreProcess in org.deeplearning4j.text.tokenization.tokenizer

Methods in org.deeplearning4j.text.tokenization.tokenizer with parameters of type TokenPreProcess

Modifier and Type	Method and Description
void	UimaTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)
void	DefaultStreamTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)
void	Tokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor) Set the token pre process
void	PosUimaTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)
void	DefaultTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)

Uses of TokenPreProcess in org.deeplearning4j.text.tokenization.tokenizer.preprocessor

Classes in org.deeplearning4j.text.tokenization.tokenizer.preprocessor that implement TokenPreProcess

Modifier and Type	Class and Description
class	EndingPreProcessor Gets rid of endings: ed,ing, ly, s, .

Uses of TokenPreProcess in org.deeplearning4j.text.tokenization.tokenizerfactory

Methods in org.deeplearning4j.text.tokenization.tokenizerfactory with parameters of type TokenPreProcess

Modifier and Type	Method and Description
void	PosUimaTokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor)
void	DefaultTokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor)
void	UimaTokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor)
void	TokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor) Sets a token pre processor to be used with every tokenizer