Uses of Interface
org.deeplearning4j.text.tokenization.tokenizer.Tokenizer

Packages that use Tokenizer

Package	Description
org.deeplearning4j.text.tokenization.tokenizer
org.deeplearning4j.text.tokenization.tokenizerfactory

Uses of Tokenizer in org.deeplearning4j.text.tokenization.tokenizer

Classes in org.deeplearning4j.text.tokenization.tokenizer that implement Tokenizer

Modifier and Type	Class and Description
class	DefaultStreamTokenizer Tokenizer based on the StreamTokenizer
class	DefaultTokenizer
class	PosUimaTokenizer Filter by part of speech tag.
class	UimaTokenizer Tokenizer based on the passed in analysis engine

Uses of Tokenizer in org.deeplearning4j.text.tokenization.tokenizerfactory

Methods in org.deeplearning4j.text.tokenization.tokenizerfactory that return Tokenizer

Modifier and Type	Method and Description
Tokenizer	PosUimaTokenizerFactory.create(InputStream toTokenize)
Tokenizer	DefaultTokenizerFactory.create(InputStream toTokenize)
Tokenizer	UimaTokenizerFactory.create(InputStream toTokenize)
Tokenizer	TokenizerFactory.create(InputStream toTokenize) Create a tokenizer based on an input stream
Tokenizer	PosUimaTokenizerFactory.create(String toTokenize)
Tokenizer	DefaultTokenizerFactory.create(String toTokenize)
Tokenizer	UimaTokenizerFactory.create(String toTokenize)
Tokenizer	TokenizerFactory.create(String toTokenize) The tokenizer to createComplex