Uses of Interface
com.yahoo.language.process.Tokenizer
-
Packages that use Tokenizer Package Description com.yahoo.language com.yahoo.language.process -
-
Uses of Tokenizer in com.yahoo.language
Methods in com.yahoo.language that return Tokenizer Modifier and Type Method Description Tokenizer
Linguistics. getTokenizer()
Returns a thread-unsafe tokenizer. -
Uses of Tokenizer in com.yahoo.language.process
Constructors in com.yahoo.language.process with parameters of type Tokenizer Constructor Description SegmenterImpl(Tokenizer tokenizer)
StemmerImpl(Tokenizer tokenizer)
-