@ExportPackage
Package com.yahoo.language.simple
-
Class Summary Class Description SimpleDetector Includes functionality for determining the langCode from a sample or from the encoding.SimpleLinguistics Factory of simple linguistic processor implementations.SimpleNormalizer SimpleToken SimpleTokenizer A tokenizer which splits on whitespace, normalizes and transforms using the given implementations and stems using the kstem algorithm.SimpleTokenType SimpleTransformer Converts all accented characters into their de-accented counterparts followed by their combining diacritics, then strips off the diacritics using a regex.