@ExportPackage @PublicApi
Package com.yahoo.language.sentencepiece
-
Interface Summary Interface Description SentencePieceConfig.Producer -
Class Summary Class Description SentencePieceConfig This class represents the root node of sentence-piece Copyright Yahoo.SentencePieceConfig.Builder SentencePieceConfig.Model This class represents sentence-piece.model[]SentencePieceConfig.Model.Builder SentencePieceConfig.Scoring This class represents sentence-piece.scoring The scoring strategy to use when picking a segmentation.SentencePieceEncoder Integration with https://github.com/google/sentencepiece through http://docs.djl.ai/extensions/sentencepiece/index.html SentencePiece is a language-agnostic tokenizer for neural nets.SentencePieceEncoder.Builder -
Enum Summary Enum Description Scoring The scoring strategy to use for picking segmentsSentencePieceConfig.Scoring.Enum