Package | Description |
---|---|
org.deeplearning4j.text.tokenization.tokenizer |
Modifier and Type | Class and Description |
---|---|
class |
BertWordPieceStreamTokenizer
A tokenizer that works with a vocab from a published bert model and tokenizes a token at a time from a stream
|
Copyright © 2019. All rights reserved.