| Class | Description |
|---|---|
| BertWordPiecePreProcessor |
A preprocessor for cleaning/normaling text.
|
| CommonPreprocessor |
A TokenPreProcess implementation that removes puncuation marks and lower-cases.
|
| CompositePreProcessor |
CompositePreProcessor is a
TokenPreProcess that applies multiple preprocessors sequentially |
| EndingPreProcessor |
Gets rid of endings:
ed,ing, ly, s, .
|
| LowCasePreProcessor | |
| StringCleaning |
Various string cleaning utils
|
Copyright © 2019. All rights reserved.