Class CommonPreprocessor
- java.lang.Object
-
- org.deeplearning4j.text.tokenization.tokenizer.preprocessor.CommonPreprocessor
-
- All Implemented Interfaces:
TokenPreProcess
public class CommonPreprocessor extends Object implements TokenPreProcess
-
-
Constructor Summary
Constructors Constructor Description CommonPreprocessor()
-
-
-
Method Detail
-
preProcess
public String preProcess(String token)
Description copied from interface:TokenPreProcess
Pre process a token- Specified by:
preProcess
in interfaceTokenPreProcess
- Parameters:
token
- the token to pre process- Returns:
- the preprocessed token
-
-