Build an Analyzer or tokenizer function
- Companion:
- object
- Source:
- AnalyzerBuilder.scala
Value members
Concrete methods
Build the Analyzer wrapped inside a Resource.
Build the Analyzer wrapped inside a Resource.
- Source:
- AnalyzerBuilder.scala
Directly construct a tokenizing function
Directly construct a tokenizing function
- Source:
- AnalyzerBuilder.scala
Adds an ASCII folding stage to the analyzer pipeline ASCII folding converts alphanumeric and symbolic Unicode characters into their ASCII equivalents, if one exists.
Adds an ASCII folding stage to the analyzer pipeline ASCII folding converts alphanumeric and symbolic Unicode characters into their ASCII equivalents, if one exists.
- Source:
- AnalyzerBuilder.scala
Adds a lowercasing stage to the analyzer pipeline
Adds a lowercasing stage to the analyzer pipeline
- Source:
- AnalyzerBuilder.scala
Adds the Porter Stemmer to the end of the analyzer pipeline and enables lowercasing.
Stemming reduces words like jumping
and jumps
to their root word jump
.
NOTE: Lowercasing is forced as it is required for the Lucene PorterStemFilter.
Adds the Porter Stemmer to the end of the analyzer pipeline and enables lowercasing.
Stemming reduces words like jumping
and jumps
to their root word jump
.
NOTE: Lowercasing is forced as it is required for the Lucene PorterStemFilter.
- Source:
- AnalyzerBuilder.scala
Adds a stop filter stage to analyzer pipeline for non-empty sets.
Adds a stop filter stage to analyzer pipeline for non-empty sets.
- Source:
- AnalyzerBuilder.scala