AnalyzerBuilder

final class AnalyzerBuilder

Build an Analyzer or tokenizer function

Companion:
object
Source:
AnalyzerBuilder.scala
class Object
trait Matchable
class Any

Value members

Concrete methods

def build[F[_]](implicit F: Sync[F]): Resource[F, Analyzer]

Build the Analyzer wrapped inside a Resource.

Build the Analyzer wrapped inside a Resource.

Source:
AnalyzerBuilder.scala
def tokenizer[F[_]](implicit F: Sync[F]): Resource[F, String => F[Vector[String]]]

Directly construct a tokenizing function

Directly construct a tokenizing function

Source:
AnalyzerBuilder.scala

Adds an ASCII folding stage to the analyzer pipeline ASCII folding converts alphanumeric and symbolic Unicode characters into their ASCII equivalents, if one exists.

Adds an ASCII folding stage to the analyzer pipeline ASCII folding converts alphanumeric and symbolic Unicode characters into their ASCII equivalents, if one exists.

Source:
AnalyzerBuilder.scala

Adds a lowercasing stage to the analyzer pipeline

Adds a lowercasing stage to the analyzer pipeline

Source:
AnalyzerBuilder.scala

Adds the Porter Stemmer to the end of the analyzer pipeline and enables lowercasing. Stemming reduces words like jumping and jumps to their root word jump. NOTE: Lowercasing is forced as it is required for the Lucene PorterStemFilter.

Adds the Porter Stemmer to the end of the analyzer pipeline and enables lowercasing. Stemming reduces words like jumping and jumps to their root word jump. NOTE: Lowercasing is forced as it is required for the Lucene PorterStemFilter.

Source:
AnalyzerBuilder.scala

Adds a stop filter stage to analyzer pipeline for non-empty sets.

Adds a stop filter stage to analyzer pipeline for non-empty sets.

Source:
AnalyzerBuilder.scala