textmogrify.lucene
package textmogrify.lucene
Type members
Classlikes
Build an Analyzer or tokenizer function
Build an Analyzer or tokenizer function
- Companion:
- object
- Source:
- AnalyzerBuilder.scala
sealed abstract case class AnalyzerPipe[F[_]](readerF: Reader => Resource[F, TokenGetter])(implicit F: Async[F])
AnalyzerPipe provides methods to tokenize a possibly very long Stream[F, String]
or Stream[F, Byte], such as from a file. When possible, prefer starting with a
Stream[F, Byte] and use tokenizeBytes.
AnalyzerPipe provides methods to tokenize a possibly very long Stream[F, String]
or Stream[F, Byte], such as from a file. When possible, prefer starting with a
Stream[F, Byte] and use tokenizeBytes.
- Companion:
- object
- Source:
- AnalyzerPipe.scala