- java.lang.Object
-
- org.apache.lucene.util.AttributeSource
-
- org.apache.lucene.analysis.TokenStream
-
- org.apache.lucene.analysis.Tokenizer
-
- org.apache.lucene.analysis.util.CharTokenizer
-
- org.apache.jackrabbit.oak.plugins.index.lucene.util.CRTokenizer
-
- All Implemented Interfaces:
- Closeable, AutoCloseable
public class CRTokenizer
extends org.apache.lucene.analysis.util.CharTokenizer
A CharTokenizer
dividing tokens at \n
.
This should be deprecated if / once LUCENE-5833 fix gets included in the Lucene version we ship.
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State
-
Field Summary
-
Fields inherited from class org.apache.lucene.analysis.Tokenizer
input
-
Constructor Summary
Constructors
Constructor and Description |
CRTokenizer(org.apache.lucene.util.Version matchVersion,
Reader input) |
-
Method Summary
Methods
Modifier and Type |
Method and Description |
protected boolean |
isTokenChar(int c) |
-
Methods inherited from class org.apache.lucene.analysis.util.CharTokenizer
end, incrementToken, normalize, reset
-
Methods inherited from class org.apache.lucene.analysis.Tokenizer
close, correctOffset, setReader
-
Methods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
Copyright © 2012–2020 The Apache Software Foundation. All rights reserved.