public class CRTokenizer
extends org.apache.lucene.analysis.util.CharTokenizer
CharTokenizer
dividing tokens at \n
.
This should be deprecated/removed and not used anymore in SuggestHelper
(and related 'suggest fields merging code' removed in LuceneIndexEditor
)
if / once LUCENE-5833 fix gets included in the Lucene version we ship.Constructor and Description |
---|
CRTokenizer(org.apache.lucene.util.Version matchVersion,
Reader input) |
Modifier and Type | Method and Description |
---|---|
protected boolean |
isTokenChar(int c) |
end, incrementToken, normalize, reset
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
public CRTokenizer(org.apache.lucene.util.Version matchVersion, Reader input)
Copyright © 2012-2015 The Apache Software Foundation. All Rights Reserved.