org.deeplearning4j.text.sentenceiterator

Class LuceneSentenceIterator

java.lang.Object

org.deeplearning4j.text.sentenceiterator.LuceneSentenceIterator

All Implemented Interfaces:

SentenceIterator

public class LuceneSentenceIterator
extends Object
implements SentenceIterator

Lucene sentence iterator. Read a sentence index and produce sentences.

Author:

Adam Gibson

Field Summary

Fields

Modifier and Type	Field and Description
static String	WORD_FIELD

Constructor Summary

Constructors

Constructor and Description
LuceneSentenceIterator(org.apache.lucene.store.Directory dir)

Method Summary

Modifier and Type	Method and Description
void	finish() Allows for any finishing (closing of input streams or the like)
SentencePreProcessor	getPreProcessor()
boolean	hasNext() Same idea as Iterator
String	nextSentence() Gets the next sentence or null if there's nothing left (Do yourself a favor and check hasNext() )
void	reset() Resets the iterator to the beginning
void	setPreProcessor(SentencePreProcessor preProcessor)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

WORD_FIELD

public static final String WORD_FIELD

See Also:

Constant Field Values

Constructor Detail

LuceneSentenceIterator

public LuceneSentenceIterator(org.apache.lucene.store.Directory dir)

Method Detail

nextSentence

public String nextSentence()

Description copied from interface: SentenceIterator

Gets the next sentence or null if there's nothing left (Do yourself a favor and check hasNext() )

Specified by:

nextSentence in interface SentenceIterator

Returns:

the next sentence in the iterator

hasNext

public boolean hasNext()

Description copied from interface: SentenceIterator

Same idea as Iterator

Specified by:

hasNext in interface SentenceIterator

Returns:

whether there's anymore sentences left

reset

public void reset()

Description copied from interface: SentenceIterator

Resets the iterator to the beginning

Specified by:

reset in interface SentenceIterator

finish

public void finish()

Description copied from interface: SentenceIterator

Allows for any finishing (closing of input streams or the like)

Specified by:

finish in interface SentenceIterator

getPreProcessor

public SentencePreProcessor getPreProcessor()

Specified by:

getPreProcessor in interface SentenceIterator

setPreProcessor

public void setPreProcessor(SentencePreProcessor preProcessor)

Specified by:

setPreProcessor in interface SentenceIterator