org.elasticsearch.index.engine

Class InternalEngine

java.lang.Object

org.elasticsearch.index.engine.Engine

org.elasticsearch.index.engine.InternalEngine

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class InternalEngine
extends Engine

Nested Class Summary

Nested classes/interfaces inherited from class org.elasticsearch.index.engine.Engine

Engine.CommitId, Engine.Delete, Engine.EventListener, Engine.Get, Engine.GetResult, Engine.Index, Engine.IndexThrottle, Engine.NoOpLock, Engine.Operation, Engine.Searcher, Engine.SyncedFlushResult, Engine.Warmer

Field Summary

Fields inherited from class org.elasticsearch.index.engine.Engine

deletionPolicy, engineConfig, eventListener, failedEngine, failEngineLock, isClosed, lastWriteNanos, logger, readLock, rwl, shardId, store, SYNC_COMMIT_ID, writeLock

Constructor Summary

Constructors

Constructor and Description
InternalEngine(EngineConfig engineConfig)

Method Summary

Modifier and Type	Method and Description
org.apache.lucene.index.IndexCommit	acquireIndexCommit(boolean flushFirst) Snapshots the index and returns a handle to it.
void	activateThrottling() Request that this engine throttle incoming indexing requests to one thread.
protected void	closeNoLock(java.lang.String reason) Closes the engine without acquiring the write lock.
void	deactivateThrottling() Reverses a previous Engine.activateThrottling() call.
void	delete(Engine.Delete delete)
Engine.CommitId	flush() Flushes the state of the engine including the transaction log, clearing memory and persisting documents in the lucene index to disk including a potentially heavy and durable fsync operation.
Engine.CommitId	flush(boolean force, boolean waitIfOngoing) Flushes the state of the engine including the transaction log, clearing memory.
void	forceMerge(boolean flush, int maxNumSegments, boolean onlyExpungeDeletes, boolean upgrade, boolean upgradeOnlyAncientSegments) Triggers a forced merge on this engine
Engine.GetResult	get(Engine.Get get, java.util.function.Function<java.lang.String,Engine.Searcher> searcherFactory)
DocsStats	getDocStats() Returns the engines current document statistics
long	getIndexBufferRAMBytesUsed() How much heap is used that would be freed by a refresh.
long	getIndexThrottleTimeInMillis() Returns the number of milliseconds this engine was under index throttling.
protected org.apache.lucene.index.SegmentInfos	getLastCommittedSegmentInfos()
MergeStats	getMergeStats()
protected org.apache.lucene.search.SearcherManager	getSearcherManager()
Translog	getTranslog() returns the translog for this engine
void	index(Engine.Index index)
boolean	isRecovering() Returns true iff this engine is currently recovering from translog.
boolean	isThrottled() Returns the true iff this engine is currently under index throttling.
protected boolean	maybeFailEngine(java.lang.String source, java.lang.Exception e) Check whether the engine should be failed
void	onSettingsChanged()
InternalEngine	recoverFromTranslog() Performs recovery from the transaction log.
void	refresh(java.lang.String source) Synchronously refreshes the engine for new search operations to reflect the latest changes.
java.util.List<Segment>	segments(boolean verbose) The list of segments in the engine.
Engine.SyncedFlushResult	syncFlush(java.lang.String syncId, Engine.CommitId expectedCommitId) Attempts to do a special commit where the given syncID is put into the commit data.
void	writeIndexingBuffer() Called when our engine is using too much heap and should move buffered indexed/deleted documents to disk.
protected void	writerSegmentStats(SegmentsStats stats)

Methods inherited from class org.elasticsearch.index.engine.Engine

acquireSearcher, close, commitStats, config, ensureOpen, failEngine, flushAndClose, forceMerge, get, getFromSearcher, getLastWriteNanos, getSegmentInfo, guardedRamBytesUsed, isMergedSegment, newSearcher, readLastCommittedSegmentInfos, refreshNeeded, segmentReader, segmentsStats

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InternalEngine

public InternalEngine(EngineConfig engineConfig)
               throws EngineException

Throws:

EngineException

Method Detail

recoverFromTranslog

public InternalEngine recoverFromTranslog()
                                   throws java.io.IOException

Description copied from class: Engine

Performs recovery from the transaction log. This operation will close the engine if the recovery fails.

Specified by:

recoverFromTranslog in class Engine

Throws:

java.io.IOException

getTranslog

public Translog getTranslog()

Description copied from class: Engine

returns the translog for this engine

Specified by:

getTranslog in class Engine

get

public Engine.GetResult get(Engine.Get get,
                            java.util.function.Function<java.lang.String,Engine.Searcher> searcherFactory)
                     throws EngineException

Specified by:

get in class Engine

Throws:

EngineException

index

public void index(Engine.Index index)

Specified by:

index in class Engine

delete

public void delete(Engine.Delete delete)
            throws EngineException

Specified by:

delete in class Engine

Throws:

EngineException

refresh

public void refresh(java.lang.String source)
             throws EngineException

Description copied from class: Engine

Synchronously refreshes the engine for new search operations to reflect the latest changes.

Specified by:

refresh in class Engine

Throws:

EngineException

writeIndexingBuffer

public void writeIndexingBuffer()
                         throws EngineException

Description copied from class: Engine

Called when our engine is using too much heap and should move buffered indexed/deleted documents to disk.

Specified by:

writeIndexingBuffer in class Engine

Throws:

EngineException

syncFlush

public Engine.SyncedFlushResult syncFlush(java.lang.String syncId,
                                          Engine.CommitId expectedCommitId)
                                   throws EngineException

Description copied from class: Engine

Attempts to do a special commit where the given syncID is put into the commit data. The attempt succeeds if there are not pending writes in lucene and the current point is equal to the expected one.

Specified by:

syncFlush in class Engine

Parameters:

syncId - id of this sync

expectedCommitId - the expected value of

Returns:

true if the sync commit was made, false o.w.

Throws:

EngineException

flush

public Engine.CommitId flush()
                      throws EngineException

Description copied from class: Engine

Flushes the state of the engine including the transaction log, clearing memory and persisting documents in the lucene index to disk including a potentially heavy and durable fsync operation. This operation is not going to block if another flush operation is currently running and won't write a lucene commit if nothing needs to be committed.

Specified by:

flush in class Engine

Returns:

the commit Id for the resulting commit

Throws:

EngineException

flush

public Engine.CommitId flush(boolean force,
                             boolean waitIfOngoing)
                      throws EngineException

Description copied from class: Engine

Flushes the state of the engine including the transaction log, clearing memory.

Specified by:

flush in class Engine

Parameters:

force - if true a lucene commit is executed even if no changes need to be committed.

waitIfOngoing - if true this call will block until all currently running flushes have finished. Otherwise this call will return without blocking.

Returns:

the commit Id for the resulting commit

Throws:

EngineException

forceMerge

public void forceMerge(boolean flush,
                       int maxNumSegments,
                       boolean onlyExpungeDeletes,
                       boolean upgrade,
                       boolean upgradeOnlyAncientSegments)
                throws EngineException,
                       EngineClosedException,
                       java.io.IOException

Description copied from class: Engine

Triggers a forced merge on this engine

Specified by:

forceMerge in class Engine

Throws:

EngineException

EngineClosedException

java.io.IOException

acquireIndexCommit

public org.apache.lucene.index.IndexCommit acquireIndexCommit(boolean flushFirst)
                                                       throws EngineException

Description copied from class: Engine

Snapshots the index and returns a handle to it. If needed will try and "commit" the lucene index to make sure we have a "fresh" copy of the files to snapshot.

Specified by:

acquireIndexCommit in class Engine

Parameters:

flushFirst - indicates whether the engine should flush before returning the snapshot

Throws:

EngineException

maybeFailEngine

protected boolean maybeFailEngine(java.lang.String source,
                                  java.lang.Exception e)

Description copied from class: Engine

Check whether the engine should be failed

Overrides:

maybeFailEngine in class Engine

getLastCommittedSegmentInfos

protected org.apache.lucene.index.SegmentInfos getLastCommittedSegmentInfos()

Specified by:

getLastCommittedSegmentInfos in class Engine

writerSegmentStats

protected final void writerSegmentStats(SegmentsStats stats)

Overrides:

writerSegmentStats in class Engine

getIndexBufferRAMBytesUsed

public long getIndexBufferRAMBytesUsed()

Description copied from class: Engine

How much heap is used that would be freed by a refresh. Note that this may throw AlreadyClosedException.

Specified by:

getIndexBufferRAMBytesUsed in class Engine

segments

public java.util.List<Segment> segments(boolean verbose)

Description copied from class: Engine

The list of segments in the engine.

Specified by:

segments in class Engine

closeNoLock

protected final void closeNoLock(java.lang.String reason)

Closes the engine without acquiring the write lock. This should only be called while the write lock is hold or in a disaster condition ie. if the engine is failed.

Specified by:

closeNoLock in class Engine

getSearcherManager

protected org.apache.lucene.search.SearcherManager getSearcherManager()

Specified by:

getSearcherManager in class Engine

activateThrottling

public void activateThrottling()

Description copied from class: Engine

Request that this engine throttle incoming indexing requests to one thread. Must be matched by a later call to Engine.deactivateThrottling().

Specified by:

activateThrottling in class Engine

deactivateThrottling

public void deactivateThrottling()

Description copied from class: Engine

Reverses a previous Engine.activateThrottling() call.

Specified by:

deactivateThrottling in class Engine

isThrottled

public boolean isThrottled()

Description copied from class: Engine

Returns the true iff this engine is currently under index throttling.

Specified by:

isThrottled in class Engine

See Also:

Engine.getIndexThrottleTimeInMillis()

getIndexThrottleTimeInMillis

public long getIndexThrottleTimeInMillis()

Description copied from class: Engine

Returns the number of milliseconds this engine was under index throttling.

Specified by:

getIndexThrottleTimeInMillis in class Engine

onSettingsChanged

public void onSettingsChanged()

Overrides:

onSettingsChanged in class Engine

getMergeStats

public MergeStats getMergeStats()

Overrides:

getMergeStats in class Engine

getDocStats

public DocsStats getDocStats()

Description copied from class: Engine

Returns the engines current document statistics

Overrides:

getDocStats in class Engine

isRecovering

public boolean isRecovering()

Description copied from class: Engine

Returns true iff this engine is currently recovering from translog.

Overrides:

isRecovering in class Engine