Module org.elasticsearch.server

Package org.elasticsearch.ingest

Class IngestService

java.lang.Object

org.elasticsearch.ingest.IngestService

All Implemented Interfaces:

ClusterStateApplier, ReportingService<IngestInfo>

public class IngestService
extends Object
implements ClusterStateApplier, ReportingService<IngestInfo>

Holder class for several ingest related services.

Nested Class Summary

Nested classes/interfaces inherited from interface org.elasticsearch.node.ReportingService

ReportingService.Info

Field Summary

Fields

Modifier and Type	Field	Description
static final String	INGEST_ORIGIN
static final String	NOOP_PIPELINE_NAME

Constructor Summary

Constructors

Constructor	Description
IngestService(ClusterService clusterService, ThreadPool threadPool, Environment env, ScriptService scriptService, AnalysisRegistry analysisRegistry, List<IngestPlugin> ingestPlugins, Client client)

Method Summary

Modifier and Type	Method	Description
void	addIngestClusterStateListener(Consumer<ClusterState> listener)	Adds a listener that gets invoked with the current cluster state before processor factories get invoked.
void	applyClusterState(ClusterChangedEvent event)	Called when a new cluster state (ClusterChangedEvent.state() needs to be applied.
void	delete(DeletePipelineRequest request, ActionListener<AcknowledgedResponse> listener)	Deletes the pipeline specified by id in the request.
void	executeBulkRequest(int numberOfActionRequests, Iterable<DocWriteRequest<?>> actionRequests, BiConsumer<Integer,Exception> onFailure, BiConsumer<Thread,Exception> onCompletion, IntConsumer onDropped, String executorName)
ClusterService	getClusterService()
Pipeline	getPipeline(String id)	Returns the pipeline by the specified id
static List<PipelineConfiguration>	getPipelines(ClusterState clusterState, String... ids)
<P extends Processor> Collection<String>	getPipelineWithProcessorType(Class<P> clazz, Predicate<P> predicate)
Map<String,Processor.Factory>	getProcessorFactories()
<P extends Processor> List<P>	getProcessorsInPipeline(String pipelineId, Class<P> clazz)	Gets all the Processors of the given type from within a Pipeline.
ScriptService	getScriptService()
IngestInfo	info()
void	putPipeline(PutPipelineRequest request, ActionListener<AcknowledgedResponse> listener, Consumer<ActionListener<NodesInfoResponse>> nodeInfoListener)	Stores the specified pipeline definition in the request.
void	reloadPipeline(String id)
static boolean	resolvePipelines(DocWriteRequest<?> originalRequest, IndexRequest indexRequest, Metadata metadata)
static boolean	resolvePipelines(DocWriteRequest<?> originalRequest, IndexRequest indexRequest, Metadata metadata, long epochMillis)
IngestStats	stats()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

NOOP_PIPELINE_NAME

public static final String NOOP_PIPELINE_NAME

See Also:

• Constant Field Values

INGEST_ORIGIN

public static final String INGEST_ORIGIN

See Also:

• Constant Field Values

Constructor Details

IngestService

public IngestService(ClusterService clusterService,
 ThreadPool threadPool,
 Environment env,
 ScriptService scriptService,
 AnalysisRegistry analysisRegistry,
 List<IngestPlugin> ingestPlugins,
 Client client)

Method Details

resolvePipelines

public static boolean resolvePipelines(DocWriteRequest<?> originalRequest,
 IndexRequest indexRequest,
 Metadata metadata)

resolvePipelines

public static boolean resolvePipelines(DocWriteRequest<?> originalRequest,
 IndexRequest indexRequest,
 Metadata metadata,
 long epochMillis)

getClusterService

public ClusterService getClusterService()

getScriptService

public ScriptService getScriptService()

delete

public void delete(DeletePipelineRequest request,
 ActionListener<AcknowledgedResponse> listener)

Deletes the pipeline specified by id in the request.

getPipelines

public static List<PipelineConfiguration> getPipelines(ClusterState clusterState,
 String... ids)

Returns:

pipeline configuration specified by id. If multiple ids or wildcards are specified multiple pipelines may be returned

putPipeline

public void putPipeline(PutPipelineRequest request,
 ActionListener<AcknowledgedResponse> listener,
 Consumer<ActionListener<NodesInfoResponse>> nodeInfoListener)
                 throws Exception

Stores the specified pipeline definition in the request.

Throws:

Exception

getPipeline

public Pipeline getPipeline(String id)

Returns the pipeline by the specified id

getProcessorFactories

public Map<String,Processor.Factory> getProcessorFactories()

info

public IngestInfo info()

Specified by:

info in interface ReportingService<IngestInfo>

executeBulkRequest

public void executeBulkRequest(int numberOfActionRequests,
 Iterable<DocWriteRequest<?>> actionRequests,
 BiConsumer<Integer,Exception> onFailure,
 BiConsumer<Thread,Exception> onCompletion,
 IntConsumer onDropped,
 String executorName)

stats

public IngestStats stats()

addIngestClusterStateListener

public void addIngestClusterStateListener(Consumer<ClusterState> listener)

Adds a listener that gets invoked with the current cluster state before processor factories get invoked. This is useful for components that are used by ingest processors, so that they have the opportunity to update before these components get used by the ingest processor factory.

applyClusterState

public void applyClusterState(ClusterChangedEvent event)

Description copied from interface: ClusterStateApplier

Called when a new cluster state (ClusterChangedEvent.state() needs to be applied. The cluster state to be applied is already committed when this method is called, so an applier must therefore be prepared to deal with any state it receives without throwing an exception. Throwing an exception from an applier is very bad because it will stop the application of this state before it has reached all the other appliers, and will likely result in another attempt to apply the same (or very similar) cluster state which might continue until this node is removed from the cluster.

Cluster states are applied one-by-one which means they can be a performance bottleneck. Implementations of this method should therefore be fast, so please consider forking work into the background rather than doing everything inline.

Specified by:

applyClusterState in interface ClusterStateApplier

getProcessorsInPipeline

public <P extends Processor> List<P> getProcessorsInPipeline(String pipelineId,
 Class<P> clazz)

Gets all the Processors of the given type from within a Pipeline.

Parameters:

pipelineId - the pipeline to inspect

clazz - the Processor class to look for

Returns:

True if the pipeline contains an instance of the Processor class passed in

getPipelineWithProcessorType

public <P extends Processor> Collection<String> getPipelineWithProcessorType(Class<P> clazz,
 Predicate<P> predicate)

reloadPipeline

public void reloadPipeline(String id)
                    throws Exception

Throws:

Exception