Interface PipelinesService
-
@Generated public interface PipelinesService
The Delta Live Tables API allows you to create, edit, delete, start, and view details about pipelines.Delta Live Tables is a framework for building reliable, maintainable, and testable data processing pipelines. You define the transformations to perform on your data, and Delta Live Tables manages task orchestration, cluster management, monitoring, data quality, and error handling.
Instead of defining your data pipelines using a series of separate Apache Spark tasks, Delta Live Tables manages how your data is transformed based on a target schema you define for each processing step. You can also enforce data quality with Delta Live Tables expectations. Expectations allow you to define expected data quality and specify how to handle records that fail those expectations.
This is the high-level interface, that contains generated methods.
Evolving: this interface is under development. Method signatures may change.
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description CreatePipelineResponse
create(CreatePipeline createPipeline)
Create a pipeline.void
delete(DeletePipelineRequest deletePipelineRequest)
Delete a pipeline.GetPipelineResponse
get(GetPipelineRequest getPipelineRequest)
Get a pipeline.GetUpdateResponse
getUpdate(GetUpdateRequest getUpdateRequest)
Get a pipeline update.ListPipelineEventsResponse
listPipelineEvents(ListPipelineEventsRequest listPipelineEventsRequest)
List pipeline events.ListPipelinesResponse
listPipelines(ListPipelinesRequest listPipelinesRequest)
List pipelines.ListUpdatesResponse
listUpdates(ListUpdatesRequest listUpdatesRequest)
List pipeline updates.void
reset(ResetRequest resetRequest)
Reset a pipeline.StartUpdateResponse
startUpdate(StartUpdate startUpdate)
Queue a pipeline update.void
stop(StopRequest stopRequest)
Stop a pipeline.void
update(EditPipeline editPipeline)
Edit a pipeline.
-
-
-
Method Detail
-
create
CreatePipelineResponse create(CreatePipeline createPipeline)
Create a pipeline.Creates a new data processing pipeline based on the requested configuration. If successful, this method returns the ID of the new pipeline.
-
delete
void delete(DeletePipelineRequest deletePipelineRequest)
Delete a pipeline.Deletes a pipeline.
-
get
GetPipelineResponse get(GetPipelineRequest getPipelineRequest)
Get a pipeline.
-
getUpdate
GetUpdateResponse getUpdate(GetUpdateRequest getUpdateRequest)
Get a pipeline update.Gets an update from an active pipeline.
-
listPipelineEvents
ListPipelineEventsResponse listPipelineEvents(ListPipelineEventsRequest listPipelineEventsRequest)
List pipeline events.Retrieves events for a pipeline.
-
listPipelines
ListPipelinesResponse listPipelines(ListPipelinesRequest listPipelinesRequest)
List pipelines.Lists pipelines defined in the Delta Live Tables system.
-
listUpdates
ListUpdatesResponse listUpdates(ListUpdatesRequest listUpdatesRequest)
List pipeline updates.List updates for an active pipeline.
-
reset
void reset(ResetRequest resetRequest)
Reset a pipeline.Resets a pipeline.
-
startUpdate
StartUpdateResponse startUpdate(StartUpdate startUpdate)
Queue a pipeline update.Starts or queues a pipeline update.
-
stop
void stop(StopRequest stopRequest)
Stop a pipeline.Stops a pipeline.
-
update
void update(EditPipeline editPipeline)
Edit a pipeline.Updates a pipeline with the supplied configuration.
-
-