Package | Description |
---|---|
io.cdap.cdap.api.dataset.lib |
Collection of
Dataset implementations available out-of-the-box
in CDAP. |
io.cdap.cdap.api.dataset.lib.partitioned |
Implementation of classes which use partitioned datasets (such as partition consumers) in CDAP.
|
Class and Description |
---|
ComparableCodec
Responsible for serialization and deserialization of
Comparable . |
Class and Description |
---|
AbstractPartitionConsumer
Abstract implementation of PartitionConsumer, which manages state persistence and
serialization/deserialization before delegating to the abstract methods.
|
ComparableCodec
Responsible for serialization and deserialization of
Comparable . |
ConsumablePartition
Represents a
Partition available for consuming. |
ConsumerConfiguration
Configuration parameters to be used by a
PartitionConsumer . |
ConsumerConfiguration.Builder
A Builder to construct ConsumerConfiguration instances.
|
ConsumerWorkingSet
Keeps track of a list of partitions that are either available for consuming or are currently
being consumed.
|
PartitionAcceptor
Defines whether to accept
PartitionDetail s, while iterating over a collection of them. |
PartitionAcceptor.Return
Return value, determining what to do with a Partition.
|
PartitionBatchInput.BatchPartitionCommitter
Used to persist the state of the partition consumer.
|
PartitionConsumer
Incrementally consumes new/unprocessed
Partition s of a PartitionedFileSet . |
PartitionConsumerResult
Returns access to a list of partitions for consuming, as well as a list of
PartitionKey s
corresponding to partitions that have previously failed processing the configured number of
tries. |
ProcessState
Represents the process/consumed state of the partition.
|
StatePersistor
Defines how some state will be persisted/managed.
|
Copyright © 2024 Cask Data, Inc. Licensed under the Apache License, Version 2.0.