| Package | Description |
|---|---|
| io.cdap.cdap.api.dataset.lib |
Collection of
Dataset implementations available out-of-the-box
in CDAP. |
| io.cdap.cdap.api.dataset.lib.partitioned |
Implementation of classes which use partitioned datasets (such as partition consumers) in CDAP.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
PartitionDetail
Represents a partition of a partitioned file set, having metadata associated with it.
|
interface |
PartitionOutput
Represents a partition of a partitioned file set for writing.
|
interface |
TimePartition
Represents a partition of a time partitioned file set.
|
interface |
TimePartitionDetail
Represents a partition of a time partitioned file set.
|
interface |
TimePartitionOutput
Represents a partition of a partitioned file set for writing.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
PartitionedFileSetArguments.addInputPartition(Map<String,String> arguments,
Partition partition)
Sets a partition as input for a PartitionedFileSet.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
PartitionedFileSetArguments.addInputPartitions(Map<String,String> arguments,
Iterable<? extends Partition> partitions)
Sets partitions as input for a PartitionedFileSet.
|
static void |
PartitionedFileSetArguments.addInputPartitions(Map<String,String> arguments,
Iterator<? extends Partition> partitionIterator)
Sets partitions as input for a PartitionedFileSet.
|
| Modifier and Type | Method and Description |
|---|---|
void |
PartitionConsumer.onFinish(List<? extends Partition> partitions,
boolean succeeded)
This method must be called on any partitions returned by the
#consumePartitions method. |
void |
TransactionalPartitionConsumer.onFinish(List<? extends Partition> partitions,
boolean succeeded) |
void |
AbstractPartitionConsumer.onFinish(List<? extends Partition> partitions,
boolean succeeded) |
void |
PartitionConsumer.untake(List<? extends Partition> partitions)
Returns a list of partitions to the working set, without increasing the number of retries.
|
void |
TransactionalPartitionConsumer.untake(List<? extends Partition> partitions) |
void |
AbstractPartitionConsumer.untake(List<? extends Partition> partitions) |
Copyright © 2024 Cask Data, Inc. Licensed under the Apache License, Version 2.0.