class KafkaContinuousPartitionReader extends ContinuousPartitionReader[InternalRow]
A per-task data reader for continuous Kafka processing.
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- KafkaContinuousPartitionReader
- ContinuousPartitionReader
- PartitionReader
- Closeable
- AutoCloseable
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Instance Constructors
- new KafkaContinuousPartitionReader(topicPartition: TopicPartition, startOffset: Long, kafkaParams: Map[String, AnyRef], pollTimeoutMs: Long, failOnDataLoss: Boolean, includeHeaders: Boolean)
- topicPartition
The (topic, partition) pair this data reader is responsible for.
- startOffset
The offset to start reading from within the partition.
- kafkaParams
Kafka consumer params to use.
- pollTimeoutMs
The timeout for Kafka consumer polling.
- failOnDataLoss
Flag indicating whether data reader should fail if some offsets are skipped.
Value Members
- def close(): Unit
- Definition Classes
- KafkaContinuousPartitionReader → Closeable → AutoCloseable
- def currentMetricsValues(): Array[CustomTaskMetric]
- Definition Classes
- PartitionReader
- def get(): UnsafeRow
- Definition Classes
- KafkaContinuousPartitionReader → PartitionReader
- def getOffset(): KafkaSourcePartitionOffset
- Definition Classes
- KafkaContinuousPartitionReader → ContinuousPartitionReader
- def next(): Boolean
- Definition Classes
- KafkaContinuousPartitionReader → PartitionReader