Package

org.apache.gearpump.streaming.kafka.lib

source

Permalink

package source

Visibility
  1. Public
  2. All

Type Members

  1. abstract class AbstractKafkaSource extends TimeReplayableSource

    Permalink

    Contains implementation for Kafka source connectors, users should use org.apache.gearpump.streaming.kafka.KafkaSource.

    Contains implementation for Kafka source connectors, users should use org.apache.gearpump.streaming.kafka.KafkaSource.

    This is a TimeReplayableSource which is able to replay messages given a start time. Each kafka message is tagged with a timestamp by org.apache.gearpump.streaming.transaction.api.MessageDecoder and the (timestamp, offset) mapping is stored to a org.apache.gearpump.streaming.transaction.api.CheckpointStore. On recovery, we could retrieve the previously stored offset from the org.apache.gearpump.streaming.transaction.api.CheckpointStore by timestamp and start to read from there.

    kafka message is wrapped into gearpump org.apache.gearpump.Message and further filtered by a org.apache.gearpump.streaming.transaction.api.TimeStampFilter such that obsolete messages are dropped.

  2. class DefaultMessageDecoder extends MessageDecoder

    Permalink
  3. class StringMessageDecoder extends MessageDecoder

    Permalink

Value Members

  1. object AbstractKafkaSource extends Serializable

    Permalink
  2. package consumer

    Permalink
  3. package grouper

    Permalink

Ungrouped