org.apache.gearpump.streaming.kafka.lib.source
Reads a record from incoming queue, decodes, filters and checkpoints offsets before returns a Message.
Reads a record from incoming queue, decodes, filters and checkpoints offsets before returns a Message. Message can be null if the incoming queue is empty.
a org.apache.gearpump.Message or null
Contains implementation for Kafka source connectors, users should use org.apache.gearpump.streaming.kafka.KafkaSource.
This is a TimeReplayableSource which is able to replay messages given a start time. Each kafka message is tagged with a timestamp by org.apache.gearpump.streaming.transaction.api.MessageDecoder and the (timestamp, offset) mapping is stored to a org.apache.gearpump.streaming.transaction.api.CheckpointStore. On recovery, we could retrieve the previously stored offset from the org.apache.gearpump.streaming.transaction.api.CheckpointStore by timestamp and start to read from there.
kafka message is wrapped into gearpump org.apache.gearpump.Message and further filtered by a org.apache.gearpump.streaming.transaction.api.TimeStampFilter such that obsolete messages are dropped.