kafka.javaapi.consumer
Interface ConsumerConnector

public interface ConsumerConnector

Method Summary

void	commitOffsets() Commit the offsets of all broker partitions connected by this connector.
void	commitOffsets(boolean retryOnFailure)
java.util.Map<java.lang.String,java.util.List<kafka.consumer.KafkaStream<byte[],byte[]>>>	createMessageStreams(java.util.Map<java.lang.String,java.lang.Integer> topicCountMap)
<K,V> java.util.Map<java.lang.String,java.util.List<kafka.consumer.KafkaStream<K,V>>>	createMessageStreams(java.util.Map<java.lang.String,java.lang.Integer> topicCountMap, kafka.serializer.Decoder<K> keyDecoder, kafka.serializer.Decoder<V> valueDecoder) Create a list of MessageStreams of type T for each topic.
java.util.List<kafka.consumer.KafkaStream<byte[],byte[]>>	createMessageStreamsByFilter(kafka.consumer.TopicFilter topicFilter)
java.util.List<kafka.consumer.KafkaStream<byte[],byte[]>>	createMessageStreamsByFilter(kafka.consumer.TopicFilter topicFilter, int numStreams)
<K,V> java.util.List<kafka.consumer.KafkaStream<K,V>>	createMessageStreamsByFilter(kafka.consumer.TopicFilter topicFilter, int numStreams, kafka.serializer.Decoder<K> keyDecoder, kafka.serializer.Decoder<V> valueDecoder) Create a list of MessageAndTopicStreams containing messages of type T.
void	shutdown() Shut down the connector

Method Detail

createMessageStreams

<K,V> java.util.Map<java.lang.String,java.util.List<kafka.consumer.KafkaStream<K,V>>> createMessageStreams(java.util.Map<java.lang.String,java.lang.Integer> topicCountMap,
                                                                                                           kafka.serializer.Decoder<K> keyDecoder,
                                                                                                           kafka.serializer.Decoder<V> valueDecoder)

Create a list of MessageStreams of type T for each topic.

Parameters:

topicCountMap - a map of (topic, #streams) pair

keyDecoder - a decoder that decodes the message key

valueDecoder - a decoder that decodes the message itself

Returns:

a map of (topic, list of KafkaStream) pairs. The number of items in the list is #streams. Each stream supports an iterator over message/metadata pairs.

createMessageStreams

java.util.Map<java.lang.String,java.util.List<kafka.consumer.KafkaStream<byte[],byte[]>>> createMessageStreams(java.util.Map<java.lang.String,java.lang.Integer> topicCountMap)

createMessageStreamsByFilter

<K,V> java.util.List<kafka.consumer.KafkaStream<K,V>> createMessageStreamsByFilter(kafka.consumer.TopicFilter topicFilter,
                                                                                   int numStreams,
                                                                                   kafka.serializer.Decoder<K> keyDecoder,
                                                                                   kafka.serializer.Decoder<V> valueDecoder)

Create a list of MessageAndTopicStreams containing messages of type T.

Parameters:

topicFilter - a TopicFilter that specifies which topics to subscribe to (encapsulates a whitelist or a blacklist).

numStreams - the number of message streams to return.

keyDecoder - a decoder that decodes the message key

valueDecoder - a decoder that decodes the message itself

Returns:

a list of KafkaStream. Each stream supports an iterator over its MessageAndMetadata elements.

createMessageStreamsByFilter

java.util.List<kafka.consumer.KafkaStream<byte[],byte[]>> createMessageStreamsByFilter(kafka.consumer.TopicFilter topicFilter,
                                                                                       int numStreams)

createMessageStreamsByFilter

java.util.List<kafka.consumer.KafkaStream<byte[],byte[]>> createMessageStreamsByFilter(kafka.consumer.TopicFilter topicFilter)

commitOffsets

void commitOffsets()

Commit the offsets of all broker partitions connected by this connector.

commitOffsets

void commitOffsets(boolean retryOnFailure)

shutdown

void shutdown()

Shut down the connector