KafkaSourceConfig

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

6. def consumerConfig: ConsumerConfig

   

7. val consumerProps: Properties

   

   kafka consumer config

8. final def eq(arg0: AnyRef): Boolean

   

   Definition Classes

   AnyRef

9. def equals(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

10. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

11. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

12. def getConsumerTopics: List[String]

    
    returns

    a list of kafka consumer topics

13. def getFetchSleepMS: Int

    

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the FETCH_THRESHOLD this is to get sleep interval

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the FETCH_THRESHOLD this is to get sleep interval

    returns

    sleep interval in milliseconds

14. def getFetchThreshold: Int

    

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    returns

    fetch threshold

15. def getGrouper: KafkaGrouper

    

    get org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper instance, whose corresponding org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper defines how kafka.common.TopicAndPartitions are mapped to source tasks

    get org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper instance, whose corresponding org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper defines how kafka.common.TopicAndPartitions are mapped to source tasks

    returns

16. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

17. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

18. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

19. final def notify(): Unit

    

    Definition Classes

    AnyRef

20. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

21. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

22. def toString(): String

    

    Definition Classes

    AnyRef → Any

23. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

24. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

25. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

26. def withConsumerTopics(topics: String): KafkaSourceConfig

    

    set kafka consumer topics

    set kafka consumer topics

    topics

    comma-separated string

    returns

    new KafkaConfig based on this but with CONSUMER_TOPICS set to given value

27. def withFetchSleepMS(sleepMS: Int): KafkaSourceConfig

    

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the FETCH_THRESHOLD this is to set sleep interval

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the FETCH_THRESHOLD this is to set sleep interval

    sleepMS

    sleep interval in milliseconds

    returns

    new KafkaConfig based on this but with FETCH_SLEEP_MS set to given value

28. def withFetchThreshold(threshold: Int): KafkaSourceConfig

    

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    org.apache.gearpump.streaming.kafka.lib.consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    threshold

    queue size

    returns

    new KafkaConfig based on this but with FETCH_THRESHOLD set to give value

29. def withGrouper(className: String): KafkaSourceConfig

    

    set org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper, whose corresponding org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper defines how kafka.common.TopicAndPartitions are mapped to source tasks

    set org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper, whose corresponding org.apache.gearpump.streaming.kafka.lib.grouper.KafkaGrouper defines how kafka.common.TopicAndPartitions are mapped to source tasks

    className

    name of the factory class

    returns

    new KafkaConfig based on this but with GROUPER_CLASS set to given value