com.twitter.finatra.kafkastreams
Callback method which is executed after the injector is created and before any other lifecycle methods.
Callback method which is executed after the injector is created and before any other lifecycle methods.
Use the provided StreamsBuilder to create your KafkaStreams topology.
It is NOT expected that you block in this method as you will prevent completion of the server lifecycle.
Callback method which is executed after the injector is created and before KafkaStreams is configured.
Callback method which is executed after the injector is created and before KafkaStreams is configured.
Use the provided KafkaStreamsConfig and augment to configure your KafkaStreams topology.
Example:
override def streamsProperties(config: KafkaStreamsConfig): KafkaStreamsConfig = { super .streamsProperties(config) .retries(60) .retryBackoff(1.second) .consumer.sessionTimeout(10.seconds) .consumer.heartbeatInterval(1.second) .producer.retries(300) .producer.retryBackoff(1.second) .producer.requestTimeout(2.minutes) .producer.transactionTimeout(2.minutes) .producer.batchSize(500.kilobytes) }
the default KafkaStreamsConfig defined at createKafkaStreamsProperties
a KafkaStreamsConfig with your additional configurations applied.
StatelessKafkaStreamsServer is used for stateless Kafka transformations that do not need to store data in local state stores. Note 1: When using this class, server startup will fail if a local state store is used. Note 2: In the future, we could potentially, use a different TaskAssignment strategy to avoid extra unneeded metadata in the partition join requests