kafkastreams

Type Members

1. abstract class KafkaStreamsTwitterServer extends TwitterServer with KafkaFlagUtils with ScalaStreamsImplicits

   

   A com.twitter.server.TwitterServer that supports configuring a KafkaStreams topology.

   A com.twitter.server.TwitterServer that supports configuring a KafkaStreams topology.

   To use, override the configureKafkaStreams method to setup your topology.

   import com.twitter.finatra.kafkastreams.KafkaStreamsTwitterServer
   
   object MyKafkaStreamsTwitterServerMain extends MyKafkaStreamsTwitterServer
   
   class MyKafkaStreamsTwitterServer extends KafkaStreamsTwitterServer {
   
   override def configureKafkaStreams(streamsBuilder: StreamsBuilder): Unit = {
     streamsBuilder.asScala
       .stream("dp-it-devel-tweetid-to-interaction")(
         Consumed.`with`(ScalaSerdes.Long, ScalaSerdes.Thrift[MigratorInteraction])
       )
   }

2. abstract class StatelessKafkaStreamsTwitterServer extends KafkaStreamsTwitterServer

   

   StatelessKafkaStreamsServer is used for stateless Kafka transformations that do not need to store data in local state stores.

   StatelessKafkaStreamsServer is used for stateless Kafka transformations that do not need to store data in local state stores. Note 1: When using this class, server startup will fail if a local state store is used. Note 2: In the future, we could potentially, use a different TaskAssignment strategy to avoid extra unneeded metadata in the partition join requests