kafka

Type Members

1. class DataStorePersistence extends Runnable with Closeable with MethodProfiling with LazyLogging

   

   Persists expired entries to the data store

   Persists expired entries to the data store

   1. checks for expired entries 2. gets zk lock 3. gets offsets from zk 4. writes expired entries to data store 5. updates offsets in zk 6. releases zk lock

2. class KafkaCacheLoader extends ThreadedConsumer

   

   Consumes from kakfa and populates the local cache

   Consumes from kakfa and populates the local cache

   1. reads offsets stored in zk on startup 2. scheduled repeating - reads features from kafka, adds to in-memory cache 3. listens for offsets change in zk, removes expired features from in-memory cache

3. class KafkaFeatureCache extends WritableFeatureCache with ReadableFeatureCache with ExpiringFeatureCache with OffsetListener with LazyLogging

   

   Locally cached features

4. class KafkaQueryRunner extends LocalQueryRunner

   

5. class KafkaStore extends TransientStore with LazyLogging