option

Type Members

1. case class AsyncPoolSize(get: Int) extends Product with Serializable

   

   AsyncPoolSize controls the size of the fixed thread pool used to back an asynchronous cache.

   AsyncPoolSize controls the size of the fixed thread pool used to back an asynchronous cache. Only will have an effect if UseAsyncCache is true

2. case class FlatMapParallelism(parHint: Int) extends Product with Serializable

   

   How many instances/tasks of this flatmap task should be spawned in the environment

3. case class FlushFrequency(get: Duration) extends Product with Serializable

   

   FlushFrequency is how often, regardless of traffic, a given Cache should be flushed to the network.

4. case class IncludeSuccessHandler(get: Boolean) extends Product with Serializable

   

   Kryo serialization problems have been observed with using OnlineSuccessHandler.

   Kryo serialization problems have been observed with using OnlineSuccessHandler. This enables easy disabling of the handler. TODO (https://github.com/twitter/summingbird/issues/82): remove once we know what the hell is going on with this

5. case class MaxEmitPerExecute(get: Int) extends Product with Serializable

   

   MaxEmitPerExecute controls the number of elements that can at once be emitted to the underlying platform.

   MaxEmitPerExecute controls the number of elements that can at once be emitted to the underlying platform. Must be careful this is >> than your fan out or more tuples could be generated than are emitted.

6. case class MaxFutureWaitTime(get: Duration) extends Product with Serializable

   

   All futures should return in a reasonable period of time, otherwise there will be memory issues keeping all of them open.

   All futures should return in a reasonable period of time, otherwise there will be memory issues keeping all of them open. This option is to set the longest we wait on a future. It is not a substitute for correctly configured and implemented stores, services and sinks. All of those should return or fail fairly quickly (on the order of a second or so).

7. case class MaxWaitingFutures(get: Int) extends Product with Serializable

   

   MaxWaitingFutures is the maximum number of key-value pairs that the SinkBolt in Storm will process before starting to force the futures.

   MaxWaitingFutures is the maximum number of key-value pairs that the SinkBolt in Storm will process before starting to force the futures. For example, setting MaxWaitingFutures(100) means that if a key-value pair is added to the OnlineStore and the (n - 100)th write has not completed, Storm will block before moving on to the next key-value pair.

   TODO (https://github.com/twitter/summingbird/issues/83): look into removing this due to the possibility of deadlock with the sink's cache.

8. case class OnlineExceptionHandler(handlerFn: PartialFunction[Throwable, Unit]) extends Product with Serializable

   

9. case class OnlineSuccessHandler(handlerFn: (Unit) ⇒ Unit) extends Product with Serializable

   

10. case class SoftMemoryFlushPercent(get: Float) extends Product with Serializable

    

    SoftMemoryFlushPercent is the percentage of memory used in the JVM at which a flush will be triggered of the cache.

11. case class SourceParallelism(parHint: Int) extends Product with Serializable

    

    Parallelism in the number of instances/tasks to attempt to achieve for a given source

12. case class SummerBatchMultiplier(get: Int) extends Product with Serializable

    

    This value is mulitplied by the summer parallelism to set the true value used to hash and shard the key/value pairs.

    This value is mulitplied by the summer parallelism to set the true value used to hash and shard the key/value pairs. This allows for there to be more, smaller batches sent out to a number of threads which are set by SummerParallelism.

13. trait SummerBuilder extends Serializable

    

    A SummerBuilder is a generic trait that should be implemented to build a totally custom aggregator.

    A SummerBuilder is a generic trait that should be implemented to build a totally custom aggregator. This is the same trait for both map side and reduce side aggregation.

14. case class SummerConstructor(get: SummerBuilder) extends Product with Serializable

    

    The SummerConstructor option, set this instead of CacheSize, AsyncPoolSize, etc..

    The SummerConstructor option, set this instead of CacheSize, AsyncPoolSize, etc.. to provide how to construct the aggregation for this bolt

15. case class SummerParallelism(parHint: Int) extends Product with Serializable

    

    How many instances/tasks of this summer task should be spawned in the environment

16. case class UseAsyncCache(get: Boolean) extends Product with Serializable

    

    UseAsyncCache is used to enable a background asynchronous cache.

    UseAsyncCache is used to enable a background asynchronous cache. These do all cache related operations in background threads.

17. case class ValueCombinerCacheSize(get: Int) extends Product with Serializable

    

    ValueCombinerCacheSize is used in caches that support it as a trigger to crush down a high locality of values without emitting.