accumulables

Type Members

1. case class HashMap[T, N](map: scala.collection.mutable.HashMap[T, N])(implicit evidence$1: Numeric[N]) extends Product with Serializable

   

   mutable.HashMap with an overriden, elided toString method.

   mutable.HashMap with an overriden, elided toString method. Useful for HistogramParam to avoid the Spark UI printing a bunch of huge HashMap toStrings of intermediate, per-task values.

2. class HistogramParam[T, N] extends AccumulableParam[HashMap[T, N], T]

   

   Allows for assembling a histogram using a Spark Accumulable.

   Allows for assembling a histogram using a Spark Accumulable.

   When we put (k, v2) into an accumulator that already contains (k, v1), the result will be a HashMap containing (k, v1 + v2).