Class

org.apache.spark.util

CollectionAccumulator

Related Doc: package util

Permalink

class CollectionAccumulator[T] extends AccumulatorV2Kryo[T, List[T]] with KryoSerializable

An accumulator for collecting a list of elements.

Since

2.0.0

Linear Supertypes
AccumulatorV2Kryo[T, List[T]], KryoSerializable, AccumulatorV2[T, List[T]], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CollectionAccumulator
  2. AccumulatorV2Kryo
  3. KryoSerializable
  4. AccumulatorV2
  5. Serializable
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CollectionAccumulator()

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def add(v: T): Unit

    Permalink

    Takes the inputs and accumulates.

    Takes the inputs and accumulates.

    Definition Classes
    CollectionAccumulatorAccumulatorV2
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def copy(): CollectionAccumulator[T]

    Permalink

    Creates a new copy of this accumulator.

    Creates a new copy of this accumulator.

    Definition Classes
    CollectionAccumulatorAccumulatorV2
  8. def copyAndReset(): CollectionAccumulator[T]

    Permalink

    Creates a new copy of this accumulator, which is zero value.

    Creates a new copy of this accumulator, which is zero value. i.e. call isZero on the copy must return true.

    Definition Classes
    CollectionAccumulatorAccumulatorV2
  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  14. final def id: Long

    Permalink

    Returns the id of this accumulator, can only be called after registration.

    Returns the id of this accumulator, can only be called after registration.

    Definition Classes
    AccumulatorV2
  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  16. final def isRegistered: Boolean

    Permalink

    Returns true if this accumulator has been registered.

    Returns true if this accumulator has been registered. Note that all accumulators must be registered before use, or it will throw exception.

    Definition Classes
    AccumulatorV2
  17. def isZero: Boolean

    Permalink

    Returns if this accumulator is zero value or not.

    Returns if this accumulator is zero value or not. e.g. for a counter accumulator, 0 is zero value; for a list accumulator, Nil is zero value.

    Definition Classes
    CollectionAccumulatorAccumulatorV2
  18. def merge(other: AccumulatorV2[T, List[T]]): Unit

    Permalink

    Merges another same-type accumulator into this one and update its state, i.e.

    Merges another same-type accumulator into this one and update its state, i.e. this should be merge-in-place.

    Definition Classes
    CollectionAccumulatorAccumulatorV2
  19. final def name: Option[String]

    Permalink

    Returns the name of this accumulator, can only be called after registration.

    Returns the name of this accumulator, can only be called after registration.

    Definition Classes
    AccumulatorV2
  20. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  21. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  22. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  23. final def read(kryo: Kryo, input: Input, context: TaskContext): Unit

    Permalink
    Definition Classes
    AccumulatorV2Kryo
  24. final def read(kryo: Kryo, input: Input): Unit

    Permalink

    Child classes must implement readKryo() and cannot override this.

    Child classes must implement readKryo() and cannot override this.

    Definition Classes
    AccumulatorV2Kryo → KryoSerializable
  25. def readKryo(kryo: Kryo, input: Input): Unit

    Permalink
  26. def reset(): Unit

    Permalink

    Resets this accumulator, which is zero value.

    Resets this accumulator, which is zero value. i.e. call isZero must return true.

    Definition Classes
    CollectionAccumulatorAccumulatorV2
  27. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  28. def toString(): String

    Permalink
    Definition Classes
    AccumulatorV2 → AnyRef → Any
  29. def value: List[T]

    Permalink

    Defines the current value of this accumulator

    Defines the current value of this accumulator

    Definition Classes
    CollectionAccumulatorAccumulatorV2
  30. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  33. final def write(kryo: Kryo, output: Output): Unit

    Permalink

    Child classes cannot override this and must instead implement writeKryo/readKryo for consistent writeReplace() behavior.

    Child classes cannot override this and must instead implement writeKryo/readKryo for consistent writeReplace() behavior.

    Definition Classes
    AccumulatorV2Kryo → KryoSerializable
  34. def writeKryo(kryo: Kryo, output: Output): Unit

    Permalink
  35. final def writeReplace(): Any

    Permalink
    Attributes
    protected
    Definition Classes
    AccumulatorV2

Inherited from AccumulatorV2Kryo[T, List[T]]

Inherited from KryoSerializable

Inherited from AccumulatorV2[T, List[T]]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped