org.apache.spark

util

package util

Spark utilities.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. util
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. abstract class AccumulatorV2[IN, OUT] extends Serializable

    The base class for accumulators, that can accumulate inputs of type IN, and produce output of type OUT.

  2. class CollectionAccumulator[T] extends AccumulatorV2[T, List[T]]

    An accumulator for collecting a list of elements.

  3. class DoubleAccumulator extends AccumulatorV2[Double, Double]

    An accumulator for computing sum, count, and averages for double precision floating numbers.

  4. class EnumUtil extends AnyRef

  5. class LegacyAccumulatorWrapper[R, T] extends AccumulatorV2[T, R]

  6. class LongAccumulator extends AccumulatorV2[Long, Long]

    An accumulator for computing sum, count, and averages for 64-bit integers.

  7. case class MutablePair[T1, T2](_1: T1, _2: T2) extends Product2[T1, T2] with Product with Serializable

    :: DeveloperApi :: A tuple of 2 elements.

  8. class StatCounter extends Serializable

    A class for tracking the statistics of a set of numbers (count, mean and variance) in a numerically robust way.

  9. trait TaskCompletionListener extends EventListener

    :: DeveloperApi ::

  10. trait TaskFailureListener extends EventListener

    :: DeveloperApi ::

Value Members

  1. object SizeEstimator extends Logging

    :: DeveloperApi :: Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in memory-aware caches.

  2. object StatCounter extends Serializable

  3. package collection

  4. package random

    Utilities for random number generation.

Inherited from AnyRef

Inherited from Any

Ungrouped