org.apache.spark

util

package util

Spark utilities.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. util
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. class EnumUtil extends AnyRef

  2. case class MutablePair[T1, T2](_1: T1, _2: T2) extends Product2[T1, T2] with Product with Serializable

    :: DeveloperApi :: A tuple of 2 elements.

    :: DeveloperApi :: A tuple of 2 elements. This can be used as an alternative to Scala's Tuple2 when we want to minimize object allocation.

    _1

    Element 1 of this MutablePair

    _2

    Element 2 of this MutablePair

    Annotations
    @DeveloperApi()
  3. class StatCounter extends Serializable

    A class for tracking the statistics of a set of numbers (count, mean and variance) in a numerically robust way.

    A class for tracking the statistics of a set of numbers (count, mean and variance) in a numerically robust way. Includes support for merging two StatCounters. Based on Welford and Chan's algorithms for running variance.

  4. trait TaskCompletionListener extends EventListener

    :: DeveloperApi ::

    :: DeveloperApi ::

    Listener providing a callback function to invoke when a task's execution completes.

    Annotations
    @DeveloperApi()
  5. class Vector extends Serializable

    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) Use Vectors.dense from Spark's mllib.linalg package instead.

Value Members

  1. object RpcUtils

  2. object SizeEstimator extends Logging

    :: DeveloperApi :: Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in memory-aware caches.

    :: DeveloperApi :: Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in memory-aware caches.

    Based on the following JavaWorld article: http://www.javaworld.com/javaworld/javaqa/2003-12/02-qa-1226-sizeof.html

    Annotations
    @DeveloperApi()
  3. object StatCounter extends Serializable

  4. object Vector extends Serializable

  5. package collection

  6. package random

    Utilities for random number generation.

Inherited from AnyRef

Inherited from Any

Ungrouped