Object

com.salesforce.op.utils.spark

SequenceAggregators

Related Doc: package spark

Permalink

object SequenceAggregators

A factory for Spark sequence aggregators

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SequenceAggregators
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type MapMap = Map[String, Map[String, Long]]

    Permalink
  2. type SeqD = Seq[Double]

    Permalink
  3. type SeqL = Seq[Long]

    Permalink
  4. type SeqMapDouble = Seq[Map[String, Double]]

    Permalink
  5. type SeqMapLL = Seq[Map[Long, Long]]

    Permalink
  6. type SeqMapLong = Seq[Map[String, Long]]

    Permalink
  7. type SeqMapMap = Seq[MapMap]

    Permalink
  8. type SeqMapMapLong = Seq[Map[String, Map[Long, Long]]]

    Permalink
  9. type SeqMapTuple = Seq[Map[String, (Double, Int)]]

    Permalink
  10. type SeqOptD = Seq[Option[Double]]

    Permalink
  11. type SeqOptL = Seq[Option[Long]]

    Permalink
  12. type SeqSet = Seq[Set[String]]

    Permalink
  13. type SeqTupD = Seq[(Double, Int)]

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def MeanSeqMapDouble(size: Int): Aggregator[SeqMapDouble, SeqMapTuple, SeqMapDouble]

    Permalink

    Creates a TypedColumn that computes the means by key of a Dataset column of type Seq[Map[String, Double]].

    Creates a TypedColumn that computes the means by key of a Dataset column of type Seq[Map[String, Double]]. Each map has a separate mean by key computed. Because each map does not have to have all the possible keys, the element counts for each map's keys can all be different.

    size

    the size of the Sequence

    returns

    spark aggregator

  5. def MeanSeqNullNum(size: Int): Aggregator[SeqOptD, SeqTupD, SeqD]

    Permalink

    Creates a TypedColumn that computes mean on a Dataset column of type Seq[Option[Double]]

    Creates a TypedColumn that computes mean on a Dataset column of type Seq[Option[Double]]

    size

    the size of the Sequence

    returns

    spark aggregator

  6. def ModeSeqMapLong(size: Int): Aggregator[SeqMapLong, SeqMapMapLong, SeqMapLong]

    Permalink

    Creates a TypedColumn that computes the modes by key of a Dataset column of type Seq[Map[String, Long]].

    Creates a TypedColumn that computes the modes by key of a Dataset column of type Seq[Map[String, Long]]. Each map has a separate mode by key computed. Because each map does not have to have all the possible keys, the element counts for each map's keys can all be different.

    size

    the size of the Sequence

    returns

    spark aggregator

  7. def ModeSeqNullInt(size: Int): Aggregator[SeqOptL, SeqMapLL, SeqL]

    Permalink

    Creates a TypedColumn that computes mode on a Dataset column of type Seq[Option[Long]]

    Creates a TypedColumn that computes mode on a Dataset column of type Seq[Option[Long]]

    size

    the size of the Sequence

    returns

    spark aggregator

  8. def SumNumSeq[T](size: Int)(implicit arg0: Numeric[T], arg1: Encoder[T], enc: Encoder[Seq[T]]): Aggregator[Seq[T], Seq[T], Seq[T]]

    Permalink

    Creates a TypedColumn that sums a Dataset column of type Seq[T: Numeric]

    Creates a TypedColumn that sums a Dataset column of type Seq[T: Numeric]

    T

    numeric type

    size

    the size of the Sequence

    returns

    spark aggregator

  9. def SumSeqMapMap(size: Int): Aggregator[SeqMapMap, SeqMapMap, SeqMapMap]

    Permalink

    Creates a TypedColumn that sums a Dataset column of type Seq[Map[String, Map[String, Long]]] such that the maps are summed with the keys preserved and the values resulting are the sum of the values for the two maps

    Creates a TypedColumn that sums a Dataset column of type Seq[Map[String, Map[String, Long]]] such that the maps are summed with the keys preserved and the values resulting are the sum of the values for the two maps

    size

    the size of the Sequence

    returns

    spark aggregator

  10. def SumSeqSet(size: Int): Aggregator[SeqSet, SeqSet, SeqSet]

    Permalink

    Creates a TypedColumn that sums a Dataset column of type Seq[Set[String]]

    Creates a TypedColumn that sums a Dataset column of type Seq[Set[String]]

    size

    the size of the Sequence

    returns

    spark aggregator

  11. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  12. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  17. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  23. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  24. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped