Package

org.hammerlab.magic.rdd

cmp

Permalink

package cmp

Visibility
  1. Public
  2. All

Type Members

  1. class Cmp[K, V] extends AnyRef

    Permalink

    Given an outer-join of two RDDs, expose statistics about how many identical elements at identical positions they have.

  2. case class CmpStats(equal: Long = 0, notEqual: Long = 0, onlyA: Long = 0, onlyB: Long = 0) extends Product with Serializable

    Permalink

    Summable data-type for counting the number of elements that are the same vs.

    Summable data-type for counting the number of elements that are the same vs. different in two RDDs, or that exist in just one or the other.

  3. class ElemCmp[T] extends AnyRef

    Permalink

    Given an outer join of two RDDs with the presence or absence of values for a key replaced with a Boolean for each RDD, expose statistics about how many elements exist in either or both RDDs.

  4. case class ElemCmpStats(both: Long = 0, onlyA: Long = 0, onlyB: Long = 0) extends Product with Serializable

    Permalink

    Summable data type recording the number of elements that are present in either or both of two RDDs.

  5. class EqualsRDD[T] extends AnyRef

    Permalink

    Wrap an RDD and expose compare, compareElements, and isEqual methods for testing its equality to other RDDs.

  6. class SameElementsRDD[K, V] extends AnyRef

    Permalink

    Wrap an RDD and expose methods for comparing its elements to those of other RDD's, disregarding the order in which they appear in each.

Value Members

  1. object Cmp

    Permalink
  2. object ElemCmp

    Permalink
  3. object EqualsRDD

    Permalink
  4. object SameElementsRDD

    Permalink

Ungrouped