Object/Class

com.github.timgent.sparkdataquality.checks.metrics

SingleMetricBasedCheck

Related Docs: class SingleMetricBasedCheck | package metrics

Permalink

object SingleMetricBasedCheck extends Serializable

Linear Supertypes
Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SingleMetricBasedCheck
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. def complianceCheck(threshold: AbsoluteThreshold[Double], complianceFn: ComplianceFn, filter: MetricFilter = MetricFilter.noFilter): SingleMetricBasedCheck[DoubleMetric]

    Permalink

    Checks the fraction of rows that are compliant with the given complianceFn

    Checks the fraction of rows that are compliant with the given complianceFn

    threshold

    - the threshold for what fraction of rows is acceptable

    complianceFn

    - the function rows are tested with to see if they are compliant

    filter

    - the filter that is applied before the compliance fraction is calculated

  7. def distinctValuesCheck(threshold: AbsoluteThreshold[Long], onColumns: List[String], filter: MetricFilter = MetricFilter.noFilter): SingleMetricBasedCheck[LongMetric]

    Permalink

    Checks the number of distinct values across the given columns

    Checks the number of distinct values across the given columns

    threshold

    - the threshold for what number of distinct values is acceptable

    onColumns

    - the columns to check for distinct values in

    filter

    - the filter that is applied before the distinct value count is done

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. def sizeCheck(threshold: AbsoluteThreshold[Long], filter: MetricFilter = MetricFilter.noFilter): SingleMetricBasedCheck[LongMetric]

    Permalink

    Checks the count of rows in a dataset after the given filter is applied is within the given threshold

    Checks the count of rows in a dataset after the given filter is applied is within the given threshold

    filter

    - filter to be applied before rows are counted

  18. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  19. def thresholdBasedCheck[MV <: MetricValue](metricDescriptor: MetricDescriptor, description: String, threshold: AbsoluteThreshold[SingleMetricBasedCheck.thresholdBasedCheck.MV.T]): SingleMetricBasedCheck[MV]

    Permalink

    A check based on a single metric that checks if that metric is within the given threshold

    A check based on a single metric that checks if that metric is within the given threshold

    MV

    - the type of the MetricValue that will be calculated in order to complete this check

    metricDescriptor

    - describes the metric the check will be done on

    description

    - the user friendly description for this check

    threshold

    - the threshold that the metric must be within to pass

  20. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  21. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped