Class

com.github.timgent.sparkdataquality.checks.metrics.SingleMetricBasedCheck

DistinctValuesCheck

Related Doc: package SingleMetricBasedCheck

Permalink

case class DistinctValuesCheck(threshold: AbsoluteThreshold[Long], onColumns: List[String], filter: MetricFilter = MetricFilter.noFilter) extends ThresholdBasedCheck[LongMetric] with Product with Serializable

Checks the number of distinct values across the given columns

threshold

- the threshold for what number of distinct values is acceptable

onColumns

- the columns to check for distinct values in

filter

- the filter that is applied before the distinct value count is done

Linear Supertypes
Serializable, Serializable, Product, Equals, ThresholdBasedCheck[LongMetric], SingleMetricBasedCheck[LongMetric], MetricsBasedCheck, QCCheck, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DistinctValuesCheck
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. ThresholdBasedCheck
  7. SingleMetricBasedCheck
  8. MetricsBasedCheck
  9. QCCheck
  10. AnyRef
  11. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DistinctValuesCheck(threshold: AbsoluteThreshold[Long], onColumns: List[String], filter: MetricFilter = MetricFilter.noFilter)

    Permalink

    threshold

    - the threshold for what number of distinct values is acceptable

    onColumns

    - the columns to check for distinct values in

    filter

    - the filter that is applied before the distinct value count is done

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. def applyCheck(metric: LongMetric): CheckResult

    Permalink
    Attributes
    protected
    Definition Classes
    ThresholdBasedCheck → SingleMetricBasedCheck

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def checkShortName: String

    Permalink
    Definition Classes
    DistinctValuesCheck → ThresholdBasedCheck

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def description: String

    Permalink
    Definition Classes
    DistinctValuesCheck → QCCheck

  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  10. val filter: MetricFilter

    Permalink

    - the filter that is applied before the distinct value count is done

  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  14. def metricDescriptor: MetricDescriptor

    Permalink
    Definition Classes
    DistinctValuesCheck → SingleMetricBasedCheck

  15. final def metricNotPresentErrorResult: CheckResult

    Permalink
    Attributes
    protected
    Definition Classes
    MetricsBasedCheck

  16. final def metricTypeErrorResult: CheckResult

    Permalink
    Attributes
    protected
    Definition Classes
    MetricsBasedCheck

  17. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  18. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  19. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  20. val onColumns: List[String]

    Permalink

    - the columns to check for distinct values in

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  22. val threshold: AbsoluteThreshold[Long]

    Permalink

    - the threshold for what number of distinct values is acceptable

    - the threshold for what number of distinct values is acceptable

    Definition Classes
    DistinctValuesCheck → ThresholdBasedCheck

  23. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  24. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  25. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from ThresholdBasedCheck[LongMetric]

Inherited from SingleMetricBasedCheck[LongMetric]

Inherited from MetricsBasedCheck

Inherited from QCCheck

Inherited from AnyRef

Inherited from Any

Ungrouped