Package

com.github.timgent.sparkdataquality

checks

Permalink

package checks

Visibility
  1. Public
  2. All

Type Members

  1. trait ArbitraryCheck extends QCCheck

    Permalink

    Arbitrary check - could provide any function to do this type of check

  2. case class CheckResult(qcType: QcType, status: CheckStatus, resultDescription: String, checkDescription: String, datasourceDescription: Option[DatasourceDescription] = None) extends Product with Serializable

    Permalink

    The result of a check

    The result of a check

    status

    - status of the check

    resultDescription

    - description of the check result

    checkDescription

    - description of the check

    datasourceDescription

    - optional description of the datasource used in the check

  3. sealed trait CheckStatus extends EnumEntry

    Permalink

    Represents the resulting status of a check

  4. trait DatasetComparisonCheck extends QCCheck

    Permalink

    Check for comparing a pair of datasets

  5. sealed trait DatasourceDescription extends AnyRef

    Permalink
  6. case class DeequQCCheck(check: DeequCheck) extends QCCheck with Product with Serializable

    Permalink

    Light wrapper for a deequ check

  7. trait QCCheck extends AnyRef

    Permalink

    Represents a check to be done

  8. case class RawCheckResult(status: CheckStatus, resultDescription: String) extends Product with Serializable

    Permalink

    Check result without additional information about datasource and check description

    Check result without additional information about datasource and check description

    status

    - status of the check

    resultDescription

    - description of the check result

  9. trait SingleDatasetCheck extends QCCheck

    Permalink

    A check to be done on a single dataset

Ungrouped