Class/Object

com.coxautodata.waimak.dataflow

CommitMeta

Related Docs: object CommitMeta | package dataflow

Permalink

case class CommitMeta[S <: DataFlow[S]](commits: Map[String, Seq[CommitEntry]], pushes: Map[String, Seq[DataCommitter[S]]]) extends Product with Serializable

Contains configurations for commits and pushes, while configs are added, there are no modifications to the dataflow, as it waits for a validation before execution.

commits

Map[ COMMIT_NAME, Seq[CommitEntry] ]

pushes

Map[ COMMIT_NAME, Seq[DataCommitter] - there should be one committer per commit name, but due to lazy definitions of the data flows, validation will have to catch it.

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CommitMeta
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CommitMeta(commits: Map[String, Seq[CommitEntry]], pushes: Map[String, Seq[DataCommitter[S]]])

    Permalink

    commits

    Map[ COMMIT_NAME, Seq[CommitEntry] ]

    pushes

    Map[ COMMIT_NAME, Seq[DataCommitter] - there should be one committer per commit name, but due to lazy definitions of the data flows, validation will have to catch it.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. def addCommits(commitName: String, labels: Seq[String], partitions: Option[Either[Seq[String], Int]], repartition: Boolean, cacheLabels: Boolean): CommitMeta[S]

    Permalink

  5. def addPush(commitName: String, committer: DataCommitter[S]): CommitMeta[S]

    Permalink

  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. val commits: Map[String, Seq[CommitEntry]]

    Permalink

    Map[ COMMIT_NAME, Seq[CommitEntry] ]

  9. def commitsWithoutPushes(): Set[String]

    Permalink

  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  14. def labelsUsedInMultipleCommits(): Option[Map[String, Seq[String]]]

    Permalink

  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  18. def phantomLabels(presentLabels: Set[String]): Map[String, Set[String]]

    Permalink

    Checks if commits refer to labels that are not produced in the flow.

    Checks if commits refer to labels that are not produced in the flow.

    presentLabels

    labels that are produced in the data flow

    returns

    Map[COMMIT_NAME, Set[Labels that are not defined in the DataFlow, but in the commits] ]

  19. val pushes: Map[String, Seq[DataCommitter[S]]]

    Permalink

    Map[ COMMIT_NAME, Seq[DataCommitter] - there should be one committer per commit name, but due to lazy definitions of the data flows, validation will have to catch it.

  20. def pushesWithoutCommits(): Set[String]

    Permalink

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  22. def validate(dataFlow: S): Try[Unit]

    Permalink

  23. def validateCommitters(dataFlow: S): Try[Unit]

    Permalink

  24. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  25. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped