Class

io.smartdatalake.definitions

PartitionDiffMode

Related Doc: package definitions

Permalink

case class PartitionDiffMode(partitionColNb: Option[Int] = None, mainInputId: Option[String] = None, mainOutputId: Option[String] = None, nbOfPartitionValuesPerRun: Option[Int] = None) extends ExecutionMode with Product with Serializable

Partition difference execution mode lists partitions on input & output DataObject and starts loading all missing partitions. Partition columns to be used for comparision need to be a common 'init' of input and output partition columns.

partitionColNb

optional number of partition columns to use as a common 'init'.

mainInputId

optional selection of inputId to be used for partition comparision. Only needed if there are multiple input DataObject's.

mainOutputId

optional selection of outputId to be used for partition comparision. Only needed if there are multiple output DataObject's.

nbOfPartitionValuesPerRun

optional restriction of the number of partition values per run.

Linear Supertypes
Serializable, Serializable, Product, Equals, ExecutionMode, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. PartitionDiffMode
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. ExecutionMode
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PartitionDiffMode(partitionColNb: Option[Int] = None, mainInputId: Option[String] = None, mainOutputId: Option[String] = None, nbOfPartitionValuesPerRun: Option[Int] = None)

    Permalink

    partitionColNb

    optional number of partition columns to use as a common 'init'.

    mainInputId

    optional selection of inputId to be used for partition comparision. Only needed if there are multiple input DataObject's.

    mainOutputId

    optional selection of outputId to be used for partition comparision. Only needed if there are multiple output DataObject's.

    nbOfPartitionValuesPerRun

    optional restriction of the number of partition values per run.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  8. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  9. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  10. val mainInputId: Option[String]

    Permalink

    optional selection of inputId to be used for partition comparision.

    optional selection of inputId to be used for partition comparision. Only needed if there are multiple input DataObject's.

    Definition Classes
    PartitionDiffModeExecutionMode
  11. val mainOutputId: Option[String]

    Permalink

    optional selection of outputId to be used for partition comparision.

    optional selection of outputId to be used for partition comparision. Only needed if there are multiple output DataObject's.

    Definition Classes
    PartitionDiffModeExecutionMode
  12. val nbOfPartitionValuesPerRun: Option[Int]

    Permalink

    optional restriction of the number of partition values per run.

  13. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  15. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. val partitionColNb: Option[Int]

    Permalink

    optional number of partition columns to use as a common 'init'.

  17. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  18. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from ExecutionMode

Inherited from AnyRef

Inherited from Any

Ungrouped