SparkSubFeed

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def breakLineage(): SparkSubFeed

   

   Break lineage.

   Break lineage. This means to discard an existing DataFrame or List of FileRefs, so that it is requested again from the DataObject. This is usable to break long DataFrame Lineages over multiple Actions and instead reread the data from an intermediate table

   Definition Classes

   SparkSubFeed → SubFeed

6. def clearPartitionValues(): SparkSubFeed

   

   Definition Classes

   SparkSubFeed → SubFeed

7. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. val dataFrame: Option[DataFrame]

   

   Spark DataFrame to be processed.

   Spark DataFrame to be processed. DataFrame should not be saved to state (@transient).

9. val dataObjectId: DataObjectId

   

   id of the DataObject this SubFeed corresponds to

   id of the DataObject this SubFeed corresponds to

   Definition Classes

   SparkSubFeed → SubFeed

10. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

11. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

12. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

13. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

14. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

15. final def notify(): Unit

    

    Definition Classes

    AnyRef

16. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

17. val partitionValues: Seq[PartitionValues]

    

    Values of Partitions transported by this SubFeed

    Values of Partitions transported by this SubFeed

    Definition Classes

    SparkSubFeed → SubFeed

18. def persist: SparkSubFeed

    

19. def resultId: String

    

    Definition Classes

    SubFeed → DAGResult

20. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

21. def updatePartitionValues(partitions: Seq[String]): SparkSubFeed

    

    Definition Classes

    SparkSubFeed → SubFeed

22. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

23. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

24. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )