CheckpointScioContext

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   Any

2. final def ##(): Int

   

   Definition Classes

   Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def checkpoint[T](fileOrPath: String)(fn: ⇒ SCollection[T])(implicit arg0: ClassTag[T]): SCollection[T]

   

   Checkpoints are useful for debugging one part of a long flow, when you would otherwise have to run many steps to get to the one you care about.

   Checkpoints are useful for debugging one part of a long flow, when you would otherwise have to run many steps to get to the one you care about. To enable checkpoints, sprinkle calls to checkpoint[T]() throughout your flow, ideally after expensive steps.

   fileOrPath

   filename or fully qualified path to the checkpoint

   fn

   result of this arbitrary => SCollection[T flow is what is checkpointed

6. def getClass(): Class[_ <: AnyVal]

   

   Definition Classes

   AnyVal → Any

7. final def isInstanceOf[T0]: Boolean

   

   Definition Classes

   Any

8. val self: ScioContext

   

9. def toString(): String

   

   Definition Classes

   Any