Class

com.spotify.scio.io.dynamic

DynamicIoSCollection

Related Doc: package dynamic

Permalink

implicit final class DynamicIoSCollection[T] extends AnyVal

Enhanced version of SCollection with dynamic destinations methods.

Linear Supertypes
AnyVal, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DynamicIoSCollection
  2. AnyVal
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DynamicIoSCollection(self: SCollection[T])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def getClass(): Class[_ <: AnyVal]

    Permalink
    Definition Classes
    AnyVal → Any
  6. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  7. def saveAsDynamicAvroFile(path: String, numShards: Int = 0, schema: Schema = null, suffix: String = ".avro", codec: CodecFactory = CodecFactory.deflateCodec(6), metadata: Map[String, AnyRef] = Map.empty)(destinationFn: (T) ⇒ String)(implicit ct: ClassTag[T]): Future[Tap[T]]

    Permalink

    Save this SCollection as Avro files specified by the destination function.

  8. def saveAsDynamicTextFile(path: String, numShards: Int = 0, suffix: String = ".txt", compression: Compression = Compression.UNCOMPRESSED)(destinationFn: (String) ⇒ String)(implicit ct: ClassTag[T]): Future[Tap[String]]

    Permalink

    Save this SCollection as text files specified by the destination function.

  9. def toString(): String

    Permalink
    Definition Classes
    Any

Inherited from AnyVal

Inherited from Any

Ungrouped