Class

com.spotify.scio.experimental

ExperimentalSCollection

Related Doc: package experimental

Permalink

implicit class ExperimentalSCollection[T] extends AnyRef

Enhanced version of SCollection with experimental features.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExperimentalSCollection
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ExperimentalSCollection(self: SCollection[T])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  10. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  12. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  13. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  14. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  15. def saveAsTypedBigQuery(tableSpec: String, writeDisposition: WriteDisposition = null, createDisposition: CreateDisposition = null)(implicit ct: ClassTag[T], tt: scala.reflect.api.JavaUniverse.TypeTag[T], ev: <:<[T, HasAnnotation]): Future[Tap[T]]

    Permalink

    Save this SCollection as a BigQuery table.

    Save this SCollection as a BigQuery table. Note that element type T must be annotated with BigQueryType.

    This could be a complete case class with BigQueryType.toTable. For example:

    @BigQueryType.toTable
    case class Result(name: String, score: Double)
    
    val p: SCollection[Result] = // process data and convert elements to Result
    p.saveAsTypedBigQuery("myproject:mydataset.mytable")

    It could also be an empty class with schema from BigQueryType.fromSchema, BigQueryType.fromTable, or BigQueryType.fromQuery. For example:

    @BigQueryType.fromTable("publicdata:samples.gsod")
    class Row
    
    sc.typedBigQuery[Row]()
      .sample(withReplacement = false, fraction = 0.1)
      .saveAsTypedBigQuery("myproject:samples.gsod")
  16. def saveAsTypedBigQuery(table: TableReference, writeDisposition: WriteDisposition, createDisposition: CreateDisposition)(implicit ct: ClassTag[T], tt: scala.reflect.api.JavaUniverse.TypeTag[T], ev: <:<[T, HasAnnotation]): Future[Tap[T]]

    Permalink

    Save this SCollection as a BigQuery table.

    Save this SCollection as a BigQuery table. Note that element type T must be a case class annotated with BigQueryType.toTable.

  17. val self: SCollection[T]

    Permalink
  18. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  19. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  20. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped