Class/Object

com.samelamin.spark.bigquery.streaming

BigQuerySource

Related Docs: object BigQuerySource | package streaming

Permalink

class BigQuerySource extends Source

Created by sam elamin on 29/01/2017.

Linear Supertypes
Source, BaseStreamingSource, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. BigQuerySource
  2. Source
  3. BaseStreamingSource
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BigQuerySource(sqlContext: SQLContext, user_schema: Option[StructType], options: Map[String, String])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. def commit(end: Offset): Unit

    Permalink
    Definition Classes
    Source

  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  10. val fullyQualifiedOutputTableId: String

    Permalink

  11. def getBatch(start: Option[Offset], end: Offset): DataFrame

    Permalink

    Returns the data that is between the offsets (start, end].

    Returns the data that is between the offsets (start, end]. When start is None then the batch should begin with the first available record. This method must always return the same data for a particular start and end pair.

    Definition Classes
    BigQuerySource → Source

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. def getConvertedSchema(sqlContext: SQLContext): StructType

    Permalink

  14. def getOffset: Option[Offset]

    Permalink
    Definition Classes
    BigQuerySource → Source

  15. val hadoopConfiguration: Configuration

    Permalink

  16. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  17. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  18. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  19. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  20. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. def schema: StructType

    Permalink

    Returns the schema of the data from this source

    Returns the schema of the data from this source

    Definition Classes
    BigQuerySource → Source

  22. def stop(): Unit

    Permalink
    Definition Classes
    BigQuerySource → Source → BaseStreamingSource

  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  24. val timestampColumn: String

    Permalink

  25. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Source

Inherited from BaseStreamingSource

Inherited from AnyRef

Inherited from Any

Ungrouped