Class/Object

it.agilelab.bigdata.wasp.consumers.spark.plugins.postgresql

PostgreSQLSparkBatchWriter

Related Docs: object PostgreSQLSparkBatchWriter | package postgresql

Permalink

case class PostgreSQLSparkBatchWriter(sqlSinkModel: SQLSinkModel) extends PostgreSQLSparkBaseWriter with SparkBatchWriter with Product with Serializable

A SparkBatchWriter that writes to PostgreSQL using upserts (INSERT ON CONFLICT)

sqlSinkModel

Model for the upsert operations

Linear Supertypes
Serializable, Serializable, Product, Equals, SparkBatchWriter, PostgreSQLSparkBaseWriter, JDBCConnectionInfoProvider, JDBCPooledConnectionSupport, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. PostgreSQLSparkBatchWriter
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. SparkBatchWriter
  7. PostgreSQLSparkBaseWriter
  8. JDBCConnectionInfoProvider
  9. JDBCPooledConnectionSupport
  10. AnyRef
  11. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PostgreSQLSparkBatchWriter(sqlSinkModel: SQLSinkModel)

    Permalink

    sqlSinkModel

    Model for the upsert operations

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. def closePool(): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    JDBCPooledConnectionSupport

  7. def createConnection(): Connection

    Permalink
    Attributes
    protected
    Definition Classes
    PostgreSQLSparkBaseWriter

  8. def createConnectionFactory: () ⇒ Connection

    Permalink
    Definition Classes
    JDBCPooledConnectionSupport

  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  10. def fetchMetadata(table: String): TableMetadata

    Permalink
    Attributes
    protected
    Definition Classes
    PostgreSQLSparkBaseWriter

  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. def getConnectionActiveSize: Int

    Permalink
    Attributes
    protected
    Definition Classes
    JDBCPooledConnectionSupport

  14. def getDriver: String

    Permalink
    Definition Classes
    PostgreSQLSparkBaseWriter → JDBCConnectionInfoProvider

  15. def getMetadataFetcherService(): JDBCMetadataFetcherService

    Permalink
    Attributes
    protected
    Definition Classes
    PostgreSQLSparkBaseWriter

  16. def getPoolSize: Int

    Permalink
    Definition Classes
    PostgreSQLSparkBaseWriter → JDBCPooledConnectionSupport

  17. def getProperties: Properties

    Permalink
    Definition Classes
    PostgreSQLSparkBaseWriter → JDBCConnectionInfoProvider

  18. def getUrl: String

    Permalink
    Definition Classes
    PostgreSQLSparkBaseWriter → JDBCConnectionInfoProvider

  19. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  20. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  21. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  23. val sqlSinkModel: SQLSinkModel

    Permalink

    Model for the upsert operations

    Model for the upsert operations

    Definition Classes
    PostgreSQLSparkBatchWriter → PostgreSQLSparkBaseWriter

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  25. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. def write(df: DataFrame): Unit

    Permalink
    Definition Classes
    PostgreSQLSparkBatchWriter → SparkBatchWriter

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from SparkBatchWriter

Inherited from PostgreSQLSparkBaseWriter

Inherited from JDBCConnectionInfoProvider

Inherited from JDBCPooledConnectionSupport

Inherited from AnyRef

Inherited from Any

Ungrouped