postgresql

Type Members

1. case class ColumnMetadata(name: String, index: Int, typeNumber: Int, typeName: String, nullable: Boolean) extends Product with Serializable

   

2. trait JDBCConnectionInfoProvider extends AnyRef

   

3. trait JDBCMetadataFetcherService extends Logging

   

   Service for fetching metadata for a table using JDBC.

   Service for fetching metadata for a table using JDBC.

   No attempt at caching metadata is made, as such frequent invocations are to be avoided and the metadata should be cached/reused by the caller.

4. class JDBCMetadataFetcherServiceImpl extends JDBCMetadataFetcherService

   

   Service for fetching metadata for a table using JDBC.

   Service for fetching metadata for a table using JDBC.

   No attempt at caching metadata is made, as such frequent invocations are to be avoided and the metadata should be cached/reused by the caller.

5. trait JDBCPooledConnectionSupport extends AnyRef

   

   Provides support for pooled JDBC connections using DBCP.

6. class PostgreSQLConsumerSparkPlugin extends WaspConsumersSparkPlugin with Logging

   

   A WASP Consumers Spark plugin to write to PostgreSQL via batch and streaming, with support for INSERT ON CONFLICT operations, connection pooling, batching and transactions.

7. trait PostgreSQLSparkBaseWriter extends JDBCPooledConnectionSupport with JDBCConnectionInfoProvider

   

   Base class for writers that write to PostgreSQL using upserts (INSERT ON CONFLICT)

8. case class PostgreSQLSparkBatchWriter(sqlSinkModel: SQLSinkModel) extends PostgreSQLSparkBaseWriter with SparkBatchWriter with Product with Serializable

   

   A SparkBatchWriter that writes to PostgreSQL using upserts (INSERT ON CONFLICT)

   A SparkBatchWriter that writes to PostgreSQL using upserts (INSERT ON CONFLICT)

   sqlSinkModel

   Model for the upsert operations

9. case class PostgreSQLSparkStructuredStreamingWriter(sqlSinkModel: SQLSinkModel) extends PostgreSQLSparkBaseWriter with SparkStructuredStreamingWriter with Product with Serializable

   

   A SparkStructuredStreamingWriter that writes to PostgreSQL using upserts (INSERT ON CONFLICT)

   A SparkStructuredStreamingWriter that writes to PostgreSQL using upserts (INSERT ON CONFLICT)

   sqlSinkModel

   Model for the upsert operations

10. trait PostgreSQLUpsertGenerationSupport extends AnyRef

    

11. class PostgreSQLUpsertWriter extends PostgreSQLUpsertGenerationSupport with Logging

    

12. class TableMetadata extends Serializable