metastore

Type Members

1. trait ImpalaDBConnector extends HadoopDBConnector

   

   Impala trait that implements the Impala-specific HadoopDBConnector functions

2. case class ImpalaDummyConnector(sparkSession: SparkSession, forceRecreateTables: Boolean = false) extends ImpalaDBConnector with Product with Serializable

   

   A dummy Impala database connector that does not submit the DDLs but collects all that have been submitted in a List.

   A dummy Impala database connector that does not submit the DDLs but collects all that have been submitted in a List. This is useful for testing or using in flows where you wish to collect the DDLs and run them manually.

   sparkSession

   SparkSession object

3. case class ImpalaJDBCConnector(sparkSession: SparkSession, jdbcString: String, forceRecreateTables: Boolean = false) extends ImpalaDBConnector with JDBCConnector with Product with Serializable

   

   Impala Database connector that is contructed from a JDBC connection string

   Impala Database connector that is contructed from a JDBC connection string

   sparkSession

   SparkSession object

   jdbcString

   the JDBC connection string

4. case class ImpalaWaimakJDBCConnector(sparkSession: SparkSession, database: String, cluster: String = "default", forceRecreateTables: Boolean = false) extends ImpalaDBConnector with WaimakJDBCConnector with Product with Serializable

   

   Impala Database connector that is constructed using the Waimak JDBC template in spark conf

   Impala Database connector that is constructed using the Waimak JDBC template in spark conf

   sparkSession

   SparkSession object

   database

   name of the database to connect to

   cluster

   the cluster label in the JDBC template string