metastore

Type Members

1. trait ImpalaDBConnector extends HadoopDBConnector

   

   Impala trait that implements the Impala-specific HadoopDBConnector functions

2. case class ImpalaDummyConnector(context: SparkFlowContext) extends ImpalaDBConnector with Product with Serializable

   

   A dummy Impala database connector that does not submit the DDLs but collects all that have been submitted in a List.

   A dummy Impala database connector that does not submit the DDLs but collects all that have been submitted in a List. This is useful for testing or using in flows where you wish to collect the DDLs and run them manually.

   context

   The flow context object containing the SparkSession and FileSystem

3. case class ImpalaJDBCConnector(context: SparkFlowContext, jdbcString: String, properties: Properties = new java.util.Properties(), secureProperties: Map[String, String] = Map.empty) extends ImpalaDBConnector with JDBCConnector with Product with Serializable

   

   Impala Database connector that is constructed from a JDBC connection string

   Impala Database connector that is constructed from a JDBC connection string

   context

   The flow context object containing the SparkSession and FileSystem

   jdbcString

   the JDBC connection string

   properties

   Key value pairs passed as connection arguments to the DriverManager during connection

   secureProperties

   Key value set of parameters used to get parameter values for JDBC properties from a secure jceks file at CredentialProviderFactory.CREDENTIAL_PROVIDER_PATH. First value is the key of the parameter in the jceks file and the second parameter is the key of the parameter you want in jdbc properties

4. case class ImpalaWaimakJDBCConnector(context: SparkFlowContext, database: String, cluster: String = "default", properties: Properties = new java.util.Properties(), secureProperties: Map[String, String] = Map.empty) extends ImpalaDBConnector with WaimakJDBCConnector with Product with Serializable

   

   Impala Database connector that is constructed using the Waimak JDBC template in spark conf

   Impala Database connector that is constructed using the Waimak JDBC template in spark conf

   context

   The flow context object containing the SparkSession and FileSystem

   database

   name of the database to connect to

   cluster

   the cluster label in the JDBC template string

   properties

   Key value pairs passed as connection arguments to the DriverManager during connection

   secureProperties

   Key value set of parameters used to get parameter values for JDBC properties from a secure jceks file at CredentialProviderFactory.CREDENTIAL_PROVIDER_PATH. First value is the key of the parameter in the jceks file and the second parameter is the key of the parameter you want in jdbc properties