app

Type Members

1. class DefaultSmartDataLakeBuilder extends SmartDataLakeBuilder

   

   Default Smart Data Lake Command Line Application.

   Default Smart Data Lake Command Line Application.

   Implementation Note: This must be a class and not an object in order to be found by reflection in DatabricksSmartDataLakeBuilder

2. case class GlobalConfig(kryoClasses: Option[Seq[String]] = None, sparkOptions: Option[Map[String, String]] = None, enableHive: Boolean = true) extends Product with Serializable

   

3. abstract class SmartDataLakeBuilder extends SmartDataLakeLogger

   

   Abstract Smart Data Lake Command Line Application.

4. case class SmartDataLakeBuilderConfig(feedSel: String = null, applicationName: Option[String] = None, configuration: Option[String] = None, master: Option[String] = None, deployMode: Option[String] = None, username: Option[String] = None, kerberosDomain: Option[String] = None, keytabPath: Option[File] = None, partitionValues: Option[Seq[PartitionValues]] = None, multiPartitionValues: Option[Seq[PartitionValues]] = None, parallelism: Int = 1, overrideJars: Option[Seq[String]] = None) extends Product with Serializable

   

   This case class represents a default configuration for the App.

   This case class represents a default configuration for the App. It is populated by parsing command-line arguments. It also specifies default values.

   feedSel

   Regex pattern to select the feed to execute.

   applicationName

   Application name.

   configuration

   A configuration file or a directory containing configuration files.

   master

   The Spark master URL passed to SparkContext when in local mode.

   deployMode

   The Spark deploy mode passed to SparkContext when in local mode.

   username

   Kerberos user name (username@kerberosDomain) for local mode.

   kerberosDomain

   Kerberos domain (username@kerberosDomain) for local mode.

   keytabPath

   Path to Kerberos keytab file for local mode.