Class

io.smartdatalake.app

SmartDataLakeBuilderConfig

Related Doc: package app

Permalink

case class SmartDataLakeBuilderConfig(feedSel: String = null, applicationName: Option[String] = None, configuration: Option[String] = None, master: Option[String] = None, deployMode: Option[String] = None, username: Option[String] = None, kerberosDomain: Option[String] = None, keytabPath: Option[File] = None, partitionValues: Option[Seq[PartitionValues]] = None, multiPartitionValues: Option[Seq[PartitionValues]] = None, parallelism: Int = 1, overrideJars: Option[Seq[String]] = None) extends Product with Serializable

This case class represents a default configuration for the App. It is populated by parsing command-line arguments. It also specifies default values.

feedSel

Regex pattern to select the feed to execute.

applicationName

Application name.

configuration

A configuration file or a directory containing configuration files.

master

The Spark master URL passed to SparkContext when in local mode.

deployMode

The Spark deploy mode passed to SparkContext when in local mode.

username

Kerberos user name (username@kerberosDomain) for local mode.

kerberosDomain

Kerberos domain (username@kerberosDomain) for local mode.

keytabPath

Path to Kerberos keytab file for local mode.

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SmartDataLakeBuilderConfig
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SmartDataLakeBuilderConfig(feedSel: String = null, applicationName: Option[String] = None, configuration: Option[String] = None, master: Option[String] = None, deployMode: Option[String] = None, username: Option[String] = None, kerberosDomain: Option[String] = None, keytabPath: Option[File] = None, partitionValues: Option[Seq[PartitionValues]] = None, multiPartitionValues: Option[Seq[PartitionValues]] = None, parallelism: Int = 1, overrideJars: Option[Seq[String]] = None)

    Permalink

    feedSel

    Regex pattern to select the feed to execute.

    applicationName

    Application name.

    configuration

    A configuration file or a directory containing configuration files.

    master

    The Spark master URL passed to SparkContext when in local mode.

    deployMode

    The Spark deploy mode passed to SparkContext when in local mode.

    username

    Kerberos user name (username@kerberosDomain) for local mode.

    kerberosDomain

    Kerberos domain (username@kerberosDomain) for local mode.

    keytabPath

    Path to Kerberos keytab file for local mode.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. val applicationName: Option[String]

    Permalink

    Application name.

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. val configuration: Option[String]

    Permalink

    A configuration file or a directory containing configuration files.

  8. val deployMode: Option[String]

    Permalink

    The Spark deploy mode passed to SparkContext when in local mode.

  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  10. val feedSel: String

    Permalink

    Regex pattern to select the feed to execute.

  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. def getPartitionValues: Option[Seq[PartitionValues]]

    Permalink

  14. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  15. val kerberosDomain: Option[String]

    Permalink

    Kerberos domain (username@kerberosDomain) for local mode.

  16. val keytabPath: Option[File]

    Permalink

    Path to Kerberos keytab file for local mode.

  17. val master: Option[String]

    Permalink

    The Spark master URL passed to SparkContext when in local mode.

  18. val multiPartitionValues: Option[Seq[PartitionValues]]

    Permalink

  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. val overrideJars: Option[Seq[String]]

    Permalink

  23. val parallelism: Int

    Permalink

  24. val partitionValues: Option[Seq[PartitionValues]]

    Permalink

  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  26. val username: Option[String]

    Permalink

    Kerberos user name (username@kerberosDomain) for local mode.

  27. def validate(): Unit

    Permalink

  28. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  29. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  30. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped