Package

com.vbounyasit.bigdata

config

Permalink

package config

Visibility
  1. Public
  2. All

Type Members

  1. trait ConfigDefinition extends AnyRef

    Permalink

    Everything related to configuration files loading is handled here.

  2. case class ConfigurationsLoader(sparkParamsConf: SparkParamsConf, sourcesConf: SourcesConf, jobsConf: JobsConf) extends Product with Serializable

    Permalink

    A case class representing the different configurations we want to load for our application.

    A case class representing the different configurations we want to load for our application.

    sparkParamsConf

    The Spark parameters used while running the application

    sourcesConf

    The configuration for the pool of sources we want to extract data from

    jobsConf

    The configuration related to our processing jobs

Value Members

  1. object ConfigsExtractor

    Permalink

    Utility functions for extracting error-free data from config data

  2. object ConfigurationsLoader extends Serializable

    Permalink

  3. package data

    Permalink

Ungrouped