Package

bigdata

Permalink

package bigdata

Linear Supertypes

AnyRef, Any

Ordering

Alphabetic
By Inheritance

Inherited

bigdata
AnyRef
Any

Hide All
Show All

Visibility

Public
All

Type Members

type ApplicationConf[T] = Option[ApplicationConfData[T]]
case class DatePattern(pattern: String) extends Product with Serializable
trait ETL[U, V] extends AnyRef

A trait defining the functions for an ETL operation.
type EitherRP = Either[ExceptionHandler, SourcePipeline]
type ExceptionWithMessage[T <: ExceptionHandler] = (String) ⇒ T
type ExecutionPlans = Map[String, ExecutionPlan]
type PureConfigLoaded[T] = Either[ConfigReaderFailures, T]
type Sources = Map[String, SourcePipeline]
abstract class SparkApplication[U, V] extends SparkSessionProvider with ETL[U, V] with LoggerProvider

A class representing a submitted Spark application.

Value Members

object ETL

The different data classes used in our ETL operation.
object SparkApplication
object appImplicits

Implicits used in runnable applications
package args
package config
val datePattern: DatePattern
package example
package exceptions
object implicits

Various implicits for the project
package providers
package testing
package transform
package utils

Inherited from AnyRef

Inherited from Any

Ungrouped