: stage
: Storage Handler
in the form [SinkType:[configName:]]viewName
(SinkType, configName, viewName)
Partition a dataset using dataset columns.
Partition a dataset using dataset columns. To partition the dataset using the ingestion time, use the reserved column names :
: Input dataset
: list of columns to use for partitioning.
The Spark session used to run this job
Just to force any job to implement its entry point using within the "run" method
Just to force any job to implement its entry point using within the "run" method
: Spark Dataframe for Spark Jobs None otherwise