The arguments parameters that will be parsed for every jobs launched
The arguments parameters that will be parsed for every jobs launched
An optional configuration file related to our application.
An optional configuration file related to our application.
Note: On the Application side, you can fill this parameter using the loadConfig function from pureconfig
The configuration for the different jobs we have.
The configuration for the different jobs we have.
The output tables and jobs to run
The output tables and jobs to run
The configuration related to the different input sources we can use.
The configuration related to the different input sources we can use.
The spark parameters that will be used on the remote cluster we submit our job on.
The spark parameters that will be used on the remote cluster we submit our job on.
The spark parameters that will be used when running Unit/Integration tests on our local machine.
The spark parameters that will be used when running Unit/Integration tests on our local machine.