org.apache.spark.sql.SparkSession
Sets a name for the application, which will be shown in the Spark web UI.
Sets a name for the application, which will be shown in the Spark web UI. If no application name is set, a randomly generated name will be used.
2.0.0
Sets a list of config options based on the given SparkConf
.
Sets a list of config options based on the given SparkConf
.
2.0.0
Sets a config option.
Sets a config option. Options set using this method are automatically propagated to
both SparkConf
and SparkSession's own configuration.
2.0.0
Sets a config option.
Sets a config option. Options set using this method are automatically propagated to
both SparkConf
and SparkSession's own configuration.
2.0.0
Sets a config option.
Sets a config option. Options set using this method are automatically propagated to
both SparkConf
and SparkSession's own configuration.
2.0.0
Sets a config option.
Sets a config option. Options set using this method are automatically propagated to
both SparkConf
and SparkSession's own configuration.
2.0.0
Enables Hive support, including connectivity to a persistent Hive metastore, support for Hive serdes, and Hive user-defined functions.
Enables Hive support, including connectivity to a persistent Hive metastore, support for Hive serdes, and Hive user-defined functions.
2.0.0
Gets an existing SparkSession or, if there is no existing one, creates a new one based on the options set in this builder.
Gets an existing SparkSession or, if there is no existing one, creates a new one based on the options set in this builder.
This method first checks whether there is a valid thread-local SparkSession, and if yes, return that one. It then checks whether there is a valid global default SparkSession, and if yes, return that one. If no valid global default SparkSession exists, the method creates a new SparkSession and assigns the newly created SparkSession as the global default.
In case an existing SparkSession is returned, the config options specified in this builder will be applied to the existing SparkSession.
2.0.0
Sets the Spark master URL to connect to, such as "local" to run locally, "local[4]" to run locally with 4 cores, or "spark://master:7077" to run on a Spark standalone cluster.
Sets the Spark master URL to connect to, such as "local" to run locally, "local[4]" to run locally with 4 cores, or "spark://master:7077" to run on a Spark standalone cluster.
2.0.0
Inject extensions into the SparkSession.
Inject extensions into the SparkSession. This allows a user to add Analyzer rules, Optimizer rules, Planning Strategies or a customized parser.
2.2.0
Builder for SparkSession.