package plugin
Type Members
-
trait
DriverPlugin extends AnyRef
:: DeveloperApi :: Driver component of a
SparkPlugin
.:: DeveloperApi :: Driver component of a
SparkPlugin
.- Since
3.0.0
-
trait
ExecutorPlugin extends AnyRef
:: DeveloperApi :: Executor component of a
SparkPlugin
.:: DeveloperApi :: Executor component of a
SparkPlugin
.- Since
3.0.0
-
trait
PluginContext extends AnyRef
:: DeveloperApi :: Context information and operations for plugins loaded by Spark.
:: DeveloperApi :: Context information and operations for plugins loaded by Spark.
An instance of this class is provided to plugins in their initialization method. It is safe for plugins to keep a reference to the instance for later use (for example, to send messages to the plugin's driver component).
Context instances are plugin-specific, so metrics and messages are tied each plugin. It is not possible for a plugin to directly interact with other plugins.
- Since
3.0.0
-
trait
SparkPlugin extends AnyRef
:: DeveloperApi :: A plugin that can be dynamically loaded into a Spark application.
:: DeveloperApi :: A plugin that can be dynamically loaded into a Spark application.
Plugins can be loaded by adding the plugin's class name to the appropriate Spark configuration. Check the Spark monitoring guide for details.
Plugins have two optional components: a driver-side component, of which a single instance is created per application, inside the Spark driver. And an executor-side component, of which one instance is created in each executor that is started by Spark. Details of each component can be found in the documentation for
DriverPlugin
andExecutorPlugin
.- Since
3.0.0