Packages

class Builder extends Logging

Linear Supertypes
Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Builder
  2. Logging
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new Builder()

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  6. def config(map: Map[String, Any]): Builder

    Sets a config option.

    Sets a config option. Options set using this method are automatically propagated to both SparkConf and SparkSession's own configuration.

    Since

    3.5.0

  7. def config(map: Map[String, Any]): Builder

    Sets a config a map of options.

    Sets a config a map of options. Options set using this method are automatically propagated to the Spark Connect session. Only runtime options are supported.

    Since

    3.5.0

  8. def config(key: String, value: Boolean): Builder

    Sets a config option.

    Sets a config option. Options set using this method are automatically propagated to the Spark Connect session. Only runtime options are supported.

    Since

    3.5.0

  9. def config(key: String, value: Double): Builder

    Sets a config option.

    Sets a config option. Options set using this method are automatically propagated to the Spark Connect session. Only runtime options are supported.

    Since

    3.5.0

  10. def config(key: String, value: Long): Builder

    Sets a config option.

    Sets a config option. Options set using this method are automatically propagated to the Spark Connect session. Only runtime options are supported.

    Since

    3.5.0

  11. def config(key: String, value: String): Builder

    Sets a config option.

    Sets a config option. Options set using this method are automatically propagated to the Spark Connect session. Only runtime options are supported.

    Since

    3.5.0

  12. def create(): SparkSession

    Create a new SparkSession.

    Create a new SparkSession.

    This will always return a newly created session.

    This method will update the default and/or active session if they are not set.

    Since

    3.5.0

  13. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  15. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  16. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  17. def getOrCreate(): SparkSession

    Get or create a SparkSession.

    Get or create a SparkSession.

    If a session exist with the same configuration that is returned instead of creating a new session.

    This method will update the default and/or active session if they are not set. This method will always set the specified configuration options on the session, even when it is not newly created.

    Since

    3.5.0

  18. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  19. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  20. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  21. def interceptor(interceptor: ClientInterceptor): Builder

    Add an interceptor ClientInterceptor to be used during channel creation.

    Add an interceptor ClientInterceptor to be used during channel creation.

    Note that interceptors added last are executed first by gRPC.

    Since

    3.5.0

  22. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  23. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  24. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  25. def logDebug(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  26. def logDebug(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  27. def logError(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  28. def logError(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  29. def logInfo(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  30. def logInfo(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  31. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  32. def logTrace(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  33. def logTrace(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  34. def logWarning(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  35. def logWarning(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  36. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  37. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  38. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  39. def remote(connectionString: String): Builder
  40. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  41. def toString(): String
    Definition Classes
    AnyRef → Any
  42. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  43. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  44. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Deprecated Value Members

  1. def appName(name: String): Builder
    Annotations
    @deprecated
    Deprecated

    appName does not work in Spark Connect

  2. def build(): SparkSession

    Build the SparkSession.

    Build the SparkSession.

    This will always return a newly created session.

    Annotations
    @deprecated
    Deprecated

    (Since version 3.5.0) Please use create() instead.

  3. def enableHiveSupport(): Builder
    Annotations
    @deprecated
    Deprecated

    enableHiveSupport does not work in Spark Connect

  4. def master(master: String): Builder
    Annotations
    @deprecated
    Deprecated

    master does not work in Spark Connect, please use remote instead

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped