trait ConnectConversions extends AnyRef

Conversions from sql interfaces to the Connect specific implementation.

This class is mainly used by the implementation. It is also meant to be used by extension developers.

We provide both a trait and an object. The trait is useful in situations where an extension developer needs to use these conversions in a project covering multiple Spark versions. They can create a shim for these conversions, the Spark 4+ version of the shim implements this trait, and shims for older versions do not.

Annotations
@DeveloperApi()
Linear Supertypes
AnyRef, Any
Known Subclasses
ConnectConversions
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ConnectConversions
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Type Members

  1. implicit class ColumnConstructorExt extends AnyRef

    Implicit helper that makes it easy to construct a Column from an Expression or an Expression builder.

    Implicit helper that makes it easy to construct a Column from an Expression or an Expression builder. This allows developers to create a Column in the same way as in earlier versions of Spark (before 4.0).

    Annotations
    @DeveloperApi()

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. implicit def castToImpl[K, V](kvds: sql.KeyValueGroupedDataset[K, V]): KeyValueGroupedDataset[K, V]
  6. implicit def castToImpl(rgds: sql.RelationalGroupedDataset): RelationalGroupedDataset
  7. implicit def castToImpl[T](ds: sql.Dataset[T]): Dataset[T]
  8. implicit def castToImpl(session: sql.SparkSession): SparkSession
  9. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  10. def column(f: (Builder) => Unit): Column

    Create a Column using a function that manipulates an proto.Expression.Builder.

    Create a Column using a function that manipulates an proto.Expression.Builder.

    This method is meant to be used by Connect plugins. We do not guarantee any compatibility between (minor) versions.

    Annotations
    @DeveloperApi()
  11. def column(expr: Expression): Column

    Create a Column from a proto.Expression

    Create a Column from a proto.Expression

    This method is meant to be used by Connect plugins. We do not guarantee any compatibility between (minor) versions.

    Annotations
    @DeveloperApi()
  12. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  13. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  14. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  15. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  16. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  20. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  21. def toString(): String
    Definition Classes
    AnyRef → Any
  22. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  23. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  24. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from AnyRef

Inherited from Any

Ungrouped