ExpressionEncoder

Instance Constructors

new ExpressionEncoder(schema: StructType, flat: Boolean, toRowExpressions: Seq[Expression], fromRowExpression: Expression, clsTag: ClassTag[T])

schema
The schema after converting T to a Spark SQL row.
toRowExpressions
A set of expressions, one for each top-level field that can be used to extract the values from a raw object into an InternalRow.
fromRowExpression
An expression that will construct an object given an InternalRow.
clsTag
A classtag for T.

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def assertUnresolved(): Unit

The process of resolution to a given schema throws away information about where a given field is being bound by ordinal instead of by name.
The process of resolution to a given schema throws away information about where a given field is being bound by ordinal instead of by name. This method checks to make sure this process has not been done already in places where we plan to do later composition of encoders.
val attrs: Seq[String]

Attributes
protected
def bind(schema: Seq[Attribute]): ExpressionEncoder[T]

Returns a copy of this encoder where the expressions used to construct an object from an input row have been bound to the ordinals of the given schema.
Returns a copy of this encoder where the expressions used to construct an object from an input row have been bound to the ordinals of the given schema. Note that you need to first call resolve before bind.
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
val clsTag: ClassTag[T]

A classtag for T.
A classtag for T.

Definition Classes
ExpressionEncoder → Encoder
def defaultBinding: ExpressionEncoder[T]

Returns this encoder where it has been bound to its own output (i.e.
Returns this encoder where it has been bound to its own output (i.e. no remaping of columns is performed).
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
val flat: Boolean
def fromRow(row: InternalRow): T

Returns an object of type T, extracting the required values from the provided row.
Returns an object of type T, extracting the required values from the provided row. Note that you must resolve and bind an encoder to a specific schema before you can call this function.
val fromRowExpression: Expression

An expression that will construct an object given an InternalRow.
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def resolve(schema: Seq[Attribute], outerScopes: ConcurrentMap[String, AnyRef]): ExpressionEncoder[T]

Returns a new copy of this encoder, where the expressions used by fromRow are resolved to the given schema.
val schema: StructType

The schema after converting T to a Spark SQL row.
The schema after converting T to a Spark SQL row.

Definition Classes
ExpressionEncoder → Encoder
val schemaString: String

Attributes
protected
def shift(delta: Int): ExpressionEncoder[T]

Returns a new encoder with input columns shifted by delta ordinals
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toRow(t: T): InternalRow

Returns an encoded version of t as a Spark SQL row.
Returns an encoded version of t as a Spark SQL row. Note that multiple calls to toRow are allowed to return the same actual InternalRow object. Thus, the caller should copy the result before making another call if required.
val toRowExpressions: Seq[Expression]

A set of expressions, one for each top-level field that can be used to extract the values from a raw object into an InternalRow.
def toString(): String

Definition Classes
ExpressionEncoder → AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Docs: object ExpressionEncoder | package encoders

case class ExpressionEncoder[T](schema: StructType, flat: Boolean, toRowExpressions: Seq[Expression], fromRowExpression: Expression, clsTag: ClassTag[T]) extends Encoder[T] with Product with Serializable

Instance Constructors

new ExpressionEncoder(schema: StructType, flat: Boolean, toRowExpressions: Seq[Expression], fromRowExpression: Expression, clsTag: ClassTag[T])

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def assertUnresolved(): Unit

val attrs: Seq[String]

def bind(schema: Seq[Attribute]): ExpressionEncoder[T]

def clone(): AnyRef

val clsTag: ClassTag[T]

def defaultBinding: ExpressionEncoder[T]

final def eq(arg0: AnyRef): Boolean

def finalize(): Unit

val flat: Boolean

def fromRow(row: InternalRow): T

val fromRowExpression: Expression

final def getClass(): Class[_]

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def resolve(schema: Seq[Attribute], outerScopes: ConcurrentMap[String, AnyRef]): ExpressionEncoder[T]

val schema: StructType

val schemaString: String

def shift(delta: Int): ExpressionEncoder[T]

final def synchronized[T0](arg0: ⇒ T0): T0

def toRow(t: T): InternalRow

val toRowExpressions: Seq[Expression]

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Product

Inherited from Equals

Inherited from Encoder[T]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped