Type Members

1.  abstract class AbstractTypedColumn[T, U] extends UntypedExpression[T]

   Generic representation of a typed column.

   Generic representation of a typed column. A typed column can either be a TypedAggregate or a frameless.TypedColumn.

   Documentation marked "apache/spark" is thanks to apache/spark Contributors at https://github.com/apache/spark, licensed under Apache v2.0 available at http://www.apache.org/licenses/LICENSE-2.0

   T

   phantom type representing the dataset on which this columns is selected. When T = A with B the selection is on either A or B.

   U

   type of column

2.  trait DropUnitValues[L <: HList] extends DepFn1[L] with Serializable

   Drops fields with Unit type from labelled generic representation of types.

   Drops fields with Unit type from labelled generic representation of types.

   L

   labelled generic representation of type fields

3.  trait FramelessSyntax extends AnyRef
4.  sealed abstract class Job[A] extends AnyRef
5.  trait LowPrioWith extends AnyRef
6.  trait NewInstanceExprs[T <: HList] extends Serializable

   Assists the generation of constructor call parameters from a labelled generic representation.

   Assists the generation of constructor call parameters from a labelled generic representation. As Unit typed fields were removed earlier, we need to put back unit literals in the appropriate positions.

   T

   labelled generic representation of type fields

7.  class RecordEncoder[F, G <: HList, H <: HList] extends TypedEncoder[F]
8.  case class RecordEncoderField(ordinal: Int, name: String, encoder: TypedEncoder[_]) extends Product with Serializable
9.  trait RecordEncoderFields[T <: HList] extends Serializable
10.  sealed class SortedTypedColumn[T, U] extends UntypedExpression[T]
11.  trait SparkDelay[F[_]] extends AnyRef
12.  sealed class TypedAggregate[T, U] extends AbstractTypedColumn[T, U]

    Expression used in agg-like constructions.

13.  sealed class TypedColumn[T, U] extends AbstractTypedColumn[T, U]

    Expression used in select-like constructions.

14.  class TypedDataset[T] extends TypedDatasetForwarded[T]

    TypedDataset is a safer interface for working with Dataset.

    TypedDataset is a safer interface for working with Dataset.

    NOTE: Prefer TypedDataset.create over new TypedDataset unless you know what you are doing.

    Documentation marked "apache/spark" is thanks to apache/spark Contributors at https://github.com/apache/spark, licensed under Apache v2.0 available at http://www.apache.org/licenses/LICENSE-2.0

15.  trait TypedDatasetForwarded[T] extends AnyRef

    This trait implements TypedDataset methods that have the same signature than their Dataset equivalent.

    This trait implements TypedDataset methods that have the same signature than their Dataset equivalent. Each method simply forwards the call to the underlying Dataset.

    Documentation marked "apache/spark" is thanks to apache/spark Contributors at https://github.com/apache/spark, licensed under Apache v2.0 available at http://www.apache.org/licenses/LICENSE-2.0

16.  abstract class TypedEncoder[T] extends Serializable
17.  sealed trait UntypedExpression[T] extends AnyRef
18.  trait With[A, B] extends AnyRef

    Compute the intersection of two types:

    Compute the intersection of two types:

    - With[A, A] = A - With[A, B] = A with B (when A != B)

    This type function is needed to prevent IDEs from infering large types with shape A with A with ... with A. These types could be confusing for both end users and IDE's type checkers.