Class

org.apache.spark.sql.execution.streaming

IncrementalExecution

Related Doc: package streaming

Permalink

class IncrementalExecution extends QueryExecution

A variant of QueryExecution that allows the execution of the given LogicalPlan plan incrementally. Possibly preserving state in between each execution.

Linear Supertypes
QueryExecution, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. IncrementalExecution
  2. QueryExecution
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. lazy val analyzed: LogicalPlan

    Permalink
    Definition Classes
    QueryExecution
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def assertAnalyzed(): Unit

    Permalink
    Definition Classes
    QueryExecution
  7. def assertSupported(): Unit

    Permalink

    No need assert supported, as this check has already been done

    No need assert supported, as this check has already been done

    Definition Classes
    IncrementalExecutionQueryExecution
  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. val currentBatchId: Long

    Permalink
  10. object debug

    Permalink

    A special namespace for commands that can be used to debug query execution.

    A special namespace for commands that can be used to debug query execution.

    Definition Classes
    QueryExecution
  11. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  13. lazy val executedPlan: SparkPlan

    Permalink
    Definition Classes
    QueryExecution
  14. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  16. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  17. def hiveResultString(): Seq[String]

    Permalink

    Returns the result as a hive compatible sequence of strings.

    Returns the result as a hive compatible sequence of strings. For native commands, the execution is simply passed back to Hive.

    Definition Classes
    QueryExecution
  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  19. val logical: LogicalPlan

    Permalink
    Definition Classes
    QueryExecution
  20. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  21. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  22. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  23. lazy val optimizedPlan: LogicalPlan

    Permalink
    Definition Classes
    QueryExecution
  24. def planner: SparkPlanner

    Permalink
    Definition Classes
    IncrementalExecutionQueryExecution
  25. def preparations: Seq[Rule[SparkPlan]]

    Permalink

    A sequence of rules that will be applied in order to the physical plan before execution.

    A sequence of rules that will be applied in order to the physical plan before execution.

    Definition Classes
    IncrementalExecutionQueryExecution
  26. def prepareForExecution(plan: SparkPlan): SparkPlan

    Permalink

    Prepares a planned SparkPlan for execution by inserting shuffle operations and internal row format conversions as needed.

    Prepares a planned SparkPlan for execution by inserting shuffle operations and internal row format conversions as needed.

    Attributes
    protected
    Definition Classes
    QueryExecution
  27. def simpleString: String

    Permalink
    Definition Classes
    QueryExecution
  28. lazy val sparkPlan: SparkPlan

    Permalink
    Definition Classes
    QueryExecution
  29. val sparkSession: SparkSession

    Permalink
    Definition Classes
    QueryExecution
  30. val state: Rule[SparkPlan]

    Permalink

    Locates save/restore pairs surrounding aggregation.

  31. val stateStrategy: List[StatefulAggregationStrategy]

    Permalink
  32. def stringOrError[A](f: ⇒ A): String

    Permalink
    Attributes
    protected
    Definition Classes
    QueryExecution
  33. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  34. lazy val toRdd: RDD[InternalRow]

    Permalink

    Internal version of the RDD.

    Internal version of the RDD. Avoids copies and has no schema

    Definition Classes
    QueryExecution
  35. def toString(): String

    Permalink
    Definition Classes
    QueryExecution → AnyRef → Any
  36. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  37. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  38. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  39. lazy val withCachedData: LogicalPlan

    Permalink
    Definition Classes
    QueryExecution

Inherited from QueryExecution

Inherited from AnyRef

Inherited from Any

Ungrouped