org.apache.spark.sql.execution
Used to plan the aggregate operator for expressions based on the AggregateFunction2 interface.
Strategy to convert FlatMapGroupsWithState logical operator to physical operator in streaming plans.
Select the proper physical plan for join based on joining keys and size of logical plan.
Plans special cases of limit operators.
Used to plan aggregation queries that are computed incrementally as part of a StreamingQuery.
Used to plan the streaming deduplicate operator.
This strategy is just for explaining Dataset/DataFrame created by spark.readStream.
Override to add extra planning strategies to the planner.
Override to add extra planning strategies to the planner. These strategies are tried after the strategies defined in ExperimentalMethods, and before the regular strategies.
Used to build table scan operators where complex projection and filtering are done using separate physical operators.
Used to build table scan operators where complex projection and filtering are done using separate physical operators. This function returns the given scan operator with Project and Filter nodes added only when needed. For example, a Project operator is only used when the final desired output requires complex expressions to be evaluated or when columns can be further eliminated out after filtering has been done.
The prunePushedDownFilters parameter is used to remove those filters that can be optimized
away by the filter pushdown optimization.
The required attributes for both filtering and expression evaluation are passed to the
provided scanBuilder function so that it can avoid unnecessary column materialization.