A relation produced by applying func
to each partition of the child
, concatenating the
resulting columns at the end of the input row.
A logical plan node with a left and right child.
A hint for the optimizer that we should broadcast the child
if used in a join operator.
A relation produced by applying func
to each grouping key and associated values from left and
right children.
A logical node that represents a non-query command to be executed by the system.
Cube is a syntactic sugar for GROUPING SETS, and will be transformed to GroupingSets, and eventually will be transformed to Aggregate(.
Returns a new logical plan that dedups input rows.
Apply a number of projections to every input row, hence we will get multiple output rows for a input row.
Applies a Generator to a stream of input rows, combining the output of each into a new stream of rows.
A GROUP BY clause with GROUPING SETS can generate a result set equivalent to generated by a UNION ALL of multiple simple GROUP BY clauses.
A logical plan node with no children.
Applies func to each unique group in child
, based on the evaluation of groupingAttributes
.
A relation produced by applying func
to each partition of the child
.
Performs a physical redistribution of the data.
Returns a new RDD that has exactly numPartitions
partitions.
This method repartitions data using Expressions into numPartitions
, and receives
information about the number of partitions during execution.
Rollup is a syntactic sugar for GROUPING SETS, and will be transformed to GroupingSets, and eventually will be transformed to Aggregate(.
Sample the dataset.
A placeholder for implementation specific input and output properties when passing data to a script.
Transforms the input by forking and running the specified script.
A logical plan node with single child.
A container for holding named common table expressions (CTEs) and a query plan.
Factory for constructing new AppendColumn
nodes.
Factory for constructing new CoGroup
nodes.
Factory for constructing new MapGroups
nodes.
A relation with one row.