Spark Project SQL 1.1.0 API

Row

rdd

JavaSchemaRDD ExistingRdd

registerFunction

UDFRegistration

registerRDDAsTable

SQLContext JavaSQLContext

relation

InsertIntoParquetTable ParquetTableScan

repartition

SchemaRDD JavaSchemaRDD

requiredChildDistribution

Aggregate BroadcastHashJoin Distinct GeneratedAggregate HashOuterJoin LeftSemiJoinHash ShuffledHashJoin Sort SparkPlan

result

AggregateEvaluation

resultAttribute

ComputedAggregate EvaluatePython

right

BroadcastHashJoin BroadcastNestedLoopJoin CartesianProduct Except HashJoin HashOuterJoin Intersect LeftSemiJoinBNL LeftSemiJoinHash ShuffledHashJoin

rightKeys

BroadcastHashJoin HashJoin HashOuterJoin LeftSemiJoinHash ShuffledHashJoin