joins

Type Members

1. case class BroadcastHashJoin(leftKeys: Seq[Expression], rightKeys: Seq[Expression], buildSide: BuildSide, left: SparkPlan, right: SparkPlan) extends SparkPlan with BinaryNode with HashJoin with Product with Serializable

   

   :: DeveloperApi :: Performs an inner hash join of two child relations.

   :: DeveloperApi :: Performs an inner hash join of two child relations. When the output RDD of this operator is being constructed, a Spark job is asynchronously started to calculate the values for the broadcasted relation. This data is then placed in a Spark broadcast variable. The streamed relation is not shuffled.

   Annotations

   @DeveloperApi()

2. case class BroadcastLeftSemiJoinHash(leftKeys: Seq[Expression], rightKeys: Seq[Expression], left: SparkPlan, right: SparkPlan) extends SparkPlan with BinaryNode with HashJoin with Product with Serializable

   

   :: DeveloperApi :: Build the right table's join keys into a HashSet, and iteratively go through the left table, to find the if join keys are in the Hash set.

   :: DeveloperApi :: Build the right table's join keys into a HashSet, and iteratively go through the left table, to find the if join keys are in the Hash set.

   Annotations

   @DeveloperApi()

3. case class BroadcastNestedLoopJoin(left: SparkPlan, right: SparkPlan, buildSide: BuildSide, joinType: JoinType, condition: Option[Expression]) extends SparkPlan with BinaryNode with Product with Serializable

   

   :: DeveloperApi ::

   :: DeveloperApi ::

   Annotations

   @DeveloperApi()

4. sealed abstract class BuildSide extends AnyRef

   

   Annotations

   @DeveloperApi()

5. case class CartesianProduct(left: SparkPlan, right: SparkPlan) extends SparkPlan with BinaryNode with Product with Serializable

   

   :: DeveloperApi ::

   :: DeveloperApi ::

   Annotations

   @DeveloperApi()

6. trait HashJoin extends AnyRef

   

7. case class HashOuterJoin(leftKeys: Seq[Expression], rightKeys: Seq[Expression], joinType: JoinType, condition: Option[Expression], left: SparkPlan, right: SparkPlan) extends SparkPlan with BinaryNode with Product with Serializable

   

   :: DeveloperApi :: Performs a hash based outer join for two child relations by shuffling the data using the join keys.

   :: DeveloperApi :: Performs a hash based outer join for two child relations by shuffling the data using the join keys. This operator requires loading the associated partition in both side into memory.

   Annotations

   @DeveloperApi()

8. case class LeftSemiJoinBNL(streamed: SparkPlan, broadcast: SparkPlan, condition: Option[Expression]) extends SparkPlan with BinaryNode with Product with Serializable

   

   :: DeveloperApi :: Using BroadcastNestedLoopJoin to calculate left semi join result when there's no join keys for hash join.

   :: DeveloperApi :: Using BroadcastNestedLoopJoin to calculate left semi join result when there's no join keys for hash join.

   Annotations

   @DeveloperApi()

9. case class LeftSemiJoinHash(leftKeys: Seq[Expression], rightKeys: Seq[Expression], left: SparkPlan, right: SparkPlan) extends SparkPlan with BinaryNode with HashJoin with Product with Serializable

   

   :: DeveloperApi :: Build the right table's join keys into a HashSet, and iteratively go through the left table, to find the if join keys are in the Hash set.

   :: DeveloperApi :: Build the right table's join keys into a HashSet, and iteratively go through the left table, to find the if join keys are in the Hash set.

   Annotations

   @DeveloperApi()

10. case class ShuffledHashJoin(leftKeys: Seq[Expression], rightKeys: Seq[Expression], buildSide: BuildSide, left: SparkPlan, right: SparkPlan) extends SparkPlan with BinaryNode with HashJoin with Product with Serializable

    

    :: DeveloperApi :: Performs an inner hash join of two child relations by first shuffling the data using the join keys.

    :: DeveloperApi :: Performs an inner hash join of two child relations by first shuffling the data using the join keys.

    Annotations

    @DeveloperApi()

11. case class SortMergeJoin(leftKeys: Seq[Expression], rightKeys: Seq[Expression], left: SparkPlan, right: SparkPlan) extends SparkPlan with BinaryNode with Product with Serializable

    

    :: DeveloperApi :: Performs an sort merge join of two child relations.

    :: DeveloperApi :: Performs an sort merge join of two child relations.

    Annotations

    @DeveloperApi()