Packages

object DataWritingCommand

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DataWritingCommand
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def assertEmptyRootPath(tablePath: URI, saveMode: SaveMode, hadoopConf: Configuration): Unit

    When execute CTAS operators, and the location is not empty, throw AnalysisException.

    When execute CTAS operators, and the location is not empty, throw AnalysisException. For CTAS, the SaveMode is always ErrorIfExists

    tablePath

    Table location.

    saveMode

    Save mode of the table.

    hadoopConf

    Configuration.

  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. def logicalPlanOutputWithNames(query: LogicalPlan, names: Seq[String]): Seq[Attribute]

    Returns output attributes with provided names.

    Returns output attributes with provided names. The length of provided names should be the same of the length of LogicalPlan.output.

  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. def propogateMetrics(sparkContext: SparkContext, command: DataWritingCommand, metrics: Map[String, SQLMetric]): Unit

    When execute CTAS operators, Spark will use InsertIntoHadoopFsRelationCommand or InsertIntoHiveTable command to write data, they both inherit metrics from DataWritingCommand, but after running InsertIntoHadoopFsRelationCommand or InsertIntoHiveTable, we only update metrics in these two command through BasicWriteJobStatsTracker, we also need to propogate metrics to the command that actually calls InsertIntoHadoopFsRelationCommand or InsertIntoHiveTable.

    When execute CTAS operators, Spark will use InsertIntoHadoopFsRelationCommand or InsertIntoHiveTable command to write data, they both inherit metrics from DataWritingCommand, but after running InsertIntoHadoopFsRelationCommand or InsertIntoHiveTable, we only update metrics in these two command through BasicWriteJobStatsTracker, we also need to propogate metrics to the command that actually calls InsertIntoHadoopFsRelationCommand or InsertIntoHiveTable.

    sparkContext

    Current SparkContext.

    command

    Command to execute writing data.

    metrics

    Metrics of real DataWritingCommand.

  18. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped