org.apache.spark.sql.execution.datasources
OutputWriterFactory
Related Doc:
package datasources
Returns the file extension to be used when writing files out.
When writing to a HadoopFsRelation, this method gets called by each task on executor side to instantiate new OutputWriters.
When writing to a HadoopFsRelation, this method gets called by each task on executor side to instantiate new OutputWriters.
Path to write the file.
Schema of the rows to be written. Partition columns are not included in the schema if the relation being written is partitioned.
The Hadoop MapReduce task context.
A factory that produces OutputWriters. A new OutputWriterFactory is created on driver side for each write job issued when writing to a HadoopFsRelation, and then gets serialized to executor side to create actual OutputWriters on the fly.