io.github.spark_redshift_community.spark.redshift
Input format for text records saved with in-record delimiter and newline characters escaped.
For example, a record containing two fields: "a\n" and "|b\\" saved with delimiter | should be the following:
"a\n"
"|b\\"
|
a\\\n|\\|b\\\\\n
, where the in-record |, \r, \n, and \\ characters are escaped by \\. Users can configure the delimiter via RedshiftInputFormat$#KEY_DELIMITER. Its default value RedshiftInputFormat$#DEFAULT_DELIMITER is set to match Redshift's UNLOAD with the ESCAPE option:
\r
\n
\\
UNLOAD ('select_statement') TO 's3://object_path_prefix' ESCAPE
org.apache.spark.SparkContext#newAPIHadoopFile
Input format for text records saved with in-record delimiter and newline characters escaped.
For example, a record containing two fields:
"a\n"
and"|b\\"
saved with delimiter|
should be the following:, where the in-record
|
,\r
,\n
, and\\
characters are escaped by\\
. Users can configure the delimiter via RedshiftInputFormat$#KEY_DELIMITER. Its default value RedshiftInputFormat$#DEFAULT_DELIMITER is set to match Redshift's UNLOAD with the ESCAPE option:org.apache.spark.SparkContext#newAPIHadoopFile