package redshift
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- redshift
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- All
Type Members
-
class
DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider
Redshift Source implementation for Spark SQL
-
implicit
class
RedshiftContext extends AnyRef
Wrapper of SQLContext that provide
redshiftFile
method. -
class
RedshiftInputFormat extends FileInputFormat[Long, Array[String]]
Input format for text records saved with in-record delimiter and newline characters escaped.
Input format for text records saved with in-record delimiter and newline characters escaped.
For example, a record containing two fields:
"a\n"
and"|b\\"
saved with delimiter|
should be the following:a\\\n|\\|b\\\\\n
, where the in-record
|
,\r
,\n
, and\\
characters are escaped by\\
. Users can configure the delimiter via RedshiftInputFormat$#KEY_DELIMITER. Its default value RedshiftInputFormat$#DEFAULT_DELIMITER is set to match Redshift's UNLOAD with the ESCAPE option:UNLOAD ('select_statement') TO 's3://object_path_prefix' ESCAPE
- See also
org.apache.spark.SparkContext#newAPIHadoopFile
- class SerializableConfiguration extends Serializable with KryoSerializable
- class SetAccumulator[T] extends AccumulatorV2[T, Set[T]]
Value Members
- object DefaultRedshiftWriter extends RedshiftWriter
- object RedshiftInputFormat