Package

com.databricks.spark

redshift

Permalink

package redshift

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. redshift
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Type Members

  1. class DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider

    Permalink

    Redshift Source implementation for Spark SQL

  2. implicit class RedshiftContext extends AnyRef

    Permalink

    Wrapper of SQLContext that provide redshiftFile method.

  3. class RedshiftInputFormat extends FileInputFormat[Long, Array[String]]

    Permalink

    Input format for text records saved with in-record delimiter and newline characters escaped.

    Input format for text records saved with in-record delimiter and newline characters escaped.

    For example, a record containing two fields: "a\n" and "|b\\" saved with delimiter | should be the following:

    a\\\n|\\|b\\\\\n

    , where the in-record |, \r, \n, and \\ characters are escaped by \\. Users can configure the delimiter via RedshiftInputFormat$#KEY_DELIMITER. Its default value RedshiftInputFormat$#DEFAULT_DELIMITER is set to match Redshift's UNLOAD with the ESCAPE option:

    UNLOAD ('select_statement')
    TO 's3://object_path_prefix'
    ESCAPE
    See also

    org.apache.spark.SparkContext#newAPIHadoopFile

Value Members

  1. object DefaultRedshiftWriter extends RedshiftWriter

    Permalink
  2. object RedshiftInputFormat

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped