Package

net.snowflake.spark

snowflake

Permalink

package snowflake

Visibility
  1. Public
  2. All

Type Members

  1. class DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider with StreamSinkProvider

    Permalink

    Snowflake Source implementation for Spark SQL Major TODO points:

    Snowflake Source implementation for Spark SQL Major TODO points:

    • Add support for compression Snowflake->Spark
    • Add support for using Snowflake Stage files, so the user doesn't need to provide AWS passwords
    • Add support for VARIANT
  2. case class FailedFileList(storage: CloudStorage, conn: Connection, fileIndex: Int = 0, files: Option[HashSet[String]] = None) extends IngestContext with Product with Serializable

    Permalink
  3. sealed trait IngestContext extends AnyRef

    Permalink
  4. case class IngestedFileList(storage: CloudStorage, conn: Connection, failedFileList: Option[FailedFileList] = None, ingestList: Option[List[(String, Long)]] = None) extends IngestContext with Product with Serializable

    Permalink
  5. class SnowflakeConnectorException extends Exception

    Permalink
  6. class SnowflakeIngestService extends AnyRef

    Permalink
  7. class SnowflakePushdownException extends SnowflakeConnectorException

    Permalink
  8. class SnowflakeSink extends Sink

    Permalink

Value Members

  1. object CSVConverter

    Permalink
  2. object DefaultSnowflakeWriter extends SnowflakeWriter

    Permalink
  3. object FSType extends Enumeration

    Permalink
  4. object IngestContextManager

    Permalink
  5. object JsonConverter

    Permalink
  6. object Parameters

    Permalink

    All user-specifiable parameters for spark-snowflake, along with their validation rules and defaults.

  7. object SnowflakeConnectorUtils

    Permalink

    Connector utils, including what needs to be invoked to enable pushdowns.

  8. object SnowflakeIngestConnector

    Permalink
  9. object SnowflakeTelemetry

    Permalink
  10. object TelemetryTypes extends Enumeration

    Permalink
  11. object Utils

    Permalink

    Various arbitrary helper functions

  12. package io

    Permalink

    Interface to IO component

  13. package pushdowns

    Permalink
  14. package s3upload

    Permalink

Ungrouped