MergedParameters

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def checkBucketConfiguration: Boolean

   

   Returns true if bucket lifecycle configuration should be checked

6. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

7. def createPerQueryTempDir(): String

   

   Creates a per-query subdirectory in the rootTempDir, with a random UUID.

8. final def eq(arg0: AnyRef): Boolean

   

   Definition Classes

   AnyRef

9. def extraCopyOptions: String

   

   Extra options to append to the Snowflake COPY command (e.g.

   Extra options to append to the Snowflake COPY command (e.g. "MAXERROR 100").

10. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

11. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

12. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

13. def isTimezoneSnowflake: Boolean

    

14. def isTimezoneSnowflakeDefault: Boolean

    

15. def isTimezoneSpark: Boolean

    

16. def jdbcDriver: Option[String]

    

    The JDBC driver class name.

    The JDBC driver class name. This is used to make sure the driver is registered before connecting over JDBC.

17. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

18. final def notify(): Unit

    

    Definition Classes

    AnyRef

19. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

20. val parameters: Map[String, String]

    

21. def postActions: Array[String]

    

    List of semi-colon separated SQL statements to run after successful write operations.

    List of semi-colon separated SQL statements to run after successful write operations. This can be useful for running GRANT operations to make your new tables readable to other users and groups.

    If the action string contains %s, the table name will be substituted in, in case a staging table is being used.

    Defaults to empty.

22. def preActions: Array[String]

    

    List of semi-colon separated SQL statements to run before write operations.

    List of semi-colon separated SQL statements to run before write operations. This can be useful for running DELETE operations to clean up data

    If the action string contains %s, the table name will be substituted in, in case a staging table is being used.

    Defaults to empty.

23. def query: Option[String]

    

    The Snowflake query to be used as the target when loading data.

24. def rootTempDir: String

    

    A root directory to be used for intermediate data exchange, expected to be on S3, or somewhere that can be written to and read from by Snowflake.

    A root directory to be used for intermediate data exchange, expected to be on S3, or somewhere that can be written to and read from by Snowflake. Make sure that AWS credentials are available for S3.

25. def s3maxfilesize: String

    

    Max file size used to move data out from Snowflake

26. def sfAccount: Option[String]

    

    Snowflake account - optional

27. def sfCompress: Boolean

    

    Snowflake use compression on/off - "on" by default

28. def sfDatabase: String

    

    Snowflake database name

29. def sfExtraOptions: Map[String, AnyRef]

    

    Returns a map of options that are not known to the connector, and are passed verbosely to the JDBC driver

30. def sfPassword: String

    

    Snowflake password

31. def sfRole: Option[String]

    

    Snowflake role - optional

32. def sfSSL: String

    

    Snowflake SSL on/off - "on" by default

33. def sfSchema: String

    

    Snowflake schema

34. def sfTimezone: Option[String]

    

    Snowflake timezone- optional

35. def sfURL: String

    

    URL pointing to the snowflake database, simply host:port

36. def sfUser: String

    

    Snowflake user

37. def sfWarehouse: Option[String]

    

    Snowflake warehouse

38. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

39. def table: Option[TableName]

    

    The Snowflake table to be used as the target when loading or writing data.

40. def temporaryAWSCredentials: Option[AWSCredentials]

    

    Temporary AWS credentials which are passed to Snowflake.

    Temporary AWS credentials which are passed to Snowflake. These only need to be supplied by the user when Hadoop is configured to authenticate to S3 via IAM roles assigned to EC2 instances.

41. def toString(): String

    

    Definition Classes

    MergedParameters → AnyRef → Any

42. def useStagingTable: Boolean

    

    When true, data is always loaded into a new temporary table when performing an overwrite.

    When true, data is always loaded into a new temporary table when performing an overwrite. This is to ensure that the whole load process succeeds before dropping any data from Snowflake, which can be useful if, in the event of failures, stale data is better than no data for your systems.

    Defaults to true.

43. lazy val usingExternalStage: Boolean

    

44. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

45. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

46. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )