Literal to be used with the Spark DataFrame's .format method
Given a URI, verify that the Hadoop FileSystem for that URI is not the S3 block FileSystem.
Given a URI, verify that the Hadoop FileSystem for that URI is not the S3 block FileSystem.
spark-snowflakedb
cannot use this FileSystem because the files written to it will not be
readable by Snowflake (and vice versa).
Checks whether the S3 bucket for the given UI has an object lifecycle configuration to ensure cleanup of temporary files.
Checks whether the S3 bucket for the given UI has an object lifecycle configuration to ensure cleanup of temporary files. If no applicable configuration is found, this method logs a helpful warning for the user.
Snowflake COPY and UNLOAD commands don't support s3n or s3a, but users may wish to use them for data loads.
Snowflake COPY and UNLOAD commands don't support s3n or s3a, but users may wish to use them for data loads. This function converts the URL back to the s3:// format.
Joins prefix URL a to path suffix b, and appends a trailing /, in order to create a temp directory path for S3.
Creates a randomly named temp directory path for intermediate data
Same as readMapFromFile, but accepts the file content as an argument
Returns a copy of the given URI with the user credentials removed.
Removes (hopefully :)) sensitive content from a query string
Various arbitrary helper functions