Package com.exasol.spark.s3

Class S3Source

java.lang.Object

com.exasol.spark.s3.S3Source

All Implemented Interfaces:

org.apache.spark.sql.connector.catalog.TableProvider, org.apache.spark.sql.sources.DataSourceRegister

public class S3Source
extends Object
implements org.apache.spark.sql.connector.catalog.TableProvider, org.apache.spark.sql.sources.DataSourceRegister

An S3 Spark Connector Source.

Constructor Summary

Constructors

Constructor	Description
S3Source()

Method Summary

Modifier and Type	Method	Description
org.apache.spark.sql.connector.catalog.Table	getTable(org.apache.spark.sql.types.StructType schema, org.apache.spark.sql.connector.expressions.Transform[] partitioning, Map<String,String> properties)
org.apache.spark.sql.types.StructType	inferSchema(org.apache.spark.sql.util.CaseInsensitiveStringMap map)
String	shortName()
boolean	supportsExternalMetadata()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.catalog.TableProvider

inferPartitioning

Constructor Detail

S3Source

public S3Source()

Method Detail

shortName

public String shortName()

Specified by:

shortName in interface org.apache.spark.sql.sources.DataSourceRegister

supportsExternalMetadata

public boolean supportsExternalMetadata()

Specified by:

supportsExternalMetadata in interface org.apache.spark.sql.connector.catalog.TableProvider

inferSchema

public org.apache.spark.sql.types.StructType inferSchema(org.apache.spark.sql.util.CaseInsensitiveStringMap map)

Specified by:

inferSchema in interface org.apache.spark.sql.connector.catalog.TableProvider

getTable

public org.apache.spark.sql.connector.catalog.Table getTable(org.apache.spark.sql.types.StructType schema,
                                                             org.apache.spark.sql.connector.expressions.Transform[] partitioning,
                                                             Map<String,String> properties)

Specified by:

getTable in interface org.apache.spark.sql.connector.catalog.TableProvider