s3

Type Members

1. abstract class BaseS3RecordReader[K, V] extends RecordReader[K, V]

   

   This is the base class for readers that will create key value pairs for object requests.

   This is the base class for readers that will create key value pairs for object requests. Subclass must extend [readObjectRequest] method to map from S3 object requests to (K,V)

2. class BytesS3InputFormat extends S3InputFormat[String, Array[Byte]]

   

3. trait Implicits extends Serializable

   

4. class S3GeoTiffInfoReader extends GeoTiffInfoReader

   

5. abstract class S3InputFormat[K, V] extends InputFormat[K, V]

   

   Reads keys from s3n URL using AWS Java SDK.

   Reads keys from s3n URL using AWS Java SDK. The number of keys per InputSplits are controlled by S3 pagination. If AWS credentials are not part of the URL they will be discovered using [DefaultAWSCredentialsProviderChain]:

   • EnvironmentVariableCredentialsProvider
   • SystemPropertiesCredentialsProvider
   • ProfileCredentialsProvider
   • InstanceProfileCredentialsProvider

6. class S3InputSplit extends InputSplit with Writable

   

   Represents are batch of keys to be read from an S3 bucket.

   Represents are batch of keys to be read from an S3 bucket. AWS credentials have already been discovered and provided by the S3InputFormat.

7. class S3LayerManager extends LayerManager[LayerId]

   

8. class S3LayerReader extends FilteringLayerReader[LayerId]

   

   Handles reading raster RDDs and their metadata from S3.

9. class S3LayerWriter extends LayerWriter[LayerId]

   

   Handles writing Raster RDDs and their metadata to S3.

10. class S3RDDReader extends Serializable

    

11. class S3RDDWriter extends Serializable

    

12. abstract class S3RecordReader[K, V] extends BaseS3RecordReader[K, V]

    

    This reader will fetch bytes of each key one at a time using [AmazonS3Client.getObject].

    This reader will fetch bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3 object bytes to (K,V)

13. class S3SparkLayerProvider extends S3CollectionLayerProvider with LayerReaderProvider with LayerWriterProvider

    

    Provides S3LayerReader instance for URI with s3 scheme.

    Provides S3LayerReader instance for URI with s3 scheme. The uri represents S3 bucket an prefix of catalog root. ex: s3://<bucket>/<prefix-to-catalog>

14. class SaveToS3Methods[K, V] extends MethodExtensions[RDD[(K, V)]]

    

15. abstract class StreamingS3RecordReader[K, V] extends BaseS3RecordReader[K, V]

    

    This reader will stream bytes of each key one at a time using [AmazonS3Client.getObject].

    This reader will stream bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3RangeReader to (K,V)

16. class TiffTagsS3InputFormat extends S3InputFormat[GetObjectRequest, TiffTags]

    

    Reads the tiff tags of GeoTiffs on S3, avoiding full file read.

17. implicit class withSaveToS3Methods[K, V] extends SaveToS3Methods[K, V]

    

    Definition Classes

    Implicits

18. class GeoTiffS3InputFormat extends S3InputFormat[ProjectedExtent, Tile]

    

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    Annotations

    @deprecated

    Deprecated

    (Since version 1.0.0) GeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

19. class GeoTiffS3RecordReader extends S3RecordReader[ProjectedExtent, Tile]

    

    Annotations

    @deprecated

    Deprecated

    (Since version 1.0.0) GeoTiffS3RecordReader is deprecated, use S3GeoTiffRDD instead

20. class MultibandGeoTiffS3InputFormat extends S3InputFormat[ProjectedExtent, MultibandTile]

    

    Read multi band GeoTiff from S3

    Read multi band GeoTiff from S3

    Annotations

    @deprecated

    Deprecated

    (Since version 1.0.0) MultibandGeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

21. class TemporalGeoTiffS3InputFormat extends S3InputFormat[TemporalProjectedExtent, Tile]

    

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    This can be configured with the hadoop configuration by providing: TemporalGeoTiffS3InputFormat.GEOTIFF_TIME_TAG; default of "TIFFTAG_DATETIME" TemporalGeoTiffS3InputFormat.GEOTIFF_TIME_FORMAT; default is ""yyyy:MM:dd HH:mm:ss""

    Annotations

    @deprecated

    Deprecated

    (Since version 1.0.0) TemporalGeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

22. class TemporalGeoTiffS3RecordReader extends S3RecordReader[TemporalProjectedExtent, Tile]

    

    Annotations

    @deprecated

    Deprecated

    (Since version 1.0.0) TemporalGeoTiffS3RecordReader is deprecated, use S3GeoTiffRDD instead

23. class TemporalMultibandGeoTiffS3InputFormat extends S3InputFormat[TemporalProjectedExtent, MultibandTile]

    

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    This can be configured with the hadoop configuration by providing: TemporalMultibandGeoTiffS3InputFormat.GEOTIFF_TIME_TAG; default of "TIFFTAG_DATETIME" TemporalMultibandGeoTiffS3InputFormat.GEOTIFF_TIME_FORMAT; default is ""yyyy:MM:DD HH:MM:SS""

    Annotations

    @deprecated

    Deprecated

    (Since version 1.0.0) TemporalMultibandGeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead