storage

Type Members

1. trait Archiver extends AnyRef

   

2. trait Compressor extends Serializable

   

   A Compressor is able to compress an input string into a byte array and vice versa.

   A Compressor is able to compress an input string into a byte array and vice versa.

   Annotations

   @Evolving()

3. case class Condition(key: String, operator: String, value: Option[String], valueType: ValueType) extends Product with Serializable

   

   Condition is used by io.github.setl.storage.repository.Repository to find data

   Condition is used by io.github.setl.storage.repository.Repository to find data

   key

   key of the field

   operator

   e.g. ">", "<", ">=", "<=", "="

   value

   value to compare

   valueType

   type of the value

   Annotations

   @Evolving()

4. class ConnectorBuilder extends Builder[Connector]

   

   ConnectorBuilder will build a io.github.setl.storage.connector.Connector object with the given configuration.

   ConnectorBuilder will build a io.github.setl.storage.connector.Connector object with the given configuration.

   Annotations

   @Evolving()

5. abstract class DatasetConverter[A, B] extends Converter

   

   DatasetConverter inherits from a Converter.

   DatasetConverter inherits from a Converter. It can convert between two Dataset: Dataset[A] and Dataset[B]

   A

   Type of Dataset[A]

   B

   Type of Dataset[B]

   Annotations

   @Evolving()

6. class GZIPCompressor extends Compressor

   

7. class SnappyCompressor extends Compressor

   

8. class SparkRepositoryBuilder[DataType] extends Builder[SparkRepository[DataType]]

   

   The SparkRepositoryBuilder will build a SparkRepository according to the given DataType and Storage

   The SparkRepositoryBuilder will build a SparkRepository according to the given DataType and Storage

   DataType

   type of data

   Annotations

   @Evolving()

9. class XZCompressor extends Compressor

   

10. class ZipArchiver extends Compressor with Archiver with Logging