package storage
- Alphabetic
- Public
- All
Type Members
- trait Archiver extends AnyRef
-
trait
Compressor extends Serializable
A Compressor is able to compress an input string into a byte array and vice versa.
A Compressor is able to compress an input string into a byte array and vice versa.
- Annotations
- @Evolving()
-
case class
Condition(key: String, operator: String, value: Option[String], valueType: ValueType) extends Product with Serializable
Condition is used by io.github.setl.storage.repository.Repository to find data
Condition is used by io.github.setl.storage.repository.Repository to find data
- key
key of the field
- operator
e.g. ">", "<", ">=", "<=", "="
- value
value to compare
- valueType
type of the value
- Annotations
- @Evolving()
-
class
ConnectorBuilder extends Builder[Connector]
ConnectorBuilder will build a io.github.setl.storage.connector.Connector object with the given configuration.
ConnectorBuilder will build a io.github.setl.storage.connector.Connector object with the given configuration.
- Annotations
- @Evolving()
-
abstract
class
DatasetConverter[A, B] extends Converter
DatasetConverter inherits from a Converter.
DatasetConverter inherits from a Converter. It can convert between two Dataset: Dataset[A] and Dataset[B]
- A
Type of Dataset[A]
- B
Type of Dataset[B]
- Annotations
- @Evolving()
-
class
GZIPCompressor extends Compressor
XZCompressor implement
Compressor
's interface with the GZIP compression algorithm - class SnappyCompressor extends Compressor
-
class
SparkRepositoryBuilder[DataType] extends Builder[SparkRepository[DataType]]
The SparkRepositoryBuilder will build a SparkRepository according to the given DataType and Storage
The SparkRepositoryBuilder will build a SparkRepository according to the given DataType and Storage
- DataType
type of data
- Annotations
- @Evolving()
-
class
XZCompressor extends Compressor
XZCompressor implement
Compressor
's interface with the XZ compression algorithm - class ZipArchiver extends Compressor with Archiver with Logging
Value Members
- object Condition extends Serializable
- object ConnectorBuilder