Codec to read and write zipped Csv-files with Hadoop
Note that only the first file entry of a Zip-Archive is read, and only Zip-files with one Entry named "data.csv" can be created.
Attention: reading with custom codec in Spark is only implemented for writing files, and not for reading files.
Usage in Csv/RelaxedCsvFileDataObject:
csv-options {
compression = io.smartdatalake.workflow.dataobject.ZipCsvCodec
}
Linear Supertypes
ZipCodec, DefaultCodec, DirectDecompressionCodec, CompressionCodec, Configurable, AnyRef, Any
Codec to read and write zipped Csv-files with Hadoop Note that only the first file entry of a Zip-Archive is read, and only Zip-files with one Entry named "data.csv" can be created. Attention: reading with custom codec in Spark is only implemented for writing files, and not for reading files. Usage in Csv/RelaxedCsvFileDataObject: csv-options { compression = io.smartdatalake.workflow.dataobject.ZipCsvCodec }