org.apache.spark

io

package io

IO codecs used for compression. See org.apache.spark.io.CompressionCodec.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. io
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. trait CompressionCodec extends AnyRef

    :: DeveloperApi :: CompressionCodec allows the customization of choosing different compression implementations to be used in block storage.

    :: DeveloperApi :: CompressionCodec allows the customization of choosing different compression implementations to be used in block storage.

    Note: The wire protocol for a codec is not guaranteed compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

    Annotations
    @DeveloperApi()

  2. class LZ4CompressionCodec extends CompressionCodec

    :: DeveloperApi :: LZ4 implementation of org.apache.spark.io.CompressionCodec.

    :: DeveloperApi :: LZ4 implementation of org.apache.spark.io.CompressionCodec. Block size can be configured by spark.io.compression.lz4.blockSize.

    Note: The wire protocol for this codec is not guaranteed to be compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

    Annotations
    @DeveloperApi()

  3. class LZFCompressionCodec extends CompressionCodec

    :: DeveloperApi :: LZF implementation of org.apache.spark.io.CompressionCodec.

    :: DeveloperApi :: LZF implementation of org.apache.spark.io.CompressionCodec.

    Note: The wire protocol for this codec is not guaranteed to be compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

    Annotations
    @DeveloperApi()

  4. class SnappyCompressionCodec extends CompressionCodec

    :: DeveloperApi :: Snappy implementation of org.apache.spark.io.CompressionCodec.

    :: DeveloperApi :: Snappy implementation of org.apache.spark.io.CompressionCodec. Block size can be configured by spark.io.compression.snappy.blockSize.

    Note: The wire protocol for this codec is not guaranteed to be compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

    Annotations
    @DeveloperApi()

Inherited from AnyRef

Inherited from Any

Ungrouped