Package

org.hammerlab.magic

hadoop

Permalink

package hadoop

Visibility
  1. Public
  2. All

Type Members

  1. class UnsplittableSequenceFileInputFormat[K, V] extends SequenceFileInputFormat[K, V]

    Permalink

    SequenceFileInputFormat guaranteed to be loaded in with the same splits it was written out with.

Value Members

  1. object Gunzip

    Permalink

    gunzip a file in HDFS.

  2. object Untar

    Permalink

    Untar (and optionally unzip as well, where appropriate) an HDFS file.

    Untar (and optionally unzip as well, where appropriate) an HDFS file.

    No fancy parallelism is used, just a scan through the entire file on the driver node.

Ungrouped