public static interface FileOutputFormatBuilder.OutputOptions<T>
Modifier and Type | Method and Description |
---|---|
FileOutputFormatBuilder.OutputOptions<T> |
compression(String compressionType)
Sets the compression type to use for data blocks, overriding the default.
|
FileOutputFormatBuilder.OutputOptions<T> |
dataBlockSize(long dataBlockSize)
Sets the size for data blocks within each file.
Data blocks are a span of key/value pairs stored in the file that are compressed and indexed as a group. |
FileOutputFormatBuilder.OutputOptions<T> |
fileBlockSize(long fileBlockSize)
Sets the size for file blocks in the file system; file blocks are managed, and replicated, by
the underlying file system.
|
FileOutputFormatBuilder.OutputOptions<T> |
indexBlockSize(long indexBlockSize)
Sets the size for index blocks within each file; smaller blocks means a deeper index
hierarchy within the file, while larger blocks mean a more shallow index hierarchy within the
file.
|
FileOutputFormatBuilder.OutputOptions<T> |
replication(int replication)
Sets the file system replication factor for the resulting file, overriding the file system
default.
|
FileOutputFormatBuilder.OutputOptions<T> |
sampler(SamplerConfiguration samplerConfig)
Specify a sampler to be used when writing out data.
|
void |
store(T job)
Finish configuring, verify and serialize options into the Job or JobConf
|
FileOutputFormatBuilder.OutputOptions<T> |
summarizers(SummarizerConfiguration... summarizerConfigs)
Specifies a list of summarizer configurations to create summary data in the output file.
|
FileOutputFormatBuilder.OutputOptions<T> compression(String compressionType)
compressionType
- one of "none", "gz", "lzo", or "snappy"FileOutputFormatBuilder.OutputOptions<T> dataBlockSize(long dataBlockSize)
Making this value smaller may increase seek performance, but at the cost of increasing the size of the indexes (which can also affect seek performance).
dataBlockSize
- the block size, in bytesFileOutputFormatBuilder.OutputOptions<T> fileBlockSize(long fileBlockSize)
fileBlockSize
- the block size, in bytesFileOutputFormatBuilder.OutputOptions<T> indexBlockSize(long indexBlockSize)
indexBlockSize
- the block size, in bytesFileOutputFormatBuilder.OutputOptions<T> replication(int replication)
replication
- the number of replicas for produced filesFileOutputFormatBuilder.OutputOptions<T> sampler(SamplerConfiguration samplerConfig)
samplerConfig
- The configuration for creating sample data in the output file.FileOutputFormatBuilder.OutputOptions<T> summarizers(SummarizerConfiguration... summarizerConfigs)
Summarizer
's.summarizerConfigs
- summarizer configurationsvoid store(T job)
Copyright © 2011–2019 The Apache Software Foundation. All rights reserved.