public class FileOutputFormatBuilderImpl<T> extends Object implements FileOutputFormatBuilder, FileOutputFormatBuilder.PathParams<T>, FileOutputFormatBuilder.OutputOptions<T>
FileOutputFormatBuilder.OutputOptions<T>, FileOutputFormatBuilder.PathParams<T>
Constructor and Description |
---|
FileOutputFormatBuilderImpl(Class<?> callingClass) |
Modifier and Type | Method and Description |
---|---|
FileOutputFormatBuilder.OutputOptions<T> |
compression(String compressionType)
Sets the compression type to use for data blocks, overriding the default.
|
FileOutputFormatBuilder.OutputOptions<T> |
dataBlockSize(long dataBlockSize)
Sets the size for data blocks within each file.
Data blocks are a span of key/value pairs stored in the file that are compressed and indexed as a group. |
FileOutputFormatBuilder.OutputOptions<T> |
fileBlockSize(long fileBlockSize)
Sets the size for file blocks in the file system; file blocks are managed, and replicated, by
the underlying file system.
|
FileOutputFormatBuilder.OutputOptions<T> |
indexBlockSize(long indexBlockSize)
Sets the size for index blocks within each file; smaller blocks means a deeper index
hierarchy within the file, while larger blocks mean a more shallow index hierarchy within the
file.
|
FileOutputFormatBuilder.OutputOptions<T> |
outputPath(org.apache.hadoop.fs.Path path)
Set the Path of the output directory for the map-reduce job.
|
FileOutputFormatBuilder.OutputOptions<T> |
replication(int replication)
Sets the file system replication factor for the resulting file, overriding the file system
default.
|
FileOutputFormatBuilder.OutputOptions<T> |
sampler(SamplerConfiguration samplerConfig)
Specify a sampler to be used when writing out data.
|
void |
store(T j)
Finish configuring, verify and serialize options into the Job or JobConf
|
FileOutputFormatBuilder.OutputOptions<T> |
summarizers(SummarizerConfiguration... summarizerConfigs)
Specifies a list of summarizer configurations to create summary data in the output file.
|
public FileOutputFormatBuilderImpl(Class<?> callingClass)
public FileOutputFormatBuilder.OutputOptions<T> outputPath(org.apache.hadoop.fs.Path path)
FileOutputFormatBuilder.PathParams
outputPath
in interface FileOutputFormatBuilder.PathParams<T>
public FileOutputFormatBuilder.OutputOptions<T> compression(String compressionType)
FileOutputFormatBuilder.OutputOptions
compression
in interface FileOutputFormatBuilder.OutputOptions<T>
compressionType
- one of "none", "gz", "lzo", or "snappy"public FileOutputFormatBuilder.OutputOptions<T> dataBlockSize(long dataBlockSize)
FileOutputFormatBuilder.OutputOptions
Making this value smaller may increase seek performance, but at the cost of increasing the size of the indexes (which can also affect seek performance).
dataBlockSize
in interface FileOutputFormatBuilder.OutputOptions<T>
dataBlockSize
- the block size, in bytespublic FileOutputFormatBuilder.OutputOptions<T> fileBlockSize(long fileBlockSize)
FileOutputFormatBuilder.OutputOptions
fileBlockSize
in interface FileOutputFormatBuilder.OutputOptions<T>
fileBlockSize
- the block size, in bytespublic FileOutputFormatBuilder.OutputOptions<T> indexBlockSize(long indexBlockSize)
FileOutputFormatBuilder.OutputOptions
indexBlockSize
in interface FileOutputFormatBuilder.OutputOptions<T>
indexBlockSize
- the block size, in bytespublic FileOutputFormatBuilder.OutputOptions<T> replication(int replication)
FileOutputFormatBuilder.OutputOptions
replication
in interface FileOutputFormatBuilder.OutputOptions<T>
replication
- the number of replicas for produced filespublic FileOutputFormatBuilder.OutputOptions<T> sampler(SamplerConfiguration samplerConfig)
FileOutputFormatBuilder.OutputOptions
sampler
in interface FileOutputFormatBuilder.OutputOptions<T>
samplerConfig
- The configuration for creating sample data in the output file.public FileOutputFormatBuilder.OutputOptions<T> summarizers(SummarizerConfiguration... summarizerConfigs)
FileOutputFormatBuilder.OutputOptions
Summarizer
's.summarizers
in interface FileOutputFormatBuilder.OutputOptions<T>
summarizerConfigs
- summarizer configurationspublic void store(T j)
FileOutputFormatBuilder.OutputOptions
store
in interface FileOutputFormatBuilder.OutputOptions<T>
Copyright © 2011–2019 The Apache Software Foundation. All rights reserved.