A B C D E F G H I J L M N O P R S T U V W

A

accept(Path) - Method in class org.apache.parquet.hadoop.util.HiddenFileFilter

addColumn(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

allocator - Variable in class org.apache.parquet.ParquetReadOptions.Builder

appendFile(Configuration, Path) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

will be removed in 2.0.0; use ParquetFileWriter.appendFile(InputFile) instead

appendFile(InputFile) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

appendRowGroup(FSDataInputStream, BlockMetaData, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

will be removed in 2.0.0; use ParquetFileWriter.appendRowGroup(SeekableInputStream,BlockMetaData,boolean) instead

appendRowGroup(SeekableInputStream, BlockMetaData, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

appendRowGroups(FSDataInputStream, List<BlockMetaData>, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

will be removed in 2.0.0; use ParquetFileWriter.appendRowGroups(SeekableInputStream,List,boolean) instead

appendRowGroups(SeekableInputStream, List<BlockMetaData>, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

appendTo(ParquetFileWriter) - Method in class org.apache.parquet.hadoop.ParquetFileReader

B

BAD_RECORD_THRESHOLD_CONF_KEY - Static variable in class org.apache.parquet.hadoop.UnmaterializableRecordCounter

BadConfigurationException - Exception in org.apache.parquet.hadoop

Thrown when the input/output formats are misconfigured

BadConfigurationException() - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException

BadConfigurationException(String, Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException

BadConfigurationException(String) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException

BadConfigurationException(Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException

BenchmarkCounter - Class in org.apache.parquet.hadoop.util.counters

Encapsulate counter operations, compatible with Hadoop1/2, mapred/mapreduce API

BenchmarkCounter() - Constructor for class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

BenchmarkCounter.NullCounter - Class in org.apache.parquet.hadoop.util.counters

BLOCK_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

BlockMetaData - Class in org.apache.parquet.hadoop.metadata

Block metadata stored in the footer and passed in an InputSplit

BlockMetaData() - Constructor for class org.apache.parquet.hadoop.metadata.BlockMetaData

build() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

build() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Build a ParquetWriter with the accumulated configuration.

build() - Method in class org.apache.parquet.HadoopReadOptions.Builder

build() - Method in class org.apache.parquet.ParquetReadOptions.Builder

builder(Path) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter

Creates a Builder for configuring ParquetWriter with the example object model.

builder(OutputFile) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter

Creates a Builder for configuring ParquetWriter with the example object model.

builder(ReadSupport<T>, Path) - Static method in class org.apache.parquet.hadoop.ParquetReader

Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder

Deprecated.

Builder(InputFile) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder

Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder

Builder(OutputFile) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder

builder(Configuration) - Static method in class org.apache.parquet.HadoopReadOptions

Builder(Configuration) - Constructor for class org.apache.parquet.HadoopReadOptions.Builder

builder() - Static method in class org.apache.parquet.ParquetReadOptions

Builder() - Constructor for class org.apache.parquet.ParquetReadOptions.Builder

BytesCompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesCompressor

Deprecated.

BytesDecompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor

Deprecated.

C

canDrop(FilterPredicate, List<ColumnChunkMetaData>, DictionaryPageReadStore) - Static method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

canDrop(FilterPredicate, List<ColumnChunkMetaData>) - Static method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

checkContractViolations(InputFile) - Static method in class org.apache.parquet.hadoop.ColumnIndexValidator

cleanDirectBuffer(ByteBuffer) - Static method in class org.apache.parquet.hadoop.codec.CleanUtil

CleanUtil - Class in org.apache.parquet.hadoop.codec

A Helper class which use reflections to clean up DirectBuffer.

close() - Method in class org.apache.parquet.hadoop.ParquetFileReader

close() - Method in class org.apache.parquet.hadoop.ParquetReader

close() - Method in class org.apache.parquet.hadoop.ParquetRecordReader

close(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter

close() - Method in class org.apache.parquet.hadoop.ParquetWriter

close() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream

CODEC_BY_NAME - Static variable in class org.apache.parquet.hadoop.CodecFactory

CodecConfig - Class in org.apache.parquet.hadoop.codec

Template class and factory for accessing codec related configurations in different APIs(mapreduce or mapred), use CodecConfig.from(org.apache.hadoop.mapred.JobConf) for mapred API, use CodecConfig.from(org.apache.hadoop.mapreduce.TaskAttemptContext) for mapreduce API

CodecConfig() - Constructor for class org.apache.parquet.hadoop.codec.CodecConfig

CodecFactory - Class in org.apache.parquet.hadoop

CodecFactory(Configuration, int) - Constructor for class org.apache.parquet.hadoop.CodecFactory

Create a new codec factory.

codecFactory - Variable in class org.apache.parquet.ParquetReadOptions.Builder

CodecFactory.BytesCompressor - Class in org.apache.parquet.hadoop

Deprecated.

will be removed in 2.0.0; use CompressionCodecFactory.BytesInputCompressor instead.

CodecFactory.BytesDecompressor - Class in org.apache.parquet.hadoop

Deprecated.

will be removed in 2.0.0; use CompressionCodecFactory.BytesInputDecompressor instead.

COLUMN_INDEX_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure whether column index filtering of pages is enabled

COLUMN_INDEX_TRUNCATE_LENGTH - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

ColumnChunkMetaData - Class in org.apache.parquet.hadoop.metadata

Column meta data for a block stored in the file footer and passed in the InputSplit

ColumnChunkMetaData(ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

ColumnChunkMetaData(EncodingStats, ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

ColumnChunkProperties - Class in org.apache.parquet.hadoop.metadata

ColumnIndexValidator - Class in org.apache.parquet.hadoop

ColumnIndexValidator() - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator

ColumnIndexValidator.Contract - Enum in org.apache.parquet.hadoop

ColumnIndexValidator.ContractViolation - Class in org.apache.parquet.hadoop

commitJob(JobContext) - Method in class org.apache.parquet.hadoop.mapred.MapredParquetOutputCommitter

commitJob(JobContext) - Method in class org.apache.parquet.hadoop.ParquetOutputCommitter

compress(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

Fills specified buffer with compressed data.

compress(BytesInput) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor

Deprecated.

COMPRESSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

conf - Variable in class org.apache.parquet.hadoop.ParquetReader.Builder

config(String, String) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set a property that will be available to the read path.

configuration - Variable in class org.apache.parquet.hadoop.CodecFactory

ConfigurationUtil - Class in org.apache.parquet.hadoop.util

ConfigurationUtil() - Constructor for class org.apache.parquet.hadoop.util.ConfigurationUtil

Container<T> - Class in org.apache.parquet.hadoop.mapred

A simple container of objects that you can get and set.

Container() - Constructor for class org.apache.parquet.hadoop.mapred.Container

ContextUtil - Class in org.apache.parquet.hadoop.util

Utility methods to allow applications to deal with inconsistencies between MapReduce Context Objects API between hadoop-0.20 and later versions.

ContextUtil() - Constructor for class org.apache.parquet.hadoop.util.ContextUtil

ContractViolation(ColumnIndexValidator.Contract, String, String, int, int, ColumnPath, int) - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator.ContractViolation

convertEncodingStats(List<PageEncodingStats>) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

convertEncodingStats(EncodingStats) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

copy(ParquetReadOptions) - Method in class org.apache.parquet.ParquetReadOptions.Builder

CounterLoader - Interface in org.apache.parquet.hadoop.util.counters

Factory interface for CounterLoaders, will load the counter according to groupName, counterName, and if in the configuration, flag with name counterFlag is false, the counter will not be loaded

create(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile

createCompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

createCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory

createDecompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

createDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory

createDirectCodecFactory(Configuration, ByteBufferAllocator, int) - Static method in class org.apache.parquet.hadoop.CodecFactory

Create a codec factory that will provide compressors and decompressors that will work natively with ByteBuffers backed by direct memory.

createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

createOrOverwrite(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile

createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

CURRENT_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter

D

decompress(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

Fills specified buffer with uncompressed data.

decompress(BytesInput, int) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor

Deprecated.

decompress(ByteBuffer, int, ByteBuffer, int) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor

Deprecated.

DEFAULT_BLOCK_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetWriter

DEFAULT_COMPRESSION_CODEC_NAME - Static variable in class org.apache.parquet.hadoop.ParquetWriter

DEFAULT_IS_DICTIONARY_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetWriter

DEFAULT_IS_VALIDATING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetWriter

DEFAULT_PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetWriter

DEFAULT_WRITER_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetWriter

defaultBlockSize() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile

DelegatingReadSupport<T> - Class in org.apache.parquet.hadoop.api

Helps composing read supports

DelegatingReadSupport(ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.api.DelegatingReadSupport

DelegatingWriteSupport<T> - Class in org.apache.parquet.hadoop.api

Helps composing write supports

DelegatingWriteSupport(WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.api.DelegatingWriteSupport

DeprecatedParquetInputFormat<V> - Class in org.apache.parquet.hadoop.mapred

DeprecatedParquetInputFormat() - Constructor for class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat

DeprecatedParquetOutputFormat<V> - Class in org.apache.parquet.hadoop.mapred

DeprecatedParquetOutputFormat() - Constructor for class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

description - Variable in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract

DICTIONARY_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure whether row group dictionary filtering is enabled

DICTIONARY_PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

DictionaryFilter - Class in org.apache.parquet.filter2.dictionarylevel

Applies filters based on the contents of column dictionaries.

E

ENABLE_DICTIONARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

ENABLE_JOB_SUMMARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

Deprecated.

enableDictionaryEncoding() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Enables dictionary encoding for the constructed writer.

enablePageWriteChecksum() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Enables writing page level checksums for the constructed writer.

enableValidation() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Enables validation for the constructed writer.

EncodingList - Class in org.apache.parquet.hadoop.metadata

end() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

end() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

end(Map<String, String>) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

ends a file once all blocks have been written.

endBlock() - Method in class org.apache.parquet.hadoop.ParquetFileWriter

ends a block once all column chunks have been written

endColumn() - Method in class org.apache.parquet.hadoop.ParquetFileWriter

end a column (once all rep, def and data have been written)

equals(Object) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

equals(Object) - Method in class org.apache.parquet.hadoop.metadata.EncodingList

ESTIMATE_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

ExampleInputFormat - Class in org.apache.parquet.hadoop.example

Example input format to read Parquet files This Input format uses a rather inefficient data model but works independently of higher level abstractions.

ExampleInputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleInputFormat

ExampleOutputFormat - Class in org.apache.parquet.hadoop.example

An example output format must be provided the schema up front

ExampleOutputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleOutputFormat

ExampleParquetWriter - Class in org.apache.parquet.hadoop.example

An example file writer class.

ExampleParquetWriter.Builder - Class in org.apache.parquet.hadoop.example

F

FileMetaData - Class in org.apache.parquet.hadoop.metadata

File level meta data (Schema, codec, ...)

FileMetaData(MessageType, Map<String, String>, String) - Constructor for class org.apache.parquet.hadoop.metadata.FileMetaData

FILTER_PREDICATE - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure the filter predicate

filterRowGroups(FilterCompat.Filter, List<BlockMetaData>, MessageType) - Static method in class org.apache.parquet.filter2.compat.RowGroupFilter

Deprecated.

will be removed in 2.0.0.

filterRowGroups(List<RowGroupFilter.FilterLevel>, FilterCompat.Filter, List<BlockMetaData>, ParquetFileReader) - Static method in class org.apache.parquet.filter2.compat.RowGroupFilter

FinalizedWriteContext(Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext

finalizeWrite() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport

finalizeWrite() - Method in class org.apache.parquet.hadoop.api.WriteSupport

called once in the end after the last record was written

finish() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

finished() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

finished() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

flush() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream

Footer - Class in org.apache.parquet.hadoop

Represent the footer for a given file

Footer(Path, ParquetMetadata) - Constructor for class org.apache.parquet.hadoop.Footer

from(JobConf) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig

use mapred api to read codec config

from(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig

use mapreduce api to read codec config

fromJSON(String) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata

fromParquetColumnIndex(PrimitiveType, ColumnIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

fromParquetMetadata(FileMetaData) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

fromParquetOffsetIndex(OffsetIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

fromParquetStatistics(Statistics, PrimitiveType.PrimitiveTypeName) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

Deprecated.

will be removed in 2.0.0.

fromParquetStatistics(String, Statistics, PrimitiveType.PrimitiveTypeName) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

Deprecated.

will be removed in 2.0.0.

fromParquetStatistics(String, Statistics, PrimitiveType) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

fromPath(Path, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopInputFile

fromPath(Path, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopOutputFile

fromStatus(FileStatus, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopInputFile

G

get() - Method in class org.apache.parquet.hadoop.mapred.Container

get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

Deprecated.

get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

Deprecated.

get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

Deprecated.

will be removed in 2.0.0. Use ColumnChunkMetaData.get(ColumnPath, PrimitiveType, CompressionCodecName, EncodingStats, Set, Statistics, long, long, long, long, long) instead.

get(ColumnPath, PrimitiveType, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

Deprecated.

will be removed in 2.0.0. Use ColumnChunkProperties.get(ColumnPath, PrimitiveType, CompressionCodecName, Set) instead.

get(ColumnPath, PrimitiveType, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

getAllocator() - Method in class org.apache.parquet.ParquetReadOptions

getBlockFileSystems() - Static method in class org.apache.parquet.hadoop.util.HadoopOutputFile

getBlocks() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata

getBlocks() - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

the file footer is no longer read before creating input splits

getBlockSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

Deprecated.

getBytesRead() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

getBytesRead() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

getBytesWritten() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

getClassFromConfig(Configuration, String, Class<?>) - Static method in class org.apache.parquet.hadoop.util.ConfigurationUtil

getCodec() - Method in class org.apache.parquet.hadoop.codec.CodecConfig

getCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory

getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

getCodecFactory() - Method in class org.apache.parquet.ParquetReadOptions

getCodecName() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor

Deprecated.

getColumnIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getColumns() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

getCompressedSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

getCompression(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getCompression(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory

getCompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

getConf() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

getConf() - Method in class org.apache.parquet.HadoopReadOptions

getConfiguration() - Method in class org.apache.parquet.hadoop.api.InitContext

getConfiguration() - Method in class org.apache.parquet.hadoop.codec.CodecConfig

getConfiguration(JobContext) - Static method in class org.apache.parquet.hadoop.util.ContextUtil

Invoke getConfiguration() method on JobContext.

getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile

getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile

getCount() - Method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter

getCount() - Method in interface org.apache.parquet.hadoop.util.counters.ICounter

getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter

getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter

getCounter(TaskAttemptContext, String, String) - Static method in class org.apache.parquet.hadoop.util.ContextUtil

getCounterByNameAndFlag(String, String, String) - Method in interface org.apache.parquet.hadoop.util.counters.CounterLoader

getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterLoader

getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterLoader

getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData

getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData

getCurrentKey() - Method in class org.apache.parquet.hadoop.ParquetRecordReader

always returns null

getCurrentValue() - Method in class org.apache.parquet.hadoop.ParquetRecordReader

getDataSize() - Method in class org.apache.parquet.hadoop.ParquetWriter

getDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory

getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

getDictionaryPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getDictionaryPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getDictionaryPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getDictionaryReader(BlockMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader

getEnableDictionary(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getEnableDictionary(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

getEncodingList(List<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.EncodingList

getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

getEncodingStats() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getEnd() - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

getEstimatePageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext

getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext

getExtraMetadata() - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

will be removed in 2.0.0. the file footer is no longer read before creating input splits

getFile() - Method in class org.apache.parquet.hadoop.Footer

getFile() - Method in class org.apache.parquet.hadoop.ParquetFileReader

getFileMetaData() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata

getFileMetaData() - Method in class org.apache.parquet.hadoop.ParquetFileReader

getFileSchema() - Method in class org.apache.parquet.hadoop.api.InitContext

this is the union of all the schemas when reading multiple files.

getFileSchema() - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

the file footer is no longer read before creating input splits

getFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

Returns a non-null Filter, which is a wrapper around either a FilterPredicate, an UnboundRecordFilter, or a no-op filter.

getFirstDataPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileReader

getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileWriter

getFooter() - Method in class org.apache.parquet.hadoop.ParquetWriter

getFooters(JobConf) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat

getFooters(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

getFooters(Configuration, List<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

getFooters(Configuration, Collection<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

the footers for the files

getGlobalMetaData(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

getHadoopOutputCompressorClass(Class) - Method in class org.apache.parquet.hadoop.codec.CodecConfig

getJobSummaryLevel(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getKeyValueMetadata() - Method in class org.apache.parquet.hadoop.api.InitContext

each key is associated with the list of distinct values found in footers

getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData

getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData

getLength() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile

getLength() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference

getLongBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getMaxAllocationSize() - Method in class org.apache.parquet.ParquetReadOptions

getMaxRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getMemoryManager() - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getMergedKeyValueMetaData() - Method in class org.apache.parquet.hadoop.api.InitContext

Deprecated.

getMetadataFilter() - Method in class org.apache.parquet.ParquetReadOptions

getMinRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getName() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport

getName() - Method in class org.apache.parquet.hadoop.api.WriteSupport

Called to get a name to identify the WriteSupport object model.

getName() - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport

getNextDictionaryReader() - Method in class org.apache.parquet.hadoop.ParquetFileReader

Returns a DictionaryPageReadStore for the row group that would be returned by calling ParquetFileReader.readNextRowGroup() or skipped by calling ParquetFileReader.skipNextRowGroup().

getNextRowGroupSize() - Method in class org.apache.parquet.hadoop.ParquetFileWriter

getOffset() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference

getOffsetIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getOutputCommitter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getPageWriteChecksumEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getParquetCompressionCodec(Configuration) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig

getParquetMetadata() - Method in class org.apache.parquet.hadoop.Footer

getPath() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

getPath() - Method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.getFile() instead

getPos() - Method in class org.apache.parquet.hadoop.ParquetFileWriter

getPos() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream

getPrimitive(Type) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

getProgress() - Method in class org.apache.parquet.hadoop.ParquetRecordReader

getProperty(String) - Method in class org.apache.parquet.HadoopReadOptions

getProperty(String) - Method in class org.apache.parquet.ParquetReadOptions

getPropertyNames() - Method in class org.apache.parquet.ParquetReadOptions

getReadSupport() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

getReadSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

getReadSupportInstance(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

getReadSupportMetadata() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext

getRecordCount() - Method in class org.apache.parquet.hadoop.ParquetFileReader

getRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions

getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat

getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

getRecordWriter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getRecordWriter(TaskAttemptContext, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getRecordWriter(TaskAttemptContext, Path) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getRecordWriter(TaskAttemptContext, Path, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getRecordWriter(Configuration, Path, CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getRecordWriter(Configuration, Path, CompressionCodecName, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getRemaining() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

getRequestedSchema() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext

getRowCount() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

getRowGroupOffsets() - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

will be removed in 2.0.0.

getRowGroups() - Method in class org.apache.parquet.hadoop.ParquetFileReader

getSchema() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext

getSchema(Job) - Static method in class org.apache.parquet.hadoop.example.ExampleOutputFormat

retrieve the schema from the conf

getSchema(Configuration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport

getSchema() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData

getSchema() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData

getSchemaForRead(MessageType, String) - Static method in class org.apache.parquet.hadoop.api.ReadSupport

attempts to validate and construct a MessageType from a read projection schema

getSchemaForRead(MessageType, MessageType) - Static method in class org.apache.parquet.hadoop.api.ReadSupport

getSplits(JobConf, int) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat

getSplits(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

getSplits(Configuration, List<Footer>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

Deprecated.

split planning using file footers will be removed

getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getStatistics() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getTime() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

getTotalBytes() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

getTotalByteSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

getTotalSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getTotalUncompressedSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

Deprecated.

will be removed in 2.0.0. Use ColumnChunkMetaData.getPrimitiveType() instead.

getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

Deprecated.

will be removed in 2.0.0. Use ColumnChunkProperties.getPrimitiveType() instead.

getUnboundRecordFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

Deprecated.

use ParquetInputFormat.getFilter(Configuration)

getValidation(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getValidation(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getValueCount() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

getWriterVersion(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder

getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat

getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

getWriteSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

GlobalMetaData - Class in org.apache.parquet.hadoop.metadata

Merged metadata when reading from multiple files.

GlobalMetaData(MessageType, Map<String, Set<String>>, Set<String>) - Constructor for class org.apache.parquet.hadoop.metadata.GlobalMetaData

GroupReadSupport - Class in org.apache.parquet.hadoop.example

GroupReadSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupReadSupport

GroupWriteSupport - Class in org.apache.parquet.hadoop.example

GroupWriteSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupWriteSupport

H

HadoopCodecs - Class in org.apache.parquet.hadoop.util

HadoopCodecs() - Constructor for class org.apache.parquet.hadoop.util.HadoopCodecs

HadoopInputFile - Class in org.apache.parquet.hadoop.util

HadoopOutputFile - Class in org.apache.parquet.hadoop.util

HadoopPositionOutputStream - Class in org.apache.parquet.hadoop.util

HadoopReadOptions - Class in org.apache.parquet

HadoopReadOptions.Builder - Class in org.apache.parquet

HadoopStreams - Class in org.apache.parquet.hadoop.util

Convenience methods to get Parquet abstractions for Hadoop data streams.

HadoopStreams() - Constructor for class org.apache.parquet.hadoop.util.HadoopStreams

hasCounterMethod(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.util.ContextUtil

hashCode() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

hashCode() - Method in class org.apache.parquet.hadoop.metadata.EncodingList

HiddenFileFilter - Class in org.apache.parquet.hadoop.util

A PathFilter that filters out hidden files.

I

ICounter - Interface in org.apache.parquet.hadoop.util.counters

Interface for counters in mapred/mapreduce package of hadoop

incErrors(RecordMaterializer.RecordMaterializationException) - Method in class org.apache.parquet.hadoop.UnmaterializableRecordCounter

increment(long) - Method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter

increment(long) - Method in interface org.apache.parquet.hadoop.util.counters.ICounter

increment(long) - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter

increment(long) - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter

incrementBytesRead(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

incrementCounter(Counter, long) - Static method in class org.apache.parquet.hadoop.util.ContextUtil

incrementTime(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

incrementTotalBytes(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

IndexReference - Class in org.apache.parquet.internal.hadoop.metadata

Reference to an index (OffsetIndex and ColumnIndex) for a row-group containing the offset and length values so the reader can read the referenced data.

IndexReference(long, int) - Constructor for class org.apache.parquet.internal.hadoop.metadata.IndexReference

init(InitContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport

init(Configuration) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport

init(Configuration, Map<String, String>, MessageType) - Method in class org.apache.parquet.hadoop.api.ReadSupport

Deprecated.

override ReadSupport.init(InitContext) instead

init(InitContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport

called in InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext) in the front end

init(Configuration) - Method in class org.apache.parquet.hadoop.api.WriteSupport

called first in the task

init(Configuration, Map<String, String>, MessageType) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport

init(Configuration) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport

InitContext - Class in org.apache.parquet.hadoop.api

Context passed to ReadSupport when initializing for read

InitContext(Configuration, Map<String, Set<String>>, MessageType) - Constructor for class org.apache.parquet.hadoop.api.InitContext

initCounterFromContext(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

Init counters in hadoop's mapreduce API, support both 1.x and 2.x

initCounterFromReporter(Reporter, Configuration) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter

Init counters in hadoop's mapred API, which is used by cascading and Hive.

initialize(InputSplit, TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetRecordReader

initialize(InputSplit, Configuration, Reporter) - Method in class org.apache.parquet.hadoop.ParquetRecordReader

INSTANCE - Static variable in class org.apache.parquet.hadoop.util.HiddenFileFilter

isCompressionSet(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

isCompressionSet(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

isEnabled(String, boolean) - Method in class org.apache.parquet.ParquetReadOptions

isHadoopCompressionSet() - Method in class org.apache.parquet.hadoop.codec.CodecConfig

isParquetCompressionSet(Configuration) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig

isSplitable(JobContext, Path) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

isTaskSideMetaData(JobConf) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat

isTaskSideMetaData(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

iterator() - Method in class org.apache.parquet.hadoop.metadata.EncodingList

J

JOB_SUMMARY_LEVEL - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

Must be one of the values in ParquetOutputFormat.JobSummaryLevel (case insensitive)

L

listStatus(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat

M

MAGIC - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter

MAGIC_STR - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter

main(String[]) - Static method in class org.apache.parquet.hadoop.PrintFooter

MapRedCounterAdapter - Class in org.apache.parquet.hadoop.util.counters.mapred

Adapt a mapred counter to ICounter

MapRedCounterAdapter(Counters.Counter) - Constructor for class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter

MapRedCounterLoader - Class in org.apache.parquet.hadoop.util.counters.mapred

Concrete factory for counters in mapred API, get a counter using mapred API when the corresponding flag is set, otherwise return a NullCounter

MapRedCounterLoader(Reporter, Configuration) - Constructor for class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterLoader

MapredParquetOutputCommitter - Class in org.apache.parquet.hadoop.mapred

Adapter for supporting ParquetOutputCommitter in mapred API

MapredParquetOutputCommitter() - Constructor for class org.apache.parquet.hadoop.mapred.MapredParquetOutputCommitter

MapReduceCounterAdapter - Class in org.apache.parquet.hadoop.util.counters.mapreduce

Adapt a mapreduce counter to ICounter

MapReduceCounterAdapter(Counter) - Constructor for class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter

MapReduceCounterLoader - Class in org.apache.parquet.hadoop.util.counters.mapreduce

Concrete factory for counters in mapred API, get a counter using mapreduce API when the corresponding flag is set, otherwise return a NullCounter

MapReduceCounterLoader(TaskAttemptContext) - Constructor for class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterLoader

MAX_PADDING_BYTES - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

MAX_PADDING_SIZE_DEFAULT - Static variable in class org.apache.parquet.hadoop.ParquetWriter

MAX_ROW_COUNT_FOR_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

MAX_STATS_SIZE - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter

maxAllocationSize - Variable in class org.apache.parquet.ParquetReadOptions.Builder

MEMORY_POOL_RATIO - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

MemoryManager - Class in org.apache.parquet.hadoop

Implements a memory manager that keeps a global context of how many Parquet writers there are and manages the memory between them.

MemoryManager(float, long) - Constructor for class org.apache.parquet.hadoop.MemoryManager

merge() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData

Will merge the metadata as if it was coming from a single file.

mergeMetadataFiles(List<Path>, Configuration) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

metadataFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder

MIN_MEMORY_ALLOCATION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

MIN_ROW_COUNT_FOR_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

N

needsDictionary() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

needsInput() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

needsInput() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

newDirectFactory(Configuration, ByteBufferAllocator, int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs

newFactory(int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs

newFactory(Configuration, int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs

newGenericCounter(String, String, long) - Static method in class org.apache.parquet.hadoop.util.ContextUtil

newJobContext(Configuration, JobID) - Static method in class org.apache.parquet.hadoop.util.ContextUtil

Creates JobContext from a JobConf and jobId using the correct constructor for based on Hadoop version.

newStream() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile

newTaskAttemptContext(Configuration, TaskAttemptID) - Static method in class org.apache.parquet.hadoop.util.ContextUtil

Creates TaskAttemptContext from a JobConf and jobId using the correct constructor for based on Hadoop version.

nextKeyValue() - Method in class org.apache.parquet.hadoop.ParquetRecordReader

NO_FILTER - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter

NonBlockedCompressorStream - Class in org.apache.parquet.hadoop.codec

CompressorStream class that should be used instead of the default hadoop CompressorStream object.

NonBlockedCompressorStream(OutputStream, Compressor, int) - Constructor for class org.apache.parquet.hadoop.codec.NonBlockedCompressorStream

NonBlockedDecompressorStream - Class in org.apache.parquet.hadoop.codec

DecompressorStream class that should be used instead of the default hadoop DecompressorStream object.

NonBlockedDecompressorStream(InputStream, Decompressor, int) - Constructor for class org.apache.parquet.hadoop.codec.NonBlockedDecompressorStream

NullCounter() - Constructor for class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter

O

OBJECT_MODEL_NAME_PROP - Static variable in class org.apache.parquet.hadoop.ParquetWriter

offsets(long...) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

open(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile)

open(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile,ParquetReadOptions)

open(Configuration, Path, ParquetMetadata) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0

open(InputFile) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Open a file.

open(InputFile, ParquetReadOptions) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Open a file with options.

org.apache.parquet - package org.apache.parquet

org.apache.parquet.filter2.compat - package org.apache.parquet.filter2.compat

org.apache.parquet.filter2.dictionarylevel - package org.apache.parquet.filter2.dictionarylevel

org.apache.parquet.filter2.statisticslevel - package org.apache.parquet.filter2.statisticslevel

org.apache.parquet.format.converter - package org.apache.parquet.format.converter

org.apache.parquet.hadoop - package org.apache.parquet.hadoop

Provides classes to store use Parquet files in Hadoop In a map reduce job:

org.apache.parquet.hadoop.api - package org.apache.parquet.hadoop.api

APIs to integrate various type systems with Parquet

org.apache.parquet.hadoop.codec - package org.apache.parquet.hadoop.codec

org.apache.parquet.hadoop.example - package org.apache.parquet.hadoop.example

org.apache.parquet.hadoop.mapred - package org.apache.parquet.hadoop.mapred

org.apache.parquet.hadoop.metadata - package org.apache.parquet.hadoop.metadata

org.apache.parquet.hadoop.util - package org.apache.parquet.hadoop.util

org.apache.parquet.hadoop.util.counters - package org.apache.parquet.hadoop.util.counters

org.apache.parquet.hadoop.util.counters.mapred - package org.apache.parquet.hadoop.util.counters.mapred

org.apache.parquet.hadoop.util.counters.mapreduce - package org.apache.parquet.hadoop.util.counters.mapreduce

org.apache.parquet.internal.hadoop.metadata - package org.apache.parquet.internal.hadoop.metadata

P

PAGE_ROW_COUNT_LIMIT - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

PAGE_VERIFY_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure whether page level checksum verification is enabled

PAGE_WRITE_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

pageSize - Variable in class org.apache.parquet.hadoop.CodecFactory

PARQUET_COMMON_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter

PARQUET_EXAMPLE_SCHEMA - Static variable in class org.apache.parquet.hadoop.example.GroupWriteSupport

PARQUET_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter

PARQUET_READ_PARALLELISM - Static variable in class org.apache.parquet.hadoop.ParquetFileReader

PARQUET_READ_SCHEMA - Static variable in class org.apache.parquet.hadoop.api.ReadSupport

configuration key for a parquet read projection schema

ParquetFileReader - Class in org.apache.parquet.hadoop

Internal implementation of the Parquet file reader as a block container

ParquetFileReader(Configuration, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0.

ParquetFileReader(Configuration, FileMetaData, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0.

ParquetFileReader(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0.

ParquetFileReader(Configuration, Path, ParquetMetadata) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0.

ParquetFileReader(InputFile, ParquetReadOptions) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader

ParquetFileWriter - Class in org.apache.parquet.hadoop

Internal implementation of the Parquet file writer as a block container

ParquetFileWriter(Configuration, MessageType, Path) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

will be removed in 2.0.0

ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

will be removed in 2.0.0

ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

will be removed in 2.0.0

ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

will be removed in 2.0.0

ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter

ParquetFileWriter.Mode - Enum in org.apache.parquet.hadoop

ParquetInputFormat<T> - Class in org.apache.parquet.hadoop

The input format to read a Parquet file.

ParquetInputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat

Hadoop will instantiate using this constructor

ParquetInputFormat(Class<S>) - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat

Constructor for subclasses, such as AvroParquetInputFormat, or wrappers.

ParquetInputSplit - Class in org.apache.parquet.hadoop

Deprecated.

will be removed in 2.0.0. use FileInputSplit instead.

ParquetInputSplit() - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

Writables must have a parameterless constructor

ParquetInputSplit(Path, long, long, String[], List<BlockMetaData>, String, String, Map<String, String>, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

ParquetInputSplit(Path, long, long, long, String[], long[]) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

ParquetMetadata - Class in org.apache.parquet.hadoop.metadata

Meta Data block stored in the footer of the file contains file level (Codec, Schema, ...) and block level (location, columns, record count, ...) meta data

ParquetMetadata(FileMetaData, List<BlockMetaData>) - Constructor for class org.apache.parquet.hadoop.metadata.ParquetMetadata

ParquetMetadataConverter - Class in org.apache.parquet.format.converter

ParquetMetadataConverter() - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter

ParquetMetadataConverter(int) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter

ParquetMetadataConverter(Configuration) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter

Deprecated.

will be removed in 2.0.0; use ParquetMetadataConverter(ParquetReadOptions)

ParquetMetadataConverter(ParquetReadOptions) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter

ParquetMetadataConverter.MetadataFilter - Class in org.apache.parquet.format.converter

ParquetOutputCommitter - Class in org.apache.parquet.hadoop

ParquetOutputCommitter(Path, TaskAttemptContext) - Constructor for class org.apache.parquet.hadoop.ParquetOutputCommitter

ParquetOutputFormat<T> - Class in org.apache.parquet.hadoop

OutputFormat to write to a Parquet file It requires a WriteSupport to convert the actual records to the underlying format.

ParquetOutputFormat(S) - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat

constructor used when this OutputFormat in wrapped in another one (In Pig for example)

ParquetOutputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat

used when directly using the output format and configuring the write support implementation using parquet.write.support.class

ParquetOutputFormat.JobSummaryLevel - Enum in org.apache.parquet.hadoop

ParquetReader<T> - Class in org.apache.parquet.hadoop

Read records from a Parquet file.

ParquetReader(Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader

Deprecated.

use ParquetReader.builder(ReadSupport, Path)

ParquetReader(Configuration, Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader

Deprecated.

use ParquetReader.builder(ReadSupport, Path)

ParquetReader(Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader

Deprecated.

use ParquetReader.builder(ReadSupport, Path)

ParquetReader(Configuration, Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader

Deprecated.

use ParquetReader.builder(ReadSupport, Path)

ParquetReader.Builder<T> - Class in org.apache.parquet.hadoop

ParquetReadOptions - Class in org.apache.parquet

ParquetReadOptions.Builder - Class in org.apache.parquet

ParquetRecordReader<T> - Class in org.apache.parquet.hadoop

Reads the records from a block of a Parquet file

ParquetRecordReader(ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader

ParquetRecordReader(ReadSupport<T>, FilterCompat.Filter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader

ParquetRecordReader(ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader

Deprecated.

will be removed in 2.0.0.

ParquetRecordWriter<T> - Class in org.apache.parquet.hadoop

Writes records to a Parquet file

ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, int, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter

Deprecated.

ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, long, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion, MemoryManager) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter

Deprecated.

ParquetWriter<T> - Class in org.apache.parquet.hadoop

Write records to a Parquet file.

ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

will be removed in 2.0.0

ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

will be removed in 2.0.0

ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

will be removed in 2.0.0

ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

will be removed in 2.0.0

ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

will be removed in 2.0.0

ParquetWriter(Path, ParquetFileWriter.Mode, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

will be removed in 2.0.0

ParquetWriter(Path, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

will be removed in 2.0.0

ParquetWriter(Path, Configuration, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter

Deprecated.

ParquetWriter.Builder<T,SELF extends ParquetWriter.Builder<T,SELF>> - Class in org.apache.parquet.hadoop

An abstract builder class for ParquetWriter instances.

positiveLongFitsInAnInt(long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

checks that a positive long value fits in an int.

prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport

prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport

called in RecordReader.initialize(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext) in the back end the returned RecordMaterializer will materialize the records and add them to the destination

prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport

prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport

prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.WriteSupport

This will be called once per row group

prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport

PrintFooter - Class in org.apache.parquet.hadoop

Utility to print footer information

PrintFooter() - Constructor for class org.apache.parquet.hadoop.PrintFooter

properties - Variable in class org.apache.parquet.ParquetReadOptions.Builder

R

range(long, long) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

[ startOffset, endOffset )

read(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedDecompressorStream

read() - Method in class org.apache.parquet.hadoop.ParquetReader

read(InputFile) - Static method in class org.apache.parquet.hadoop.ParquetReader

READ_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure the ReadSupport implementation

readAllFootersInParallel(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

readAllFootersInParallel(Configuration, List<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readAllFootersInParallel(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readAllFootersInParallel(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readAllFootersInParallelUsingSummaryFiles(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

readAllFootersInParallelUsingSummaryFiles(Configuration, Collection<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

readColumnIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader

ReadContext(MessageType) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext

ReadContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext

readFields(DataInput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

readFooter(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readFooter(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readFooter(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readFooter(Configuration, FileStatus, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readFooter(InputFile, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readFooters(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readFooters(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readFooters(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

will be removed in 2.0.0; use ParquetFileReader.open(InputFile, ParquetReadOptions)

readNextFilteredRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader

Reads all the columns requested from the row group at the current file position.

readNextRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader

Reads all the columns requested from the row group at the current file position.

readObjectFromConfAsBase64(String, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil

Reads an object (that was written using SerializationUtil.writeObjectToConfAsBase64(java.lang.String, java.lang.Object, org.apache.hadoop.conf.Configuration)) from a configuration

readOffsetIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader

readParquetMetadata(InputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

Deprecated.

readParquetMetadata(InputStream, ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

readSummaryFile(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

ReadSupport<T> - Class in org.apache.parquet.hadoop.api

Abstraction used by the ParquetInputFormat to materialize records

ReadSupport() - Constructor for class org.apache.parquet.hadoop.api.ReadSupport

ReadSupport.ReadContext - Class in org.apache.parquet.hadoop.api

information to read the file

realInputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat

realOutputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

RECORD_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure whether record-level filtering is enabled

recordFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder

registerScaleCallBack(String, Runnable) - Method in class org.apache.parquet.hadoop.MemoryManager

Register callback and deduplicate it if any.

reinit(Configuration) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor

Deprecated.

release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor

Deprecated.

release() - Method in class org.apache.parquet.hadoop.CodecFactory

reset() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

reset() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

RowGroupFilter - Class in org.apache.parquet.filter2.compat

Given a FilterCompat.Filter applies it to a list of BlockMetaData (row groups) If the Filter is an UnboundRecordFilter or the no op filter, no filtering will be performed.

RowGroupFilter.FilterLevel - Enum in org.apache.parquet.filter2.compat

S

self() - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder

self() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

SerializationUtil - Class in org.apache.parquet.hadoop.util

Serialization utils copied from: https://github.com/kevinweil/elephant-bird/blob/master/core/src/main/java/com/twitter/elephantbird/util/HadoopUtils.java TODO: Refactor elephant-bird so that we can depend on utils like this without extra baggage.

set(T) - Method in class org.apache.parquet.hadoop.mapred.Container

set(String, String) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

set(String, String) - Method in class org.apache.parquet.ParquetReadOptions.Builder

setAsOutputFormat(JobConf) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

setBlockSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

setBlockSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setColumnIndexReference(IndexReference) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

setColumnIndexTruncateLength(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setColumnIndexTruncateLength(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setCompression(Configuration, CompressionCodecName) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

setCompression(Job, CompressionCodecName) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setConf(Configuration) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec

setDictionary(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

setDictionary(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

setDictionaryPageSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setEnableDictionary(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

setEnableDictionary(Job, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setFilterPredicate(Configuration, FilterPredicate) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

setInput(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor

setInput(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor

Sets input data for decompression.

setMaxPaddingSize(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setMaxPaddingSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setOffsetIndexReference(IndexReference) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

setPageRowCountLimit(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setPageRowCountLimit(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setPageSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

setPageSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setPageWriteChecksumEnabled(JobContext, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setPageWriteChecksumEnabled(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setPath(String) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

setReadSupportClass(Job, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

setReadSupportClass(JobConf, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

setRequestedSchema(MessageType) - Method in class org.apache.parquet.hadoop.ParquetFileReader

setRowCount(long) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

setSchema(Job, MessageType) - Static method in class org.apache.parquet.hadoop.example.ExampleOutputFormat

set the schema being written to the job conf

setSchema(MessageType, Configuration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport

setStatisticsTruncateLength(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setTaskSideMetaData(Job, boolean) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

setTotalByteSize(long) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

setUnboundRecordFilter(Job, Class<? extends UnboundRecordFilter>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat

setValidation(JobContext, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setValidation(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setWriteSupportClass(Configuration, Class<?>) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat

setWriteSupportClass(Job, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

setWriteSupportClass(JobConf, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat

size() - Method in class org.apache.parquet.hadoop.metadata.EncodingList

SKIP_ROW_GROUPS - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter

skipNextRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader

SnappyCodec - Class in org.apache.parquet.hadoop.codec

Snappy compression codec for Parquet.

SnappyCodec() - Constructor for class org.apache.parquet.hadoop.codec.SnappyCodec

SnappyCompressor - Class in org.apache.parquet.hadoop.codec

This class is a wrapper around the snappy compressor.

SnappyCompressor() - Constructor for class org.apache.parquet.hadoop.codec.SnappyCompressor

SnappyDecompressor - Class in org.apache.parquet.hadoop.codec

SnappyDecompressor() - Constructor for class org.apache.parquet.hadoop.codec.SnappyDecompressor

SnappyUtil - Class in org.apache.parquet.hadoop.codec

Utilities for SnappyCompressor and SnappyDecompressor.

SnappyUtil() - Constructor for class org.apache.parquet.hadoop.codec.SnappyUtil

SPLIT_FILES - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to turn off file splitting.

start() - Method in class org.apache.parquet.hadoop.ParquetFileWriter

start the file

startBlock(long) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

start a block

startColumn(ColumnDescriptor, long, CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

start a column inside a block

STATISTICS_TRUNCATE_LENGTH - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

StatisticsFilter - Class in org.apache.parquet.filter2.statisticslevel

Applies a FilterPredicate to statistics about a group of records.

STATS_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure whether row group stats filtering is enabled

STRICT_TYPE_CHECKING - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure type checking for conflicting schemas (default: true)

supportsBlockSize() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile

sync() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream

T

TASK_SIDE_METADATA - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to turn on or off task side metadata loading (default true) if true then metadata is read on the task side and some tasks may finish immediately.

toJSON(ParquetMetadata) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata

toList() - Method in class org.apache.parquet.hadoop.metadata.EncodingList

toParquetColumnIndex(PrimitiveType, ColumnIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

toParquetMetadata(int, ParquetMetadata) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

toParquetOffsetIndex(OffsetIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

toParquetStatistics(Statistics) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

toParquetStatistics(Statistics, int) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter

toPrettyJSON(ParquetMetadata) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata

toString() - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport

toString() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport

toString() - Method in class org.apache.parquet.hadoop.ColumnIndexValidator.ContractViolation

toString() - Method in class org.apache.parquet.hadoop.Footer

toString() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData

toString() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData

toString() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties

toString() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData

toString() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData

toString() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata

toString() - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

toString() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile

toString() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile

U

UNBOUND_RECORD_FILTER - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat

key to configure the filter

UnmaterializableRecordCounter - Class in org.apache.parquet.hadoop

Tracks number of records that cannot be materialized and throws ParquetDecodingException if the rate of errors crosses a limit.

UnmaterializableRecordCounter(Configuration, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter

UnmaterializableRecordCounter(ParquetReadOptions, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter

UnmaterializableRecordCounter(double, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter

useColumnIndexFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useColumnIndexFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useColumnIndexFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder

useColumnIndexFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder

useColumnIndexFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder

useColumnIndexFilter() - Method in class org.apache.parquet.ParquetReadOptions

useDictionaryFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useDictionaryFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useDictionaryFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder

useDictionaryFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder

useDictionaryFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder

useDictionaryFilter() - Method in class org.apache.parquet.ParquetReadOptions

usePageChecksumVerification(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

usePageChecksumVerification() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

usePageChecksumVerification - Variable in class org.apache.parquet.ParquetReadOptions.Builder

usePageChecksumVerification(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder

usePageChecksumVerification() - Method in class org.apache.parquet.ParquetReadOptions.Builder

usePageChecksumVerification() - Method in class org.apache.parquet.ParquetReadOptions

useRecordFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useRecordFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useRecordFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder

useRecordFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder

useRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder

useRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions

useSignedStringMinMax(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useSignedStringMinMax() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useSignedStringMinMax - Variable in class org.apache.parquet.ParquetReadOptions.Builder

useSignedStringMinMax(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder

useSignedStringMinMax() - Method in class org.apache.parquet.ParquetReadOptions.Builder

useSignedStringMinMax() - Method in class org.apache.parquet.ParquetReadOptions

useStatsFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useStatsFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

useStatsFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder

useStatsFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder

useStatsFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder

useStatsFilter() - Method in class org.apache.parquet.ParquetReadOptions

V

validateBuffer(byte[], int, int) - Static method in class org.apache.parquet.hadoop.codec.SnappyUtil

VALIDATION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

valueOf(String) - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel

Returns an array containing the constants of this enum type, in the order they are declared.

visit(FilterCompat.FilterPredicateCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter

visit(FilterCompat.UnboundRecordFilterCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter

visit(FilterCompat.NoOpFilter) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter

visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.And) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.Or) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.Not) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter

visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.And) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.Or) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.Not) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter

W

withAllocator(ByteBufferAllocator) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withCompressionCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the compression codec used by the constructed writer.

withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the Configuration used by the constructed writer.

withDictionaryEncoding(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Enable or disable dictionary encoding for the constructed writer.

withDictionaryPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the Parquet format dictionary page size used by the constructed writer.

withExtraMetaData(Map<String, String>) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder

withFileRange(long, long) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

withFilter(FilterCompat.Filter) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder

withMaxAllocationInBytes(int) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withMaxPaddingSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the maximum amount of padding, in bytes, that will be used to align row groups with blocks in the underlying filesystem.

withMetadataFilter(ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withOffsets(long...) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withPageChecksumVerification(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withPageRowCountLimit(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Sets the Parquet format page row count limit used by the constructed writer.

withPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the Parquet format page size used by the constructed writer.

withPageWriteChecksumEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Enables writing page level checksums for the constructed writer.

withRange(long, long) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withRecordFilter(FilterCompat.Filter) - Method in class org.apache.parquet.ParquetReadOptions.Builder

withRowGroupSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the Parquet format row group size used by the constructed writer.

withType(MessageType) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder

withValidation(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Enable or disable validation for the constructed writer.

withWriteMode(ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the write mode used when creating the backing file for this writer.

withWriterVersion(ParquetProperties.WriterVersion) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder

Set the format version used by the constructed writer.

wrap(FSDataInputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams

Wraps a FSDataInputStream in a SeekableInputStream implementation for Parquet readers.

wrap(FSDataOutputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams

Wraps a FSDataOutputStream in a PositionOutputStream implementation for Parquet writers.

write(T) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport

write(T) - Method in class org.apache.parquet.hadoop.api.WriteSupport

called once per record

write(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressorStream

write(Group) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport

write(DataOutput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit

Deprecated.

write(Void, T) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter

write(T) - Method in class org.apache.parquet.hadoop.ParquetWriter

write(int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream

write(byte[]) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream

write(byte[], int, int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream

WRITE_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

WriteContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.WriteSupport.WriteContext

writeDataPage(int, int, BytesInput, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

writeDataPage(int, int, BytesInput, Statistics, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

this method does not support writing column indexes; Use ParquetFileWriter.writeDataPage(int, int, BytesInput, Statistics, long, Encoding, Encoding, Encoding) instead

writeDataPage(int, int, BytesInput, Statistics, long, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

Writes a single page

writeDataPageHeader(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

Deprecated.

writeDataPageHeader(int, int, int, Statistics, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

Deprecated.

writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

writeDataPageV2Header(int, int, int, int, int, Statistics, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

Deprecated.

writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

writeDictionaryPage(DictionaryPage) - Method in class org.apache.parquet.hadoop.ParquetFileWriter

writes a dictionary page page

writeDictionaryPageHeader(int, int, int, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

writeDictionaryPageHeader(int, int, int, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter

writeMergedMetadataFile(List<Path>, Path, Configuration) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

writeMetadataFile(Configuration, Path, List<Footer>) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

writeMetadataFile(Configuration, Path, List<Footer>, ParquetOutputFormat.JobSummaryLevel) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter

Deprecated.

metadata files are not recommended and will be removed in 2.0.0

writeMetaDataFile(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetOutputCommitter

writeObjectToConfAsBase64(String, Object, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil

Writes an object to a configuration.

WRITER_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat

WriteSupport<T> - Class in org.apache.parquet.hadoop.api

Abstraction to use with ParquetOutputFormat to convert incoming records

WriteSupport() - Constructor for class org.apache.parquet.hadoop.api.WriteSupport

WriteSupport.FinalizedWriteContext - Class in org.apache.parquet.hadoop.api

Information to be added in the file once all the records have been written

WriteSupport.WriteContext - Class in org.apache.parquet.hadoop.api

information to be persisted in the file

A B C D E F G H I J L M N O P R S T U V W