A B C D E F G H I J K L M N O P Q R S T U V W Z 
All Classes All Packages

A

AADPrefixVerifier - Interface in org.apache.parquet.crypto
 
accept(Path) - Method in class org.apache.parquet.hadoop.util.HiddenFileFilter
 
addColumn(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
addKeyMaterial(String, String) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
Add key material for one encryption key.
addKeyMaterial(String, String) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
AES_GCM_CTR_V1 - org.apache.parquet.crypto.ParquetCipher
 
AES_GCM_V1 - org.apache.parquet.crypto.ParquetCipher
 
AesCipher - Class in org.apache.parquet.crypto
 
AesCtrDecryptor - Class in org.apache.parquet.crypto
 
AesCtrEncryptor - Class in org.apache.parquet.crypto
 
AesGcmDecryptor - Class in org.apache.parquet.crypto
 
AesGcmEncryptor - Class in org.apache.parquet.crypto
 
aesKey - Variable in class org.apache.parquet.crypto.AesCipher
 
AesMode - Enum in org.apache.parquet.crypto
 
ALL - org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
Write both summary file with row group info and summary file without (both _metadata and _common_metadata)
allocator - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
appendColumnChunk(ColumnDescriptor, SeekableInputStream, ColumnChunkMetaData, BloomFilter, ColumnIndex, OffsetIndex) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
appendFile(Configuration, Path) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
will be removed in 2.0.0; use ParquetFileWriter.appendFile(InputFile) instead
appendFile(InputFile) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
appendRowGroup(FSDataInputStream, BlockMetaData, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
appendRowGroup(SeekableInputStream, BlockMetaData, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
appendRowGroups(FSDataInputStream, List<BlockMetaData>, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
appendRowGroups(SeekableInputStream, List<BlockMetaData>, boolean) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
appendTo(ParquetFileWriter) - Method in class org.apache.parquet.hadoop.ParquetFileReader
 

B

BAD_RECORD_THRESHOLD_CONF_KEY - Static variable in class org.apache.parquet.hadoop.UnmaterializableRecordCounter
 
BadConfigurationException - Exception in org.apache.parquet.hadoop
Thrown when the input/output formats are misconfigured
BadConfigurationException() - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
 
BadConfigurationException(String) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
 
BadConfigurationException(String, Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
 
BadConfigurationException(Throwable) - Constructor for exception org.apache.parquet.hadoop.BadConfigurationException
 
BenchmarkCounter - Class in org.apache.parquet.hadoop.util.counters
Encapsulate counter operations, compatible with Hadoop1/2, mapred/mapreduce API
BenchmarkCounter() - Constructor for class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
 
BenchmarkCounter.NullCounter - Class in org.apache.parquet.hadoop.util.counters
 
BLOCK_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
BlockMetaData - Class in org.apache.parquet.hadoop.metadata
Block metadata stored in the footer and passed in an InputSplit
BlockMetaData() - Constructor for class org.apache.parquet.hadoop.metadata.BlockMetaData
 
blockRead(byte[], int, int) - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
 
BLOOM_FILTER_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
BLOOM_FILTER_EXPECTED_NDV - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
BLOOM_FILTER_MAX_BYTES - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
BLOOM_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure whether row group bloom filtering is enabled
BLOOMFILTER - org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
 
BloomFilterBitset - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
BloomFilterHeader - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
BloomFilterImpl - Class in org.apache.parquet.filter2.bloomfilterlevel
 
BloomFilterReader - Class in org.apache.parquet.hadoop
Bloom filter reader that reads Bloom filter data from an open ParquetFileReader.
BloomFilterReader(ParquetFileReader, BlockMetaData) - Constructor for class org.apache.parquet.hadoop.BloomFilterReader
 
build() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties.Builder
 
build() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
 
build() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
 
build() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
 
build() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
build() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Build a ParquetWriter with the accumulated configuration.
build() - Method in class org.apache.parquet.HadoopReadOptions.Builder
 
build() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
buildColumnChunkMetaData(ColumnMetaData, ColumnPath, PrimitiveType, String) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
builder() - Static method in class org.apache.parquet.crypto.FileDecryptionProperties
 
builder() - Static method in class org.apache.parquet.ParquetReadOptions
 
builder(byte[]) - Static method in class org.apache.parquet.crypto.FileEncryptionProperties
 
builder(String) - Static method in class org.apache.parquet.crypto.ColumnDecryptionProperties
Convenience builder for regular (not nested) columns.
builder(String) - Static method in class org.apache.parquet.crypto.ColumnEncryptionProperties
Convenience builder for regular (not nested) columns.
builder(Configuration) - Static method in class org.apache.parquet.HadoopReadOptions
 
builder(Configuration, Path) - Static method in class org.apache.parquet.HadoopReadOptions
 
builder(Path) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter
Creates a Builder for configuring ParquetWriter with the example object model.
builder(ReadSupport<T>, Path) - Static method in class org.apache.parquet.hadoop.ParquetReader
 
builder(ColumnPath) - Static method in class org.apache.parquet.crypto.ColumnDecryptionProperties
 
builder(ColumnPath) - Static method in class org.apache.parquet.crypto.ColumnEncryptionProperties
Builder for encrypted columns.
builder(OutputFile) - Static method in class org.apache.parquet.hadoop.example.ExampleParquetWriter
Creates a Builder for configuring ParquetWriter with the example object model.
Builder() - Constructor for class org.apache.parquet.ParquetReadOptions.Builder
 
Builder(Configuration) - Constructor for class org.apache.parquet.HadoopReadOptions.Builder
 
Builder(Configuration, Path) - Constructor for class org.apache.parquet.HadoopReadOptions.Builder
 
Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder
Deprecated.
Builder(Path) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder
 
Builder(InputFile) - Constructor for class org.apache.parquet.hadoop.ParquetReader.Builder
 
Builder(OutputFile) - Constructor for class org.apache.parquet.hadoop.ParquetWriter.Builder
 
BytesCompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
Deprecated.
 
BytesDecompressor() - Constructor for class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
Deprecated.
 

C

CACHE_LIFETIME_DEFAULT_SECONDS - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
 
CACHE_LIFETIME_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
Lifetime of cached entities (key encryption keys, local wrapping keys, KMS client objects).
canDrop(FilterPredicate, List<ColumnChunkMetaData>) - Static method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
canDrop(FilterPredicate, List<ColumnChunkMetaData>, DictionaryPageReadStore) - Static method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
canDrop(FilterPredicate, List<ColumnChunkMetaData>, BloomFilterReader) - Static method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
checkContractViolations(InputFile) - Static method in class org.apache.parquet.hadoop.ColumnIndexValidator
 
checkFooterIntegrity() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
 
checkFooterIntegrity() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
CHUNK_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
 
cipher - Variable in class org.apache.parquet.crypto.AesCipher
 
cleanDirectBuffer(ByteBuffer) - Static method in class org.apache.parquet.hadoop.codec.CleanUtil
 
CleanUtil - Class in org.apache.parquet.hadoop.codec
A Helper class which use reflections to clean up DirectBuffer.
close() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
close() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
 
close() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
close() - Method in class org.apache.parquet.hadoop.ParquetReader
 
close() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
close() - Method in class org.apache.parquet.hadoop.ParquetWriter
 
close() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
 
close(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter
CODEC_BY_NAME - Static variable in class org.apache.parquet.hadoop.CodecFactory
 
CodecConfig - Class in org.apache.parquet.hadoop.codec
Template class and factory for accessing codec related configurations in different APIs(mapreduce or mapred), use CodecConfig.from(org.apache.hadoop.mapred.JobConf) for mapred API, use CodecConfig.from(org.apache.hadoop.mapreduce.TaskAttemptContext) for mapreduce API
CodecConfig() - Constructor for class org.apache.parquet.hadoop.codec.CodecConfig
 
codecFactory - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
CodecFactory - Class in org.apache.parquet.hadoop
 
CodecFactory(Configuration, int) - Constructor for class org.apache.parquet.hadoop.CodecFactory
Create a new codec factory.
CodecFactory.BytesCompressor - Class in org.apache.parquet.hadoop
Deprecated.
will be removed in 2.0.0; use CompressionCodecFactory.BytesInputCompressor instead.
CodecFactory.BytesDecompressor - Class in org.apache.parquet.hadoop
Deprecated.
will be removed in 2.0.0; use CompressionCodecFactory.BytesInputDecompressor instead.
COLUMN_INDEX_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure whether column index filtering of pages is enabled
COLUMN_INDEX_TRUNCATE_LENGTH - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
COLUMN_KEYS_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
List of columns to encrypt, with master key IDs (see HIVE-21848).
ColumnChunkMetaData - Class in org.apache.parquet.hadoop.metadata
Column meta data for a block stored in the file footer and passed in the InputSplit
ColumnChunkMetaData(EncodingStats, ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
ColumnChunkMetaData(ColumnChunkProperties) - Constructor for class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
ColumnChunkPageWriteStore - Class in org.apache.parquet.hadoop
 
ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
 
ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int, boolean) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
 
ColumnChunkPageWriteStore(CodecFactory.BytesCompressor, MessageType, ByteBufferAllocator, int, boolean, InternalFileEncryptor, int) - Constructor for class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
 
ColumnChunkProperties - Class in org.apache.parquet.hadoop.metadata
 
ColumnDecryptionProperties - Class in org.apache.parquet.crypto
This class is only required for setting explicit column decryption keys - to override key retriever (or to provide keys when key metadata and/or key retriever are not available)
ColumnDecryptionProperties.Builder - Class in org.apache.parquet.crypto
 
ColumnEncryptionProperties - Class in org.apache.parquet.crypto
 
ColumnEncryptionProperties.Builder - Class in org.apache.parquet.crypto
 
ColumnIndex - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
ColumnIndexValidator - Class in org.apache.parquet.hadoop
 
ColumnIndexValidator() - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator
 
ColumnIndexValidator.Contract - Enum in org.apache.parquet.hadoop
 
ColumnIndexValidator.ContractViolation - Class in org.apache.parquet.hadoop
 
ColumnMasker - Class in org.apache.parquet.hadoop.util
 
ColumnMasker() - Constructor for class org.apache.parquet.hadoop.util.ColumnMasker
 
ColumnMasker.MaskMode - Enum in org.apache.parquet.hadoop.util
 
ColumnMetaData - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
ColumnPruner - Class in org.apache.parquet.hadoop.util
 
ColumnPruner() - Constructor for class org.apache.parquet.hadoop.util.ColumnPruner
 
commitJob(JobContext) - Method in class org.apache.parquet.hadoop.mapred.MapredParquetOutputCommitter
 
commitJob(JobContext) - Method in class org.apache.parquet.hadoop.ParquetOutputCommitter
 
COMMON_ONLY - org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
Write only the summary file without the row group info (_common_metadata only)
compress(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
Fills specified buffer with compressed data.
compress(BytesInput) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
Deprecated.
 
COMPRESSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
CompressionConverter - Class in org.apache.parquet.hadoop.util
 
CompressionConverter() - Constructor for class org.apache.parquet.hadoop.util.CompressionConverter
 
CompressionConverter.TransParquetFileReader - Class in org.apache.parquet.hadoop.util
 
ConcatenatingKeyValueMetadataMergeStrategy - Class in org.apache.parquet.hadoop.metadata
Strategy to concatenate if there are multiple values for a given key in metadata.
ConcatenatingKeyValueMetadataMergeStrategy() - Constructor for class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
Default constructor.
ConcatenatingKeyValueMetadataMergeStrategy(String) - Constructor for class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
Constructor to use different delimiter for concatenation.
conf - Variable in class org.apache.parquet.hadoop.ParquetReader.Builder
 
config(String, String) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set a property that will be available to the read path.
configuration - Variable in class org.apache.parquet.hadoop.CodecFactory
 
ConfigurationUtil - Class in org.apache.parquet.hadoop.util
 
ConfigurationUtil() - Constructor for class org.apache.parquet.hadoop.util.ConfigurationUtil
 
Container<T> - Class in org.apache.parquet.hadoop.mapred
A simple container of objects that you can get and set.
Container() - Constructor for class org.apache.parquet.hadoop.mapred.Container
 
ContextUtil - Class in org.apache.parquet.hadoop.util
Utility methods to allow applications to deal with inconsistencies between MapReduce Context Objects API between hadoop-0.20 and later versions.
ContextUtil() - Constructor for class org.apache.parquet.hadoop.util.ContextUtil
 
ContractViolation(ColumnIndexValidator.Contract, String, String, int, int, ColumnPath, int) - Constructor for class org.apache.parquet.hadoop.ColumnIndexValidator.ContractViolation
 
convertEncodingStats(List<PageEncodingStats>) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
convertEncodingStats(EncodingStats) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
convertToColumnPaths(List<String>) - Static method in class org.apache.parquet.hadoop.util.ColumnMasker
 
copy(ParquetReadOptions) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
CounterLoader - Interface in org.apache.parquet.hadoop.util.counters
Factory interface for CounterLoaders, will load the counter according to groupName, counterName, and if in the configuration, flag with name counterFlag is false, the counter will not be loaded
create(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
CREATE - org.apache.parquet.hadoop.ParquetFileWriter.Mode
 
createCompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
createCompressor() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
createCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
 
createDecompressor() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
createDecompressor() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
createDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
 
createDirectCodecFactory(Configuration, ByteBufferAllocator, int) - Static method in class org.apache.parquet.hadoop.CodecFactory
Create a codec factory that will provide compressors and decompressors that will work natively with ByteBuffers backed by direct memory.
createEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
createFooterAAD(byte[]) - Static method in class org.apache.parquet.crypto.AesCipher
 
createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
createInputStream(InputStream) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
createInputStream(InputStream, Decompressor) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
createModuleAAD(byte[], ModuleCipherFactory.ModuleType, int, int, int) - Static method in class org.apache.parquet.crypto.AesCipher
 
createOrOverwrite(long) - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
createOutputStream(OutputStream) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
createOutputStream(OutputStream, Compressor) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
createSignedFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
CRYPTO_FACTORY_CLASS_PROPERTY_NAME - Static variable in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
 
CRYPTO_FACTORY_CLASS_PROPERTY_NAME - Static variable in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
 
CTR - org.apache.parquet.crypto.AesMode
 
CTR_IV_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
 
CURRENT_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
 

D

DATA_KEY_LENGTH_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
 
DATA_KEY_LENGTH_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
Length of data encryption keys (DEKs), randomly generated by parquet key management tools.
DataPage - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
DataPageHeader - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
decompress(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
Fills specified buffer with uncompressed data.
decompress(ByteBuffer, int, ByteBuffer, int) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
Deprecated.
 
decompress(BytesInput, int) - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
Deprecated.
 
decrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrDecryptor
 
decrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmDecryptor
 
decrypt(byte[], int, int, byte[]) - Method in class org.apache.parquet.crypto.AesCtrDecryptor
 
decrypt(byte[], int, int, byte[]) - Method in class org.apache.parquet.crypto.AesGcmDecryptor
 
decrypt(InputStream, byte[]) - Method in class org.apache.parquet.crypto.AesCtrDecryptor
 
decrypt(InputStream, byte[]) - Method in class org.apache.parquet.crypto.AesGcmDecryptor
 
decryptIfNeeded() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
DecryptionKeyRetriever - Interface in org.apache.parquet.crypto
Interface for classes retrieving encryption keys using the key metadata.
DecryptionPropertiesFactory - Interface in org.apache.parquet.crypto
DecryptionPropertiesFactory interface enables transparent activation of Parquet decryption.
decryptKeyLocally(String, byte[], byte[]) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
Decrypts encrypted key with "masterKey", using AES-GCM and the "AAD"
DEFAULT_BLOCK_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
DEFAULT_COMPRESSION_CODEC_NAME - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
DEFAULT_IS_DICTIONARY_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
DEFAULT_IS_VALIDATING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
DEFAULT_PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
DEFAULT_PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
DEFAULT_PARQUET_COMPRESS_ZSTD_LEVEL - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
DEFAULT_WRITER_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
defaultBlockSize() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
DEFAULTPARQUET_COMPRESS_ZSTD_WORKERS - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
DelegatingReadSupport<T> - Class in org.apache.parquet.hadoop.api
Helps composing read supports
DelegatingReadSupport(ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.api.DelegatingReadSupport
 
DelegatingWriteSupport<T> - Class in org.apache.parquet.hadoop.api
Helps composing write supports
DelegatingWriteSupport(WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.api.DelegatingWriteSupport
 
DeprecatedParquetInputFormat<V> - Class in org.apache.parquet.hadoop.mapred
 
DeprecatedParquetInputFormat() - Constructor for class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
 
DeprecatedParquetOutputFormat<V> - Class in org.apache.parquet.hadoop.mapred
 
DeprecatedParquetOutputFormat() - Constructor for class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
description - Variable in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
DICTIONARY - org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
 
DICTIONARY_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure whether row group dictionary filtering is enabled
DICTIONARY_PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
DictionaryFilter - Class in org.apache.parquet.filter2.dictionarylevel
Applies filters based on the contents of column dictionaries.
DictionaryPage - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
DictionaryPageHeader - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
DOUBLE_WRAPPING_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
 
DOUBLE_WRAPPING_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
Use double wrapping - where data encryption keys (DEKs) are encrypted with key encryption keys (KEKs), which in turn are encrypted with master keys.

E

EF_MAGIC_STR - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
 
EFMAGIC - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
 
ENABLE_DICTIONARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
ENABLE_JOB_SUMMARY - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
Deprecated.
enableDictionaryEncoding() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Enables dictionary encoding for the constructed writer.
enablePageWriteChecksum() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Enables writing page level checksums for the constructed writer.
enableValidation() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Enables validation for the constructed writer.
EncodingList - Class in org.apache.parquet.hadoop.metadata
 
encrypt(boolean, byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
 
encrypt(boolean, byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
 
encrypt(boolean, byte[], byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
 
encrypt(boolean, byte[], byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
 
encrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesCtrEncryptor
 
encrypt(byte[], byte[]) - Method in class org.apache.parquet.crypto.AesGcmEncryptor
 
encryptColumnMetaData(InternalColumnEncryptionSetup) - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
encryptedFooter() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
 
ENCRYPTION_ALGORITHM_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
 
ENCRYPTION_ALGORITHM_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
Parquet encryption algorithm.
EncryptionPropertiesFactory - Interface in org.apache.parquet.crypto
EncryptionPropertiesFactory interface enables transparent activation of Parquet encryption.
encryptKeyLocally(byte[], byte[], byte[]) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
Encrypts "key" with "masterKey", using AES-GCM and the "AAD"
end() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
end() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
end(Map<String, String>) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
ends a file once all blocks have been written.
endBlock() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
ends a block once all column chunks have been written
endColumn() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
end a column (once all rep, def and data have been written)
equals(Object) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
equals(Object) - Method in class org.apache.parquet.hadoop.metadata.EncodingList
 
ESTIMATE_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
ExampleInputFormat - Class in org.apache.parquet.hadoop.example
Example input format to read Parquet files This Input format uses a rather inefficient data model but works independently of higher level abstractions.
ExampleInputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleInputFormat
 
ExampleOutputFormat - Class in org.apache.parquet.hadoop.example
An example output format must be provided the schema up front
ExampleOutputFormat() - Constructor for class org.apache.parquet.hadoop.example.ExampleOutputFormat
 
ExampleParquetWriter - Class in org.apache.parquet.hadoop.example
An example file writer class.
ExampleParquetWriter.Builder - Class in org.apache.parquet.hadoop.example
 

F

f - Variable in class org.apache.parquet.hadoop.ParquetFileReader
 
fetchFooterDecryptor() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
fileDecryptionProperties - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
FileDecryptionProperties - Class in org.apache.parquet.crypto
 
FileDecryptionProperties.Builder - Class in org.apache.parquet.crypto
 
FileEncryptionProperties - Class in org.apache.parquet.crypto
 
FileEncryptionProperties.Builder - Class in org.apache.parquet.crypto
 
FileKeyMaterialStore - Interface in org.apache.parquet.crypto.keytools
 
FileKeyUnwrapper - Class in org.apache.parquet.crypto.keytools
 
FileKeyWrapper - Class in org.apache.parquet.crypto.keytools
 
FileMetaData - Class in org.apache.parquet.hadoop.metadata
File level meta data (Schema, codec, ...)
FileMetaData(MessageType, Map<String, String>, String) - Constructor for class org.apache.parquet.hadoop.metadata.FileMetaData
 
FileMetaData(MessageType, Map<String, String>, String, InternalFileDecryptor) - Constructor for class org.apache.parquet.hadoop.metadata.FileMetaData
 
FILTER_PREDICATE - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure the filter predicate
filterRowGroups(List<RowGroupFilter.FilterLevel>, FilterCompat.Filter, List<BlockMetaData>, ParquetFileReader) - Static method in class org.apache.parquet.filter2.compat.RowGroupFilter
 
filterRowGroups(FilterCompat.Filter, List<BlockMetaData>, MessageType) - Static method in class org.apache.parquet.filter2.compat.RowGroupFilter
Deprecated.
will be removed in 2.0.0.
FinalizedWriteContext(Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext
 
finalizeWrite() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
 
finalizeWrite() - Method in class org.apache.parquet.hadoop.api.WriteSupport
called once in the end after the last record was written
finish() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
finish() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
finished() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
finished() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
flush() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
flush() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
 
flushToFileWriter(ParquetFileWriter) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
 
Footer - Class in org.apache.parquet.hadoop
Represent the footer for a given file
Footer - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
Footer(Path, ParquetMetadata) - Constructor for class org.apache.parquet.hadoop.Footer
 
FOOTER_KEY_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
Master key ID for footer encryption/signing.
from(JobConf) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
use mapred api to read codec config
from(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
use mapreduce api to read codec config
fromJSON(String) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
 
fromParquetColumnIndex(PrimitiveType, ColumnIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
fromParquetMetadata(FileMetaData) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
fromParquetMetadata(FileMetaData, InternalFileDecryptor, boolean) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
fromParquetOffsetIndex(OffsetIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
fromParquetStatistics(String, Statistics, PrimitiveType) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
fromParquetStatistics(String, Statistics, PrimitiveType.PrimitiveTypeName) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
Deprecated.
will be removed in 2.0.0.
fromParquetStatistics(Statistics, PrimitiveType.PrimitiveTypeName) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
Deprecated.
will be removed in 2.0.0.
fromPath(Path, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopInputFile
 
fromPath(Path, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
fromStatus(FileStatus, Configuration) - Static method in class org.apache.parquet.hadoop.util.HadoopInputFile
 
fromString(String) - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
 

G

GCM - org.apache.parquet.crypto.AesMode
 
GCM_TAG_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
 
GCM_TAG_LENGTH_BITS - Static variable in class org.apache.parquet.crypto.AesCipher
 
get() - Method in class org.apache.parquet.hadoop.mapred.Container
 
get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
Deprecated.
get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
Deprecated.
get(ColumnPath, PrimitiveType.PrimitiveTypeName, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
get(ColumnPath, PrimitiveType, CompressionCodecName, Set<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
get(ColumnPath, PrimitiveType, CompressionCodecName, EncodingStats, Set<Encoding>, Statistics, long, long, long, long, long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getAADPrefix() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
 
getAlgorithm() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
 
getAllocator() - Method in class org.apache.parquet.ParquetReadOptions
 
getBlockFileSystems() - Static method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
getBlocks() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
 
getBlocks() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
the file footer is no longer read before creating input splits
getBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
Deprecated.
getBlockSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getBloomFilterDataReader(BlockMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getBloomFilterEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getBloomFilterMaxBytes(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getBloomFilterOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getBloomFilterWriter(ColumnDescriptor) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
 
getBytesRead() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
getBytesRead() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
 
getBytesWritten() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
getCipherName() - Method in enum org.apache.parquet.crypto.AesMode
 
getClassFromConfig(Configuration, String, Class<?>) - Static method in class org.apache.parquet.hadoop.util.ConfigurationUtil
 
getCodec() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
 
getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getCodec() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
getCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
 
getCodecFactory() - Method in class org.apache.parquet.ParquetReadOptions
 
getCodecName() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
Deprecated.
 
getColumnCryptoMetaData() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
 
getColumnIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getColumnKey(ColumnPath) - Method in class org.apache.parquet.crypto.FileDecryptionProperties
 
getColumnProperties(ColumnPath) - Method in class org.apache.parquet.crypto.FileEncryptionProperties
 
getColumns() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
getColumnSetup(ColumnPath) - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
getColumnSetup(ColumnPath, boolean, int) - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
getCompressedSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
getCompression(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getCompression(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getCompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
 
getCompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
getCompressorType() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
getConf() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
getConf() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
getConf() - Method in class org.apache.parquet.HadoopReadOptions
 
getConfiguration() - Method in class org.apache.parquet.hadoop.api.InitContext
 
getConfiguration() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
 
getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
 
getConfiguration() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
getConfiguration(JobContext) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
Invoke getConfiguration() method on JobContext.
getCount() - Method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter
 
getCount() - Method in interface org.apache.parquet.hadoop.util.counters.ICounter
 
getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
 
getCount() - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter
 
getCounter(TaskAttemptContext, String, String) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
 
getCounterByNameAndFlag(String, String, String) - Method in interface org.apache.parquet.hadoop.util.counters.CounterLoader
 
getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterLoader
 
getCounterByNameAndFlag(String, String, String) - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterLoader
 
getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
 
getCreatedBy() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
 
getCurrentKey() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
always returns null
getCurrentValue() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
getDataDecryptor() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
 
getDataEncryptor() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
 
getDataSize() - Method in class org.apache.parquet.hadoop.ParquetWriter
 
getDecompressor(CompressionCodecName) - Method in class org.apache.parquet.hadoop.CodecFactory
 
getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
getDecompressorType() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
getDecryptionProperties() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
getDecryptionProperties() - Method in class org.apache.parquet.ParquetReadOptions
 
getDecryptor(AesMode, byte[]) - Static method in class org.apache.parquet.crypto.ModuleCipherFactory
 
getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
getDefaultExtension() - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
getDictionaryPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getDictionaryPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getDictionaryPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getDictionaryReader(BlockMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getEnableDictionary(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getEnableDictionary(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
getEncoding(Encoding) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
getEncodingList(List<Encoding>) - Static method in class org.apache.parquet.hadoop.metadata.EncodingList
 
getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getEncodings() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
getEncodingStats() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getEncryptedColumns() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
 
getEncryptionAlgorithm() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
getEncryptionAlgorithm() - Method in enum org.apache.parquet.crypto.ParquetCipher
 
getEncryptor(AesMode, byte[]) - Static method in class org.apache.parquet.crypto.ModuleCipherFactory
 
getEnd() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
 
getEstimatePageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getExtraMetadata() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
will be removed in 2.0.0. the file footer is no longer read before creating input splits
getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.FinalizedWriteContext
 
getExtraMetaData() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
 
getFile() - Method in class org.apache.parquet.hadoop.Footer
 
getFile() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getFileAAD() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
 
getFileAAD() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
getFileAAD() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
getFileCryptoMetaData() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
getFileDecryptionProperties(Configuration, Path) - Method in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
Get FileDecryptionProperties object which is created by the implementation of this interface.
getFileDecryptionProperties(Configuration, Path) - Method in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
 
getFileDecryptor() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
 
getFileEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Method in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
Get FileEncryptionProperties object which is created by the implementation of this interface.
getFileEncryptionProperties(Configuration, Path, WriteSupport.WriteContext) - Method in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
 
getFileMetaData() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
 
getFileMetaData() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getFileSchema() - Method in class org.apache.parquet.hadoop.api.InitContext
this is the union of all the schemas when reading multiple files.
getFileSchema() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
the file footer is no longer read before creating input splits
getFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
Returns a non-null Filter, which is a wrapper around either a FilterPredicate, an UnboundRecordFilter, or a no-op filter.
getFilteredRecordCount() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getFirstDataPageOffset() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getFooter() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
getFooter() - Method in class org.apache.parquet.hadoop.ParquetWriter
 
getFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
getFooterKey() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
 
getFooterKey() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
 
getFooterKeyMetadata() - Method in class org.apache.parquet.crypto.FileEncryptionProperties
 
getFooters(Configuration, Collection<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
the footers for the files
getFooters(Configuration, List<FileStatus>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
 
getFooters(JobConf) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
 
getFooters(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
 
getFooterSigningKeyMetaData() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
getGlobalMetaData(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
 
getHadoopOutputCompressorClass(Class) - Method in class org.apache.parquet.hadoop.codec.CodecConfig
 
getJobSummaryLevel(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getKey(byte[]) - Method in interface org.apache.parquet.crypto.DecryptionKeyRetriever
Returns encryption key using the key metadata.
getKey(byte[]) - Method in class org.apache.parquet.crypto.keytools.FileKeyUnwrapper
 
getKeyBytes() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties
 
getKeyBytes() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
 
getKeyIDSet() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
 
getKeyIDSet() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
getKeyMaterial(String) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
Get key material
getKeyMaterial(String) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
getKeyMetaData() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
 
getKeyRetriever() - Method in class org.apache.parquet.crypto.FileDecryptionProperties
 
getKeyValueMetadata() - Method in class org.apache.parquet.hadoop.api.InitContext
each key is associated with the list of distinct values found in footers
getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
 
getKeyValueMetaData() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
 
getLength() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
 
getLength() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference
 
getLongBlockSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getMasterKeyFromServer(String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
Get master key from the remote KMS server.
getMaxAllocationSize() - Method in class org.apache.parquet.ParquetReadOptions
 
getMaxRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getMemoryManager() - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getMergedKeyValueMetaData() - Method in class org.apache.parquet.hadoop.api.InitContext
Deprecated.
getMetaDataDecryptor() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
 
getMetaDataEncryptor() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
 
getMetadataFilter() - Method in class org.apache.parquet.ParquetReadOptions
 
getMinRowCountForPageSizeCheck(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getMode() - Method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
 
getName() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
 
getName() - Method in class org.apache.parquet.hadoop.api.WriteSupport
Called to get a name to identify the WriteSupport object model.
getName() - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
 
getNextDictionaryReader() - Method in class org.apache.parquet.hadoop.ParquetFileReader
Returns a DictionaryPageReadStore for the row group that would be returned by calling ParquetFileReader.readNextRowGroup() or skipped by calling ParquetFileReader.skipNextRowGroup().
getNextRowGroupSize() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
getOffset() - Method in class org.apache.parquet.internal.hadoop.metadata.IndexReference
 
getOffsetIndexReference() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getOrdinal() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
 
getOrdinal() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
 
getOrdinal() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
getOutputCommitter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getPageSize(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getPageSize(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getPageWriteChecksumEnabled(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getPageWriter(ColumnDescriptor) - Method in class org.apache.parquet.hadoop.ColumnChunkPageWriteStore
 
getParquetCompressionCodec(Configuration) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
 
getParquetMetadata() - Method in class org.apache.parquet.hadoop.Footer
 
getPath() - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties
 
getPath() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
 
getPath() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getPath() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
getPath() - Method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
will be removed in 2.0.0; use ParquetFileReader.getFile() instead
getPath() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
 
getPath() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
getPos() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
getPos() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
 
getPos() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
 
getPrimitive(Type) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getPrimitiveType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
getProgress() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
getProperty(String) - Method in class org.apache.parquet.HadoopReadOptions
 
getProperty(String) - Method in class org.apache.parquet.ParquetReadOptions
 
getPropertyNames() - Method in class org.apache.parquet.ParquetReadOptions
 
getReadSupport() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
getReadSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
getReadSupportInstance(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
getReadSupportMetadata() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
 
getRecordCount() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions
 
getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
 
getRecordWriter(Configuration, Path, CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getRecordWriter(Configuration, Path, CompressionCodecName, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
getRecordWriter(TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
getRecordWriter(TaskAttemptContext, Path) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getRecordWriter(TaskAttemptContext, Path, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getRecordWriter(TaskAttemptContext, ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getRemaining() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
getRequestedSchema() - Method in class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
 
getRowCount() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
getRowGroupOffsets() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
will be removed in 2.0.0.
getRowGroupOrdinal() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getRowGroups() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
getSchema() - Method in class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
 
getSchema() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
 
getSchema() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
 
getSchema(Configuration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport
 
getSchema(Job) - Static method in class org.apache.parquet.hadoop.example.ExampleOutputFormat
retrieve the schema from the conf
getSchemaForRead(MessageType, String) - Static method in class org.apache.parquet.hadoop.api.ReadSupport
attempts to validate and construct a MessageType from a read projection schema
getSchemaForRead(MessageType, MessageType) - Static method in class org.apache.parquet.hadoop.api.ReadSupport
 
getSignedFooterEncryptor() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
getSplits(Configuration, List<Footer>) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
Deprecated.
split planning using file footers will be removed
getSplits(JobConf, int) - Method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
 
getSplits(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
getStartingPos() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getStatistics() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getStream() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
 
getTime() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
 
getTotalBytes() - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
 
getTotalByteSize() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
getTotalSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getTotalUncompressedSize() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
Deprecated.
will be removed in 2.0.0. Use ColumnChunkMetaData.getPrimitiveType() instead.
getType() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
Deprecated.
will be removed in 2.0.0. Use ColumnChunkProperties.getPrimitiveType() instead.
getUnboundRecordFilter(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
getValidation(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getValidation(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getValue() - Method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
getValueCount() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getWithEncryptedMetadata(ParquetMetadataConverter, ColumnPath, PrimitiveType, byte[], byte[], InternalFileDecryptor, int, int, String) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
getWriterVersion(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
 
getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
getWriteSupport(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
 
getWriteSupportClass(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
GlobalMetaData - Class in org.apache.parquet.hadoop.metadata
Merged metadata when reading from multiple files.
GlobalMetaData(MessageType, Map<String, Set<String>>, Set<String>) - Constructor for class org.apache.parquet.hadoop.metadata.GlobalMetaData
 
GroupReadSupport - Class in org.apache.parquet.hadoop.example
 
GroupReadSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupReadSupport
 
GroupWriteSupport - Class in org.apache.parquet.hadoop.example
 
GroupWriteSupport() - Constructor for class org.apache.parquet.hadoop.example.GroupWriteSupport
 

H

HadoopCodecs - Class in org.apache.parquet.hadoop.util
 
HadoopCodecs() - Constructor for class org.apache.parquet.hadoop.util.HadoopCodecs
 
hadoopConfiguration - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
HadoopFSKeyMaterialStore - Class in org.apache.parquet.crypto.keytools
 
HadoopInputFile - Class in org.apache.parquet.hadoop.util
 
HadoopOutputFile - Class in org.apache.parquet.hadoop.util
 
HadoopPositionOutputStream - Class in org.apache.parquet.hadoop.util
 
HadoopReadOptions - Class in org.apache.parquet
 
HadoopReadOptions.Builder - Class in org.apache.parquet
 
HadoopStreams - Class in org.apache.parquet.hadoop.util
Convenience methods to get Parquet abstractions for Hadoop data streams.
HadoopStreams() - Constructor for class org.apache.parquet.hadoop.util.HadoopStreams
 
hasCounterMethod(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
 
hasDictionaryPage() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
HASH - org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
 
hashCode() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
hashCode() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
 
HiddenFileFilter - Class in org.apache.parquet.hadoop.util
A PathFilter that filters out hidden files.

I

ICounter - Interface in org.apache.parquet.hadoop.util.counters
Interface for counters in mapred/mapreduce package of hadoop
incErrors(RecordMaterializer.RecordMaterializationException) - Method in class org.apache.parquet.hadoop.UnmaterializableRecordCounter
 
increment(long) - Method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter
 
increment(long) - Method in interface org.apache.parquet.hadoop.util.counters.ICounter
 
increment(long) - Method in class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
 
increment(long) - Method in class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter
 
incrementBytesRead(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
 
incrementCounter(Counter, long) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
 
incrementTime(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
 
incrementTotalBytes(long) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
 
IndexReference - Class in org.apache.parquet.internal.hadoop.metadata
Reference to an index (OffsetIndex and ColumnIndex) for a row-group containing the offset and length values so the reader can read the referenced data.
IndexReference(long, int) - Constructor for class org.apache.parquet.internal.hadoop.metadata.IndexReference
 
init(Configuration) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
 
init(Configuration) - Method in class org.apache.parquet.hadoop.api.WriteSupport
called first in the task
init(Configuration) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
 
init(Configuration, Map<String, String>, MessageType) - Method in class org.apache.parquet.hadoop.api.ReadSupport
Deprecated.
init(Configuration, Map<String, String>, MessageType) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport
 
init(InitContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
 
init(InitContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport
called in InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext) in the front end
InitContext - Class in org.apache.parquet.hadoop.api
Context passed to ReadSupport when initializing for read
InitContext(Configuration, Map<String, Set<String>>, MessageType) - Constructor for class org.apache.parquet.hadoop.api.InitContext
 
initCounterFromContext(TaskAttemptContext) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
Init counters in hadoop's mapreduce API, support both 1.x and 2.x
initCounterFromReporter(Reporter, Configuration) - Static method in class org.apache.parquet.hadoop.util.counters.BenchmarkCounter
Init counters in hadoop's mapred API, which is used by cascading and Hive.
initialize(Configuration, String, String, String) - Method in interface org.apache.parquet.crypto.keytools.KmsClient
Pass configuration with KMS-specific parameters.
initialize(Configuration, String, String, String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
initialize(Path, Configuration, boolean) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
Initializes key material store for a parquet file.
initialize(Path, Configuration, boolean) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
initialize(InputSplit, Configuration, Reporter) - Method in class org.apache.parquet.hadoop.ParquetRecordReader
 
initialize(InputSplit, TaskAttemptContext) - Method in class org.apache.parquet.hadoop.ParquetRecordReader
initializeInternal() - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
Pass configuration with KMS-specific parameters.
INSTANCE - Static variable in class org.apache.parquet.hadoop.util.HiddenFileFilter
 
InternalColumnDecryptionSetup - Class in org.apache.parquet.crypto
 
InternalColumnEncryptionSetup - Class in org.apache.parquet.crypto
 
InternalFileDecryptor - Class in org.apache.parquet.crypto
 
InternalFileDecryptor(FileDecryptionProperties) - Constructor for class org.apache.parquet.crypto.InternalFileDecryptor
 
InternalFileEncryptor - Class in org.apache.parquet.crypto
 
InternalFileEncryptor(FileEncryptionProperties) - Constructor for class org.apache.parquet.crypto.InternalFileEncryptor
 
isCompressionSet(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
isCompressionSet(JobContext) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
isEnabled(String, boolean) - Method in class org.apache.parquet.ParquetReadOptions
 
isEncrypted() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
 
isEncrypted() - Method in class org.apache.parquet.crypto.InternalColumnDecryptionSetup
 
isEncrypted() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
 
isEncryptedWithFooterKey() - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties
 
isEncryptedWithFooterKey() - Method in class org.apache.parquet.crypto.InternalColumnEncryptionSetup
 
isFooterEncrypted() - Method in class org.apache.parquet.crypto.InternalFileEncryptor
 
isHadoopCompressionSet() - Method in class org.apache.parquet.hadoop.codec.CodecConfig
 
isParquetCompressionSet(Configuration) - Static method in class org.apache.parquet.hadoop.codec.CodecConfig
 
isSplitable(JobContext, Path) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
 
isTaskSideMetaData(Configuration) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
isTaskSideMetaData(JobConf) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
 
iterator() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
 

J

JOB_SUMMARY_LEVEL - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
Must be one of the values in ParquetOutputFormat.JobSummaryLevel (case insensitive)

K

KEK_ID_LENGTH - Static variable in class org.apache.parquet.crypto.keytools.FileKeyWrapper
 
KEK_LENGTH_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
 
KEK_LENGTH_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
Length of key encryption keys (KEKs), randomly generated by parquet key management tools.
KEY_ACCESS_TOKEN_DEFAULT - Static variable in interface org.apache.parquet.crypto.keytools.KmsClient
 
KEY_ACCESS_TOKEN_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
Authorization token that will be passed to KMS.
KEY_MATERIAL_FILE_PREFIX - Static variable in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
KEY_MATERIAL_FILE_SUFFFIX - Static variable in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
KEY_MATERIAL_INTERNAL_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
 
KEY_MATERIAL_INTERNAL_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
Store key material inside Parquet file footers; this mode doesn’t produce additional files.
KeyAccessDeniedException - Exception in org.apache.parquet.crypto
 
KeyAccessDeniedException() - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
 
KeyAccessDeniedException(String) - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
 
KeyAccessDeniedException(String, Throwable) - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
 
KeyAccessDeniedException(Throwable) - Constructor for exception org.apache.parquet.crypto.KeyAccessDeniedException
 
KeyMaterial - Class in org.apache.parquet.crypto.keytools
KeyMaterial class represents the "key material", keeping the information that allows readers to recover an encryption key (see description of the KeyMetadata class).
KeyMetadata - Class in org.apache.parquet.crypto.keytools
Parquet encryption specification defines "key metadata" as an arbitrary byte array, generated by file writers for each encryption key, and passed to the low level API for storage in the file footer .
KeyToolkit - Class in org.apache.parquet.crypto.keytools
 
KeyToolkit() - Constructor for class org.apache.parquet.crypto.keytools.KeyToolkit
 
KeyValueMetadataMergeStrategy - Interface in org.apache.parquet.hadoop.metadata
Strategy to merge metadata.
KMS_CLIENT_CLASS_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
Class implementing the KmsClient interface.
KMS_INSTANCE_ID_DEFAULT - Static variable in interface org.apache.parquet.crypto.keytools.KmsClient
 
KMS_INSTANCE_ID_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
ID of the KMS instance that will be used for encryption (if multiple KMS instances are available).
KMS_INSTANCE_URL_DEFAULT - Static variable in interface org.apache.parquet.crypto.keytools.KmsClient
 
KMS_INSTANCE_URL_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.KeyToolkit
URL of the KMS instance.
KmsClient - Interface in org.apache.parquet.crypto.keytools
 
kmsInstanceID - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
kmsInstanceURL - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
kmsToken - Variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 

L

listStatus(JobContext) - Method in class org.apache.parquet.hadoop.ParquetInputFormat
 
loadFactory(Configuration) - Static method in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
Load DecryptionPropertiesFactory class specified by CRYPTO_FACTORY_CLASS_PROPERTY_NAME as the path in the configuration
loadFactory(Configuration) - Static method in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
Load EncryptionPropertiesFactory class specified by CRYPTO_FACTORY_CLASS_PROPERTY_NAME as the path in the configuration
LOCAL_WRAP_NO_KEY_VERSION - Static variable in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
localNonce - Variable in class org.apache.parquet.crypto.AesCipher
 
LocalWrapKmsClient - Class in org.apache.parquet.crypto.keytools
Typically, KMS systems support in-server key wrapping.
LocalWrapKmsClient() - Constructor for class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
LOG - Static variable in interface org.apache.parquet.crypto.DecryptionPropertiesFactory
 
LOG - Static variable in interface org.apache.parquet.crypto.EncryptionPropertiesFactory
 

M

MAGIC - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
 
MAGIC_STR - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
 
main(String[]) - Static method in class org.apache.parquet.hadoop.PrintFooter
 
MapRedCounterAdapter - Class in org.apache.parquet.hadoop.util.counters.mapred
Adapt a mapred counter to ICounter
MapRedCounterAdapter(Counters.Counter) - Constructor for class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
 
MapRedCounterLoader - Class in org.apache.parquet.hadoop.util.counters.mapred
Concrete factory for counters in mapred API, get a counter using mapred API when the corresponding flag is set, otherwise return a NullCounter
MapRedCounterLoader(Reporter, Configuration) - Constructor for class org.apache.parquet.hadoop.util.counters.mapred.MapRedCounterLoader
 
MapredParquetOutputCommitter - Class in org.apache.parquet.hadoop.mapred
Adapter for supporting ParquetOutputCommitter in mapred API
MapredParquetOutputCommitter() - Constructor for class org.apache.parquet.hadoop.mapred.MapredParquetOutputCommitter
 
MapReduceCounterAdapter - Class in org.apache.parquet.hadoop.util.counters.mapreduce
Adapt a mapreduce counter to ICounter
MapReduceCounterAdapter(Counter) - Constructor for class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterAdapter
 
MapReduceCounterLoader - Class in org.apache.parquet.hadoop.util.counters.mapreduce
Concrete factory for counters in mapred API, get a counter using mapreduce API when the corresponding flag is set, otherwise return a NullCounter
MapReduceCounterLoader(TaskAttemptContext) - Constructor for class org.apache.parquet.hadoop.util.counters.mapreduce.MapReduceCounterLoader
 
MAX_ASCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
MAX_DESCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
MAX_GTEQ_VALUE - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
MAX_PADDING_BYTES - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
MAX_PADDING_SIZE_DEFAULT - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
MAX_ROW_COUNT_FOR_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
MAX_STATS_SIZE - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
maxAllocationSize - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
MEMORY_POOL_RATIO - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
MemoryManager - Class in org.apache.parquet.hadoop
Implements a memory manager that keeps a global context of how many Parquet writers there are and manages the memory between them.
MemoryManager(float, long) - Constructor for class org.apache.parquet.hadoop.MemoryManager
 
merge() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
Will merge the metadata as if it was coming from a single file.
merge(Map<String, Set<String>>) - Method in class org.apache.parquet.hadoop.metadata.ConcatenatingKeyValueMetadataMergeStrategy
 
merge(Map<String, Set<String>>) - Method in interface org.apache.parquet.hadoop.metadata.KeyValueMetadataMergeStrategy
 
merge(Map<String, Set<String>>) - Method in class org.apache.parquet.hadoop.metadata.StrictKeyValueMetadataMergeStrategy
 
merge(KeyValueMetadataMergeStrategy) - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
Will merge the metadata as if it was coming from a single file.
mergeMetadataFiles(List<Path>, Configuration) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
mergeMetadataFiles(List<Path>, Configuration, KeyValueMetadataMergeStrategy) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
metadataFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
MIN_ASCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
MIN_DESCENDING - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
MIN_LTEQ_VALUE - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
MIN_MEMORY_ALLOCATION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
MIN_ROW_COUNT_FOR_PAGE_SIZE_CHECK - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
ModuleCipherFactory - Class in org.apache.parquet.crypto
 
ModuleCipherFactory() - Constructor for class org.apache.parquet.crypto.ModuleCipherFactory
 
ModuleCipherFactory.ModuleType - Enum in org.apache.parquet.crypto
 
moveMaterialTo(FileKeyMaterialStore) - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
Move key material to another store.
moveMaterialTo(FileKeyMaterialStore) - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 

N

needsDictionary() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
needsInput() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
needsInput() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
newDirectFactory(Configuration, ByteBufferAllocator, int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs
 
newFactory(int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs
 
newFactory(Configuration, int) - Static method in class org.apache.parquet.hadoop.util.HadoopCodecs
 
newGenericCounter(String, String, long) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
 
newJobContext(Configuration, JobID) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
Creates JobContext from a JobConf and jobId using the correct constructor for based on Hadoop version.
newStream() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
 
newTaskAttemptContext(Configuration, TaskAttemptID) - Static method in class org.apache.parquet.hadoop.util.ContextUtil
Creates TaskAttemptContext from a JobConf and jobId using the correct constructor for based on Hadoop version.
nextKeyValue() - Method in class org.apache.parquet.hadoop.ParquetRecordReader
NO_FILTER - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
NonBlockedCompressorStream - Class in org.apache.parquet.hadoop.codec
CompressorStream class that should be used instead of the default hadoop CompressorStream object.
NonBlockedCompressorStream(OutputStream, Compressor, int) - Constructor for class org.apache.parquet.hadoop.codec.NonBlockedCompressorStream
 
NonBlockedDecompressorStream - Class in org.apache.parquet.hadoop.codec
DecompressorStream class that should be used instead of the default hadoop DecompressorStream object.
NonBlockedDecompressorStream(InputStream, Decompressor, int) - Constructor for class org.apache.parquet.hadoop.codec.NonBlockedDecompressorStream
 
NONCE_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
 
NONE - org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
Write no summary files
NULL_COUNT_CORRECT - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
NULL_PAGE_HAS_NO_MAX - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
NULL_PAGE_HAS_NO_MIN - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
NULL_PAGE_HAS_NO_VALUES - org.apache.parquet.hadoop.ColumnIndexValidator.Contract
 
NullCounter() - Constructor for class org.apache.parquet.hadoop.util.counters.BenchmarkCounter.NullCounter
 
NULLIFY - org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
 

O

OBJECT_MODEL_NAME_PROP - Static variable in class org.apache.parquet.hadoop.ParquetWriter
 
OffsetIndex - org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
 
offsets(long...) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
open(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
will be removed in 2.0.0; use ParquetFileReader.open(InputFile)
open(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
open(Configuration, Path, ParquetMetadata) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
will be removed in 2.0.0
open(InputFile) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Open a file.
open(InputFile, ParquetReadOptions) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Open a file with options.
org.apache.parquet - package org.apache.parquet
 
org.apache.parquet.crypto - package org.apache.parquet.crypto
 
org.apache.parquet.crypto.keytools - package org.apache.parquet.crypto.keytools
 
org.apache.parquet.filter2.bloomfilterlevel - package org.apache.parquet.filter2.bloomfilterlevel
 
org.apache.parquet.filter2.compat - package org.apache.parquet.filter2.compat
 
org.apache.parquet.filter2.dictionarylevel - package org.apache.parquet.filter2.dictionarylevel
 
org.apache.parquet.filter2.statisticslevel - package org.apache.parquet.filter2.statisticslevel
 
org.apache.parquet.format.converter - package org.apache.parquet.format.converter
 
org.apache.parquet.hadoop - package org.apache.parquet.hadoop
Provides classes to store use Parquet files in Hadoop In a map reduce job:
org.apache.parquet.hadoop.api - package org.apache.parquet.hadoop.api
APIs to integrate various type systems with Parquet
org.apache.parquet.hadoop.codec - package org.apache.parquet.hadoop.codec
 
org.apache.parquet.hadoop.example - package org.apache.parquet.hadoop.example
 
org.apache.parquet.hadoop.mapred - package org.apache.parquet.hadoop.mapred
 
org.apache.parquet.hadoop.metadata - package org.apache.parquet.hadoop.metadata
 
org.apache.parquet.hadoop.util - package org.apache.parquet.hadoop.util
 
org.apache.parquet.hadoop.util.counters - package org.apache.parquet.hadoop.util.counters
 
org.apache.parquet.hadoop.util.counters.mapred - package org.apache.parquet.hadoop.util.counters.mapred
 
org.apache.parquet.hadoop.util.counters.mapreduce - package org.apache.parquet.hadoop.util.counters.mapreduce
 
org.apache.parquet.internal.hadoop.metadata - package org.apache.parquet.internal.hadoop.metadata
 
out - Variable in class org.apache.parquet.hadoop.ParquetFileWriter
 
OVERWRITE - org.apache.parquet.hadoop.ParquetFileWriter.Mode
 

P

PAGE_ROW_COUNT_LIMIT - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
PAGE_SIZE - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
PAGE_VERIFY_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure whether page level checksum verification is enabled
PAGE_WRITE_CHECKSUM_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
pageSize - Variable in class org.apache.parquet.hadoop.CodecFactory
 
PARQUET_COMMON_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
 
PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
PARQUET_COMPRESS_ZSTD_LEVEL - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
PARQUET_COMPRESS_ZSTD_WORKERS - Static variable in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
PARQUET_EXAMPLE_SCHEMA - Static variable in class org.apache.parquet.hadoop.example.GroupWriteSupport
 
PARQUET_METADATA_FILE - Static variable in class org.apache.parquet.hadoop.ParquetFileWriter
 
PARQUET_READ_PARALLELISM - Static variable in class org.apache.parquet.hadoop.ParquetFileReader
 
PARQUET_READ_SCHEMA - Static variable in class org.apache.parquet.hadoop.api.ReadSupport
configuration key for a parquet read projection schema
ParquetCipher - Enum in org.apache.parquet.crypto
 
ParquetCryptoRuntimeException - Exception in org.apache.parquet.crypto
Thrown upon encryption or decryption operation problem
ParquetCryptoRuntimeException() - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
 
ParquetCryptoRuntimeException(String) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
 
ParquetCryptoRuntimeException(String, Throwable) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
 
ParquetCryptoRuntimeException(Throwable) - Constructor for exception org.apache.parquet.crypto.ParquetCryptoRuntimeException
 
ParquetFileReader - Class in org.apache.parquet.hadoop
Internal implementation of the Parquet file reader as a block container
ParquetFileReader(Configuration, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
will be removed in 2.0.0.
ParquetFileReader(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
will be removed in 2.0.0.
ParquetFileReader(Configuration, Path, ParquetMetadata) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
will be removed in 2.0.0.
ParquetFileReader(Configuration, FileMetaData, Path, List<BlockMetaData>, List<ColumnDescriptor>) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
will be removed in 2.0.0.
ParquetFileReader(InputFile, ParquetReadOptions) - Constructor for class org.apache.parquet.hadoop.ParquetFileReader
 
ParquetFileWriter - Class in org.apache.parquet.hadoop
Internal implementation of the Parquet file writer as a block container
ParquetFileWriter(Configuration, MessageType, Path) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
will be removed in 2.0.0
ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
will be removed in 2.0.0
ParquetFileWriter(Configuration, MessageType, Path, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
will be removed in 2.0.0
ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
will be removed in 2.0.0
ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
 
ParquetFileWriter(OutputFile, MessageType, ParquetFileWriter.Mode, long, int, int, int, boolean, FileEncryptionProperties) - Constructor for class org.apache.parquet.hadoop.ParquetFileWriter
 
ParquetFileWriter.Mode - Enum in org.apache.parquet.hadoop
 
ParquetInputFormat<T> - Class in org.apache.parquet.hadoop
The input format to read a Parquet file.
ParquetInputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat
Hadoop will instantiate using this constructor
ParquetInputFormat(Class<S>) - Constructor for class org.apache.parquet.hadoop.ParquetInputFormat
Constructor for subclasses, such as AvroParquetInputFormat, or wrappers.
ParquetInputSplit - Class in org.apache.parquet.hadoop
Deprecated.
will be removed in 2.0.0. use org.apache.hadoop.mapred.FileSplit instead.
ParquetInputSplit() - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
Writables must have a parameterless constructor
ParquetInputSplit(Path, long, long, long, String[], long[]) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
 
ParquetInputSplit(Path, long, long, String[], List<BlockMetaData>, String, String, Map<String, String>, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
ParquetMetadata - Class in org.apache.parquet.hadoop.metadata
Meta Data block stored in the footer of the file contains file level (Codec, Schema, ...) and block level (location, columns, record count, ...) meta data
ParquetMetadata(FileMetaData, List<BlockMetaData>) - Constructor for class org.apache.parquet.hadoop.metadata.ParquetMetadata
 
ParquetMetadataConverter - Class in org.apache.parquet.format.converter
 
ParquetMetadataConverter() - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
 
ParquetMetadataConverter(int) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
 
ParquetMetadataConverter(Configuration) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
Deprecated.
will be removed in 2.0.0; use ParquetMetadataConverter(ParquetReadOptions)
ParquetMetadataConverter(ParquetReadOptions) - Constructor for class org.apache.parquet.format.converter.ParquetMetadataConverter
 
ParquetMetadataConverter.MetadataFilter - Class in org.apache.parquet.format.converter
 
ParquetOutputCommitter - Class in org.apache.parquet.hadoop
 
ParquetOutputCommitter(Path, TaskAttemptContext) - Constructor for class org.apache.parquet.hadoop.ParquetOutputCommitter
 
ParquetOutputFormat<T> - Class in org.apache.parquet.hadoop
OutputFormat to write to a Parquet file It requires a WriteSupport to convert the actual records to the underlying format.
ParquetOutputFormat() - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat
used when directly using the output format and configuring the write support implementation using parquet.write.support.class
ParquetOutputFormat(S) - Constructor for class org.apache.parquet.hadoop.ParquetOutputFormat
constructor used when this OutputFormat in wrapped in another one (In Pig for example)
ParquetOutputFormat.JobSummaryLevel - Enum in org.apache.parquet.hadoop
 
ParquetReader<T> - Class in org.apache.parquet.hadoop
Read records from a Parquet file.
ParquetReader(Configuration, Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader
ParquetReader(Configuration, Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader
ParquetReader(Path, ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetReader
ParquetReader(Path, ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetReader
ParquetReader.Builder<T> - Class in org.apache.parquet.hadoop
 
ParquetReadOptions - Class in org.apache.parquet
 
ParquetReadOptions.Builder - Class in org.apache.parquet
 
ParquetRecordReader<T> - Class in org.apache.parquet.hadoop
Reads the records from a block of a Parquet file
ParquetRecordReader(ReadSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
 
ParquetRecordReader(ReadSupport<T>, UnboundRecordFilter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
Deprecated.
will be removed in 2.0.0.
ParquetRecordReader(ReadSupport<T>, FilterCompat.Filter) - Constructor for class org.apache.parquet.hadoop.ParquetRecordReader
 
ParquetRecordWriter<T> - Class in org.apache.parquet.hadoop
Writes records to a Parquet file
ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, int, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
Deprecated.
ParquetRecordWriter(ParquetFileWriter, WriteSupport<T>, MessageType, Map<String, String>, long, int, CodecFactory.BytesCompressor, int, boolean, boolean, ParquetProperties.WriterVersion, MemoryManager) - Constructor for class org.apache.parquet.hadoop.ParquetRecordWriter
Deprecated.
ParquetWriter<T> - Class in org.apache.parquet.hadoop
Write records to a Parquet file.
ParquetWriter(Path, Configuration, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
ParquetWriter(Path, WriteSupport<T>) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
will be removed in 2.0.0
ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
will be removed in 2.0.0
ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
will be removed in 2.0.0
ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
will be removed in 2.0.0
ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
will be removed in 2.0.0
ParquetWriter(Path, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
will be removed in 2.0.0
ParquetWriter(Path, ParquetFileWriter.Mode, WriteSupport<T>, CompressionCodecName, int, int, int, boolean, boolean, ParquetProperties.WriterVersion, Configuration) - Constructor for class org.apache.parquet.hadoop.ParquetWriter
Deprecated.
will be removed in 2.0.0
ParquetWriter.Builder<T,​SELF extends ParquetWriter.Builder<T,​SELF>> - Class in org.apache.parquet.hadoop
An abstract builder class for ParquetWriter instances.
PLAINTEXT_FOOTER_DEFAULT - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
 
PLAINTEXT_FOOTER_PROPERTY_NAME - Static variable in class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
Write files with plaintext footer.
plaintextFile() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
plaintextFilesAllowed() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
positiveLongFitsInAnInt(long) - Static method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
checks that a positive long value fits in an int.
prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
 
prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.api.ReadSupport
called in RecordReader.initialize(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext) in the back end the returned RecordMaterializer will materialize the records and add them to the destination
prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class org.apache.parquet.hadoop.example.GroupReadSupport
 
prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
 
prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.api.WriteSupport
This will be called once per row group
prepareForWrite(RecordConsumer) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
 
PrintFooter - Class in org.apache.parquet.hadoop
Utility to print footer information
PrintFooter() - Constructor for class org.apache.parquet.hadoop.PrintFooter
 
processBlocks(CompressionConverter.TransParquetFileReader, ParquetFileWriter, ParquetMetadata, MessageType, String, CompressionCodecName) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
 
processBlocks(CompressionConverter.TransParquetFileReader, ParquetFileWriter, ParquetMetadata, MessageType, List<String>, ColumnMasker.MaskMode) - Method in class org.apache.parquet.hadoop.util.ColumnMasker
 
properties - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
PropertiesDrivenCryptoFactory - Class in org.apache.parquet.crypto.keytools
 
PropertiesDrivenCryptoFactory() - Constructor for class org.apache.parquet.crypto.keytools.PropertiesDrivenCryptoFactory
 
pruneColumns(Configuration, Path, Path, List<String>) - Method in class org.apache.parquet.hadoop.util.ColumnPruner
 

Q

quickUpdatePageAAD(byte[], int) - Static method in class org.apache.parquet.crypto.AesCipher
 

R

randomGenerator - Variable in class org.apache.parquet.crypto.AesCipher
 
range(long, long) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
[ startOffset, endOffset )
read() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
 
read() - Method in class org.apache.parquet.hadoop.ParquetReader
 
read(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedDecompressorStream
 
read(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
 
read(InputFile) - Static method in class org.apache.parquet.hadoop.ParquetReader
 
READ_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure the ReadSupport implementation
readAllFootersInParallel(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
readAllFootersInParallel(Configuration, List<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readAllFootersInParallel(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readAllFootersInParallel(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readAllFootersInParallelUsingSummaryFiles(Configuration, Collection<FileStatus>, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
readAllFootersInParallelUsingSummaryFiles(Configuration, List<FileStatus>) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
readBlock(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
 
readBlockAllocate(int, CompressionConverter.TransParquetFileReader) - Method in class org.apache.parquet.hadoop.util.CompressionConverter
 
readBloomFilter(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.BloomFilterReader
 
readBloomFilter(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
Reads Bloom filter data for the given column chunk.
readColumnIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
ReadContext(MessageType) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
 
ReadContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.ReadSupport.ReadContext
 
readFields(DataInput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
readFooter(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readFooter(Configuration, FileStatus, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readFooter(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readFooter(Configuration, Path, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readFooter(InputFile, ParquetMetadataConverter.MetadataFilter) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readFooters(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readFooters(Configuration, FileStatus, boolean) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readFooters(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
readNextFilteredRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
Reads all the columns requested from the row group at the current file position.
readNextRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
Reads all the columns requested from the row group at the current file position.
readObjectFromConfAsBase64(String, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil
readOffsetIndex(ColumnChunkMetaData) - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
readPageHeader() - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
 
readParquetMetadata(InputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
Deprecated.
readParquetMetadata(InputStream, ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
readParquetMetadata(InputStream, ParquetMetadataConverter.MetadataFilter, InternalFileDecryptor, boolean, int) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
readSummaryFile(Configuration, FileStatus) - Static method in class org.apache.parquet.hadoop.ParquetFileReader
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
ReadSupport<T> - Class in org.apache.parquet.hadoop.api
Abstraction used by the ParquetInputFormat to materialize records
ReadSupport() - Constructor for class org.apache.parquet.hadoop.api.ReadSupport
 
ReadSupport.ReadContext - Class in org.apache.parquet.hadoop.api
information to read the file
realInputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetInputFormat
 
realOutputFormat - Variable in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
RECORD_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure whether record-level filtering is enabled
recordFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
REDACT - org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
 
registerScaleCallBack(String, Runnable) - Method in class org.apache.parquet.hadoop.MemoryManager
Register callback and deduplicate it if any.
reinit(Configuration) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesCompressor
Deprecated.
 
release() - Method in class org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
Deprecated.
 
release() - Method in class org.apache.parquet.hadoop.CodecFactory
 
removeCacheEntriesForAllTokens() - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
 
removeCacheEntriesForToken(String) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
Flush any caches that are tied to the (compromised) accessToken
removeMaterial() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
Remove key material from persistent store.
removeMaterial() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
reset() - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
reset() - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
resetState() - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
resetState() - Method in class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
 
rotateMasterKeys(String, Configuration) - Static method in class org.apache.parquet.crypto.keytools.KeyToolkit
Key rotation.
RowGroupFilter - Class in org.apache.parquet.filter2.compat
Given a FilterCompat.Filter applies it to a list of BlockMetaData (row groups) If the Filter is an UnboundRecordFilter or the no op filter, no filtering will be performed.
RowGroupFilter.FilterLevel - Enum in org.apache.parquet.filter2.compat
 
rowGroupOrdinal - Variable in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 

S

saveMaterial() - Method in interface org.apache.parquet.crypto.keytools.FileKeyMaterialStore
After key material was added for all keys in the given Parquet file, save material in persistent store.
saveMaterial() - Method in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
self() - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
 
self() - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
 
SerializationUtil - Class in org.apache.parquet.hadoop.util
Serialization utils copied from: https://github.com/kevinweil/elephant-bird/blob/master/core/src/main/java/com/twitter/elephantbird/util/HadoopUtils.java TODO: Refactor elephant-bird so that we can depend on utils like this without extra baggage.
set(String, String) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
set(String, String) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
set(T) - Method in class org.apache.parquet.hadoop.mapred.Container
 
setAsOutputFormat(JobConf) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
setBlockSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
setBlockSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setBloomFilterOffset(long) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
setColumnCryptoMetadata(ColumnPath, boolean, boolean, byte[], int) - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
setColumnIndexReference(IndexReference) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
setColumnIndexTruncateLength(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setColumnIndexTruncateLength(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setCompression(Configuration, CompressionCodecName) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
setCompression(Job, CompressionCodecName) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setConf(Configuration) - Method in class org.apache.parquet.hadoop.codec.SnappyCodec
 
setConf(Configuration) - Method in class org.apache.parquet.hadoop.codec.ZstandardCodec
 
setDictionary(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
setDictionary(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
setDictionaryPageSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setEnableDictionary(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
setEnableDictionary(Job, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setFileCryptoMetaData(EncryptionAlgorithm, boolean, byte[]) - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
setFilterPredicate(Configuration, FilterPredicate) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
setInput(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyCompressor
 
setInput(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.SnappyDecompressor
Sets input data for decompression.
setMaxPaddingSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setMaxPaddingSize(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setOffsetIndexReference(IndexReference) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
setOrdinal(int) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
setPageRowCountLimit(Configuration, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setPageRowCountLimit(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setPageSize(Configuration, int) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
setPageSize(Job, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setPageWriteChecksumEnabled(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setPageWriteChecksumEnabled(JobContext, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setPath(String) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
setPlaintextFile() - Method in class org.apache.parquet.crypto.InternalFileDecryptor
 
setReadSupportClass(JobConf, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
setReadSupportClass(Job, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
setRequestedSchema(MessageType) - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
setRowCount(long) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
setRowGroupOrdinal(int) - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
setSchema(Job, MessageType) - Static method in class org.apache.parquet.hadoop.example.ExampleOutputFormat
set the schema being written to the job conf
setSchema(MessageType, Configuration) - Static method in class org.apache.parquet.hadoop.example.GroupWriteSupport
 
setStatisticsTruncateLength(JobContext, int) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setStreamPosition(long) - Method in class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
 
setTaskSideMetaData(Job, boolean) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
setTotalByteSize(long) - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
setUnboundRecordFilter(Job, Class<? extends UnboundRecordFilter>) - Static method in class org.apache.parquet.hadoop.ParquetInputFormat
 
setValidation(Configuration, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setValidation(JobContext, boolean) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setWriteSupportClass(Configuration, Class<?>) - Static method in class org.apache.parquet.hadoop.mapred.DeprecatedParquetOutputFormat
 
setWriteSupportClass(JobConf, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
setWriteSupportClass(Job, Class<?>) - Static method in class org.apache.parquet.hadoop.ParquetOutputFormat
 
size() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
 
SIZE_LENGTH - Static variable in class org.apache.parquet.crypto.AesCipher
 
SIZE_LENGTH - Static variable in class org.apache.parquet.crypto.ModuleCipherFactory
 
SKIP_ROW_GROUPS - Static variable in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
skipNextRowGroup() - Method in class org.apache.parquet.hadoop.ParquetFileReader
 
SnappyCodec - Class in org.apache.parquet.hadoop.codec
Snappy compression codec for Parquet.
SnappyCodec() - Constructor for class org.apache.parquet.hadoop.codec.SnappyCodec
 
SnappyCompressor - Class in org.apache.parquet.hadoop.codec
This class is a wrapper around the snappy compressor.
SnappyCompressor() - Constructor for class org.apache.parquet.hadoop.codec.SnappyCompressor
 
SnappyDecompressor - Class in org.apache.parquet.hadoop.codec
 
SnappyDecompressor() - Constructor for class org.apache.parquet.hadoop.codec.SnappyDecompressor
 
SnappyUtil - Class in org.apache.parquet.hadoop.codec
Utilities for SnappyCompressor and SnappyDecompressor.
SnappyUtil() - Constructor for class org.apache.parquet.hadoop.codec.SnappyUtil
 
SPLIT_FILES - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to turn off file splitting.
start() - Method in class org.apache.parquet.hadoop.ParquetFileWriter
start the file
startBlock(long) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
start a block
startColumn(ColumnDescriptor, long, CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
start a column inside a block
STATISTICS - org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
 
STATISTICS_TRUNCATE_LENGTH - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
StatisticsFilter - Class in org.apache.parquet.filter2.statisticslevel
Applies a FilterPredicate to statistics about a group of records.
STATS_FILTERING_ENABLED - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure whether row group stats filtering is enabled
STRICT_TYPE_CHECKING - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure type checking for conflicting schemas (default: true)
StrictKeyValueMetadataMergeStrategy - Class in org.apache.parquet.hadoop.metadata
Strategy to throw errors if there are multiple values for a given key in metadata.
StrictKeyValueMetadataMergeStrategy() - Constructor for class org.apache.parquet.hadoop.metadata.StrictKeyValueMetadataMergeStrategy
 
supportsBlockSize() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
sync() - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
 

T

TagVerificationException - Exception in org.apache.parquet.crypto
 
TagVerificationException() - Constructor for exception org.apache.parquet.crypto.TagVerificationException
 
TagVerificationException(String) - Constructor for exception org.apache.parquet.crypto.TagVerificationException
 
TagVerificationException(String, Throwable) - Constructor for exception org.apache.parquet.crypto.TagVerificationException
 
TagVerificationException(Throwable) - Constructor for exception org.apache.parquet.crypto.TagVerificationException
 
TASK_SIDE_METADATA - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to turn on or off task side metadata loading (default true) if true then metadata is read on the task side and some tasks may finish immediately.
TEMP_FILE_PREFIX - Static variable in class org.apache.parquet.crypto.keytools.HadoopFSKeyMaterialStore
 
toBloomFilterHeader(BloomFilter) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
toJSON(ParquetMetadata) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
 
toList() - Method in class org.apache.parquet.hadoop.metadata.EncodingList
 
toParquetColumnIndex(PrimitiveType, ColumnIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
toParquetMetadata(int, ParquetMetadata) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
toParquetMetadata(int, ParquetMetadata, InternalFileEncryptor) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
toParquetOffsetIndex(OffsetIndex) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
toParquetStatistics(Statistics) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
toParquetStatistics(Statistics, int) - Static method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
toPrettyJSON(ParquetMetadata) - Static method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
 
toString() - Method in class org.apache.parquet.hadoop.api.DelegatingReadSupport
 
toString() - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
 
toString() - Method in class org.apache.parquet.hadoop.ColumnIndexValidator.ContractViolation
 
toString() - Method in class org.apache.parquet.hadoop.Footer
 
toString() - Method in class org.apache.parquet.hadoop.metadata.BlockMetaData
 
toString() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkMetaData
 
toString() - Method in class org.apache.parquet.hadoop.metadata.ColumnChunkProperties
 
toString() - Method in class org.apache.parquet.hadoop.metadata.FileMetaData
 
toString() - Method in class org.apache.parquet.hadoop.metadata.GlobalMetaData
 
toString() - Method in class org.apache.parquet.hadoop.metadata.ParquetMetadata
 
toString() - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
 
toString() - Method in class org.apache.parquet.hadoop.util.HadoopInputFile
 
toString() - Method in class org.apache.parquet.hadoop.util.HadoopOutputFile
 
TransParquetFileReader(InputFile, ParquetReadOptions) - Constructor for class org.apache.parquet.hadoop.util.CompressionConverter.TransParquetFileReader
 

U

UNBOUND_RECORD_FILTER - Static variable in class org.apache.parquet.hadoop.ParquetInputFormat
key to configure the filter
UnmaterializableRecordCounter - Class in org.apache.parquet.hadoop
Tracks number of records that cannot be materialized and throws ParquetDecodingException if the rate of errors crosses a limit.
UnmaterializableRecordCounter(double, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter
 
UnmaterializableRecordCounter(Configuration, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter
 
UnmaterializableRecordCounter(ParquetReadOptions, long) - Constructor for class org.apache.parquet.hadoop.UnmaterializableRecordCounter
 
unwrapKey(String, String) - Method in interface org.apache.parquet.crypto.keytools.KmsClient
Decrypts (unwraps) a key with the master key.
unwrapKey(String, String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
useBloomFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
useBloomFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useBloomFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useBloomFilter() - Method in class org.apache.parquet.ParquetReadOptions
 
useBloomFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useBloomFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useColumnIndexFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
useColumnIndexFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useColumnIndexFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useColumnIndexFilter() - Method in class org.apache.parquet.ParquetReadOptions
 
useColumnIndexFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useColumnIndexFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useDictionaryFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
useDictionaryFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useDictionaryFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useDictionaryFilter() - Method in class org.apache.parquet.ParquetReadOptions
 
useDictionaryFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useDictionaryFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
usePageChecksumVerification - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
usePageChecksumVerification() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
usePageChecksumVerification() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
usePageChecksumVerification() - Method in class org.apache.parquet.ParquetReadOptions
 
usePageChecksumVerification(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
usePageChecksumVerification(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useRecordFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
useRecordFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useRecordFilter() - Method in class org.apache.parquet.ParquetReadOptions
 
useRecordFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useRecordFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useSignedStringMinMax - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
useSignedStringMinMax() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useSignedStringMinMax() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useSignedStringMinMax() - Method in class org.apache.parquet.ParquetReadOptions
 
useSignedStringMinMax(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useSignedStringMinMax(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useStatsFilter - Variable in class org.apache.parquet.ParquetReadOptions.Builder
 
useStatsFilter() - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useStatsFilter() - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
useStatsFilter() - Method in class org.apache.parquet.ParquetReadOptions
 
useStatsFilter(boolean) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
useStatsFilter(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 

V

validateBuffer(byte[], int, int) - Static method in class org.apache.parquet.hadoop.codec.SnappyUtil
 
VALIDATION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
valueOf(String) - Static method in enum org.apache.parquet.crypto.AesMode
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.parquet.crypto.ParquetCipher
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
Returns the enum constant of this type with the specified name.
values() - Static method in enum org.apache.parquet.crypto.AesMode
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.parquet.crypto.ModuleCipherFactory.ModuleType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.parquet.crypto.ParquetCipher
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.parquet.filter2.compat.RowGroupFilter.FilterLevel
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.parquet.hadoop.ColumnIndexValidator.Contract
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.parquet.hadoop.ParquetFileWriter.Mode
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.parquet.hadoop.ParquetOutputFormat.JobSummaryLevel
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.parquet.hadoop.util.ColumnMasker.MaskMode
Returns an array containing the constants of this enum type, in the order they are declared.
verify(byte[]) - Method in interface org.apache.parquet.crypto.AADPrefixVerifier
Verifies identity (AAD Prefix) of individual file, or of file collection in a data set.
visit(FilterCompat.FilterPredicateCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
 
visit(FilterCompat.NoOpFilter) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
 
visit(FilterCompat.UnboundRecordFilterCompat) - Method in class org.apache.parquet.filter2.compat.RowGroupFilter
 
visit(Operators.And) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.And) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.And) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.Eq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.Gt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.GtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.LogicalNotUserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.Lt<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.LtEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.Not) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.Not) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.Not) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.NotEq<T>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.Or) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.Or) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.Or) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 
visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.bloomfilterlevel.BloomFilterImpl
 
visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.dictionarylevel.DictionaryFilter
 
visit(Operators.UserDefined<T, U>) - Method in class org.apache.parquet.filter2.statisticslevel.StatisticsFilter
 

W

withAADPrefix(byte[]) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
Explicitly supply the file AAD prefix.
withAADPrefix(byte[]) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
Set the file AAD Prefix.
withAADPrefixVerifier(AADPrefixVerifier) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
Set callback for verification of AAD Prefixes stored in file.
withAlgorithm(ParquetCipher) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
Set encryption algorithm.
withAllocator(ByteBufferAllocator) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withBloomFilterEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Sets the bloom filter enabled/disabled
withBloomFilterEnabled(String, boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Sets the bloom filter enabled/disabled for the specified column.
withBloomFilterNDV(String, long) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Sets the NDV (number of distinct values) for the specified column.
withByteStreamSplitEncoding(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
 
withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
withCodecFactory(CompressionCodecFactory) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withColumnKeys(Map<ColumnPath, ColumnDecryptionProperties>) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
Set explicit column keys (decryption properties).
withCompressionCodec(CompressionCodecName) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the compression codec used by the constructed writer.
withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
withConf(Configuration) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the Configuration used by the constructed writer.
withDecryption(FileDecryptionProperties) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
withDecryption(FileDecryptionProperties) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withDictionaryEncoding(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Enable or disable dictionary encoding for the constructed writer.
withDictionaryEncoding(String, boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Enable or disable dictionary encoding of the specified column for the constructed writer.
withDictionaryPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the Parquet format dictionary page size used by the constructed writer.
withEncryptedColumns(Map<ColumnPath, ColumnEncryptionProperties>) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
Set the list of encrypted columns and their properties (keys etc).
withEncryption(FileEncryptionProperties) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the file encryption properties used by the constructed writer.
withExtraMetaData(Map<String, String>) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
 
withFileRange(long, long) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
withFilter(FilterCompat.Filter) - Method in class org.apache.parquet.hadoop.ParquetReader.Builder
 
withFooterKey(byte[]) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
Set an explicit footer key.
withFooterKeyID(String) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
Set a key retrieval metadata (converted from String).
withFooterKeyMetadata(byte[]) - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
Set a key retrieval metadata.
withKey(byte[]) - Method in class org.apache.parquet.crypto.ColumnDecryptionProperties.Builder
Set an explicit column key.
withKey(byte[]) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
Set a column-specific key.
withKeyID(String) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
Set a key retrieval metadata (converted from String).
withKeyMetaData(byte[]) - Method in class org.apache.parquet.crypto.ColumnEncryptionProperties.Builder
Set a key retrieval metadata.
withKeyRetriever(DecryptionKeyRetriever) - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
Set a key retriever callback.
withMaxAllocationInBytes(int) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withMaxPaddingSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the maximum amount of padding, in bytes, that will be used to align row groups with blocks in the underlying filesystem.
withMetadataFilter(ParquetMetadataConverter.MetadataFilter) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withOffsets(long...) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withoutAADPrefixStorage() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
Skip storing AAD Prefix in file metadata.
withoutFooterSignatureVerification() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
Skip integrity verification of plaintext footers.
withPageChecksumVerification(boolean) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withPageRowCountLimit(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Sets the Parquet format page row count limit used by the constructed writer.
withPageSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the Parquet format page size used by the constructed writer.
withPageWriteChecksumEnabled(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Enables writing page level checksums for the constructed writer.
withPlaintextFilesAllowed() - Method in class org.apache.parquet.crypto.FileDecryptionProperties.Builder
By default, reading plaintext (unencrypted) files is not allowed when using a decryptor - in order to detect files that were not encrypted by mistake.
withPlaintextFooter() - Method in class org.apache.parquet.crypto.FileEncryptionProperties.Builder
Create files with plaintext footer.
withRange(long, long) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withRecordFilter(FilterCompat.Filter) - Method in class org.apache.parquet.ParquetReadOptions.Builder
 
withRowGroupSize(int) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
withRowGroupSize(long) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the Parquet format row group size used by the constructed writer.
withType(MessageType) - Method in class org.apache.parquet.hadoop.example.ExampleParquetWriter.Builder
 
withValidation(boolean) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Enable or disable validation for the constructed writer.
withWriteMode(ParquetFileWriter.Mode) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the write mode used when creating the backing file for this writer.
withWriterVersion(ParquetProperties.WriterVersion) - Method in class org.apache.parquet.hadoop.ParquetWriter.Builder
Set the format version used by the constructed writer.
wrap(FSDataInputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams
Wraps a FSDataInputStream in a SeekableInputStream implementation for Parquet readers.
wrap(FSDataOutputStream) - Static method in class org.apache.parquet.hadoop.util.HadoopStreams
Wraps a FSDataOutputStream in a PositionOutputStream implementation for Parquet writers.
wrapKey(byte[], String) - Method in interface org.apache.parquet.crypto.keytools.KmsClient
Wraps a key - encrypts it with the master key, encodes the result and potentially adds a KMS-specific metadata.
wrapKey(byte[], String) - Method in class org.apache.parquet.crypto.keytools.LocalWrapKmsClient
 
write(byte[]) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
 
write(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.NonBlockedCompressorStream
 
write(byte[], int, int) - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
write(byte[], int, int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
 
write(int) - Method in class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
write(int) - Method in class org.apache.parquet.hadoop.util.HadoopPositionOutputStream
 
write(DataOutput) - Method in class org.apache.parquet.hadoop.ParquetInputSplit
Deprecated.
write(Void, T) - Method in class org.apache.parquet.hadoop.ParquetRecordWriter
write(Group) - Method in class org.apache.parquet.hadoop.example.GroupWriteSupport
 
write(T) - Method in class org.apache.parquet.hadoop.api.DelegatingWriteSupport
 
write(T) - Method in class org.apache.parquet.hadoop.api.WriteSupport
called once per record
write(T) - Method in class org.apache.parquet.hadoop.ParquetWriter
 
WRITE_SUPPORT_CLASS - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
WriteContext(MessageType, Map<String, String>) - Constructor for class org.apache.parquet.hadoop.api.WriteSupport.WriteContext
 
writeDataPage(int, int, BytesInput, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
writeDataPage(int, int, BytesInput, Statistics, long, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
Writes a single page
writeDataPage(int, int, BytesInput, Statistics, Encoding, Encoding, Encoding) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
writeDataPageHeader(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
Deprecated.
writeDataPageHeader(int, int, int, Statistics, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
Deprecated.
writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDataPageV1Header(int, int, int, Encoding, Encoding, Encoding, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDataPageV2(int, int, int, BytesInput, BytesInput, Encoding, BytesInput, int, Statistics<?>) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
Writes a single v2 data page
writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDataPageV2Header(int, int, int, int, int, Encoding, int, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDataPageV2Header(int, int, int, int, int, Statistics, Encoding, int, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
Deprecated.
writeDictionaryPage(DictionaryPage) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
writes a dictionary page page
writeDictionaryPage(DictionaryPage, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.hadoop.ParquetFileWriter
 
writeDictionaryPageHeader(int, int, int, Encoding, int, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDictionaryPageHeader(int, int, int, Encoding, int, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDictionaryPageHeader(int, int, int, Encoding, OutputStream) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeDictionaryPageHeader(int, int, int, Encoding, OutputStream, BlockCipher.Encryptor, byte[]) - Method in class org.apache.parquet.format.converter.ParquetMetadataConverter
 
writeMergedMetadataFile(List<Path>, Path, Configuration) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
writeMetadataFile(Configuration, Path, List<Footer>) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
writeMetadataFile(Configuration, Path, List<Footer>, ParquetOutputFormat.JobSummaryLevel) - Static method in class org.apache.parquet.hadoop.ParquetFileWriter
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
writeMetaDataFile(Configuration, Path) - Static method in class org.apache.parquet.hadoop.ParquetOutputCommitter
 
writeObjectToConfAsBase64(String, Object, Configuration) - Static method in class org.apache.parquet.hadoop.util.SerializationUtil
Writes an object to a configuration.
WRITER_VERSION - Static variable in class org.apache.parquet.hadoop.ParquetOutputFormat
 
WriteSupport<T> - Class in org.apache.parquet.hadoop.api
Abstraction to use with ParquetOutputFormat to convert incoming records
WriteSupport() - Constructor for class org.apache.parquet.hadoop.api.WriteSupport
 
WriteSupport.FinalizedWriteContext - Class in org.apache.parquet.hadoop.api
Information to be added in the file once all the records have been written
WriteSupport.WriteContext - Class in org.apache.parquet.hadoop.api
information to be persisted in the file

Z

ZstandardCodec - Class in org.apache.parquet.hadoop.codec
ZSTD compression codec for Parquet.
ZstandardCodec() - Constructor for class org.apache.parquet.hadoop.codec.ZstandardCodec
 
ZstdCompressorStream - Class in org.apache.parquet.hadoop.codec
 
ZstdCompressorStream(OutputStream, int, int) - Constructor for class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
ZstdCompressorStream(OutputStream, BufferPool, int, int) - Constructor for class org.apache.parquet.hadoop.codec.ZstdCompressorStream
 
ZstdDecompressorStream - Class in org.apache.parquet.hadoop.codec
 
ZstdDecompressorStream(InputStream) - Constructor for class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
 
ZstdDecompressorStream(InputStream, BufferPool) - Constructor for class org.apache.parquet.hadoop.codec.ZstdDecompressorStream
 
A B C D E F G H I J K L M N O P Q R S T U V W Z 
All Classes All Packages